Skip to content

Custom profiling commands & flamegraphs#890

Open
oschaaf wants to merge 43 commits intoistio:masterfrom
oschaaf:profiling
Open

Custom profiling commands & flamegraphs#890
oschaaf wants to merge 43 commits intoistio:masterfrom
oschaaf:profiling

Conversation

@oschaaf
Copy link
Contributor

@oschaaf oschaaf commented Apr 15, 2020

Allows running custom profiling command on the nodes via bcc-tools
and perf, and obtains flamegraphs based on that.

See the updated README.md in perf/benchmark for examples and more
information.

Signed-off-by: Otto van der Schaaf oschaaf@we-amp.com

@oschaaf
Custom profiling commands & flamegraphs
1d5d128 
Allows running custom profiling command on the nodes via bcc-tools
and perf, and obtains flamegraphs based on that.

See the updated README.md in perf/benchmark for examples and more
information.

Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@istio-testing istio-testing added the do-not-merge/work-in-progress Block merging of a PR because it isn't ready yet. label Apr 15, 2020
@googlebot googlebot added the cla: yes Set by the Google CLA bot to indicate the author of a PR has signed the Google CLA. label Apr 15, 2020
@istio-testing istio-testing added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label Apr 15, 2020
@istio-testing
Copy link
Contributor

istio-testing commented Apr 15, 2020

Hi @oschaaf. Thanks for your PR.

I'm waiting for a istio member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@oschaaf oschaaf mentioned this pull request Apr 15, 2020
Closed
oschaaf
oschaaf commented Apr 15, 2020
View reviewed changes
@carolynhu
Copy link
Contributor

carolynhu commented Apr 15, 2020

/ok-to-test

@istio-testing istio-testing added ok-to-test Set this label allow normal testing to take place for a PR not submitted by an Istio org member. and removed needs-ok-to-test labels Apr 15, 2020
@oschaaf
Docker linting, fix TODO
70b6e52 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@istio-testing istio-testing added the needs-rebase Indicates a PR needs to be rebased before being merged label Apr 16, 2020
@oschaaf
Merge remote-tracking branch 'upstream/master' into profiling
93da236 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@istio-testing istio-testing removed the needs-rebase Indicates a PR needs to be rebased before being merged label Apr 16, 2020
oschaaf added 3 commits April 16, 2020 11:22
@oschaaf
Docker lint tweak
81d4d7a 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Add perf label to flamegraph filename
ee62a80 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Deduplicate redundant functionality
689021b 
As --custom_profiling_command offers a superset of --perf,
reimplement the old --perf flag using that and eliminate the
redundant code.

Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@istio-testing istio-testing added size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Apr 16, 2020
@carolynhu
Copy link
Contributor

carolynhu commented Apr 16, 2020

@oschaaf you can ignore the benchmar_check_tools job failure, since there is a change made in the operator side, and we are fixing it.

oschaaf added 9 commits April 17, 2020 10:35
@oschaaf
Merge remote-tracking branch 'upstream/master' into profiling
a3f5587 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Dockerfile.perf linting: pin package versions
bffad09 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
bash linting: double quote arg
6425935 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Add licence / copyright banner
81f4d4d 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Python whitespace linting fix
b37cea8 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Markdown linting fixes
d5d5d59 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Merge remote-tracking branch 'upstream/master' into profiling
4871583 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Move profiling thread start into function
eb6090f 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Python linting fix
6730880 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
oschaaf added 19 commits April 29, 2020 10:28
@oschaaf
Merge remote-tracking branch 'upstream/master' into profiling
2886e04 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Sync up with the latest changes
fa42cab 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
linting fixes + fix in fortio.yaml
680b10c 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Changes ot minimize the diff
30342ff 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Merge remote-tracking branch 'upstream/master' into profiling
0b9e851 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Merge remote-tracking branch 'upstream/master' into profiling
2fccdd6
@oschaaf
Tweak flamegraph file naming
83a8e40 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Fix NH-mode --ingress option
94f6120 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Lint fix
7f28c4c 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Small enhancenments/fixes
e274665 
- Html encode title we hand to flamegraph.py
- Fix a typo in README.md
- Avoid writing to stdout/stderr from threaded code

Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Fix hang, improve error handling. Doc enhancements.
b96687e 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Merge remote-tracking branch 'upstream/master' into profiling
17d136a
@oschaaf
Lint change in runner.py
aae1f19 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Flag for allowing short runs. Doc pagefault flamgraphing.
fdfe910 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
runner.py: add --envoy_profiler option
47c63f5 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Lint fixes
b2aa8f0 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Merge remote-tracking branch 'upstream/master' into profiling
1c5a3dd
@oschaaf
Markdown lint fixes
b19423b 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Add scrape annotations for prom. node exporter
70e8f5a 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf oschaaf marked this pull request as ready for review May 13, 2020 10:48
@oschaaf oschaaf requested a review from a team May 13, 2020 10:48
@oschaaf oschaaf requested a review from a team as a code owner May 13, 2020 10:48
@istio-testing istio-testing removed the do-not-merge/work-in-progress Block merging of a PR because it isn't ready yet. label May 13, 2020
oschaaf added 4 commits May 13, 2020 20:04
@oschaaf
network flakes in Ci: Add hard coded single retry per test execution
e641309 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Remove line of code for debugging
2d71dd1 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Tweaks for bleeding edge istio
bce6a4f 
Signed-off-by: Otto van der Schaaf <oschaaf@we-amp.com>
@oschaaf
Merge remote-tracking branch 'upstream/master' into profiling
50a2a63
@istio-testing istio-testing added the needs-rebase Indicates a PR needs to be rebased before being merged label May 30, 2020
@istio-testing
Copy link
Contributor

istio-testing commented May 30, 2020

@oschaaf: PR needs rebase.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@istio-testing
Copy link
Contributor

istio-testing commented Oct 14, 2022

@oschaaf: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
containers-test-arm64_tools 50a2a63 link true /test containers-test-arm64
Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

cla: yes Set by the Google CLA bot to indicate the author of a PR has signed the Google CLA. needs-rebase Indicates a PR needs to be rebased before being merged ok-to-test Set this label allow normal testing to take place for a PR not submitted by an Istio org member. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@oschaaf @istio-testing @carolynhu @googlebot