Pin system tests for release branch#11065
Open
dd-octo-sts[bot] wants to merge 1 commit intorelease/v1.61.xfrom
Open
Pin system tests for release branch#11065dd-octo-sts[bot] wants to merge 1 commit intorelease/v1.61.xfrom
dd-octo-sts[bot] wants to merge 1 commit intorelease/v1.61.xfrom
Conversation
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060569
Total [baseline] (8.854 s) : 0, 8853794
Agent [candidate] (1.056 s) : 0, 1055614
Total [candidate] (8.842 s) : 0, 8842381
section iast
Agent [baseline] (1.224 s) : 0, 1224473
Total [baseline] (9.52 s) : 0, 9519750
Agent [candidate] (1.231 s) : 0, 1231069
Total [candidate] (9.527 s) : 0, 9526687
gantt
title insecure-bank - break down per module: candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.234 ms) : 0, 1234
crashtracking [candidate] (1.229 ms) : 0, 1229
BytebuddyAgent [baseline] (635.434 ms) : 0, 635434
BytebuddyAgent [candidate] (633.778 ms) : 0, 633778
AgentMeter [baseline] (29.592 ms) : 0, 29592
AgentMeter [candidate] (29.284 ms) : 0, 29284
GlobalTracer [baseline] (249.092 ms) : 0, 249092
GlobalTracer [candidate] (248.214 ms) : 0, 248214
AppSec [baseline] (32.087 ms) : 0, 32087
AppSec [candidate] (31.925 ms) : 0, 31925
Debugger [baseline] (59.349 ms) : 0, 59349
Debugger [candidate] (59.018 ms) : 0, 59018
Remote Config [baseline] (606.924 µs) : 0, 607
Remote Config [candidate] (590.527 µs) : 0, 591
Telemetry [baseline] (8.083 ms) : 0, 8083
Telemetry [candidate] (8.099 ms) : 0, 8099
Flare Poller [baseline] (8.817 ms) : 0, 8817
Flare Poller [candidate] (7.351 ms) : 0, 7351
section iast
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (803.086 ms) : 0, 803086
BytebuddyAgent [candidate] (806.999 ms) : 0, 806999
AgentMeter [baseline] (11.386 ms) : 0, 11386
AgentMeter [candidate] (11.72 ms) : 0, 11720
GlobalTracer [baseline] (238.545 ms) : 0, 238545
GlobalTracer [candidate] (240.426 ms) : 0, 240426
AppSec [baseline] (32.708 ms) : 0, 32708
AppSec [candidate] (31.936 ms) : 0, 31936
Debugger [baseline] (59.936 ms) : 0, 59936
Debugger [candidate] (59.624 ms) : 0, 59624
Remote Config [baseline] (1.099 ms) : 0, 1099
Remote Config [candidate] (1.151 ms) : 0, 1151
Telemetry [baseline] (11.157 ms) : 0, 11157
Telemetry [candidate] (12.198 ms) : 0, 12198
Flare Poller [baseline] (3.442 ms) : 0, 3442
Flare Poller [candidate] (3.444 ms) : 0, 3444
IAST [baseline] (25.74 ms) : 0, 25740
IAST [candidate] (25.97 ms) : 0, 25970
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064989
Total [baseline] (11.065 s) : 0, 11065028
Agent [candidate] (1.051 s) : 0, 1050771
Total [candidate] (11.027 s) : 0, 11026751
section appsec
Agent [baseline] (1.257 s) : 0, 1257187
Total [baseline] (11.162 s) : 0, 11162408
Agent [candidate] (1.255 s) : 0, 1254784
Total [candidate] (11.259 s) : 0, 11259151
section iast
Agent [baseline] (1.224 s) : 0, 1223768
Total [baseline] (11.189 s) : 0, 11189183
Agent [candidate] (1.222 s) : 0, 1222095
Total [candidate] (11.195 s) : 0, 11194629
section profiling
Agent [baseline] (1.185 s) : 0, 1185061
Total [baseline] (11.027 s) : 0, 11027071
Agent [candidate] (1.192 s) : 0, 1192085
Total [candidate] (11.077 s) : 0, 11076598
gantt
title petclinic - break down per module: candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.259 ms) : 0, 1259
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (637.335 ms) : 0, 637335
BytebuddyAgent [candidate] (630.015 ms) : 0, 630015
AgentMeter [baseline] (29.764 ms) : 0, 29764
AgentMeter [candidate] (29.277 ms) : 0, 29277
GlobalTracer [baseline] (249.775 ms) : 0, 249775
GlobalTracer [candidate] (247.987 ms) : 0, 247987
AppSec [baseline] (32.208 ms) : 0, 32208
AppSec [candidate] (31.859 ms) : 0, 31859
Debugger [baseline] (60.531 ms) : 0, 60531
Debugger [candidate] (59.983 ms) : 0, 59983
Remote Config [baseline] (609.216 µs) : 0, 609
Remote Config [candidate] (593.844 µs) : 0, 594
Telemetry [baseline] (8.199 ms) : 0, 8199
Telemetry [candidate] (8.077 ms) : 0, 8077
Flare Poller [baseline] (9.051 ms) : 0, 9051
Flare Poller [candidate] (5.817 ms) : 0, 5817
section appsec
crashtracking [baseline] (1.241 ms) : 0, 1241
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (666.895 ms) : 0, 666895
BytebuddyAgent [candidate] (666.551 ms) : 0, 666551
AgentMeter [baseline] (12.102 ms) : 0, 12102
AgentMeter [candidate] (12.069 ms) : 0, 12069
GlobalTracer [baseline] (250.561 ms) : 0, 250561
GlobalTracer [candidate] (249.836 ms) : 0, 249836
IAST [baseline] (24.763 ms) : 0, 24763
IAST [candidate] (24.792 ms) : 0, 24792
AppSec [baseline] (185.268 ms) : 0, 185268
AppSec [candidate] (184.838 ms) : 0, 184838
Debugger [baseline] (66.667 ms) : 0, 66667
Debugger [candidate] (66.145 ms) : 0, 66145
Remote Config [baseline] (611.885 µs) : 0, 612
Remote Config [candidate] (609.192 µs) : 0, 609
Telemetry [baseline] (8.808 ms) : 0, 8808
Telemetry [candidate] (8.719 ms) : 0, 8719
Flare Poller [baseline] (3.715 ms) : 0, 3715
Flare Poller [candidate] (3.571 ms) : 0, 3571
section iast
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (800.547 ms) : 0, 800547
BytebuddyAgent [candidate] (800.294 ms) : 0, 800294
AgentMeter [baseline] (11.383 ms) : 0, 11383
AgentMeter [candidate] (11.354 ms) : 0, 11354
GlobalTracer [baseline] (239.059 ms) : 0, 239059
GlobalTracer [candidate] (238.759 ms) : 0, 238759
IAST [baseline] (25.74 ms) : 0, 25740
IAST [candidate] (25.697 ms) : 0, 25697
AppSec [baseline] (32.867 ms) : 0, 32867
AppSec [candidate] (31.74 ms) : 0, 31740
Debugger [baseline] (60.99 ms) : 0, 60990
Debugger [candidate] (58.989 ms) : 0, 58989
Remote Config [baseline] (1.137 ms) : 0, 1137
Remote Config [candidate] (2.275 ms) : 0, 2275
Telemetry [baseline] (10.999 ms) : 0, 10999
Telemetry [candidate] (12.015 ms) : 0, 12015
Flare Poller [baseline] (3.451 ms) : 0, 3451
Flare Poller [candidate] (3.42 ms) : 0, 3420
section profiling
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (691.926 ms) : 0, 691926
BytebuddyAgent [candidate] (696.721 ms) : 0, 696721
AgentMeter [baseline] (9.16 ms) : 0, 9160
AgentMeter [candidate] (9.226 ms) : 0, 9226
GlobalTracer [baseline] (207.193 ms) : 0, 207193
GlobalTracer [candidate] (208.137 ms) : 0, 208137
AppSec [baseline] (32.48 ms) : 0, 32480
AppSec [candidate] (32.777 ms) : 0, 32777
Debugger [baseline] (65.899 ms) : 0, 65899
Debugger [candidate] (65.953 ms) : 0, 65953
Remote Config [baseline] (578.571 µs) : 0, 579
Remote Config [candidate] (568.847 µs) : 0, 569
Telemetry [baseline] (7.85 ms) : 0, 7850
Telemetry [candidate] (7.882 ms) : 0, 7882
Flare Poller [baseline] (3.552 ms) : 0, 3552
Flare Poller [candidate] (3.608 ms) : 0, 3608
ProfilingAgent [baseline] (93.963 ms) : 0, 93963
ProfilingAgent [candidate] (94.45 ms) : 0, 94450
Profiling [baseline] (94.54 ms) : 0, 94540
Profiling [candidate] (95.024 ms) : 0, 95024
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
dateFormat X
axisFormat %s
section baseline
no_agent (1.225 ms) : 1214, 1236
. : milestone, 1225,
iast (3.432 ms) : 3376, 3489
. : milestone, 3432,
iast_FULL (6.251 ms) : 6185, 6316
. : milestone, 6251,
iast_GLOBAL (3.716 ms) : 3652, 3781
. : milestone, 3716,
profiling (2.299 ms) : 2275, 2322
. : milestone, 2299,
tracing (1.853 ms) : 1837, 1869
. : milestone, 1853,
section candidate
no_agent (1.241 ms) : 1229, 1252
. : milestone, 1241,
iast (3.364 ms) : 3317, 3411
. : milestone, 3364,
iast_FULL (6.026 ms) : 5965, 6087
. : milestone, 6026,
iast_GLOBAL (3.704 ms) : 3639, 3768
. : milestone, 3704,
profiling (2.076 ms) : 2057, 2094
. : milestone, 2076,
tracing (1.882 ms) : 1864, 1899
. : milestone, 1882,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
dateFormat X
axisFormat %s
section baseline
no_agent (19.374 ms) : 19172, 19576
. : milestone, 19374,
appsec (18.839 ms) : 18646, 19032
. : milestone, 18839,
code_origins (17.927 ms) : 17750, 18104
. : milestone, 17927,
iast (18.304 ms) : 18121, 18486
. : milestone, 18304,
profiling (18.363 ms) : 18183, 18543
. : milestone, 18363,
tracing (17.744 ms) : 17567, 17920
. : milestone, 17744,
section candidate
no_agent (19.518 ms) : 19317, 19719
. : milestone, 19518,
appsec (18.637 ms) : 18449, 18825
. : milestone, 18637,
code_origins (17.843 ms) : 17669, 18017
. : milestone, 17843,
iast (17.819 ms) : 17646, 17993
. : milestone, 17819,
profiling (18.557 ms) : 18372, 18742
. : milestone, 18557,
tracing (17.748 ms) : 17575, 17921
. : milestone, 17748,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
dateFormat X
axisFormat %s
section baseline
no_agent (14.378 s) : 14378000, 14378000
. : milestone, 14378000,
appsec (14.195 s) : 14195000, 14195000
. : milestone, 14195000,
iast (17.978 s) : 17978000, 17978000
. : milestone, 17978000,
iast_GLOBAL (17.079 s) : 17079000, 17079000
. : milestone, 17079000,
profiling (14.41 s) : 14410000, 14410000
. : milestone, 14410000,
tracing (14.27 s) : 14270000, 14270000
. : milestone, 14270000,
section candidate
no_agent (15.078 s) : 15078000, 15078000
. : milestone, 15078000,
appsec (14.421 s) : 14421000, 14421000
. : milestone, 14421000,
iast (17.763 s) : 17763000, 17763000
. : milestone, 17763000,
iast_GLOBAL (17.382 s) : 17382000, 17382000
. : milestone, 17382000,
profiling (14.355 s) : 14355000, 14355000
. : milestone, 14355000,
tracing (14.445 s) : 14445000, 14445000
. : milestone, 14445000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
dateFormat X
axisFormat %s
section baseline
no_agent (1.498 ms) : 1486, 1509
. : milestone, 1498,
appsec (2.904 ms) : 2814, 2995
. : milestone, 2904,
iast (2.683 ms) : 2572, 2793
. : milestone, 2683,
iast_GLOBAL (2.723 ms) : 2612, 2834
. : milestone, 2723,
profiling (2.467 ms) : 2376, 2559
. : milestone, 2467,
tracing (2.433 ms) : 2344, 2521
. : milestone, 2433,
section candidate
no_agent (1.5 ms) : 1488, 1512
. : milestone, 1500,
appsec (2.909 ms) : 2819, 3000
. : milestone, 2909,
iast (2.684 ms) : 2573, 2795
. : milestone, 2684,
iast_GLOBAL (2.735 ms) : 2624, 2846
. : milestone, 2735,
profiling (2.483 ms) : 2392, 2575
. : milestone, 2483,
tracing (2.451 ms) : 2361, 2541
. : milestone, 2451,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR pins the system-tests reference for the release branch.