Skip to content

Pin system tests for release branch#11065

Open
dd-octo-sts[bot] wants to merge 1 commit intorelease/v1.61.xfrom
ci/pin-system-tests-20260408
Open

Pin system tests for release branch#11065
dd-octo-sts[bot] wants to merge 1 commit intorelease/v1.61.xfrom
ci/pin-system-tests-20260408

Conversation

@dd-octo-sts
Copy link
Copy Markdown
Contributor

@dd-octo-sts dd-octo-sts bot commented Apr 8, 2026

This PR pins the system-tests reference for the release branch.

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@dd-octo-sts dd-octo-sts bot added the tag: no release notes Changes to exclude from release notes label Apr 8, 2026
@dd-octo-sts dd-octo-sts bot requested a review from a team as a code owner April 8, 2026 12:44
@dd-octo-sts dd-octo-sts bot added the tag: dependencies Dependencies related changes label Apr 8, 2026
@dd-octo-sts dd-octo-sts bot requested a review from a team as a code owner April 8, 2026 12:44
@dd-octo-sts dd-octo-sts bot requested review from sarahchen6 and removed request for a team April 8, 2026 12:44
@dd-octo-sts dd-octo-sts bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Apr 8, 2026
@dd-octo-sts dd-octo-sts bot requested review from erikayasuda and removed request for a team April 8, 2026 12:44
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 8, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/pin-system-tests-20260408
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1775654357 1775654357
ci_job_id 1577034025 1577034025
ci_pipeline_id 106632072 106632072
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1775589541 1775589541
git_commit_sha aa7c70f aa7c70f
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ll9xuind 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ll9xuind 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
release_version 1.61.0~aa7c70f2e7 1.61.0~aa7c70f2e7

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060569
Total [baseline] (8.854 s) : 0, 8853794
Agent [candidate] (1.056 s) : 0, 1055614
Total [candidate] (8.842 s) : 0, 8842381
section iast
Agent [baseline] (1.224 s) : 0, 1224473
Total [baseline] (9.52 s) : 0, 9519750
Agent [candidate] (1.231 s) : 0, 1231069
Total [candidate] (9.527 s) : 0, 9526687
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.224 s 163.904 ms (15.5%)
Total tracing 8.854 s -
Total iast 9.52 s 665.956 ms (7.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.231 s 175.455 ms (16.6%)
Total tracing 8.842 s -
Total iast 9.527 s 684.305 ms (7.7%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.234 ms) : 0, 1234
crashtracking [candidate] (1.229 ms) : 0, 1229
BytebuddyAgent [baseline] (635.434 ms) : 0, 635434
BytebuddyAgent [candidate] (633.778 ms) : 0, 633778
AgentMeter [baseline] (29.592 ms) : 0, 29592
AgentMeter [candidate] (29.284 ms) : 0, 29284
GlobalTracer [baseline] (249.092 ms) : 0, 249092
GlobalTracer [candidate] (248.214 ms) : 0, 248214
AppSec [baseline] (32.087 ms) : 0, 32087
AppSec [candidate] (31.925 ms) : 0, 31925
Debugger [baseline] (59.349 ms) : 0, 59349
Debugger [candidate] (59.018 ms) : 0, 59018
Remote Config [baseline] (606.924 µs) : 0, 607
Remote Config [candidate] (590.527 µs) : 0, 591
Telemetry [baseline] (8.083 ms) : 0, 8083
Telemetry [candidate] (8.099 ms) : 0, 8099
Flare Poller [baseline] (8.817 ms) : 0, 8817
Flare Poller [candidate] (7.351 ms) : 0, 7351
section iast
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (803.086 ms) : 0, 803086
BytebuddyAgent [candidate] (806.999 ms) : 0, 806999
AgentMeter [baseline] (11.386 ms) : 0, 11386
AgentMeter [candidate] (11.72 ms) : 0, 11720
GlobalTracer [baseline] (238.545 ms) : 0, 238545
GlobalTracer [candidate] (240.426 ms) : 0, 240426
AppSec [baseline] (32.708 ms) : 0, 32708
AppSec [candidate] (31.936 ms) : 0, 31936
Debugger [baseline] (59.936 ms) : 0, 59936
Debugger [candidate] (59.624 ms) : 0, 59624
Remote Config [baseline] (1.099 ms) : 0, 1099
Remote Config [candidate] (1.151 ms) : 0, 1151
Telemetry [baseline] (11.157 ms) : 0, 11157
Telemetry [candidate] (12.198 ms) : 0, 12198
Flare Poller [baseline] (3.442 ms) : 0, 3442
Flare Poller [candidate] (3.444 ms) : 0, 3444
IAST [baseline] (25.74 ms) : 0, 25740
IAST [candidate] (25.97 ms) : 0, 25970
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064989
Total [baseline] (11.065 s) : 0, 11065028
Agent [candidate] (1.051 s) : 0, 1050771
Total [candidate] (11.027 s) : 0, 11026751
section appsec
Agent [baseline] (1.257 s) : 0, 1257187
Total [baseline] (11.162 s) : 0, 11162408
Agent [candidate] (1.255 s) : 0, 1254784
Total [candidate] (11.259 s) : 0, 11259151
section iast
Agent [baseline] (1.224 s) : 0, 1223768
Total [baseline] (11.189 s) : 0, 11189183
Agent [candidate] (1.222 s) : 0, 1222095
Total [candidate] (11.195 s) : 0, 11194629
section profiling
Agent [baseline] (1.185 s) : 0, 1185061
Total [baseline] (11.027 s) : 0, 11027071
Agent [candidate] (1.192 s) : 0, 1192085
Total [candidate] (11.077 s) : 0, 11076598
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.257 s 192.197 ms (18.0%)
Agent iast 1.224 s 158.778 ms (14.9%)
Agent profiling 1.185 s 120.072 ms (11.3%)
Total tracing 11.065 s -
Total appsec 11.162 s 97.38 ms (0.9%)
Total iast 11.189 s 124.155 ms (1.1%)
Total profiling 11.027 s -37.958 ms (-0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.255 s 204.012 ms (19.4%)
Agent iast 1.222 s 171.324 ms (16.3%)
Agent profiling 1.192 s 141.314 ms (13.4%)
Total tracing 11.027 s -
Total appsec 11.259 s 232.399 ms (2.1%)
Total iast 11.195 s 167.878 ms (1.5%)
Total profiling 11.077 s 49.847 ms (0.5%)
gantt
    title petclinic - break down per module: candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.259 ms) : 0, 1259
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (637.335 ms) : 0, 637335
BytebuddyAgent [candidate] (630.015 ms) : 0, 630015
AgentMeter [baseline] (29.764 ms) : 0, 29764
AgentMeter [candidate] (29.277 ms) : 0, 29277
GlobalTracer [baseline] (249.775 ms) : 0, 249775
GlobalTracer [candidate] (247.987 ms) : 0, 247987
AppSec [baseline] (32.208 ms) : 0, 32208
AppSec [candidate] (31.859 ms) : 0, 31859
Debugger [baseline] (60.531 ms) : 0, 60531
Debugger [candidate] (59.983 ms) : 0, 59983
Remote Config [baseline] (609.216 µs) : 0, 609
Remote Config [candidate] (593.844 µs) : 0, 594
Telemetry [baseline] (8.199 ms) : 0, 8199
Telemetry [candidate] (8.077 ms) : 0, 8077
Flare Poller [baseline] (9.051 ms) : 0, 9051
Flare Poller [candidate] (5.817 ms) : 0, 5817
section appsec
crashtracking [baseline] (1.241 ms) : 0, 1241
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (666.895 ms) : 0, 666895
BytebuddyAgent [candidate] (666.551 ms) : 0, 666551
AgentMeter [baseline] (12.102 ms) : 0, 12102
AgentMeter [candidate] (12.069 ms) : 0, 12069
GlobalTracer [baseline] (250.561 ms) : 0, 250561
GlobalTracer [candidate] (249.836 ms) : 0, 249836
IAST [baseline] (24.763 ms) : 0, 24763
IAST [candidate] (24.792 ms) : 0, 24792
AppSec [baseline] (185.268 ms) : 0, 185268
AppSec [candidate] (184.838 ms) : 0, 184838
Debugger [baseline] (66.667 ms) : 0, 66667
Debugger [candidate] (66.145 ms) : 0, 66145
Remote Config [baseline] (611.885 µs) : 0, 612
Remote Config [candidate] (609.192 µs) : 0, 609
Telemetry [baseline] (8.808 ms) : 0, 8808
Telemetry [candidate] (8.719 ms) : 0, 8719
Flare Poller [baseline] (3.715 ms) : 0, 3715
Flare Poller [candidate] (3.571 ms) : 0, 3571
section iast
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (800.547 ms) : 0, 800547
BytebuddyAgent [candidate] (800.294 ms) : 0, 800294
AgentMeter [baseline] (11.383 ms) : 0, 11383
AgentMeter [candidate] (11.354 ms) : 0, 11354
GlobalTracer [baseline] (239.059 ms) : 0, 239059
GlobalTracer [candidate] (238.759 ms) : 0, 238759
IAST [baseline] (25.74 ms) : 0, 25740
IAST [candidate] (25.697 ms) : 0, 25697
AppSec [baseline] (32.867 ms) : 0, 32867
AppSec [candidate] (31.74 ms) : 0, 31740
Debugger [baseline] (60.99 ms) : 0, 60990
Debugger [candidate] (58.989 ms) : 0, 58989
Remote Config [baseline] (1.137 ms) : 0, 1137
Remote Config [candidate] (2.275 ms) : 0, 2275
Telemetry [baseline] (10.999 ms) : 0, 10999
Telemetry [candidate] (12.015 ms) : 0, 12015
Flare Poller [baseline] (3.451 ms) : 0, 3451
Flare Poller [candidate] (3.42 ms) : 0, 3420
section profiling
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (691.926 ms) : 0, 691926
BytebuddyAgent [candidate] (696.721 ms) : 0, 696721
AgentMeter [baseline] (9.16 ms) : 0, 9160
AgentMeter [candidate] (9.226 ms) : 0, 9226
GlobalTracer [baseline] (207.193 ms) : 0, 207193
GlobalTracer [candidate] (208.137 ms) : 0, 208137
AppSec [baseline] (32.48 ms) : 0, 32480
AppSec [candidate] (32.777 ms) : 0, 32777
Debugger [baseline] (65.899 ms) : 0, 65899
Debugger [candidate] (65.953 ms) : 0, 65953
Remote Config [baseline] (578.571 µs) : 0, 579
Remote Config [candidate] (568.847 µs) : 0, 569
Telemetry [baseline] (7.85 ms) : 0, 7850
Telemetry [candidate] (7.882 ms) : 0, 7882
Flare Poller [baseline] (3.552 ms) : 0, 3552
Flare Poller [candidate] (3.608 ms) : 0, 3608
ProfilingAgent [baseline] (93.963 ms) : 0, 93963
ProfilingAgent [candidate] (94.45 ms) : 0, 94450
Profiling [baseline] (94.54 ms) : 0, 94540
Profiling [candidate] (95.024 ms) : 0, 95024
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/pin-system-tests-20260408
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1775654840 1775654840
ci_job_id 1577034029 1577034029
ci_pipeline_id 106632072 106632072
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1775589541 1775589541
git_commit_sha aa7c70f aa7c70f
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-hwbfr220 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-hwbfr220 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
release_version 1.61.0~aa7c70f2e7 1.61.0~aa7c70f2e7

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-198.128µs; -47.740µs] or [-10.899%; -2.626%]
unstable
[-1272.974µs; -278.030µs] or [-23.017%; -5.027%]
unstable
[-40.639op/s; +450.701op/s] or [-2.061%; +22.857%]
1.695ms 4.755ms 2176.875op/s 1.818ms 5.531ms 1971.844op/s
scenario:load:insecure-bank:iast_FULL:high_load unsure
[-346.852µs; -27.582µs] or [-6.254%; -0.497%]
better
[-1112.224µs; -413.001µs] or [-8.265%; -3.069%]
unstable
[-46.659op/s; +101.597op/s] or [-6.302%; +13.723%]
5.359ms 12.694ms 767.812op/s 5.546ms 13.456ms 740.344op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.225 ms) : 1214, 1236
.   : milestone, 1225,
iast (3.432 ms) : 3376, 3489
.   : milestone, 3432,
iast_FULL (6.251 ms) : 6185, 6316
.   : milestone, 6251,
iast_GLOBAL (3.716 ms) : 3652, 3781
.   : milestone, 3716,
profiling (2.299 ms) : 2275, 2322
.   : milestone, 2299,
tracing (1.853 ms) : 1837, 1869
.   : milestone, 1853,
section candidate
no_agent (1.241 ms) : 1229, 1252
.   : milestone, 1241,
iast (3.364 ms) : 3317, 3411
.   : milestone, 3364,
iast_FULL (6.026 ms) : 5965, 6087
.   : milestone, 6026,
iast_GLOBAL (3.704 ms) : 3639, 3768
.   : milestone, 3704,
profiling (2.076 ms) : 2057, 2094
.   : milestone, 2076,
tracing (1.882 ms) : 1864, 1899
.   : milestone, 1882,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.225 ms [1.214 ms, 1.236 ms] -
iast 3.432 ms [3.376 ms, 3.489 ms] 2.207 ms (180.2%)
iast_FULL 6.251 ms [6.185 ms, 6.316 ms] 5.026 ms (410.3%)
iast_GLOBAL 3.716 ms [3.652 ms, 3.781 ms] 2.491 ms (203.4%)
profiling 2.299 ms [2.275 ms, 2.322 ms] 1.074 ms (87.7%)
tracing 1.853 ms [1.837 ms, 1.869 ms] 627.917 µs (51.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.241 ms [1.229 ms, 1.252 ms] -
iast 3.364 ms [3.317 ms, 3.411 ms] 2.123 ms (171.1%)
iast_FULL 6.026 ms [5.965 ms, 6.087 ms] 4.785 ms (385.7%)
iast_GLOBAL 3.704 ms [3.639 ms, 3.768 ms] 2.463 ms (198.5%)
profiling 2.076 ms [2.057 ms, 2.094 ms] 835.143 µs (67.3%)
tracing 1.882 ms [1.864 ms, 1.899 ms] 641.264 µs (51.7%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.374 ms) : 19172, 19576
.   : milestone, 19374,
appsec (18.839 ms) : 18646, 19032
.   : milestone, 18839,
code_origins (17.927 ms) : 17750, 18104
.   : milestone, 17927,
iast (18.304 ms) : 18121, 18486
.   : milestone, 18304,
profiling (18.363 ms) : 18183, 18543
.   : milestone, 18363,
tracing (17.744 ms) : 17567, 17920
.   : milestone, 17744,
section candidate
no_agent (19.518 ms) : 19317, 19719
.   : milestone, 19518,
appsec (18.637 ms) : 18449, 18825
.   : milestone, 18637,
code_origins (17.843 ms) : 17669, 18017
.   : milestone, 17843,
iast (17.819 ms) : 17646, 17993
.   : milestone, 17819,
profiling (18.557 ms) : 18372, 18742
.   : milestone, 18557,
tracing (17.748 ms) : 17575, 17921
.   : milestone, 17748,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.374 ms [19.172 ms, 19.576 ms] -
appsec 18.839 ms [18.646 ms, 19.032 ms] -535.177 µs (-2.8%)
code_origins 17.927 ms [17.75 ms, 18.104 ms] -1.447 ms (-7.5%)
iast 18.304 ms [18.121 ms, 18.486 ms] -1.071 ms (-5.5%)
profiling 18.363 ms [18.183 ms, 18.543 ms] -1.012 ms (-5.2%)
tracing 17.744 ms [17.567 ms, 17.92 ms] -1.631 ms (-8.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.518 ms [19.317 ms, 19.719 ms] -
appsec 18.637 ms [18.449 ms, 18.825 ms] -881.192 µs (-4.5%)
code_origins 17.843 ms [17.669 ms, 18.017 ms] -1.675 ms (-8.6%)
iast 17.819 ms [17.646 ms, 17.993 ms] -1.698 ms (-8.7%)
profiling 18.557 ms [18.372 ms, 18.742 ms] -960.599 µs (-4.9%)
tracing 17.748 ms [17.575 ms, 17.921 ms] -1.77 ms (-9.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/pin-system-tests-20260408
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1775654464 1775654464
ci_job_id 1577034030 1577034030
ci_pipeline_id 106632072 106632072
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
git_commit_date 1775589541 1775589541
git_commit_sha aa7c70f aa7c70f
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-4r1k7nm0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-4r1k7nm0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
release_version 1.61.0~aa7c70f2e7 1.61.0~aa7c70f2e7

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.378 s) : 14378000, 14378000
.   : milestone, 14378000,
appsec (14.195 s) : 14195000, 14195000
.   : milestone, 14195000,
iast (17.978 s) : 17978000, 17978000
.   : milestone, 17978000,
iast_GLOBAL (17.079 s) : 17079000, 17079000
.   : milestone, 17079000,
profiling (14.41 s) : 14410000, 14410000
.   : milestone, 14410000,
tracing (14.27 s) : 14270000, 14270000
.   : milestone, 14270000,
section candidate
no_agent (15.078 s) : 15078000, 15078000
.   : milestone, 15078000,
appsec (14.421 s) : 14421000, 14421000
.   : milestone, 14421000,
iast (17.763 s) : 17763000, 17763000
.   : milestone, 17763000,
iast_GLOBAL (17.382 s) : 17382000, 17382000
.   : milestone, 17382000,
profiling (14.355 s) : 14355000, 14355000
.   : milestone, 14355000,
tracing (14.445 s) : 14445000, 14445000
.   : milestone, 14445000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.378 s [14.378 s, 14.378 s] -
appsec 14.195 s [14.195 s, 14.195 s] -183.0 ms (-1.3%)
iast 17.978 s [17.978 s, 17.978 s] 3.6 s (25.0%)
iast_GLOBAL 17.079 s [17.079 s, 17.079 s] 2.701 s (18.8%)
profiling 14.41 s [14.41 s, 14.41 s] 32.0 ms (0.2%)
tracing 14.27 s [14.27 s, 14.27 s] -108.0 ms (-0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.078 s [15.078 s, 15.078 s] -
appsec 14.421 s [14.421 s, 14.421 s] -657.0 ms (-4.4%)
iast 17.763 s [17.763 s, 17.763 s] 2.685 s (17.8%)
iast_GLOBAL 17.382 s [17.382 s, 17.382 s] 2.304 s (15.3%)
profiling 14.355 s [14.355 s, 14.355 s] -723.0 ms (-4.8%)
tracing 14.445 s [14.445 s, 14.445 s] -633.0 ms (-4.2%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0~aa7c70f2e7, baseline=1.61.0~aa7c70f2e7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.498 ms) : 1486, 1509
.   : milestone, 1498,
appsec (2.904 ms) : 2814, 2995
.   : milestone, 2904,
iast (2.683 ms) : 2572, 2793
.   : milestone, 2683,
iast_GLOBAL (2.723 ms) : 2612, 2834
.   : milestone, 2723,
profiling (2.467 ms) : 2376, 2559
.   : milestone, 2467,
tracing (2.433 ms) : 2344, 2521
.   : milestone, 2433,
section candidate
no_agent (1.5 ms) : 1488, 1512
.   : milestone, 1500,
appsec (2.909 ms) : 2819, 3000
.   : milestone, 2909,
iast (2.684 ms) : 2573, 2795
.   : milestone, 2684,
iast_GLOBAL (2.735 ms) : 2624, 2846
.   : milestone, 2735,
profiling (2.483 ms) : 2392, 2575
.   : milestone, 2483,
tracing (2.451 ms) : 2361, 2541
.   : milestone, 2451,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.498 ms [1.486 ms, 1.509 ms] -
appsec 2.904 ms [2.814 ms, 2.995 ms] 1.407 ms (93.9%)
iast 2.683 ms [2.572 ms, 2.793 ms] 1.185 ms (79.1%)
iast_GLOBAL 2.723 ms [2.612 ms, 2.834 ms] 1.226 ms (81.8%)
profiling 2.467 ms [2.376 ms, 2.559 ms] 969.628 µs (64.7%)
tracing 2.433 ms [2.344 ms, 2.521 ms] 934.929 µs (62.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.5 ms [1.488 ms, 1.512 ms] -
appsec 2.909 ms [2.819 ms, 3.0 ms] 1.41 ms (94.0%)
iast 2.684 ms [2.573 ms, 2.795 ms] 1.184 ms (78.9%)
iast_GLOBAL 2.735 ms [2.624 ms, 2.846 ms] 1.235 ms (82.3%)
profiling 2.483 ms [2.392 ms, 2.575 ms] 983.323 µs (65.6%)
tracing 2.451 ms [2.361 ms, 2.541 ms] 951.076 µs (63.4%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants