Test apm-sdks-benchmarks branch changes

[sarahchen6]

What Does This Do

This PR tests https://github.com/DataDog/apm-sdks-benchmarks/pull/151 which runs the latest merge-base master agent against the same benchmarks that the PR runs, calculates the % change between the results, and reports it in the PR comment.

Motivation

Additional Notes

Contributor Checklist

• Format the title according to the contribution guidelines
• Assign the type: and (comp: or inst:) labels in addition to any other useful labels
• Avoid using close, fix, or any linking keywords when referencing an issue
  Use solves instead, and assign the PR milestone to the issue
• Update the CODEOWNERS file on source file addition, migration, or deletion
• Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

[dd-octo-sts]

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite	Status
Startup	🟢 pass
Load	🟢 pass
DaCapo	🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results

Startup Time

Scenario	This PR	master	Change
insecure-bank / iast	13,952 ms	13,922 ms	+0.2%
insecure-bank / tracing	12,856 ms	12,885 ms	-0.2%
petclinic / appsec	15,580 ms	16,177 ms	-3.7%
petclinic / iast	16,475 ms	16,505 ms	-0.2%
petclinic / profiling	16,368 ms	16,500 ms	-0.8%
petclinic / tracing	14,967 ms	15,692 ms	-4.6%

DaCapo Execution Time

Scenario	This PR	master	Change
biojava / tracing	14,424 ms	14,610 ms	-1.3%
tomcat / tracing	1.65 ms	1.64 ms	+0.4%

Load Latency (p50)

Scenario	This PR	master	Change
insecure-bank / tracing	0.82 ms	0.83 ms	-2.1%
spring-petclinic / tracing	24.46 ms	24.05 ms	+1.7%

Commit: 899580b1 · CI Pipeline · Benchmarking Platform UI

[datadog-official]

✨ Fix all issues with BitsAI

⚠️ Warnings

🚦 4 Pipeline jobs failed

DataDog/apm-reliability/dd-trace-java | test_base: [17, 3/4]     

🔄 Retry job. This looks flaky and may succeed on retry.

Job execution exceeded the timeout limit of 1h0m0s seconds due to timeout.

DataDog/apm-reliability/dd-trace-java | test_base: [tip, 3/4]     

🔄 Retry job. This looks flaky and may succeed on retry.

after_script could not run to completion because the timeout was exceeded.

DataDog/apm-reliability/dd-trace-java | test_base: [11, 3/4]     

View all 4 failed jobs.

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 899580b | Docs | Datadog PR Page | Give us feedback!}

[sarahchen6]

Done testing