Skip to content

Improving smoke test capabilities#12051

Draft
PerfectSlayer wants to merge 30 commits into
masterfrom
bbujon/smoke-tests-tooling
Draft

Improving smoke test capabilities#12051
PerfectSlayer wants to merge 30 commits into
masterfrom
bbujon/smoke-tests-tooling

Conversation

@PerfectSlayer

Copy link
Copy Markdown
Contributor

This PR was created to preview the end goal of the task. It is still early work and will be split into reviewable chunks once ready. Check additional notes for the PRs ready to review.

What Does This Do

This PR introduces smoke tests framework based on JUnit.

It provides the following capabilities:

  • Register smoke applications
    • Either web server application or CLI application
    • Can be extended to new kind of applications too
    • Lifecycle handled as part of the JUnit engine
    • Registered for parameter resolution
  • Provide full trace content and structure verification
    • With assert rules and matchers (similar to instrumentation testing)
  • Receive traces from test agent
    • No longer test against our own instrumentation
    • Open to snapshot testing
    • Introduce test agent session support to tracer headers
  • Rely on the existing CI test agent
    • Will run test agent locally if docker engine is found
    • Can run the old mock server as alternative when no docker env is available

Additionally, this PR ports two smoke tests as example:

  • opentelemetry - a basic CLI app
  • spring-boot-rabbit - a complex multiple apps / queues setup

Motivation

Additional Notes

This will make some tests run with the test agent side car and enable trace invariant gate too (check_test_agent_results.sh).

Related pull-requests ready for review:

Contributor Checklist

Jira ticket: [APMLP-1247]

@PerfectSlayer PerfectSlayer added type: feature Enhancements and improvements comp: testing Testing tag: do not merge Do not merge changes labels Jul 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: do not merge Do not merge changes type: feature Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant