Skip to content

ci(agent-e2e): drop Agentspan server JAR, run against conductor-oss#424

Merged
kowser-orkes merged 3 commits into
mainfrom
feature/combine-agentspan
Jul 14, 2026
Merged

ci(agent-e2e): drop Agentspan server JAR, run against conductor-oss#424
kowser-orkes merged 3 commits into
mainfrom
feature/combine-agentspan

Conversation

@kowser-orkes

@kowser-orkes kowser-orkes commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Summary

conductor-oss ships the agent runtime by default from 3.32.0-rc.8 onward, so the e2e workflow no longer needs to boot the Agentspan release JAR as the test server.

  • agent-e2e.yml's server download switches from the Agentspan GitHub release asset to the conductor-oss Maven Central boot jar (conductor-server-<version>-boot.jar).
  • The Agentspan CLI binary is still downloaded, now on its own separate pin (AGENTSPAN_CLI_VERSION) — e2e/test_suite16_cli_skills.py still drives it against this same server.
  • Server and CLI version pins are split (CONDUCTOR_SERVER_VERSION / AGENTSPAN_CLI_VERSION) since they're no longer tied to the same release train.
  • Added an explicit permissions: contents: read block (least privilege — the token is only used for the public CLI release download).
  • e2e/conftest.py's runtimeMetadata capability-probe comments updated to reference the new pin name — the probe itself is server-agnostic and required no logic change.

Why

Matches the CI shape already used by this SDK's sibling ports (Java/C#/TS agent-e2e.yml, all similarly moving off the Agentspan server JAR) — conductor-oss is now the reference server for agent e2e, not Agentspan.

Test plan

  • CI green on this PR (agent-e2e)
  • No functional source changes — this is a CI infra + comment-only change; conftest.py's capability probe already worked against any server flavor before this change.

Kowser added 2 commits July 14, 2026 11:13
conductor-oss ships the agent runtime by default from 3.32.0-rc.8, so the
e2e server leg no longer needs the Agentspan release JAR. Server download
switches to the conductor-oss boot jar (Maven Central); the Agentspan CLI
binary stays on its own separate pin since test_suite16_cli_skills.py still
drives it against this same server.
CONDUCTOR_OSS_VERSION -> CONDUCTOR_SERVER_VERSION and AGENTSPAN_CLI_VERSION
0.4.3 -> 0.4.4, matching the already-agreed CI shape in idea-13/design.md
(analysis workspace, not shipped here) rather than inventing new names.
@codecov

codecov Bot commented Jul 14, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
see 7 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@kowser-orkes kowser-orkes changed the title Feature/combine agentspan ci(agent-e2e): drop Agentspan server JAR, run against conductor-oss Jul 14, 2026
…-testkit preflight

conductor-oss's standalone server serves secrets from the process env, so
PUT/DELETE /api/secrets/* return 500 "env-backed secrets are read-only".
This never surfaced while e2e ran against the writable agentspan server;
switching to conductor-oss exposed it as 4 CI failures (suite2, suite4,
suite26). Mirrors the assumption-skip already shipped in the Java/C# ports:
CredentialsCLI.set() and test_suite26's _put_secret() skip (not fail) on a
"read-only" response body; CredentialsCLI.delete() additionally tolerates
"read-only" as best-effort cleanup, same as it already does for "not found".

Also widens test_suite5's mcp-testkit --help preflight from a 5s timeout
that only caught FileNotFoundError to 15s + catching TimeoutExpired too —
a separate, likely-environmental flake surfaced in the same CI run.
@kowser-orkes
kowser-orkes requested a review from v1r3n July 14, 2026 20:47
@kowser-orkes
kowser-orkes merged commit bf55db9 into main Jul 14, 2026
3 checks passed
@kowser-orkes
kowser-orkes deleted the feature/combine-agentspan branch July 14, 2026 21:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants