Skip to content

fix(pipeline): parallel target invocation and cross-platform category fix#859

Merged
christso merged 5 commits intomainfrom
fix/pipeline-run-parallel-exec
Mar 30, 2026
Merged

fix(pipeline): parallel target invocation and cross-platform category fix#859
christso merged 5 commits intomainfrom
fix/pipeline-run-parallel-exec

Conversation

@christso
Copy link
Copy Markdown
Collaborator

@christso christso commented Mar 30, 2026

Summary

  • Fix sequential execution in pipeline run: replaced execSync with async exec so worker concurrency actually works — targets were running one at a time despite the async pool
  • Add progress reporting to target invocation: real-time Invoking: X/Y done counter on stderr, matching the grading step's progress style
  • Fix cross-platform deriveCategory: was using path.sep (Windows \) to split paths that use /, causing all categories to return "Uncategorized" on Windows
  • Read workers from targets.yaml: pipeline run now respects the workers field from targets.yaml (precedence: CLI flag > targets.yaml > default 5)

Test plan

  • All 1295 core tests pass (including 8 previously failing category tests)
  • Lint and build pass
  • Run agentv pipeline run and verify targets execute concurrently — 52 targets in 1m36s (vs ~8min sequential)
  • Verify progress counter updates in real-time during invocation
  • Verify workers from targets.yaml is picked up (set to 3, output showed "3 workers")

🤖 Generated with Claude Code

christso and others added 3 commits March 30, 2026 13:20
execSync blocks the Node.js event loop, so the concurrency pool ran
targets sequentially despite the async wrapper. Switch to async exec
so workers actually run in parallel. Also adds real-time progress
reporting to the invocation step and defaults workers to 5.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
path.sep is \ on Windows, so paths with / were not split correctly,
causing all categories to return 'Uncategorized'. Split on both
separators to work cross-platform.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@cloudflare-workers-and-pages
Copy link
Copy Markdown

cloudflare-workers-and-pages bot commented Mar 30, 2026

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 885c442
Status: ✅  Deploy successful!
Preview URL: https://60b67b1a.agentv.pages.dev
Branch Preview URL: https://fix-pipeline-run-parallel-ex.agentv.pages.dev

View logs

christso and others added 2 commits March 30, 2026 13:38
pipeline run now respects the workers field from targets.yaml as a
fallback when --workers is not passed on the CLI. Precedence:
CLI flag > targets.yaml > default (5).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@christso christso merged commit 4026b5d into main Mar 30, 2026
2 checks passed
@christso christso deleted the fix/pipeline-run-parallel-exec branch March 30, 2026 02:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant