chore(testdata): upstream-config drift detected (cursor)#109
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Upstream config drift detected — cursor
Reconciling testagent's corpus with current upstream docs.
Added (7)
Net-new examples found in docs that pass
testagent cursor validate --strict.testdata/upstream-examples/cursor/hooks-upstream-20260526-f38a22d8.json(from https://cursor.com/docs/hooks.md)testdata/upstream-examples/cursor/mcp-upstream-20260526-f158ff1f.json(from https://cursor.com/docs/mcp.md)testdata/upstream-examples/cursor/mcp-upstream-20260526-d22bb18c.json(from https://cursor.com/docs/mcp.md)testdata/upstream-examples/cursor/mcp-upstream-20260526-03764548.json(from https://cursor.com/docs/mcp.md)testdata/upstream-examples/cursor/mcp-upstream-20260526-6044dc9e.json(from https://cursor.com/help/customization/mcp.md)testdata/upstream-examples/cursor/mcp-upstream-20260526-d8799949.json(from https://cursor.com/help/customization/mcp.md)testdata/upstream-examples/cursor/mcp-upstream-20260526-b771803d.json(from https://cursor.com/help/customization/mcp.md)Retired (5)
Existing fixtures whose exact bytes are no longer present at the
.sourceURL we recorded. Only fixtures whose source page wasfetched this run are retired (guards against vendor docs URL
restructures).
testdata/upstream-examples/cursor/hooks-before-shell-execution-prompt-type.json(last verified 2026-05-20 at https://cursor.com/docs/hooks)testdata/upstream-examples/cursor/hooks-before-shell-execution-network-guard.json(last verified 2026-05-20 at https://cursor.com/docs/hooks)testdata/upstream-examples/cursor/hooks-before-shell-execution-kube-guard.json(last verified 2026-05-20 at https://cursor.com/docs/hooks)testdata/upstream-examples/cursor/hooks-stop-ts-track.json(last verified 2026-05-20 at https://cursor.com/docs/hooks)testdata/upstream-examples/cursor/hooks-multi-event-matchers.json(last verified 2026-05-20 at https://cursor.com/docs/hooks)Skipped — fail --strict
testagent cursor validate --strict; tracked separately inupdate-compatibility.How to evaluate
Each Added fixture passed
testagent cursor validate --strictin theworkflow. That's necessary but not sufficient — runtime behavior of
the actual vendor binary (
claude/codex/cursor) is thecanonical source of truth, not the docs page. testagent's job is to
match what the real vendor accepts, even when testagent's own internal
runtime doesn't model every field.
Triage rules:
binary would accept. If our validator accepts a fixture but the
doc example looks stale or wrong (typo, deprecated key), drop it
from this PR and file an upstream doc bug — don't widen our
validator to match a wrong doc.
docs at the URL we recorded. Default to accepting the retirement.
Push back only if the fixture exercises a real-world shape the
vendor still accepts at runtime — in which case keep it locally
and update the
.sourceURL or add a comment explaining why.Sometimes the doc is right and we're missing schema coverage
(→ extend the allowlist via
update-compatibility). Sometimesthe doc is wrong (→ leave it skipped).
When uncertain, run the real
cursorbinary against the fixture ina sandbox before merging.
🤖 Generated by
.github/workflows/upstream-drift.yml