test(ci): add expiring flaky test registry#914
Closed
luoye520ww wants to merge 1 commit into
Closed
Conversation
Collaborator
Author
Collaborator
Author
|
This work is consolidated into #941, which contains the related CI diagnostics and packaged smoke fix as one tested PR. Closing this duplicate to avoid parallel review and PR noise. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
Flaky test quarantine can become permanent when a record has no owner, issue, or expiry metadata.
Root cause
There was no bounded, machine-readable registry contract that CI could validate before consuming flaky-test records.
Scope
This PR adds the registry validator and CLI only. It does not change retry, quarantine, or CI execution behavior.
Changes
Safety
Typecheck
```text
npm.cmd run typecheck
```
Passed.
Tests
```text
node --test scripts/flaky-test-registry.test.cjs
node scripts/flaky-test-registry.cjs --file
node scripts/flaky-test-registry.cjs --file
npm.cmd run lint
npm.cmd run build
git diff --check
```
Results: 6 registry tests passed; valid fixture exited 0; invalid fixture exited 1; lint, build, and diff checks passed.
Review performed
Non-goals
CI retry/quarantine integration and daily flaky-test pressure runs are intentionally deferred to follow-up PRs.
Part of the flaky-test registry work.