Skip to content

docs: correct CLI and integration sweep claims#1428

Merged
afadesigns merged 1 commit into
mainfrom
docs/audit-cli-integration-accuracy
Jun 26, 2026
Merged

docs: correct CLI and integration sweep claims#1428
afadesigns merged 1 commit into
mainfrom
docs/audit-cli-integration-accuracy

Conversation

@afadesigns

Copy link
Copy Markdown
Owner

A documentation + integration audit, every claim verified against the live binary and the pinned corpus manifest, surfaced five accuracy gaps:

  1. -no-color auto-TTY claim (USER_GUIDE) — the doc said it is implied when stdout is not a TTY, but the binary has no isatty detection and emits ANSI even when piped (zshellcheck file | cat shows ^[[33m). Dropped the false claim.
  2. SARIF/JSON on parse error (USER_GUIDE FAQ) — the doc said there is nothing to emit, but a parse error emits a well-formed document (JSON an empty array, SARIF a valid run with an empty results list) and exits 1. Corrected.
  3. Exit code 2 (USER_GUIDE) — undocumented. A command-line parsing error (unknown flag, or a flag missing its value) exits 2; an app-validated invalid flag value exits 1. Both now documented.
  4. Integration sweep over-claim (INTEGRATIONS.md + README) — both said every listed integration runs the per-release sweep, but the heaviest Featured trees (oh-my-zsh, powerlevel10k, zsh-syntax-highlighting) are absent from .github/parser-corpus-manifest.txt and swept manually (their own compat-nightly.yml notes the clones are too heavy to pin). Qualified to the pinned corpus matrix.

Docs-only; no code or behaviour change. KATAS.md/version parity, internal links, action-pin comments, and docs-style were all audited clean.

Receipts: piped output ^[[33mwarning^[[0m (no isatty code in tree); -format sarif <broken> emits a 349-byte SARIF, exit 1; --bogus exit 2, -severity bogus exit 1; the 3 heavy corpora return 0 matches in the manifest.

A documentation audit, verified against the live binary and the pinned
corpus manifest, surfaced five accuracy gaps:

- `-no-color` is not implied for a non-TTY: the binary has no isatty
  detection and emits ANSI even when piped. Drop the false auto-disable
  claim; colour is on by default and `-no-color` turns it off.
- A parse error emits a well-formed report (JSON an empty array, SARIF a
  valid run with an empty `results` list), not nothing. Correct the FAQ.
- Document exit code 2 for a command-line parsing error (an unknown flag
  or a flag missing its value); an invalid flag value stays exit 1.
- INTEGRATIONS.md and README claimed every listed integration runs the
  per-release sweep, but the heaviest Featured trees (oh-my-zsh,
  powerlevel10k, zsh-syntax-highlighting) are swept manually, not in the
  pinned gate. Qualify the claim to the pinned corpus matrix.

Signed-off-by: afadesigns <afadesign.official@gmail.com>
@github-actions github-actions Bot added the docs Documentation changes label Jun 26, 2026

@redteamx redteamx left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved on review.

@afadesigns afadesigns merged commit d3b656d into main Jun 26, 2026
19 checks passed
@afadesigns afadesigns deleted the docs/audit-cli-integration-accuracy branch June 26, 2026 00:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs Documentation changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants