Skip to content

Fix OpenAI strict verdict extraction schema#55

Merged
ernestprovo23 merged 1 commit into
mainfrom
fix/openai-verdict-schema
Jul 19, 2026
Merged

Fix OpenAI strict verdict extraction schema#55
ernestprovo23 merged 1 commit into
mainfrom
fix/openai-verdict-schema

Conversation

@ernestprovo23

Copy link
Copy Markdown
Member

Summary

  • require every declared property in the verdict extraction schema for OpenAI strict structured output
  • remove engine-computed nested consensus and optional vote confidence from the extraction contract
  • version the extraction prompt and require honest empty values for semantic optionals
  • validate frozen replay verdict payloads recursively against the extraction schema

Verification

  • 716 tests passed
  • Ruff check and format check passed
  • git diff check passed
  • Gitleaks found no leaks
  • read-only adversarial review clean

Live evidence

The capped paid smoke reached all providers but OpenAI rejected the previous strict schema before generation because declared properties were missing from required. This PR fixes that exact provider error; a fresh capped live matrix follows after merge.

@ernestprovo23
ernestprovo23 merged commit e347f8f into main Jul 19, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant