Skip to content

[codex] ship ProofLoop live-prod reliability slate#182

Draft
HomenShum wants to merge 13 commits into
mainfrom
codex/proofloop-strict-live-official
Draft

[codex] ship ProofLoop live-prod reliability slate#182
HomenShum wants to merge 13 commits into
mainfrom
codex/proofloop-strict-live-official

Conversation

@HomenShum

@HomenShum HomenShum commented Jul 6, 2026

Copy link
Copy Markdown
Owner

Summary

Ships the ProofLoop live-prod reliability package: deterministic HMDA and Q3 benchmark lanes, Convex-env provider preflight receipts, non-retryable provider credit failures, cancel cleanup, browser receipt separation, SEC/XBRL benchmark claim tightening, and advanced finance / actuarial benchmark evidence.

Why

Live-prod ProofLoop was blocked by provider 402 retries, uncancelled long-running jobs, and a generic Q3 browser task that could stay running 1/1000. The benchmark writeups also overclaimed SEC/XBRL scope and lacked committed reviewable evidence. A follow-up correction fixed the preflight source: production live provider readiness must check the production-serving Convex env, not only the local shell.

What changed

  • Adds deterministic HMDA underwriting and Q3 variance executors behind benchmark-completion paths.
  • Makes provider 401/402/403 failures non-retryable and adds provider preflight receipts before BTB.
  • Checks provider readiness from the production-serving Convex env by default for proofloop:live:prod, while redacting raw key and balance values from committed receipts.
  • Fixes cancel job cleanup/lease clearing and workflow cancel best-effort recording.
  • Adds proofloop:live:prod as the one-command production slate with automatic receipts.
  • Keeps browser receipts separate from canonical verifier receipts.
  • Tightens SEC/XBRL language to latest 10-K/accession-based DQC-inspired checks and commits datasets/scorecard.
  • Adds autonomous credit, actuarial, and AI-2027-style multi-angle benchmark proof artifacts.

Deployment

  • Convex production-serving deployment zealous-goshawk-766 synced with npm run convex:deploy.
  • Vercel production deployment dpl_2shHR2jQwCufMaghDG2Dt1VbFRhh is Ready and aliased to https://noderoom.live and https://nodeagent.live.

Validation

  • npm run build
  • npm test -- --run tests/providerEgressPolicy.test.ts tests/agentJobsRuntime.test.ts tests/hmdaUnderwritingExecutor.test.ts tests/proofloopSupervisor.test.ts tests/secXbrlAudit.test.ts tests/q3VarianceExecutor.test.ts tests/agentJobsSource.test.ts
  • npm test -- --run tests/agentJobsSource.test.ts
  • npm run nodeagent:frame:smoke
  • npm run omnigent:nodeagent:smoke
  • npx tsc --noEmit --project convex/tsconfig.json --pretty false
  • npm run benchmark:sec-xbrl:ingest
  • npm test -- --run tests/secXbrlAudit.test.ts
  • npm run benchmark:advanced-finance
  • npm run proofloop:provider:preflight -- --key-source convex-env --convex-deployment zealous-goshawk-766 --min-balance-usd 1 --soft
  • npm run proofloop:live:prod -- --continue-on-failure after redeploy and again after Convex-env preflight correction

Final live-prod receipt: docs/eval/live-prod/live-prod-20260706T231618Z/suite-receipt.json.

Known gated item

BTB live-prod is now correctly skipped when Convex-env provider preflight says provider_insufficient_credits. The production-serving Convex env has OPENROUTER_API_KEY, but the remaining credit bucket is below the configured $1 threshold. With credits added, the same slate will run BTB instead of starting a doomed retry loop.

@vercel

vercel Bot commented Jul 6, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
noderoom Ready Ready Preview, Comment Jul 7, 2026 4:48am

Request Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant