Skip to content

docs: expand Considerations section with CI tables and guidance, add a methodology section#28

Merged
LearningCircuit merged 1 commit into
LearningCircuit:mainfrom
ishitta-iyer:docs/considerations-section
May 2, 2026
Merged

docs: expand Considerations section with CI tables and guidance, add a methodology section#28
LearningCircuit merged 1 commit into
LearningCircuit:mainfrom
ishitta-iyer:docs/considerations-section

Conversation

@ishitta-iyer

Copy link
Copy Markdown
Collaborator

This expands the Considerations section in the README.md to have a sample-size-to-detect-difference table, the grader noise floor, and a statement of what conditions must match for a cross-run comparison to be valid.
METHODOLOGY.md is the new companion document with the full statistical detail: the Wilson score interval formula, hands-on advice for running and interpreting benchmarks, a table of factors that invalidate cross-run comparisons, and a pre-flight checklist.

@LearningCircuit LearningCircuit merged commit 3527b32 into LearningCircuit:main May 2, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants