Skip to content

maxP measured#8

Open
m-wojnar wants to merge 2 commits into
mainfrom
width-ladder-pipeline
Open

maxP measured#8
m-wojnar wants to merge 2 commits into
mainfrom
width-ladder-pipeline

Conversation

@m-wojnar

Copy link
Copy Markdown
Owner
  • maxp: add measure_only mode (passive alignment logging, LRs untouched)
  • scales: width-only ladder (fixed depth 12, head_dim 64, GQA 4), s1-s5 = 256..4096 dim, 4.00x non-embed per width doubling
  • methods: drop mup-full; add maxP-meas (c solved once from a measured alignment table via --alignment-table); wire --seed (was a no-op)
  • launch_sweep: 7-pt LR grid incl. 1.0, chained jobs for s4/s5 (48h cap), per-LR runtime gating via --require sentinels, job-id capture
  • pipeline.sh: login-node submit-only DAG (sweeps s1+s2 -> table export ->
    re-tune s1+s2 -> s3 brackets -> transfer proof + E1 gate -> s4/s5)
  • export_alignment / pipeline_analyze: table export and coordinator logic

m-wojnar and others added 2 commits June 12, 2026 17:52
- maxp: add measure_only mode (passive alignment logging, LRs untouched)
- scales: width-only ladder (fixed depth 12, head_dim 64, GQA 4), s1-s5
  = 256..4096 dim, 4.00x non-embed per width doubling
- methods: drop mup-full; add maxP-meas (c solved once from a measured
  alignment table via --alignment-table); wire --seed (was a no-op)
- launch_sweep: 7-pt LR grid incl. 1.0, chained jobs for s4/s5 (48h cap),
  per-LR runtime gating via --require sentinels, job-id capture
- pipeline.sh: login-node submit-only DAG (sweeps s1+s2 -> table export ->
  re-tune s1+s2 -> s3 brackets -> transfer proof + E1 gate -> s4/s5)
- export_alignment / pipeline_analyze: table export and coordinator logic
Failed sbatch no longer leaves the next chain link dependency-less
(two concurrent writers on one checkpoint dir) or the coordinator
afterany list incomplete. Chained --measure-only/maxP runs are
rejected at submit time: resume re-snapshots z0/w0 and corrupts
alignment measurement.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant