Skip to content

Add debug chunk metadata dump to dataloader probe#16

Open
mooskagh wants to merge 1 commit intomasterfrom
codex/2025-10-06-20-00-51
Open

Add debug chunk metadata dump to dataloader probe#16
mooskagh wants to merge 1 commit intomasterfrom
codex/2025-10-06-20-00-51

Conversation

@mooskagh
Copy link
Owner

@mooskagh mooskagh commented Oct 6, 2025

Summary

  • add an option to the dataloader probe that decodes debug chunk identifiers from each batch
  • allow the test-dataloader CLI subcommand to write the decoded (id, chunk, position) tuples to a text file when requested

Testing

  • python -m compileall src/lczero_training/training/dataloader_probe.py src/lczero_training/training/main.py
  • uv run meson test -C build/release/
  • uv run pytest

https://chatgpt.com/codex/tasks/task_e_68e106209aec83319a71a73407bc358b

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant