[3/5] feat: cross-tokenizer distillation loss and multi-teacher aggregator#2349

Closed

avenkateshha wants to merge 4 commits into

NVIDIA-NeMo:mainfrom

avenkateshha:avenkateshha/xtoken-off-policy-distillation/03-loss

Commits on Apr 27, 2026

feat: add TokenAligner and cross-tokenizer projection utilities

avenkateshha
and
claude
committed
feat: cross-tokenizer collator, Arrow dataset, and eval datasets

avenkateshha
and
claude
committed
feat: cross-tokenizer distillation loss and multi-teacher aggregator

avenkateshha
and
claude
committed

Commits on Apr 28, 2026

fix(loss): add missing math, time, Union imports

avenkateshha
and
claude
committed