Skip to content

Using DTensor to handle local num_heads change while TP is applied#1373

Merged
soumith merged 1 commit into
pytorch:mainfrom
wwwjn:tp_tutorial_2
Jul 16, 2025
Merged

Using DTensor to handle local num_heads change while TP is applied#1373
soumith merged 1 commit into
pytorch:mainfrom
wwwjn:tp_tutorial_2

Commits

Commits on Jul 15, 2025