Skip to content

[megatron] support mlp_padding_free & sp; refactor TransformerLayer#62

Merged
Jintao-Huang merged 3 commits intomodelscope:mainfrom
Jintao-Huang:mlp_padding_free_support_sp
May 5, 2026
Merged

[megatron] support mlp_padding_free & sp; refactor TransformerLayer#62
Jintao-Huang merged 3 commits intomodelscope:mainfrom
Jintao-Huang:mlp_padding_free_support_sp

Commits

Commits on May 5, 2026