Skip to content

Opt-in batched block-diagonal attention: 2x pretraining throughput, validated equivalent#5

Open
alex-crlhmmr wants to merge 1 commit into
thuml:mainfrom
alex-crlhmmr:feature/batched-block-diagonal-attention
Open

Opt-in batched block-diagonal attention: 2x pretraining throughput, validated equivalent#5
alex-crlhmmr wants to merge 1 commit into
thuml:mainfrom
alex-crlhmmr:feature/batched-block-diagonal-attention

Commits

Commits on Jul 12, 2026