Skip to content

Use unroll_count(4) for the NAX attention Q@K.T loop#3843

Open
wyanzhao wants to merge 1 commit into
ml-explore:mainfrom
wyanzhao:nax-128-qk-unroll
Open

Use unroll_count(4) for the NAX attention Q@K.T loop#3843
wyanzhao wants to merge 1 commit into
ml-explore:mainfrom
wyanzhao:nax-128-qk-unroll

Unroll the NAX attention Q@K.T head-dim loop by 4 not fully

74a113d
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs