Skip to content

Add config files to experiment on the performance between dense and MOE blocks in attention layers#18

Open
Adefioye wants to merge 4 commits into
chrisjmccormick:mainfrom
Adefioye:first-exp-moe
Open

Add config files to experiment on the performance between dense and MOE blocks in attention layers#18
Adefioye wants to merge 4 commits into
chrisjmccormick:mainfrom
Adefioye:first-exp-moe

Make some cleanup

0fc0729
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs