Skip to content

LoRA/DoRA fast forward: no weight materialization (1.6-2.0x on MPS)#69

Open
Cortexelus wants to merge 1 commit into
mps-trainingfrom
fast-lora-forward
Open

LoRA/DoRA fast forward: no weight materialization (1.6-2.0x on MPS)#69
Cortexelus wants to merge 1 commit into
mps-trainingfrom
fast-lora-forward

lora: reformulated LoRA/DoRA forward — no weight materialization (1.6…

bcd2cb4
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar