Single gpu disk offload PTQ for DSR1/Ultra#2008

Open

Fridah-nv wants to merge 8 commits into

fridah/omniml-4947-mem-monitorfrom

fridah/single-gpu-disk-offload-ptq

Commits on Jul 23, 2026

feat(ptq): single-GPU disk-offload layerwise PTQ (G1/G2)
Fridah-nv
committed
fix(export): materialize non-decoder disk-offloaded tensors before save
Fridah-nv
committed
fix(export): correct offloaded export path — MoE ordering, lm_head handler, memory
Fridah-nv
committed
feat(export): streaming shard writer for 80 GB CPU RAM target

Fridah-nv
and
claude
committed
refactor(export): simplify streaming-export additions per /simplify review

Fridah-nv
and
claude
committed
fix(export): harden streaming export path per code review

Fridah-nv
and
claude
committed
fix(export): avoid save_pretrained shared-tensor crash on MoE models

Fridah-nv
and
claude
committed

Commits on Jul 24, 2026

refactor(export): remove dead offloaded branch, early-return dispatch, shard regression test

Fridah-nv
and
claude
committed