Skip to content

fix(autoquant): score grouped QKV at attention output#1993

Draft
realAsma wants to merge 2 commits into
mainfrom
asma/autoquantize-qkv-self-attn-scoring
Draft

fix(autoquant): score grouped QKV at attention output#1993
realAsma wants to merge 2 commits into
mainfrom
asma/autoquantize-qkv-self-attn-scoring