Skip to content

fix: update qwen3_omni with transformers>=5.0#296

Merged
ali-88123 merged 2 commits intoTencent:mainfrom
ali-88123:fix_qwen3_omni
May 7, 2026
Merged

fix: update qwen3_omni with transformers>=5.0#296
ali-88123 merged 2 commits intoTencent:mainfrom
ali-88123:fix_qwen3_omni

Conversation

@ali-88123
Copy link
Copy Markdown
Collaborator

This PR updates Qwen3-Omni quantization support, mainly including:

  • Adapts Qwen3-Omni model structure and input handling for transformers>=5.0
  • Supports configurable quantization scope for Qwen3-Omni thinker / talker modules
  • Adds the quantization.quant_talker option, disabled by default to quantize only the thinker module
  • Fixes audio input handling and dtype/device conversion in OmniDataset
  • Updates Qwen3-Omni FP8 static/dynamic configs and documentation
  • Updates fake data examples with an audio sample

@ali-88123 ali-88123 requested review from irisliu10 and yghstill May 7, 2026 12:29
@ali-88123 ali-88123 merged commit f76d316 into Tencent:main May 7, 2026
5 checks passed
@ali-88123 ali-88123 deleted the fix_qwen3_omni branch May 8, 2026 02:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants