Skip to content

[quantization] Introduce wrapper for Qwen3VLVisionModel#536

Draft
dvsav wants to merge 1 commit intoSamsung:mainfrom
dvsav:quant_vision_model
Draft

[quantization] Introduce wrapper for Qwen3VLVisionModel#536
dvsav wants to merge 1 commit intoSamsung:mainfrom
dvsav:quant_vision_model

Conversation

@dvsav
Copy link
Contributor

@dvsav dvsav commented Mar 5, 2026

This change introduces QuantQwen3VLVisionModel wrapper to support post-training quantization of Qwen3VLVisionModel operation.

Why?

Qwen3VLVisionModel module is used in the image encoder part of VLMs.
Trying to quantize Qwen3VLVisionModel via PTQ generates exception PTQQuantizer: no quantization wrapper for Qwen3VLVisionModel.

What

This change introduces:

  • class QuantQwen3VLVisionModel (tico/quantization/wrapq/wrappers/qwen_vl/quant_vision_model.py)
  • adds it to _CORE_MODULES (tico/quantization/wrapq/wrappers/registry.py)
  • unit tests class TestQuantQwen3VLVisionModel (test/quantization/wrapq/wrappers/nn/test_quant_vision_model.py)
  • Example of Qwen3VLVisionModel quantization and conversion to Circle (tico/quantization/wrapq/examples/qwen/quantize_quant_vision_model.py).

Unit Tests

Unit tests results with coverage information:

$ coverage run -m pytest test/quantization/wrapq/wrappers/qwen_vl/test_quant_vision_model.py -v

Coverage info (irrelevant files skipped):

$ coverage report -m
Name                                                                   Stmts   Miss  Cover   Missing
----------------------------------------------------------------------------------------------------
...
...
----------------------------------------------------------------------------------------------------
TOTAL                                                                  XXXXXX   XXXX    XX%

This change introduces QuantQwen3VLVisionModel wrapper to support post-training quantization of Qwen3VLVisionModel operation.

TICO-DCO-1.0-Signed-off-by: d.savchenkov <d.savchenkov@partner.samsung.com>
@dvsav dvsav force-pushed the quant_vision_model branch from 8595a6a to 6d61ca4 Compare March 10, 2026 15:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant