Skip to content

DFloat request — Qwen-Image #21

@kabachuha

Description

@kabachuha

Qwen Image is a 20b model capable of awesome GPT-level image generation and editing. https://github.com/QwenLM/Qwen-Image

However, it's about 40gbs in size, which makes it quite impractical.

Having a 30% reduced DFloat11 request might fit it into around 29-30GBs, making it available for lossless inference on High-End consumer devices. (And even more, with offloading)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions