Skip to content

LLM Quantization Issue #1

Description

@xi-self13

We need to be able to make LLM's Quantization to be able to make the math of the model's weight smaller and easier to calculate for such a device like a Dell Latitude 2110.

There is absolutely no way I know will work.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesthelp wantedExtra attention is needed

    Type

    Fields

    No fields configured for Task.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions