Skip to content

Tracking context length - and handling max tokens errors #6

Description

@furlat

As title - we should be measure in each ChatThread the amount of tokens and how many we have left as we as better handle output limits

we probably would like to know the fixed token cost of each tool ~ maybe in the entity registry keep an average tokens used per tool and stuff like that

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions