Skip to content

Pre-flight token counting for callers #63

@djthorpe

Description

@djthorpe

EstimateTokens() exists post-hoc; model.ContextWindow() not surfaced from provider metadata
Expose context window size on schema.Model; add EstimateRequestTokens() on manager

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions