As title - we should be measure in each ChatThread the amount of tokens and how many we have left as we as better handle output limits
we probably would like to know the fixed token cost of each tool ~ maybe in the entity registry keep an average tokens used per tool and stuff like that
As title - we should be measure in each ChatThread the amount of tokens and how many we have left as we as better handle output limits
we probably would like to know the fixed token cost of each tool ~ maybe in the entity registry keep an average tokens used per tool and stuff like that