-
Notifications
You must be signed in to change notification settings - Fork 0
Create evaluations #167
Copy link
Copy link
Open
Labels
ai/corecore functions like generateText, streamText, etc. Provider utils, and provider spec.core functions like generateText, streamText, etc. Provider utils, and provider spec.featureNew feature or requestNew feature or requestpull request welcomeFor issues with clear instructions that welcome community contirbutionsFor issues with clear instructions that welcome community contirbutions
Metadata
Metadata
Assignees
Labels
ai/corecore functions like generateText, streamText, etc. Provider utils, and provider spec.core functions like generateText, streamText, etc. Provider utils, and provider spec.featureNew feature or requestNew feature or requestpull request welcomeFor issues with clear instructions that welcome community contirbutionsFor issues with clear instructions that welcome community contirbutions
whenever we change the prompt in
tigent.yml, the system prompt, or any relevant code, we want to make sure we don't break current behavior.Ideas we had so far
evaluationswhich is an array of numbers and use issues/PRs on the ai repository as evals