Description
Extend the scoring framework with a new Creativity Score (CS) KPI that measures originality, divergent thinking, and novel connections in AI responses.
What to do
- Create
apps/web/lib/scorers/creativity.ts following existing scorer patterns
-
- Define scoring criteria (originality, metaphor use, novel connections)
-
- Implement the LLM-as-judge prompt for creativity evaluation
-
- Register the new scorer in
scoring-engine.ts
-
- Add unit tests in
__tests__/
Skills needed
- TypeScript
-
- Understanding of LLM evaluation
References
- Existing scorers:
apps/web/lib/scorers/
-
- Scoring engine:
apps/web/lib/scorers/scoring-engine.ts
-
-
- Test examples:
apps/web/__tests__/
Description
Extend the scoring framework with a new Creativity Score (CS) KPI that measures originality, divergent thinking, and novel connections in AI responses.
What to do
apps/web/lib/scorers/creativity.tsfollowing existing scorer patternsscoring-engine.ts__tests__/Skills needed
References
apps/web/lib/scorers/apps/web/lib/scorers/scoring-engine.tsapps/web/__tests__/