Skip to content

[Good First Issue] Implement a new Creativity Score KPI scorer #7

@pixelstrade-dev

Description

@pixelstrade-dev

Description

Extend the scoring framework with a new Creativity Score (CS) KPI that measures originality, divergent thinking, and novel connections in AI responses.

What to do

  1. Create apps/web/lib/scorers/creativity.ts following existing scorer patterns
    1. Define scoring criteria (originality, metaphor use, novel connections)
    1. Implement the LLM-as-judge prompt for creativity evaluation
    1. Register the new scorer in scoring-engine.ts
    1. Add unit tests in __tests__/

Skills needed

  • TypeScript
    • Understanding of LLM evaluation

References

  • Existing scorers: apps/web/lib/scorers/
    • Scoring engine: apps/web/lib/scorers/scoring-engine.ts
      • Test examples: apps/web/__tests__/

Metadata

Metadata

Labels

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions