Skip to content

test: add ops-bot evolution cases#78

Open
upsearchmain wants to merge 1 commit into
NousResearch:mainfrom
upsearchmain:codex/T-E5-1-05-ops-bot-cases
Open

test: add ops-bot evolution cases#78
upsearchmain wants to merge 1 commit into
NousResearch:mainfrom
upsearchmain:codex/T-E5-1-05-ops-bot-cases

Conversation

@upsearchmain
Copy link
Copy Markdown

Summary

  • Add 30 ops-bot JSONL evaluation cases under cases/ops-bot/cases.jsonl.
  • Distribution: 10 alert severity, 10 runbook step, 10 postmortem.
  • Keep a consistent top-level JSON shape: id, skill, category, input, expected, judge.

Verification

  • test -f ~/hermes-evolution/cases/ops-bot/cases.jsonl && echo test -f: OK
  • wc -l ~/hermes-evolution/cases/ops-bot/cases.jsonl -> 30
  • /usr/bin/python3 JSON parse command -> OK
  • distribution/shape check -> rows 30, categories 10/10/10, shape_distribution: OK
  • git diff --check origin/main...HEAD -> exit 0

Self-Review

  • P1: Scope came from task, v5 PART 13/15, skills README, edge cases, and acceptance section 7.
  • P2: One JSONL data file only, no scripts or extra abstractions.
  • P3: Only ops-bot cases file is tracked in this branch. Other profile cases were not touched.
  • P4: Success criteria were verified against the exact ~/hermes-evolution path.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant