Skip to content

eval: hello-world-no-instr Harbor (no instruction.md - expects pipeline to generate)#106

Open
GuyZivRH wants to merge 1 commit into
mainfrom
eval/hello-world-no-instr
Open

eval: hello-world-no-instr Harbor (no instruction.md - expects pipeline to generate)#106
GuyZivRH wants to merge 1 commit into
mainfrom
eval/hello-world-no-instr

Conversation

@GuyZivRH

Copy link
Copy Markdown
Collaborator

Summary

Tests that the pipeline generates instruction.md and test_outputs.py when only skills/SKILL.md is provided.

Changes

  • New hello-world-no-instr submission with generation_mode: ai
  • Contains only metadata.yaml, skills/SKILL.md, and solution/solve.sh
  • No instruction.md or tests/ directory

Expected Pipeline Behavior

  1. Detect missing instruction.md and test_outputs.py
  2. Generate both from SKILL.md using AI
  3. Upload generated files to MinIO generated/ folder with # Generated by AI header
  4. Run Harbor evaluation with the generated tests

Made with Cursor

…ne to generate)

Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant