Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions submissions/s2i-build/evals/evals.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
{
"skill_name": "s2i-build",
"evals": [
{
"id": "s2i-build-eval",
"name": "S2I Build Methodology",
"prompt": "You need to build a container image from source code on OpenShift using Source-to-Image (S2I). The project is a Node.js application with a package.json.\n\nDescribe your S2I build methodology: what OpenShift resources you create, how you select the right builder image, how you monitor the build progress, and how you handle build failures.",
"expected_output": "An S2I methodology that creates BuildConfig and ImageStream resources, selects the appropriate S2I builder image based on detected language/version, monitors build logs, and handles failures with diagnostic guidance.",
"assertions": [
"The output describes creating both a BuildConfig and an ImageStream resource on OpenShift as part of the S2I build setup.",
"The output describes selecting an S2I builder image based on the detected programming language and version from the project.",
"The output describes monitoring build progress by streaming build logs and checking build status.",
"The output requires user confirmation of the build configuration before triggering the build."
]
}
]
}
5 changes: 5 additions & 0 deletions submissions/s2i-build/metadata.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
name: s2i-build
description: "Create BuildConfig and ImageStream resources on OpenShift and trigger"
persona: rh-developer
version: "1.0.0"
eval_engine: ase
Loading