Search results

Add a langgraph-node runner for regression-testing LangGraph agents

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

runnerAdds or modifies a runner adapterAdds or modifies a runner adapter

Status: Open.

#36 In nano-step/eval-harness;

· hoainho opened on Jun 1, 2026

Add --since filter to eval-harness trend (e.g. --since=7d, --since=2026-05-01)

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#35 In nano-step/eval-harness;

· hoainho opened on Jun 1, 2026

Pretty-print eval-harness status output as a colored table

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#34 In nano-step/eval-harness;

· hoainho opened on Jun 1, 2026

Document the case YAML with a JSON Schema (for editor autocomplete)

documentationImprovements or additions to documentationImprovements or additions to documentation

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#33 In nano-step/eval-harness;

· hoainho opened on Jun 1, 2026

Add eval-harness doctor — preflight diagnostics command

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#32 In nano-step/eval-harness;

· hoainho opened on Jun 1, 2026

Add an expect_exact_lines variant to kind: shell

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#31 In nano-step/eval-harness;

· hoainho opened on Jun 1, 2026

🗺 Roadmap: v0.4.3 → v0.5.0 → v0.6.0 → v0.7.0 → v1.0.0

documentationImprovements or additions to documentationImprovements or additions to documentation

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#26 In nano-step/eval-harness;

· hoainho opened on May 30, 2026

Pin and document end-to-end: 'run a real eval-harness against omo-session-distiller'

documentationImprovements or additions to documentationImprovements or additions to documentation

good first issueGood for newcomersGood for newcomers

v0.5.0CI-ready releaseCI-ready release

Status: Open.

#25 In nano-step/eval-harness;

· hoainho opened on May 30, 2026

Verify portability on macOS (BSD coreutils) — set up a CI matrix

help wantedExtra attention is neededExtra attention is needed

portabilitymacOS / BSD / alpine compatmacOS / BSD / alpine compat

v0.4.3Correctness polish releaseCorrectness polish release

Status: Open.

#24 In nano-step/eval-harness;

· hoainho opened on May 30, 2026

Write a GitHub Actions example workflow (.github/workflows/eval.yml)

ci-integrationGitHub Actions / GitLab CI / CircleCI integrationGitHub Actions / GitLab CI / CircleCI integration

documentationImprovements or additions to documentationImprovements or additions to documentation

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

v0.5.0CI-ready releaseCI-ready release

Status: Open.

#23 In nano-step/eval-harness;

· hoainho opened on May 30, 2026

Document semver + deprecation policy

documentationImprovements or additions to documentationImprovements or additions to documentation

good first issueGood for newcomersGood for newcomers

v0.5.0CI-ready releaseCI-ready release

Status: Open.

#22 In nano-step/eval-harness;

· hoainho opened on May 30, 2026

Add stochastic pass@k mode (T>0, multiple samples per case)

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

v0.7.0Scale releaseScale release

Status: Open.

#21 In nano-step/eval-harness;

· hoainho opened on May 30, 2026