feat(evals): set default targets so all evals work out of the box#898

Draft

christso wants to merge 19 commits intomainfrom

feat/default-targets

Commits on Apr 1, 2026

feat(evals): set default targets so all evals work out of the box

christso
and
claude
committed
feat(evals): set default targets so all evals work out of the box

christso
and
claude
committed
feat(evals): make default target env-var-driven for out-of-box evals

christso
and
claude
committed
fix(ci): use explicit include patterns instead of negated globs

christso
and
claude
committed
feat(cli): support negation patterns (!glob) in eval path resolution

christso
and
claude
committed
fix(ci): remove --targets override so per-example targets auto-discover

christso
and
claude
committed
fix: remove deprecated workspace_template from mock target configs

christso
and
claude
committed
fix(ci): add Gemini credentials to workflow .env

christso
and
claude
committed
feat(evals): add llm target and classify all evals as llm or agent

christso
and
claude
committed
fix(evals): use default (copilot) instead of pi-cli for agent evals

christso
and
claude
committed
chore(ci): increase eval workers from 1 to 3

christso
and
claude
committed
fix(ci): exclude evals with local script providers from CI

christso
and
claude
committed
fix(ci): add missing echo provider and install uv for local script evals

christso
and
claude
committed
fix(evals): make LLM eval assertions pass with generic models

christso
and
claude
committed
fix(evals): switch llm and grader targets to OpenRouter

christso
and
claude
committed
fix(evals): switch per-example grader targets from azure to root grader

christso
and
claude
committed
feat(core): add target alias support for single-env-var provider switching

christso
and
claude
committed
feat(core): add use_target for target delegation

christso
and
claude
committed
refactor(targets): use use_target for llm and grader targets

christso
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(evals): set default targets so all evals work out of the box#898

feat(evals): set default targets so all evals work out of the box#898
christso wants to merge 19 commits intomainfrom
feat/default-targets

Commits on Apr 1, 2026

feat(evals): set default targets so all evals work out of the box

feat(evals): set default targets so all evals work out of the box

feat(evals): make default target env-var-driven for out-of-box evals

fix(ci): use explicit include patterns instead of negated globs

feat(cli): support negation patterns (!glob) in eval path resolution

fix(ci): remove --targets override so per-example targets auto-discover

fix: remove deprecated workspace_template from mock target configs

fix(ci): add Gemini credentials to workflow .env

feat(evals): add llm target and classify all evals as llm or agent

fix(evals): use default (copilot) instead of pi-cli for agent evals

chore(ci): increase eval workers from 1 to 3

fix(ci): exclude evals with local script providers from CI

fix(ci): add missing echo provider and install uv for local script evals

fix(evals): make LLM eval assertions pass with generic models

fix(evals): switch llm and grader targets to OpenRouter

fix(evals): switch per-example grader targets from azure to root grader

feat(core): add target alias support for single-env-var provider switching

feat(core): add use_target for target delegation

refactor(targets): use use_target for llm and grader targets