Skip to content

Fix tutorial evaluation workflow: stale docs paths and issue reporting bugs#84

Merged
amansinghoriginal merged 1 commit intodrasi-project:mainfrom
amansinghoriginal:tut-eval-pr
Mar 18, 2026
Merged

Fix tutorial evaluation workflow: stale docs paths and issue reporting bugs#84
amansinghoriginal merged 1 commit intodrasi-project:mainfrom
amansinghoriginal:tut-eval-pr

Conversation

@amansinghoriginal
Copy link
Copy Markdown
Member

Summary

  • Update docs_path matrix entries for 4 tutorials to reflect the drasi-kubernetes/ restructure from docs PR #190 (getting-started, curbside-pickup, building-comfort, absence-of-change)
  • Fix issue creation logic that misreports attempt statuses:
    • Use step.outcome instead of step.conclusion so continue-on-error steps don't always show as SUCCESS
    • Filter skipped attempt 1 (previously only attempts 2/3 were filtered, causing "Failed after 1 attempt(s)" with status SKIPPED when no evaluation ran)
    • Use precise step name matching (Run evaluation (attempt N)) to avoid matching cleanup steps

Context

All 5 tutorials have been failing since the docs repo restructure on Feb 28 (#190). 4 fail at the "Copy tutorial docs and prompt" step because the docs paths no longer exist. The auto-created failure issues (#79, #81, #83) also misreport statuses — e.g. risky-containers shows all attempts as SUCCESS despite failing.

…workflow

Update docs_path matrix entries to reflect drasi-kubernetes/ restructure from
docs PR #190. Fix issue creation logic to use step.outcome instead of
step.conclusion (which is always success for continue-on-error steps), filter
skipped attempt 1, and use precise step name matching.

Signed-off-by: Aman Singh <aman.singh.original@gmail.com>
@amansinghoriginal amansinghoriginal requested a review from a team as a code owner March 17, 2026 22:27
@amansinghoriginal amansinghoriginal merged commit 98266dc into drasi-project:main Mar 18, 2026
5 of 13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant