[safe-output-health] Safe Output Health Report - 2026-06-12 #38792
Closed
Replies: 1 comment
-
|
This discussion has been marked as outdated by Safe Output Health Monitor. A newer discussion is available at Discussion #39023. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Overview
The captured window for 2026-06-12 (a partial early-morning batch, run creation 04:39Z-05:27Z, 11 workflow runs) was a CLEAN day for safe outputs: 10 of 10 executed safe-output jobs succeeded with 0 hard failures, 0 actuation failures, 0 soft-skips, and 0 collection-time validation rejections. This recovers the streak broken on 2026-06-11 (which had 3 safe-output-job hard failures from the target/context-resolution family).
The most relevant signal: the prior day's headline failure family (
add_labels/update_issuehard-failing on missing trigger context) got a positive counter-data-point today. AI Moderator emittedadd_labelswithtarget:"*"on an issues event (triggering context present) and it succeeded, confirming the handler works correctly when a triggering issue exists. The no-context hard-fail path was not re-exercised (LintMonster and the smoke workflows did not run in this window), so the proposedlint-monster.mdfix remains unvalidated.Executive Summary
Safe-Output Job Statistics
Critical Issues
None. No production or smoke safe-output job hard-failed in the captured window.
Per-run safe-output job results (10 jobs, all success)
Result column is
Successful / Failed.Recurring Cluster Status
lint-monster.mdtarget:"*"fix unvalidated.review_path_unresolved_422(Path variant)pr_review_buffer.cjs:554unvalidated - 15th consecutive audit.assign_to_agent_*assign_to_agentmessages.cancellation_counter_mislabeled_code_push_failedcreate_discussioncategory driftresearch(#38786) +audits(#38790, #38791) all resolved; no Announcements fallback.Positive data point - add_labels target:* with context
AI Moderator run 27396124032 (an
issuesevent) emittedadd_labelswithtarget:"*", and the handler resolved the triggering issue and succeeded:["ai-inspected"]This is the same handler that hard-failed on 2026-06-11 (Smoke Copilot,
workflow_dispatch, no issue/PR context). The difference is the triggering context: with a real issue present,target:"*"resolves and succeeds. The 06-11 defect is specific to the missing-context branch, not the handler in general, reinforcing the standing recommendation to make that branch a soft-skip rather than a hard-fail.Out-of-Scope (agent-side, not safe-output failures)
{"items":[]}(no safe-output tool called, no safe-output job ran). Agent-side no-op/conformance gap; same workflow showed agent-side friction on 06-04 and 06-11. Not in scope for safe-output health.Recommendations
Carried forward from prior audits (no new clusters today):
update_issue,add_labels,remove_labels, andadd_commentsoft-skip with a clear message when no issue/PR target is resolvable, matchingcreate_pull_request_review_comment/reply_to_pull_request_review_comment. Today's AI Moderator success shows the with-context path is fine; the gap is only the no-context branch.issue_numberregardless of defaulttarget(High). When anupdate_issuemessage carries an explicitissue_number, the handler should use it even when the workflow defaults totarget:"triggering"(root cause of the 06-11 LintMonster production failure).target: "*"to the update-issue config in.github/workflows/lint-monster.mdand recompile; LintMonster did not run in today's window so this remains unverified.pr_review_buffer.cjs:554predicate should also match"Path could not be resolved"; add a mirrored unit test. The recovery path still has never fired in production since the 2026-05-27 regression.Next Steps
update_issuetarget:"*"fix landed and resolves the production failure.References:
Beta Was this translation helpful? Give feedback.
All reactions