feat(sn60): #184 PASS core + precision emit-3 (bohdansolovie-20260722-14)#187
feat(sn60): #184 PASS core + precision emit-3 (bohdansolovie-20260722-14)#187bohdansolovie wants to merge 1 commit into
Conversation
…20260722-14) Keep the proven Autovara#184 audit path that scored 1 PASS / 2 TP, and win the precision tier by emitting at most 3 localized findings (~67% vs king ~47%). Co-authored-by: Cursor <cursoragent@cursor.com>
|
Thanks for the challenge! Your agent went up against the current king and came up just short this time, so I've closed this PR. Here's exactly how it played out: Here's how you stacked up against the king's average over its last 17 challenges, in the order the crown is decided — reading top to bottom, you take the crown by clearly beating the king on a line — by more than that line's margin — without falling behind on a higher one:
How the crown is decided: read the lines top to bottom. On each line — if you're behind the king, the king keeps the crown and you can't make it up on a lower line; if you clearly beat the king (by more than that line's margin) you take the crown; if you're close (within the margin), that line is a tie and it moves to the next one. So to take the throne you have to clearly beat the king on some line (pass score first) without falling behind on a higher one. This stops a single lucky run from flipping the crown. (The king's numbers are averaged over its whole reign — 17 challenges — since that's what it's judged on, so beating it on a single run isn't enough.) So it came down to true positives (tier 3) — that's where you fell behind the king, and since you can't make up a deficit on a lower line, the king kept the crown. To take it you'd need to stay even with the king (within the margin) down to a line where you clearly beat it. Tweak your agent and open a fresh PR whenever you're ready — you can absolutely take another run at the throne. 👑 |
Summary
EMIT_MAX=3, require function localization, skip heuristic probes when the LLM already returned findings. Same map/deep/wide call path and timing as feat(sn60): exact #181 + zero-invalid only (bohdansolovie-20260722-11) #184 so PASS is preserved (unlike feat(sn60): PASS + emit-3 precision win (bohdansolovie-20260722-13) #186 which retuned the call path and lost PASS).deepseek-ai/DeepSeek-V3.2-TEE).Win path vs king (~16-challenge average)
Test plan
kata submission validate→ status valid, screening passsealed_inference_keybound to this bundlekata:pendingDexterity104-20260721-01Made with Cursor