Skip to content

feat(evals): add missing docker-via-wsl eval #41

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
CybotTM merged 2 commits into from
Jul 12, 2026
Merged

feat(evals): add missing docker-via-wsl eval #41

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
ac1adf3
feat(evals): add docker-via-wsl eval to evals.json
CybotTM Jul 12, 2026
d483b17
test: tighten docker-via-wsl regex to require -e flag
CybotTM Jul 12, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions evals/evals.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -502,5 +502,26 @@
"description": "Advises verifying the negative case too (process down -> unhealthy)"
}
]
},
{
"name": "docker-via-wsl-reissue-not-windows-shell",
"prompt": "My Bash tool's `uname -s` shows MINGW64_NT -- I'm on Windows outside WSL. The user's `docker compose up` from this Git Bash shell, run from a Z:\\ mapped network drive, fails with 'could not read from input file: Is a directory' for a bind-mounted config file. What do I do?",
"assertions": [
{
"type": "content_regex",
"value": "wsl\\.exe",
"description": "Re-issues the Docker command through wsl.exe instead of continuing to drive Docker from the Windows/Git-Bash shell"
},
{
"type": "content_regex",
"value": "-e bash -lc",
"description": "Uses the specific 'wsl.exe -e bash -lc' re-issue form, not a bare 'wsl' invocation"
},
{
"type": "content_regex",
"value": "SMB|network (share|drive)|Z:|UNC|WSL2",
"description": "Identifies the SMB/network-drive path translation inside Docker Desktop's WSL2 backend as the root cause, not a Docker cache or single-file-bind-mount bug"
}
]
}
]
Loading