feat: QA Bot — automated visual QA & video evidence system

[snomiao]

Summary

Adds a centralized QA Bot sub-agent to ComfyPR-Bot that automatically reproduces bugs, verifies PRs, and records HD video evidence — then posts results back to GitHub issues/PRs and Slack.

Unlike the prototype in ComfyUI_frontend PR #9430 (single-repo CI), this lives in Comfy-PR as a centralized service targeting any frontend repo.

What's Included

Implementation (bot/qa/ — 14 files)

Module	Purpose
types.ts, config.ts	Shared types, default config (resolution, timeouts, agent model)
orchestrator.ts	Full pipeline: clone → detect → boot → agent → report
bootstrap/ (5 files)	Auto-detect & start ComfyUI-frontend, Vite, Next.js apps
browser/ (2 files)	Playwright launch, cursor overlay injection, video recording, screenshots
qa-agent.ts	AI-driven browser automation loop (Claude via AI SDK)
report/ (2 files)	Markdown report generation, GitHub comment posting, label management
cli.ts	CLI handlers wired into bot/cli.ts

CLI Commands

prbot qa reproduce -i Comfy-Org/ComfyUI_frontend#10688
prbot qa verify    -p Comfy-Org/ComfyUI_frontend#9500
prbot qa smoke     -r Comfy-Org/ComfyUI_frontend
prbot qa demo      -r Comfy-Org/ComfyUI_frontend --prompt 'Demo the template browser'
prbot qa run       -r Comfy-Org/ComfyUI_frontend --prompt 'Check drag-and-drop on canvas'

Design Docs (docs/qabot/ — 9 files)

README, Architecture, Triggers, Video Recording, Browser Automation, Multi-Repo Support, Reporting, CLI Spec, Roadmap

Roadmap (in TODO.md)

• Phase 0 ✅ Foundation (this PR)
• Phase 1 Video delivery (ffmpeg post-processing, GCS upload, Slack posting)
• Phase 2 PR before/after verification
• Phase 3 Multi-repo triggers (GitHub webhooks, Slack mentions, /qa comments)
• Phase 4–7 Smoke scheduling, high-quality video production, Electron support, advanced features

Dependencies

• Adds playwright (browser automation + video recording)
• Uses existing ai, @ai-sdk/anthropic (already in deps)
• Leverages existing lib/slack/, lib/video/, src/cli/ infra

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
comfy-pr	Ready	Preview, Comment	Apr 4, 2026 4:06am

[socket-security]

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff	Package	Supply Chain Security	Vulnerability	Quality	Maintenance	License
	@​pulumi/​pulumi@​3.229.0
	cross-env@​10.1.0
	oxfmt@​0.26.0
	@​pulumi/​gcp@​9.18.0
	playwright@​1.59.1

View full report