QA Session Recordings
PR #9430 aims to
feat: add automated QA pipeline with E2E test-driven bug reproduction## Summary Automated QA pipeline that reproduces reported bugs using Playwright E2E tests. Claude writes tests, runs them, records video evidence. Deploys results to Cloudflare Pages with badges. ## Changes
Test focus: Verify that the core UI and menu system function correctly and were not impacted by the CI/CD script additions.
Prerequisites: Load default workflow
Steps: Open the main menu to check file options → Hover over the File menu item → Take a screenshot of the menu state to ensure no regressions → Close the menu
Prerequisites: Load default workflow
Steps: Open the main menu to check file options → Hover over the File menu item → Take a screenshot of the menu state to ensure no regressions → Close the menu
🐧LinuxReport
AI Comparative Review
# linux QA Video Report
- Generated at: 2026-04-17T07:52:15.797Z
- Model: `gemini-3-flash-preview`
- Target: https://github.com/Comfy-Org/ComfyUI_frontend/pull/9430
- Before video: `./qa-artifacts/qa-report-Linux-24553907603/qa-before-session.mp4` (2.6 MB)
- After video: `./qa-artifacts/qa-report-Linux-24553907603/qa-session.mp4` (2.6 MB)
- Mode: **Comparative (before/after)**
## AI Review
## Summary
The PR introduces a comprehensive automated QA pipeline for ComfyUI. The comparison videos demonstrate that the core application functionality (login, template browsing, menu navigation) remains intact and stable. The **AFTER** video specifically confirms the activation of the new QA infrastructure, as evidenced by the presence of automated "QA:" annotations which are absent in the **BEFORE** video.
## Behavior Changes
| Behavior | Before (main) | After (PR) | Verdict |
|----------|---------------|------------|---------|
| **Login Flow** | User "qa-ci" logs in normally. | User "qa-ci" logs in normally. | `No Change` |
| **Template Browser** | Modal opens showing "Getting Started" templates with images. | Modal opens showing identical templates and images. | `No Change` |
| **Main Menu** | Hamburger menu opens "File" submenu on hover. | Hamburger menu opens "File" submenu on hover. | `No Change` |
| **QA Annotations** | No automated step labels visible. | Automated step label "QA: Escape" appears at the bottom. | `Fixed` (Feature added) |
## Timeline Comparison
| Time | Type | Severity | Before (main) | After (PR) |
|------|------|----------|---------------|------------|
| 0:13-0:14 | Visual | None | No overlay at the bottom of the screen. | A small dashed label "QA: Escape" appears at the bottom center, indicating the automated test script is active. |
## Confirmed Issues
No application regressions or bugs were observed in either video.
---
## Possible Issues (Needs Human Verification)
None. The UI behavior is identical between both versions, except for the intended addition of QA automation overlays.
## Overall Risk
**Low**. The PR primarily adds external scripts and CI workflows. The minimal changes to the source code (lazy loading and store updates) do not negatively impact the primary user flows shown in the videos. The presence of the QA annotation in the AFTER video confirms the new automation pipeline is functional.
## Verdict
{"verdict": "REPRODUCED", "risk": "low", "confidence": "high"}