Skip to content

test: Refactor Playwright suite with shared helpers and remove redundant tests#13278

Merged
Cristhianzl merged 9 commits into
release-1.10.0from
cz/playwright-tests-refactor
May 22, 2026
Merged

test: Refactor Playwright suite with shared helpers and remove redundant tests#13278
Cristhianzl merged 9 commits into
release-1.10.0from
cz/playwright-tests-refactor

Conversation

@Cristhianzl
Copy link
Copy Markdown
Member

Objective
Restructure the Playwright e2e suite to remove duplication and dead code, and make UI-text/test-id changes a single-edit operation.

Changes

  • Add tests/utils/{constants,env,flow,playground,auth}/ helper module (18 new files) covering bootstrap, component-add,
    publish, sessions, env loading and skip guards
  • Migrate 158 specs to the shared helpers and to centralized TID / TEXTS / TIMEOUTS constants (542 repeated UI strings
    extracted into constants/texts.ts)
  • Delete 23 dead files — 18 obsolete/duplicate/always-skip specs and 5 unused utils
  • Fix breakages against the new screen flow: awaitBootstrapTest welcome-panel race, addComponentFromSidebar slug + strict-mode scoping, adjustScreenView zoom-out timing
  • Stabilize publish-flow un-publish redirect with waitForURL instead of a reload retry

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 22, 2026

Important

Review skipped

Too many files!

This PR contains 199 files, which is 49 over the limit of 150.

To get a review, narrow the scope:
• coderabbit review --type committed # exclude uncommitted changes
• coderabbit review --dir # limit to a subdirectory
• coderabbit review --base # compare against a closer base

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 345263e6-55e2-4040-a163-db2ddd28faf8

📥 Commits

Reviewing files that changed from the base of the PR and between 5dd63ed and be2ae7e.

📒 Files selected for processing (199)
  • src/frontend/tests/core/features/actionsMainPage-shard-1.spec.ts
  • src/frontend/tests/core/features/auto-login-off.spec.ts
  • src/frontend/tests/core/features/bulk-delete-sessions.spec.ts
  • src/frontend/tests/core/features/chatInputOutputUser-shard-0.spec.ts
  • src/frontend/tests/core/features/componentHoverAdd.spec.ts
  • src/frontend/tests/core/features/composio.spec.ts
  • src/frontend/tests/core/features/customComponentAdd.spec.ts
  • src/frontend/tests/core/features/default-system-prompt.spec.ts
  • src/frontend/tests/core/features/deployment-create.spec.ts
  • src/frontend/tests/core/features/deployment-edit.spec.ts
  • src/frontend/tests/core/features/deployment-providers.spec.ts
  • src/frontend/tests/core/features/deployment-test-modal.spec.ts
  • src/frontend/tests/core/features/deployments-page.spec.ts
  • src/frontend/tests/core/features/flow-lock.spec.ts
  • src/frontend/tests/core/features/folder-deletion-integrity.spec.ts
  • src/frontend/tests/core/features/folders.spec.ts
  • src/frontend/tests/core/features/freeze-path.spec.ts
  • src/frontend/tests/core/features/freeze.spec.ts
  • src/frontend/tests/core/features/globalVariables.spec.ts
  • src/frontend/tests/core/features/group.spec.ts
  • src/frontend/tests/core/features/modelInputComponent.spec.ts
  • src/frontend/tests/core/features/modelProviderCount.spec.ts
  • src/frontend/tests/core/features/modelProviderModal.spec.ts
  • src/frontend/tests/core/features/playground.spec.ts
  • src/frontend/tests/core/features/publish-flow.spec.ts
  • src/frontend/tests/core/features/right-click-dropdown.spec.ts
  • src/frontend/tests/core/features/run-flow.spec.ts
  • src/frontend/tests/core/features/saveComponents.spec.ts
  • src/frontend/tests/core/features/shareable-playground-auth.spec.ts
  • src/frontend/tests/core/features/shareable-playground-persistence.spec.ts
  • src/frontend/tests/core/features/shareable-playground-token-display.spec.ts
  • src/frontend/tests/core/features/stop-building.spec.ts
  • src/frontend/tests/core/features/store-shard-2.spec.ts
  • src/frontend/tests/core/features/structured-response-agent.spec.ts
  • src/frontend/tests/core/features/token-usage.spec.ts
  • src/frontend/tests/core/features/toolModeGroup.spec.ts
  • src/frontend/tests/core/features/traces.spec.ts
  • src/frontend/tests/core/features/tweaksTest.spec.ts
  • src/frontend/tests/core/features/user-flow-state-cleanup.spec.ts
  • src/frontend/tests/core/features/user-progress-track.spec.ts
  • src/frontend/tests/core/features/voice-assistant.spec.ts
  • src/frontend/tests/core/integrations/Basic Prompting.spec.ts
  • src/frontend/tests/core/integrations/Blog Writer.spec.ts
  • src/frontend/tests/core/integrations/Custom Component Generator.spec.ts
  • src/frontend/tests/core/integrations/Document QA.spec.ts
  • src/frontend/tests/core/integrations/Dynamic Agent.spec.ts
  • src/frontend/tests/core/integrations/Financial Report Parser.spec.ts
  • src/frontend/tests/core/integrations/Hierarchical Agent.spec.ts
  • src/frontend/tests/core/integrations/Image Sentiment Analysis.spec.ts
  • src/frontend/tests/core/integrations/Instagram Copywriter.spec.ts
  • src/frontend/tests/core/integrations/Invoice Summarizer.spec.ts
  • src/frontend/tests/core/integrations/Market Research.spec.ts
  • src/frontend/tests/core/integrations/Memory Chatbot.spec.ts
  • src/frontend/tests/core/integrations/News Aggregator.spec.ts
  • src/frontend/tests/core/integrations/Pokedex Agent.spec.ts
  • src/frontend/tests/core/integrations/Portfolio Website Code Generator.spec.ts
  • src/frontend/tests/core/integrations/Price Deal Finder.spec.ts
  • src/frontend/tests/core/integrations/Prompt Chaining.spec.ts
  • src/frontend/tests/core/integrations/Research Translation Loop.spec.ts
  • src/frontend/tests/core/integrations/SEO Keyword Generator.spec.ts
  • src/frontend/tests/core/integrations/SaaS Pricing.spec.ts
  • src/frontend/tests/core/integrations/Sequential Task Agent.spec.ts
  • src/frontend/tests/core/integrations/Simple Agent Memory.spec.ts
  • src/frontend/tests/core/integrations/Simple Agent.spec.ts
  • src/frontend/tests/core/integrations/Social Media Agent.spec.ts
  • src/frontend/tests/core/integrations/Text Sentiment Analysis.spec.ts
  • src/frontend/tests/core/integrations/Travel Planning Agent.spec.ts
  • src/frontend/tests/core/integrations/Twitter Thread Generator.spec.ts
  • src/frontend/tests/core/integrations/Youtube Analysis.spec.ts
  • src/frontend/tests/core/integrations/assistant-panel-integration.spec.ts
  • src/frontend/tests/core/integrations/assistant-panel.spec.ts
  • src/frontend/tests/core/integrations/decisionFlow.spec.ts
  • src/frontend/tests/core/integrations/similarity.spec.ts
  • src/frontend/tests/core/integrations/textInputOutput.spec.ts
  • src/frontend/tests/core/regression/general-bugs-remove-session-after-logout.spec.ts
  • src/frontend/tests/core/regression/generalBugs-prompt.spec.ts
  • src/frontend/tests/core/regression/generalBugs-shard-4.spec.ts
  • src/frontend/tests/core/regression/generalBugs-shard-5.spec.ts
  • src/frontend/tests/core/regression/generalBugs-shard-9.spec.ts
  • src/frontend/tests/core/regression/ime-input-composition.spec.ts
  • src/frontend/tests/core/regression/session-deletion-data-leakage.spec.ts
  • src/frontend/tests/core/unit/agentDefaultToolsComponent.spec.ts
  • src/frontend/tests/core/unit/chatInputOutput.spec.ts
  • src/frontend/tests/core/unit/codeAreaModalComponent.spec.ts
  • src/frontend/tests/core/unit/dropdownComponent.spec.ts
  • src/frontend/tests/core/unit/fileUploadComponent.spec.ts
  • src/frontend/tests/core/unit/floatComponent.spec.ts
  • src/frontend/tests/core/unit/inputComponent.spec.ts
  • src/frontend/tests/core/unit/inputListComponent.spec.ts
  • src/frontend/tests/core/unit/intComponent.spec.ts
  • src/frontend/tests/core/unit/keyPairListComponent.spec.ts
  • src/frontend/tests/core/unit/linkComponent.spec.ts
  • src/frontend/tests/core/unit/nestedComponent.spec.ts
  • src/frontend/tests/core/unit/promptModalComponent.spec.ts
  • src/frontend/tests/core/unit/queryInputComponent.spec.ts
  • src/frontend/tests/core/unit/sliderComponent.spec.ts
  • src/frontend/tests/core/unit/tabComponent.spec.ts
  • src/frontend/tests/core/unit/tableInputComponent.spec.ts
  • src/frontend/tests/core/unit/textAreaModalComponent.spec.ts
  • src/frontend/tests/core/unit/toggleComponent.spec.ts
  • src/frontend/tests/core/unit/webhookComponent.spec.ts
  • src/frontend/tests/extended/features/actionsMainPage-shard-0.spec.ts
  • src/frontend/tests/extended/features/auto-save-off.spec.ts
  • src/frontend/tests/extended/features/bulk-actions.spec.ts
  • src/frontend/tests/extended/features/copy-button-in-output.spec.ts
  • src/frontend/tests/extended/features/curlApiGeneration.spec.ts
  • src/frontend/tests/extended/features/deleteComponents.spec.ts
  • src/frontend/tests/extended/features/deleteFlows.spec.ts
  • src/frontend/tests/extended/features/dragAndDrop.spec.ts
  • src/frontend/tests/extended/features/edit-flow-name.spec.ts
  • src/frontend/tests/extended/features/edit-name-description-node.spec.ts
  • src/frontend/tests/extended/features/edit-tools.spec.ts
  • src/frontend/tests/extended/features/files-page.spec.ts
  • src/frontend/tests/extended/features/flowPage.spec.ts
  • src/frontend/tests/extended/features/flowSettings.spec.ts
  • src/frontend/tests/extended/features/integration-side-bar.spec.ts
  • src/frontend/tests/extended/features/langflowShortcuts.spec.ts
  • src/frontend/tests/extended/features/limit-file-size-upload.spec.ts
  • src/frontend/tests/extended/features/lock-flow.spec.ts
  • src/frontend/tests/extended/features/loop-component.spec.ts
  • src/frontend/tests/extended/features/mcp-server-starter-projects.spec.ts
  • src/frontend/tests/extended/features/mcp-server-tab.spec.ts
  • src/frontend/tests/extended/features/mcp-server.spec.ts
  • src/frontend/tests/extended/features/minimize.spec.ts
  • src/frontend/tests/extended/features/notifications.spec.ts
  • src/frontend/tests/extended/features/outdated-actions.spec.ts
  • src/frontend/tests/extended/features/output-modal-copy-button.spec.ts
  • src/frontend/tests/extended/features/pythonApiGeneration.spec.ts
  • src/frontend/tests/extended/features/refresh-dropdown-list.spec.ts
  • src/frontend/tests/extended/features/sticky-notes-dimensions.spec.ts
  • src/frontend/tests/extended/features/sticky-notes.spec.ts
  • src/frontend/tests/extended/features/stop-button-playground.spec.ts
  • src/frontend/tests/extended/features/store-shard-0.spec.ts
  • src/frontend/tests/extended/features/store-shard-1.spec.ts
  • src/frontend/tests/extended/features/store-shard-3.spec.ts
  • src/frontend/tests/extended/features/tool-mode.spec.ts
  • src/frontend/tests/extended/features/twoEdges.spec.ts
  • src/frontend/tests/extended/features/userSettings.spec.ts
  • src/frontend/tests/extended/features/validate-raise-errors-components.spec.ts
  • src/frontend/tests/extended/integrations/chatInputOutputUser-shard-1.spec.ts
  • src/frontend/tests/extended/integrations/chatInputOutputUser-shard-2.spec.ts
  • src/frontend/tests/extended/integrations/duckduckgo.spec.ts
  • src/frontend/tests/extended/integrations/youtube-transcripts.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-agent-anthropic-integration.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-agent-images-playground.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-agent-sum-duplicate-message-playground.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-component-as-tool-shortcut.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-component-webhook-api-key-display.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-delete-handle-advanced-input.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-frontend-crashing-on-invalid-replace.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-hidden-input-edges.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-minimize-state-error.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-move-flow-from-folder.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-reset-flow-run.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-save-changes-on-node.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-shard-3836.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-shard-3909.spec.ts
  • src/frontend/tests/extended/regression/general-bugs-truncate-results.spec.ts
  • src/frontend/tests/extended/regression/generalBugs-shard-1.spec.ts
  • src/frontend/tests/extended/regression/generalBugs-shard-10.spec.ts
  • src/frontend/tests/extended/regression/generalBugs-shard-11.spec.ts
  • src/frontend/tests/extended/regression/generalBugs-shard-13.spec.ts
  • src/frontend/tests/extended/regression/generalBugs-shard-3.spec.ts
  • src/frontend/tests/extended/regression/generalBugs-shard-6.spec.ts
  • src/frontend/tests/extended/regression/generalBugs-shard-7.spec.ts
  • src/frontend/tests/fixtures.ts
  • src/frontend/tests/templates/unit-test-components.spec.ts
  • src/frontend/tests/utils/add-flow-to-test-on-empty-langflow.ts
  • src/frontend/tests/utils/add-new-api-keys.ts
  • src/frontend/tests/utils/add-new-user-and-loggin.ts
  • src/frontend/tests/utils/adjust-screen-view.ts
  • src/frontend/tests/utils/auth-helpers.ts
  • src/frontend/tests/utils/auth/mock-auto-login-disabled.ts
  • src/frontend/tests/utils/auth/mock-config.ts
  • src/frontend/tests/utils/await-bootstrap-test.ts
  • src/frontend/tests/utils/build-data-transfer.ts
  • src/frontend/tests/utils/clean-old-folders.ts
  • src/frontend/tests/utils/constants/selectors.ts
  • src/frontend/tests/utils/constants/testIds.ts
  • src/frontend/tests/utils/constants/texts.ts
  • src/frontend/tests/utils/constants/timeouts.ts
  • src/frontend/tests/utils/env/load-dotenv.ts
  • src/frontend/tests/utils/env/skip-if-missing.ts
  • src/frontend/tests/utils/evaluate-input-react-state-changes.ts
  • src/frontend/tests/utils/flow/add-component-from-sidebar.ts
  • src/frontend/tests/utils/flow/build-flow-and-wait.ts
  • src/frontend/tests/utils/flow/go-back-to-projects.ts
  • src/frontend/tests/utils/flow/open-blank-flow.ts
  • src/frontend/tests/utils/flow/open-starter-project.ts
  • src/frontend/tests/utils/flow/replace-component-code.ts
  • src/frontend/tests/utils/login-langflow.ts
  • src/frontend/tests/utils/playground/publish-and-open-shareable.ts
  • src/frontend/tests/utils/playground/send-playground-message.ts
  • src/frontend/tests/utils/playground/sessions.ts
  • src/frontend/tests/utils/run-chat-output.ts
  • src/frontend/tests/utils/select-anthropic-model.ts
  • src/frontend/tests/utils/select-assistant-openai-model.ts
  • src/frontend/tests/utils/select-gpt-model.ts
  • src/frontend/tests/utils/types.ts

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch cz/playwright-tests-refactor

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions github-actions Bot added the test Changes to tests label May 22, 2026
@github-actions github-actions Bot added test Changes to tests and removed test Changes to tests labels May 22, 2026
@github-actions
Copy link
Copy Markdown
Contributor

✅ Test Coverage Advisor

No source changes detected without accompanying tests. Thanks for keeping coverage up! 🎉

Advisory check only — never blocks merge.

@codecov
Copy link
Copy Markdown

codecov Bot commented May 22, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 55.43%. Comparing base (02e1b40) to head (be2ae7e).
⚠️ Report is 7 commits behind head on release-1.10.0.

❌ Your project check has failed because the head coverage (51.72%) is below the target coverage (60.00%). You can increase the head coverage or adjust the target coverage.

Additional details and impacted files

Impacted file tree graph

@@                Coverage Diff                 @@
##           release-1.10.0   #13278      +/-   ##
==================================================
- Coverage           55.72%   55.43%   -0.29%     
==================================================
  Files                2178     2178              
  Lines              205613   205599      -14     
  Branches            31091    31042      -49     
==================================================
- Hits               114575   113980     -595     
- Misses              89717    90301     +584     
+ Partials             1321     1318       -3     
Flag Coverage Δ
backend 60.28% <ø> (-0.02%) ⬇️
frontend 55.22% <ø> (-0.44%) ⬇️
lfx 51.72% <ø> (+0.07%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 157 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@github-actions
Copy link
Copy Markdown
Contributor

Frontend Unit Test Coverage Report

Coverage Summary

Lines Statements Branches Functions
Coverage: 39%
39.72% (50428/126937) 68.38% (6867/10041) 39.1% (1139/2913)

Unit Test Results

Tests Skipped Failures Errors Time
4404 0 💤 0 ❌ 0 🔥 11m 16s ⏱️

@github-actions github-actions Bot added the lgtm This PR has been approved by a maintainer label May 22, 2026
@Cristhianzl Cristhianzl added this pull request to the merge queue May 22, 2026
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks May 22, 2026
@Cristhianzl Cristhianzl merged commit 63ee455 into release-1.10.0 May 22, 2026
181 of 183 checks passed
@Cristhianzl Cristhianzl deleted the cz/playwright-tests-refactor branch May 22, 2026 17:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lgtm This PR has been approved by a maintainer test Changes to tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants