Skip to content

test(e2e): consumer-copy regression suite + chat-honesty in CI#180

Merged
operatoruplift merged 1 commit intomasterfrom
copy-regression-tests
Apr 27, 2026
Merged

test(e2e): consumer-copy regression suite + chat-honesty in CI#180
operatoruplift merged 1 commit intomasterfrom
copy-regression-tests

Conversation

@operatoruplift
Copy link
Copy Markdown
Owner

Locks in the plain-English voice in CI

The 30-PR sweep across this stretch (#147-#179) rewrote every consumer-facing surface for plain English and eliminated 11 fabricated feature claims. This PR adds the regression net so future drift triggers a CI failure.

tests/e2e/consumer-copy.spec.ts (new — 6 specs)

Each test asserts BOTH the new phrasing is present AND the retired phrasing is absent.

Surface New phrasing required Banned phrases checked
Homepage hero "stay in charge", "Try it free" full banned list
Navbar HOW IT WORKS / HELPERS / WATCH DEMO full banned list
/paywall "Drafts your replies" + h1 "Pick a plan" LLM Council, etc.
/store h1 "Helpers" + "Free in beta" + "Install" button The Agent Store, etc.
/pricing "Pricing for teams" + "Personal plans start free" dev jargon
OG metadata meta <title> and <description> "Multi-agent orchestration" / "AI Operating System"

Banned-phrase list covers three categories:

CI workflow

Both consumer-copy.spec.ts and chat-honesty.spec.ts (already present, was just on-demand) are now in the hermetic Playwright spec list that runs on every PR. Either one failing fails the PR check.

Verified

pnpm exec tsc --noEmit
# exit 0

pnpm check
# 3 passed, 0 failed

pnpm exec playwright test tests/e2e/consumer-copy.spec.ts --reporter=list
# 6 passed (30.3s)
#  ✓  homepage hero shows the consumer pitch
#  ✓  navbar uses plain-English labels
#  ✓  /paywall sells real features, not the removed council
#  ✓  /store leads with Helpers and free-in-beta pricing
#  ✓  /pricing disambiguates personal vs team plans
#  ✓  OG metadata leads with the daily job

Net diff

2 files changed, 117 insertions(+)

Rollback

Single git revert.

Locks in the plain-English voice and removed-feature-claim guarantees
shipped across PRs #147-#168. If a future PR drifts back toward dev or
sci-fi vocabulary, CI fails before merge.

## tests/e2e/consumer-copy.spec.ts (new)

Six scoped specs, each asserts BOTH the new consumer phrasing IS
present AND the retired developer/jargon phrasing is absent.

| Test | Surface | Asserts |
|---|---|---|
| homepage hero | / | "stay in charge" + "Try it free" present |
| navbar labels | / | "HOW IT WORKS / HELPERS / WATCH DEMO" present |
| /paywall | /paywall | "Drafts your replies" + "Pick a plan" present |
| /store | /store | h1 "Helpers", "Free in beta", "Install" button |
| /pricing | /pricing | "Pricing for teams" + "Personal plans start free" |
| OG metadata | / | meta description leads with daily job |

Each test also runs `assertNoBannedPhrases()` against the rendered DOM
text. The banned list covers:
- Sci-fi cosplay: Commander, Uplift Core, Warp Network, Blackwall,
  CodePilot Pro, Founder Ops, Gold Agent, DeepRepo Orchestration
- Dev jargon: Multi-agent orchestration, AI Operating System,
  On-chain Merkle audit trail, agent orchestration, Self-Hosted
- Council fabrication: LLM Council, 5 agents debate, Chairman,
  Contrarian, First Principles thinker, Expansionist, Outsider

Plus the existing chat-honesty.spec.ts (which already covered
/chat + /paywall + /swarm against the council list) is now
unconditionally part of the CI hermetic spec set.

## .github/workflows/ci.yml

Both consumer-copy.spec.ts and chat-honesty.spec.ts are added to the
hermetic Playwright run. Both can fail the PR check.

## Verified

- pnpm exec tsc --noEmit: clean
- pnpm check: 3 passed, 0 failed
- pnpm exec playwright test consumer-copy.spec.ts: 6 passed (30.3s)

## Rollback

Single git revert. 2 files.
@vercel
Copy link
Copy Markdown

vercel Bot commented Apr 27, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
website Ready Ready Preview, Comment Apr 27, 2026 3:58pm

@operatoruplift operatoruplift merged commit 67bdc7d into master Apr 27, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant