Passmark: AI Regression Testing for Playwright

Passmark is a source-available AI regression testing framework built on top of Playwright. It lets developers write browser tests in plain English, cache successful actions in Redis, and replay tests at native Playwright speed.

It is often compared with Playwright, Cypress, Stagehand, Bug0, and AI browser automation tools by teams that want natural-language test authoring, auto-healing, Redis-based caching, and CI-friendly regression testing.

What is Passmark?

Passmark is not a full replacement for Playwright. It is a Playwright-based testing layer that adds AI-powered browser actions, natural-language test steps, Redis caching, and auto-healing behavior.

Instead of writing every browser interaction manually, teams can describe user flows in plain English. Passmark uses AI to execute the flow on the first run, stores the successful actions, and replays them later through Playwright.

Passmark is especially useful for:

• QA automation teams
• frontend teams using Playwright
• teams with fast-changing UIs
• teams replacing brittle end-to-end tests
• AI-assisted testing workflows
• regression testing in CI
• products with login, OTP, and email verification flows

Key features

AI-powered browser testing

• Write tests in plain English
• Use runSteps() and runUserFlow() for natural-language flows
• AI executes browser actions through Playwright
• Auto-healing when cached selectors or steps fail
• Useful for dynamic UIs and fast-moving products

Redis-based caching

• Cache successful browser actions in Redis
• Replay cached steps at native Playwright speed
• Re-engage AI only when cached steps fail
• Share state across tests
• Reduce repeated AI calls after the first successful run

Assertions and verification

• AI-assisted assertions
• Multi-model verification
• Support for Claude and Gemini-style model workflows
• Arbiter model for resolving disagreements
• Built-in email and OTP testing
• Useful for authentication and onboarding flows

CI and developer workflow

• Runs inside standard @playwright/test files
• Works with existing playwright.config.ts
• Compatible with Playwright CI setups
• Supports AI gateways such as Vercel, OpenRouter, and Cloudflare
• Configurable model slots for execution and assertions
• Built for TypeScript and Node.js projects

Passmark vs Playwright

Feature	Passmark	Playwright
Main use case	AI-assisted regression testing on top of Playwright	Browser automation and end-to-end testing framework
Relationship	Built on Playwright	Base testing framework
License	FSL-1.1-ALv2	Apache-2.0
Test authoring	Plain English steps plus Playwright tests	Code-first tests
AI automation	Built-in AI execution and auto-healing	Not built in by default
Caching	Redis-based action caching	Not built in by default
Speed	AI on first run, cached replay afterward	Native browser automation speed
CI support	Runs inside Playwright test files	Native CI support
Best for	Teams wanting AI-assisted Playwright regression testing	Teams wanting full code-first browser automation
Cost model	Source-available software; Redis, model, and infrastructure costs may apply	Free open-source framework

Choose Passmark if you already use Playwright and want AI-assisted test creation, auto-healing, Redis caching, and natural-language regression flows.

Choose Playwright directly if you want full code-first control without adding an AI testing layer.

Passmark vs Cypress

Cypress and Passmark solve different testing problems.

Cypress is a mature end-to-end testing framework with its own test runner, developer experience, and browser testing workflow. Passmark is a Playwright-based AI testing layer focused on natural-language flows, caching, and auto-healing.

Feature	Passmark	Cypress
Main use case	AI-assisted Playwright regression testing	End-to-end frontend testing framework
Test runner	Uses Playwright test	Cypress test runner
Test style	Plain English plus Playwright code	JavaScript/TypeScript test code
AI features	Built-in AI execution and auto-healing	Not the core product focus
Best for	Teams wanting AI-powered regression tests	Teams wanting mature frontend E2E testing

Choose Cypress if you want a mature standalone E2E testing framework.

Choose Passmark if your team prefers Playwright and wants AI-assisted testing on top of it.

Passmark vs Stagehand

Stagehand is one of the closest alternatives to Passmark because both focus on AI-powered browser automation.

Stagehand is more focused on letting developers control browsers with AI-friendly primitives. Passmark is more focused on regression testing, Redis caching, Playwright test integration, and replaying stable flows in CI.

Feature	Passmark	Stagehand
Main use case	AI regression testing for Playwright	AI browser automation framework
Framework base	Playwright	Playwright-oriented browser automation
Caching	Redis-based cached action replay	Different automation model
Testing focus	Regression tests and CI workflows	Browser automation and agent workflows
Best for	QA and frontend regression testing	AI agents and browser automation tasks

Passmark vs Bug0

Bug0 is the broader managed QA platform from the same team, while Passmark is the open-source/source-available testing framework.

Choose Passmark if you want to run AI regression testing directly in your own Playwright setup.

Choose Bug0 if you want a more managed QA platform with less setup and more hosted product features.

At a glance

Attribute	Details
License	FSL-1.1-ALv2
Category	Developer Tools / Testing
Main users	Frontend teams, QA teams, Playwright users
Focus	AI regression testing, natural-language tests, auto-healing
Built on	Playwright
Requires	Node.js, Playwright, Redis
Deployment	Runs in your project and CI
Self-hosted	Library-based; runs in your own infrastructure
Stack	TypeScript, Playwright, Redis
Alternatives	Playwright, Cypress, Stagehand, Bug0

Getting started

Install Passmark in a Playwright project:

npm install passmark @playwright/test

## FAQ

### Is Passmark a free alternative to Playwright?
Passmark is source-available under the FSL-1.1-ALv2 license, not a fully permissive open-source license. You can self-host it, though Redis, model, and infrastructure costs may apply — see the At a glance table for details.

### How does Passmark compare to Playwright?
Passmark is built directly on top of [Playwright](/alternatives-to/playwright) and adds AI-powered test authoring, Redis caching, and auto-healing rather than replacing it. See the comparison table above for a full breakdown.

### Can I add Passmark to an existing Playwright test suite?
Yes. Passmark runs inside standard `@playwright/test` files and works with your existing `playwright.config.ts`, so it can be layered onto an existing Playwright setup without a rewrite.

### Is Passmark suitable for CI regression testing?
Yes. Passmark is built for CI-friendly regression testing: it replays cached Playwright steps at native speed and only re-engages AI when a cached step fails, which keeps CI runs fast and predictable. It's used as a [Developer Tools](/categories/developer-tools) option for teams with fast-changing UIs.

### What are alternatives to Passmark and Playwright?
Browse [alternatives to Playwright](/alternatives-to/playwright) for more options, including AI-assisted tools compared to [Stagehand](/alternatives-to/stagehand) and [Cypress](/alternatives-to/cypress). Explore the full [Developer Tools](/categories/developer-tools) category for related projects.