Faultmap vs Patronus

Patronus scores the agent you built. Faultmap hands you the first test suite to build against, before you write it.

Side by side

Faultmapbefore the build

Patronusafter the build

When it runs

Before the build, in the design phase

After the build, on outputs

What it needs

Your goal, personas, data, and tools

A built agent and test inputs

What it produces

A map of where it breaks, plus the first test suite

Pass and fail scoring across test sets

The question it answers

Where will this agent break, before I build it?

Does my built agent pass these tests?

We do not replace Patronus. Faultmap runs one step earlier. Keep using Patronus after the build.

See where YOUR agent breaks

Faultmap maps the likely breaks from your goal and data before you build. First cohort: agents that use SQL as the data source. First 20 tests free. Full validation dataset $10 one time, per agent.

Reserve your beta spot

What Patronus is

Patronus in one sentence. Where Faultmap fits with it.

Runs automated tests and scoring against an agent you have built.

Automated evals

Where Faultmap fits before it

Run Faultmap in design to catch the breaks before you build.
Build the agent against the test suite Faultmap hands you.
Use Patronus after launch for automated evals.

Map the breaks before Patronus sees them.

Preview 20 agent-specific validation tests free. No card, no code.

Preview 20 tests