Testing AI agents, honestly.
Behavioral contracts, real live runs, and the bugs they caught — including one in our own code. Every terminal block in these posts is real output.
How to Test AI Agents: Behavioral Contracts, Not String Matching
Your agent passed every test in CI. Then it told a customer "Your table is booked!" — and never called the booking tool.
Testing a CrewAI Crew — and the Bug It Caught in Our Own Tool
We built a tool for testing AI agents. Then we pointed it at a real CrewAI crew — and it immediately surfaced a bug in our own adapter. This is the best kind of dogfooding: the tool doing its job caught something we'd never have noticed until it broke in a user's report.
Catching AI Agent Regressions Before Your Users Do
The scariest agent bugs don't come from code you wrote. They come from a model you upgraded, a prompt someone tweaked, or a library that changed underneath you — and the agent's behavior quietly shifted while every string-match test stayed green.
How to Test a LangGraph Agent So It Actually Uses Its Tools
You built a LangGraph agent with create_react_agent, gave it a web-search tool, and told it to ground factual answers in search. How do you prove it does that — on every run, and after every model swap?
Testing the OpenAI Agents SDK: Verify Before You Act
Some agent bugs are cosmetic. This one moves money.