Friday / Resources / AI agents
AI Agent Test Plan.
A free PDF template.
Fill this in before an AI agent touches real work. Define success first, test with real cases, and launch in stages.
On this page:
What is inside
2 pages, 6 sections, fill-in template. Open a section to read it.
01ScopeFill in
02Limits and approvals5 checks
- Permissions: only the systems and actions the job needs, with the narrowest access available.
- Approvals: anything involving money, commitments to customers or deleted data waits for a person.
- Escalation: when the agent is unsure, it stops and asks instead of guessing.
- Logging: every run records inputs, tool calls and outputs, so a failure can be explained.
- Stop condition: a cap on steps per run.
03Test set built from real workFill in
A table to fill in: Case type, Example from your work, Expected result, Pass?.
04How each result is graded4 checks
- Code checks: for anything with a fixed right answer (format, fields, totals).
- Model graders: for judgment calls, against a written rubric, spot-checked by a person.
- Human review: for the cases that matter most and for calibrating the other two.
- Consistency: run each case several times; one good run is not proof.
05Compare with how the work is done todayFill in
A table to fill in: Measure, Today, With the agent.
06Launch gateSign off
- Retest after any change to the model, instructions or tools; keep a regression set.
- Sign-off: name and date of the person who approved each stage.
A table to fill in: Stage, Approved by, Date.
The first page
The PDF as you get it, letter size, ready to print or fill in on screen.
Questions about this resource
What you get, what it costs and what happens to your email.
Is it free?
Yes. Leave your email and the download starts. You also get the Friday newsletter, and you can unsubscribe in one click.
What do I get?
A 2-page PDF template, letter size: 6 sections, fill-in template. Print it or work through it on screen.
Can Friday do this with us?
Yes. AI agent services covers this work at a fixed scope and price, and the first call is free.