Operations · Intermediate · about 16 minutes
Prompt version control and A/B testing
Someone improved the customer-reply prompt to make responses friendlier. Two weeks later the drafts are missing a policy caveat they used to include, and nobody can find the previous version. The friendliness change had removed a constraint that was doing real work, and there is no way back.
- You need
- Prompt's job: draft customer email replies, seen by customers. Current version: includes a constraint 'always state the return window that applies to this category, from the knowledge base'.
- Tool
- Your prompt library's version and notes fields
- You get
- 1. THIS IS ONE CHANGE — good.
- Time saved
- A structured A/B test takes about two hours and prevents changes that quietly degrade customer-facing output for weeks.
The steps come with the AI Playbook
See plans