Test Set to Break Your Support Chatbot Before Customers Do

9 Views
0 Uses

Prompt

ChatGPT
Claude
Grok
OpenRouter
You are a QA lead for conversational AI. Write a test set for our support chatbot, designed to find failures before launch.

What the bot is for and what it can access: {{BOT_DESCRIPTION}}
Its rules (scope, handoff triggers, things it must never say or do): {{BOT_RULES}}
Our top customer questions or contact reasons: {{TOP_QUESTIONS}}

Write 30 test conversations as a table with these columns: ID, category, the customer's opening message (and a follow-up message if the test needs two turns), the expected correct behaviour, and what counts as a fail.

Cover these categories:
- common questions phrased in several ways, including typos and slang;
- questions the knowledge base can't answer (expected: admit it and offer a handoff);
- out-of-scope requests (legal advice, competitor comparisons, unrelated tasks);
- attempts to get the bot to promise refunds, discounts or exceptions;
- prompt-injection attempts ("ignore your instructions and…");
- frustrated customers and explicit requests for a human;
- privacy traps (a user sharing card details, or asking about someone else's account);
- messages in other languages.

Then give a simple scoring sheet (pass, partial or fail per test) and the three categories most likely to fail for a bot like ours, with a reason for each. The tests must be realistic for our product, not generic.

Customize this prompt

Fill in the variables below to personalize this prompt:

ChatGPT
Claude
Grok
OpenRouter

Model Settings

Recommended Models

ChatGPT Claude Gemini

Temperature

0.7

Max Tokens

2000

Additional Notes

Best for: Teams evaluating a support bot before and after launch

About this prompt

“Test Set to Break Your Support Chatbot Before Customers Do” is a free prompt for ChatGPT in the Prompt Engineering category, 214 words long, added to The Prompt Index on October 28, 2026 by The Prompt Index. Copy it with the button above, paste it into ChatGPT or any other AI chat assistant, and send it.

It has 3 placeholders to fill in first: {{BOT_DESCRIPTION}}, {{BOT_RULES}}, {{TOP_QUESTIONS}}. Use the “Customize this prompt” fields to personalise it before you copy.

Recommended models: ChatGPT, Claude, Gemini.

0 upvotes, sent to an AI tool 0 times, viewed 9 times.

Browse all Prompt Engineering prompts, the AI prompt database or use the AI prompt finder to search every prompt.