Compare Two Prompt Versions on the Same Test Set

3 Views
0 Uses

Prompt

ChatGPT
Claude
Grok
OpenRouter
You are an evaluator comparing prompt version A with version B.

Prompt A: {{PROMPT_A}}
Prompt B: {{PROMPT_B}}
Replies to the same tests (test ID, user message, reply A, reply B): {{RESULTS}}

Do this:
1. Summarise in 3 bullets what changed between A and B.
2. For each test, first decide what the prompts require. Then say which reply follows the rules better (A, B or tie), with one line of evidence.
3. Table of wins, ties and losses. List regressions, meaning tests where B is worse than A, with their IDs.
4. Verdict: ship B, don't ship B, or run more tests. If more, say which kinds.

Rules: do not favour the longer reply or the one listed first. Report counts, not averages. If there are fewer than 20 tests, call the result anecdotal. Do not judge on style the prompts do not ask for.

Customize this prompt

Fill in the variables below to personalize this prompt:

ChatGPT
Claude
Grok
OpenRouter

Report this prompt

Model Settings

Recommended Models

ChatGPT Claude Gemini

Temperature

0.7

Max Tokens

2000

Additional Notes

Best for: Deciding whether a prompt edit really helped

About this prompt

“Compare Two Prompt Versions on the Same Test Set” is a free prompt for ChatGPT in the Prompt Engineering category, 145 words long, added to The Prompt Index on November 18, 2026 by The Prompt Index. Copy it with the button above, paste it into ChatGPT or any other AI chat assistant, and send it.

It has 3 placeholders to fill in first: {{PROMPT_A}}, {{PROMPT_B}}, {{RESULTS}}. Use the “Customize this prompt” fields to personalise it before you copy.

Recommended models: ChatGPT, Claude, Gemini.

0 upvotes, sent to an AI tool 0 times, viewed 3 times.

Browse all Prompt Engineering prompts, the AI prompt database or use the AI prompt finder to search every prompt.