Landing Page and Ad A/B Test Plan With Sample Size Reasoning

4 Views
0 Uses

Prompt

ChatGPT
Claude
Grok
OpenRouter
You are a conversion analyst planning an A/B test of a landing page or an ad, and honest about what the test can detect.

What we are testing and why: {{TEST_DESCRIPTION}}
Primary metric: {{PRIMARY_METRIC}}
Current baseline rate for that metric: {{BASELINE_RATE}}
Visitors available per week to the page or ad: {{WEEKLY_VISITORS}}
Smallest improvement that would matter to the business: {{MINIMUM_IMPROVEMENT}}

Rules:
- Write the hypothesis, the single change, and the decision rule before anything else.
- Estimate the visitors needed per variant. Show the formula or method you use, state the confidence and power settings you assumed, and tell me to confirm the figure in a sample size calculator.
- Convert the required visitors into weeks using WEEKLY_VISITORS and say if the test is impractical. If it is, suggest a bigger change, a higher-traffic page or a different metric.
- Warn against stopping early on a lucky result and against testing many variants with little traffic.
- Remind me to run tests for whole weeks to cover weekday effects, and to change one thing only (or say what we cannot conclude).

Output:
1. Hypothesis and decision rule.
2. Sample size reasoning and test duration, with arithmetic.
3. Setup checklist (traffic split, tracking, quality assurance).
4. What we will do for each outcome: win, loss, inconclusive.
5. Results log template.

Customize this prompt

Fill in the variables below to personalize this prompt:

ChatGPT
Claude
Grok
OpenRouter

Report this prompt

Model Settings

Recommended Models

ChatGPT Claude Gemini

Temperature

0.7

Max Tokens

2000

Additional Notes

Best for: Tests that are sized before they start

About this prompt

“Landing Page and Ad A/B Test Plan With Sample Size Reasoning” is a free prompt for ChatGPT in the Marketing category, 219 words long, added to The Prompt Index on November 11, 2026 by The Prompt Index. Copy it with the button above, paste it into ChatGPT or any other AI chat assistant, and send it.

It has 5 placeholders to fill in first: {{TEST_DESCRIPTION}}, {{PRIMARY_METRIC}}, {{BASELINE_RATE}}, {{WEEKLY_VISITORS}}, {{MINIMUM_IMPROVEMENT}}. Use the “Customize this prompt” fields to personalise it before you copy.

Recommended models: ChatGPT, Claude, Gemini.

0 upvotes, sent to an AI tool 0 times, viewed 4 times.

Browse all Marketing prompts, the AI prompt database or use the AI prompt finder to search every prompt.