Start a test

A test shows Eric's version of a page to some visitors and your original to the rest, so the two can be compared fairly. Everyone keeps seeing the same version for the whole test, so nobody sees the page change under them.

Start a test

• Start the test: half of new visitors see Eric's version.
• Start cautiously at 10%: only 10% see Eric's version at first. When you're comfortable, say raise it to half.

Press the button on Eric's message, type the words, or use the Waiting for you screen in the app. Eric confirms, for example: "Started: a split test on your pricing page. My version is shown to half of your visitors, the rest see the original, and nobody changes sides."

Eric never shows his version to more than half your visitors, so the original always keeps its fair share.

What it costs

The proposal says how many credits starting the test takes. They are taken once, when the test starts. Looking at the preview costs nothing.

What Eric counts

Eric tells you what he counts, such as people who book a call. If your goal isn't set yet, he counts people who carry on to another page, and asks you what counts as a new customer.

When a test can't start straight away

Pages with few visitors

If a page is too quiet for a fair test, Eric may offer to make the change without a test: it goes up for everyone, you decide whether it stays, and he tells you how the page does compared with before. That is weaker evidence than a test.

Fixes that aren't tested

Some changes are simply better, such as a lighter image. Eric offers Apply the fix instead of a test: everyone gets it once you say yes, and the original goes back in a click.

See your tests

Open Changes and tests → Split tests for tests Running now and Decided. Open a test to see both versions and how many people have seen each.