Skip to main content
There are two ways to start an A/B test, depending on whether you are testing against something that is already live. Either way, you configure the test in a short wizard on the node you are testing. On a draft with no test yet, the insights panel also nudges you with a Run an A/B test recommendation. For the concepts behind these, see how A/B tests work.

​
Test Against a Live Version (Control Versus Variant)

Use this when you have a live version and want to test a change against it. The live setup becomes the control.
1

Start the Test from the Live Version

On the live version, click Set up A/B test (it also appears as a recommendation in the insights panel). Mention Me creates a new draft version based on the running version.
The Set up A/B test dialog created from a running version

Starting an A/B test from a live version.

2

Pick the Baseline and Name the Version

If the live version already has more than one variant, choose the baseline variant to test against. Enter a Version name (internal), then click Create test. Mention Me creates a new draft version based on the live version, with your chosen baseline as the control.
3

Set Up the Test on a Node

On the node you want to test (for example Rewards or Sharing), click its + A/B test button. The baseline stays as the control (Variant A); edit Variant B to create the change you want to test.

​
Split a Node on a Draft (Variant Versus Variant)

Use this when you are building something new and want to compare two fresh ideas, with no live baseline.
1

Split the Node

On a draft version, click the + A/B test button on the node you want to test (for example Rewards or Sharing). The node splits into Variant A and Variant B.
2

Edit Each Variant

Edit both variants so they differ. Neither is a control here; the two are compared as equals.
You can A/B test six nodes of a version, each via its + A/B test button: Branding, Images, Rewards, Sharing, Referrer Copy and Referee Copy. The campaign-scoped Trigger node cannot be tested, because its rules apply to every version.

​
Configure the Test

Setting up a test on a node opens a wizard with three steps.
1

Overview

A summary of what will happen: your current setting becomes the control (or Variant A), you edit the other variant, and traffic is split 50/50. Click Next.
The A/B test wizard Overview step explaining the Variant A baseline and the 50/50 traffic split

The A/B test setup wizard, Overview step.

2

How It Runs

Choose the test metric that decides the winner, Conversion rate or Share rate (the recommended option is marked). Then set how fast the test should run:
  • For a test against a live baseline, pick a test speed: Normal (highest confidence), Fast, or Fastest. Each shows its confidence target and estimated duration.
  • For a variant-versus-variant test with no baseline, tell Mention Me your weekly order volume (Less than 200 orders a week or More than 200 orders a week). This sets the confidence target, and the test runs for a fixed 8 weeks.
The How it runs step with metric and speed options

Choosing the test metric and speed.

3

When It Concludes

Decide what happens for each outcome:
  • If a winner is found. The winning variant is promoted automatically.
  • If a better variant is found (but no winner). Choose Allocate to the best performer (recommended), keep the control, or pick a specific variant.
  • If there’s no meaningful difference. Choose to keep the control or allocate to the variant.
Click Save to finish.
The When it concludes step with three outcome cards

Setting what happens when the test concludes.

​
Edit and Refine

Next, make your variants meaningfully different and refine the test before launch: edit Variant B, use View differences, and adjust or remove the test from the node’s manage menu. See manage an A/B test.

​
Launch the Test

An A/B test launches like any other version. See launch a campaign and version. After launch, follow it on the monitor an A/B test page.
Last modified on September 25, 2026