As part of the improvements to A/B testing introduced in summer 2025, Mention Me updated the metrics used to evaluate test performance. This article explains the changes, why they were introduced, and how they differ from existing metrics.Documentation Index
Fetch the complete documentation index at: https://docs.mention-me.com/llms.txt
Use this file to discover all available pages before exploring further.
What changed?
Mention Me introduced three new metrics for tests:- Variation share rate
- Variation purchase rate
- Variation conversion rate
Metric comparison
| Existing | New | |
|---|---|---|
| Share Rate | Shares from enrolled customers / Total enrolled customers | Shares from customers with an impression / Unique impressions |
| Purchase Rate | Purchases from shares / Shares from enrolled customers | Purchases from shares / Shares from customers with an impression |
| Conversion Rate | Purchases from shares / Enrolled customers | Purchases from shares / Unique impressions |
How does this help?
The new metrics more accurately measure the impact of a specific offer by exclusively tracking users who:- Were shown that exact variant
- Decided to refer (share)
- Earned purchases from their shared offers
Why would a customer see one offer and be enrolled in another?
Referral links are valid for a set period (typically 3-6 months). If a referee visits after this time, they’re shown the most current offer — so they may convert via a different offer than the referrer originally promoted. In A/B testing, this leads to an attribution ambiguity: should the original offer be credited, or the new one shown? For experiment integrity, Mention Me’s updated metrics attribute only to the experience actually displayed to the customer. This makes A/B test evaluation more precise. These scenarios are still valuable and are fully included in overall campaign metrics outside of test performance reports.