A/B test
Change anything on a page and split the traffic.
Experimentation for Shopify
Every change is a bet.Know which ones pay.
A/B, redirect and price tests for Shopify, read in revenue and profit per visitor. Not in clicks.
254+ businesses$5.4B GMV10,400+ A/B tests
254+ Shopify brands and agencies, and the CRO team behind them
Why Conversion.io
Most tests crown the version that converts more. Conversion.io reads every variant in revenue and profit per visitor, so the version you keep is the one that earns.
FIG 0.1
Split real traffic
A/B, redirect and price tests on your Shopify store.
FIG 0.2
Measured in money
Revenue and COGS-aware profit per visitor, not just conversion.
FIG 0.3
Decide with confidence
Probability to be best, pre-calculated sample size, bandits that shift traffic to the leader.
Build tests
without a ticket
Change a page in the visual editor, write JS and CSS in the code editor, or describe the change and let AI write the code. Target by page, device, visitor type and traffic source, then run the QA checklist before launch.
Illustrative data
Features
- Visual editor
- Code editor
- AI prompt
- Page targeting
- Audience targeting
- QA checklist
- Scheduling
- Personalization
Test types
One store. Many ways to test it.
Test the page, the URL, the template or the whole theme. Then the price, the shipping, the offer and the checkout, read in profit.
Content tests
Redirect test
Send half your visitors to another URL.
Template test
Edit one template, test every page that uses it.
Theme test
Compare two full themes on live traffic.
Profit tests
Price test
Find the price that earns the most profit.
Shipping test
Try different free-shipping thresholds.
Offer test
Bundles, gifts, discounts: see which one pays.
Checkout test
Test the steps between cart and paid.
Read every test
in money
Conversion rate, order value, revenue per visitor and COGS-aware profit per visitor, each with its probability to be best, live while the test runs.
Decision metric
The share of visitors who order.
Variation 1 wins on Conversion Rateillustrative(+12.06%, 98.90% confidence)
| Group | Visitors | Conversion Rate | Uplift | Probability to be best |
|---|---|---|---|---|
| Reference | 21,670 | 3.40% | N/A | 1.10% |
| Variation 1 | 21,670 | 3.81% | +12.06% | 98.90% |
Time SeriesConversion RateReferenceVariation 1
Based on: Conversion Rate
Revenue Per Month+ €9,412
Revenue Per Year+ €112,944
Illustrative data
Features
- Revenue per visitor
- Profit per visitor (COGS)
- Probability to be best
- Live reports
- Client dashboard
- Slack & e-mail alerts
Multi-armed bandit
Traffic moves
to what earns
Switch on MAB Test and traffic shifts to the leading variation in real time. Choose how fast: Protect, Balanced or Maximise. Freeze the split once the test converges.
FIG 3.1 · Traffic allocation
Steady. Moves traffic to the leader at an even pace.
Reward · Revenue per visitor
- Visitors100%
- Reference33%
- Variation 133%
- Variation 234%
Day / 21
Learning
Illustrative data
Features
- Multi-armed bandit
- Risk presets
- Freeze on convergence
- Ramp-up
- Holdout group
- Mutually exclusive tests
Your data in. One answer out.
Shopify orders, tracking and product costs (COGS) come in, with GA4, BigQuery, Snowflake, Databricks and Redshift. Live reports, client dashboards, Slack and e-mail alerts and AI tools via MCP all read the same numbers.
FIG 4.1 Sources
Conversion.ioOne set of numbers
Outputs
Features
- Shopify app
- GA4
- BigQuery
- Snowflake
- Databricks
- Redshift
- Product costs
- MCP
Customers
Stores that test with us.
Featured“We've been working with them about 2 months and they've been incredibly professional. We've done 8 tests and 6 have been successful. We've added over half a million to our bottom line. They're extremely responsive and actually overdeliver.”
- tests
- 8
- winners
- 6
- added
- 500k+
Across every account
- 254+
- businesses
- $5.4B
- GMV
- 10,400+
- A/B tests
Customer
“We have been working together for years now and put together some really awesome tests.”
“We spend $100m/year on Meta and TikTok for paid acquisition. I have several projects with them and can really recommend them for CRO & A/B testing. Their work makes our work better.”
“We really managed to scale several tests per month right from the start, and the topic of onsite optimization is super important to us.”
Customer
“We at Huel are even more impressed with your CRO expertise. Excited to work together!”
“We own a portfolio of brands and are doing $30m a year. I want to recommend them as absolute CRO specialists and overall amazing people to work with.”
“The results have been really good right from the start. I'm a fan of quick results, and they really delivered within a short time.”
Customer
Pricing
Choose the plan that fits how you test.
Every organization starts on Free Forever. Pro adds price tests and launch rights for the whole team.
Free Forever
$0$0/ forever
No time limit
Where every organization starts. Build, run and read A/B and redirect tests on your store.
Book a demoIncludes
- A/B and redirect tests
- Visual editor and code editor
- Targeting by device, source and visitor type
- Pre-calculations for sample and runtime
- Live reports in revenue and profit per visitor
- GA4 and BigQuery connection
Pro
RecommendedOn request
Billed per organization
For brands that test continuously, and want to test the price itself.
Talk to us about ProEverything in Free Forever, plus
- Price tests on Shopify Plus
- Launch and scheduling for Regular Users
- No upgrade notice in the app
Custom
Tailored
Amount and interval by agreement
A custom subscription for agencies and portfolio operators that a list price does not fit.
Plan it with usEverything in Pro, plus
- A subscription set up for your organization
- The billing interval you choose
- Status and renewal on your billing page
The AI data intelligence and experimentation platform for Shopify brands. Run A/B, redirect and price tests on your store, and read every result in conversion rate, revenue per visitor and profit per visitor.
No. A/B and redirect tests change the storefront in the visitor's browser, without touching the theme. You edit the theme only when you ship a winner for good.
A/B tests, redirect tests and price tests. Template, theme, shipping, offer and checkout tests are already in the experiment builder and marked as coming soon.
A store on Shopify Plus and a paid Conversion.io plan. Prices are applied through Shopify's Cart Transform, so the tested price holds through to checkout.
Pre-calculations give you the sample size and runtime before you start. While the test runs, every variant shows its probability to be best next to revenue and profit per visitor, split by device, source and visitor type.
Book a demo and we set up your organization on Free Forever. To move to Pro or a custom subscription, talk to your Conversion.io contact.
Yes, in the billing settings of the app. The plan stays active until the end of the paid period and can be reactivated until then.
The CRO team of ACCELERATED, which has run conversion optimization and A/B testing for DTC brands since 2019. The company is Schröder & Weische Software GmbH in Hamburg.