How to A/B test Shopify product listings without losing your reviews

Every Shopify merchant who runs paid traffic eventually wants to A/B test product listings — a different headline, different hero image, a bundle vs. a single SKU. Then they run into the same wall:

Duplicating a product to test it leaves you with two listings: one with 312 verified reviews and one with zero.

Your test isn't measuring what you think it's measuring. The variant with zero reviews underperforms not because the page is worse, but because customers don't trust a product with no social proof. You're testing "page with reviews" vs. "page without reviews" and concluding the original was better.

This guide walks through how to actually run a fair A/B test on a Shopify product listing — and how RightReviews' cross-product review sharing eliminates the social-proof problem entirely.

The standard Shopify A/B testing approaches

There are three ways merchants typically run product-listing tests on Shopify.

Approach 1: Duplicate the product, change one thing, run paid traffic

Create a duplicate product, change the variable (headline, image, bundle), and route paid traffic to each at 50/50. Measure conversion rate.

Problem: The duplicate has zero reviews. Conversion gets dragged down by the absence of social proof, not by the change you actually made.

Approach 2: Use a Shopify A/B testing app that swaps templates server-side

Apps like Shoplift or Intelligems let you serve different page templates to different visitors on the same URL. Reviews stay on the same product, so social proof is identical across variants.

Problem: You can only vary template-level stuff (sections, layouts, copy). If your test is "single product vs. bundle," "this hero image vs. that one served from a different product feed," or "this title vs. that one in the product database itself," template-swap apps can't help.

Approach 3: Run two real products and share reviews across both

This is what RightReviews enables. You create two real Shopify products (different titles, different images, different bundles — whatever you want to test). You point RightReviews' cross-product review sharing from one to the other. Both product pages display the same set of verified reviews.

Now the only difference between the two variants is the thing you're actually testing.

How cross-product review sharing works in RightReviews

In the RightReviews admin:

1. Go to A/B overrides in the embedded app.
2. Choose the target product (the new variant with no reviews).
3. Choose the source product (the existing product with reviews).
4. Save.

From that point on, the target product's review widget renders the source product's reviews, with star summary, photo gallery, and verified-buyer badges intact. The reviews themselves remain owned by the source product — you're not duplicating data, just rendering it in two places.

If you want to end the override (or change which source it points to), the change is reversible in two clicks.

A real workflow: testing a single product vs. a bundle

Let's say your hero SKU is the Mandala Bead Loom Kit at $48 with 312 reviews and a 4.9★ average.

You want to test selling it as a Mandala Bead Loom Kit Bundle at $59 with a few extra beads — same product family, different value proposition.

Without RightReviews:

• You create the bundle as a new product.
• It has zero reviews.
• You drive paid traffic to both at 50/50.
• The bundle underperforms because the page looks dead.
• You conclude "people don't want the bundle."
• Actually: people might want the bundle, but they want to see proof first.

With RightReviews:

• You create the bundle as a new product.
• You set an A/B override: bundle product → loom-kit product (source).
• Both pages now show the 312 reviews and 4.9★.
• You run the test.
• The conversion delta is real, because the only variable that changed is the actual page (single vs. bundle).

A note on review-content integrity

We get this question a lot: "Isn't it misleading to show the same reviews on two products?"

Our take: it depends on how close the products are.

• Acceptable, in our view: product variants, bundles of the same item, region-specific SKUs of the same product, A/B-tested page variants of the same underlying item.
• Not acceptable: showing reviews from product A on completely unrelated product B. That's misleading, and we discourage it in our documentation.

We don't enforce this technically — the merchant chooses what to override — but we recommend keeping shared reviews between products that a reasonable customer would consider "the same thing or a close variant."

How to design a clean test

Three principles for a fair A/B test on a Shopify product listing:

1. Change exactly one thing

If you change the title and the image and the price, you don't know which one moved the conversion. Change one thing per test, and run the test long enough to hit statistical significance.

2. Route traffic deliberately

The cleanest way to A/B test two real products is to use a tool like Shoplift, Intelligems, or your ad-platform's split-test feature to route 50/50 traffic between the two URLs. If you just link to one from a single source, you're measuring the source's audience, not the page.

3. Equalize social proof

This is where most A/B tests fail. If you're not equalizing social proof — reviews, star ratings, "trusted by X customers" badges — your test is measuring social proof differences, not page differences. Cross-product review sharing is the cleanest way to equalize.

Other use cases for cross-product review sharing

A/B testing is the big one, but the same feature solves a few other real problems:

• Variant SKUs that share reviews. Different colors of the same shirt should share the same reviews. RightReviews handles this automatically by default for color/size variants, and you can override per product.
• Bundle vs. single-item. Reviews from the single item carry forward to the bundle.
• Regional or currency-specific product duplicates. If you maintain a duplicate product for a different market, share the reviews.
• Limited-edition relaunches. When you bring back a discontinued product as a "v2," share the v1 reviews to start the new listing with social proof.

What you need to make this work

• A Shopify store on any current plan.
• The RightReviews app installed.
• An A/B testing tool (or a paid-traffic split test) for actually routing traffic between two product URLs.
• Patience — most A/B tests need 1,000+ sessions per variant to be conclusive.

Try it on your store

Cross-product review sharing is available on every RightReviews plan, including Free. Install, set up your first override, and start testing without losing social proof.

Install RightReviews on Shopify →

See full feature list →