Storefront Lab HQ
A/B testing playbooks for Shopify merchants

How to A/B test product images on your Shopify store

Product images are the biggest lever on most product pages, and the easiest to test badly. Which image variables to test, how to keep tests clean, and the metrics that actually tell you which photo wins.

Why images are worth testing first

On most Shopify product pages, the images carry more weight than the headline, the price presentation, or the button color. Shoppers decide in seconds whether the product looks right, and the first image does most of that work. Testing copy tweaks while the hero image underperforms is optimizing the wrong lever. If you only run one test this quarter, test the product photography.

Image tests also have a practical advantage: they rarely break anything else. Swapping a hero image does not change layout, checkout flow, or pricing logic, so the blast radius of a bad variant is small and the results are easy to interpret.

Which image variables to test

Test one variable at a time. The highest-impact variables, in rough order: lifestyle context versus plain studio background, the main product angle, whether a human model appears, and the number of images in the gallery. A lifestyle hero image that shows the product in use often beats a sterile studio shot, but not always, which is exactly why you test instead of assuming.

Lower on the priority list but still worth testing once the big variables are settled: image order in the carousel, zoom behavior, and video thumbnails. Do not test everything at once. Change the hero image, measure, then move to the next variable.

How to keep the test clean

Split traffic evenly between variants and keep everything else identical: same price, same copy, same traffic sources. Image tests are vulnerable to novelty effects, where a new image wins simply because it is different and returning visitors notice it. Run the test long enough for the novelty to fade, usually at least two full weeks, and segment results by new versus returning visitors if your tool allows it.

Watch out for variant bleed in caching. If your theme or CDN caches the old image aggressively, some visitors in the new variant will see the old photo, which muddies results. Bust the cache when the test starts and verify both variants render correctly on mobile and desktop before launch.

The metrics that matter

The primary metric is conversion rate on the product page, measured as orders divided by product page sessions. Click-through from the product page to checkout is a useful secondary metric because it isolates the image's effect from checkout friction. Do not judge an image test on engagement metrics like time on page; a confusing image can increase time on page while hurting sales.

For stores with meaningful add-to-cart volume but low checkout completion, pair the image test with add-to-cart rate. If the new image lifts add-to-carts but not orders, the image did its job and the checkout needs attention next.

When not to test images

Skip image testing when your photography is fundamentally weak. Testing two bad photos against each other produces a winner that is still bad. If your product images are blurry, inconsistent, or shot on a phone in bad light, invest in a proper shoot first. A/B testing optimizes; it does not rescue.

Also skip it during major sales events. Traffic spikes change shopper behavior enough that test results from Black Friday will not generalize to February. Test in normal traffic conditions.

The honest bottom line

Product image tests are the highest-return tests most Shopify stores can run: big lever, small blast radius, easy to interpret. Test one variable at a time, run at least two weeks, judge on conversion rate, and fix bad photography before you test anything. The photo is the pitch.

Frequently asked questions

What should I test first when A/B testing product images?

The lead image choice, because the first photograph decides whether shoppers engage at all: lifestyle context versus clean product view is the classic, genuinely uncertain contest. Follow with gallery order and the inclusion of scale and detail shots. Change one variable, in this case which image leads, and keep the rest of the gallery identical.

How do I keep an image test clean?

Serve each variant consistently to the same visitor, change nothing else on the page during the test, and run through at least two weekly cycles. Watch for image quality confounds: if one variant is simply a better photograph in every dimension, you have learned photography matters, not which concept wins. Match production quality so the concept is what differs.

When is A/B testing product images a waste of time?

When the images have known defects, poor light, no scale reference, missing angles, testing order will not rescue them; fix the obvious first. Testing also wastes time on very low traffic products, where a result would take months to read. Spend testing effort on high traffic products and spend photography effort everywhere else.