How to choose a CRO app for a Shopify store
3 min read · updated
Before installing any conversion app on Shopify, check four things. Does it install through a theme app extension, so it can be switched off cleanly, rather than by editing theme code? How much does it add to page load on a mid range phone? Does it work on the pages that matter given Shopify's checkout limits? And does it measure its own effect against a control group, or just report clicks on its own widgets?
Why does the install method matter?
Shopify's App Store requirements ask apps to extend themes through theme app extensions rather than by changing theme files, and for good reason. An app that edits theme.liquid or injects code into templates can leave code behind after you uninstall it, and can break after a theme update. An app embed added through the theme editor can be switched off in one click.
If an app's setup asks you to paste code into your theme, that may be fine for a script tag, but ask what it changes and how it is removed.
How much page weight is acceptable?
As little as possible on the product page and cart. Test before and after installing on a mid range Android phone over mobile data, timing how long it takes to see the price and the add to cart button. Scripts that load asynchronously and do not block rendering are the minimum standard.
Be especially wary of tools that hide the page until they have decided what to show. On a slow connection that can turn a fast store into a blank screen.
What can an app change on Shopify, and what can it not?
Apps working through the storefront can change product pages, collections, the cart and anything else rendered by your theme. Shopify's own checkout is a different story: changes there go through Shopify's checkout settings and checkout extensibility, and most storefront scripts do not run on checkout pages.
So a conversion app's influence ends at the cart for most stores. That is still where most of the hesitation happens.
- Product pages, collections, cart: changeable by theme and app scripts
- Checkout: limited to Shopify's checkout settings and extensions
- Order status and post purchase: separate extension points
How should the app prove its value?
Ask for revenue or orders against a control group, not clicks on the app's own widget. A popup that collects ten thousand email addresses may still lower sales if it interrupts shoppers who were about to buy. Only a comparison with visitors who never saw it answers that.
Check how billing works too. Apps sold through the Shopify App Store bill through Shopify, so charges appear on your Shopify invoice and stop when you uninstall.
Which type of app fits which problem?
Popup and email capture apps grow lists. Review apps build trust on product pages. Upsell apps raise order value. Chat and AI assistant apps answer questions before purchase. Experimentation and personalisation tools change the page itself and measure the result. Most stores need two or three of these, not ten.
IntellQ sits in the last two: an agent that changes marked elements per visitor intent with a holdout group, and a chat agent that answers from your catalogue, in one script tag or through Google Tag Manager.
What should a Shopify app trial look like?
Install on a duplicate theme first if the app touches theme files. Measure product page load on a phone before and after. Run it for two full weeks with a control group, outside a sale, and read orders per visitor rather than the app's own counter. Then uninstall it on the duplicate theme and check that nothing is left behind.
Keep a simple log of every app you try, what it promised, what it measured and why you kept or removed it. Six months later that log stops you from installing the same idea twice.
Questions
How many apps should a Shopify store run?
As few as do the job. Each app can add scripts to every page, so audit installed apps twice a year and remove the ones nobody uses.
Can I A/B test my Shopify checkout?
Only within Shopify's checkout settings and checkout extensibility. Most conversion testing happens on product pages and the cart.
Do apps slow down a Shopify store?
Some do. Test the product page on a mid range phone before and after installing, and prefer apps that load asynchronously through theme app extensions.