You run an A/B test, and it’s a winner. Or maybe it’s flat (no difference in performance between variations). Does it mean that the treatments that you tested didn’t resonate with anyone? Probably not.
If you target all visitors with the A/B test, it merely reports overall results – and ignores what happens in a portion of your traffic, in segments.
What kind of improvement in CTR can we get from including review stars in search engine results, if any? What does that mean for application in your business? We attempt to answer these questions with hard data in this CXL Institute study.
Our research was performed in collaboration with Belron® International, a automotive glass replacement and repair group.
A/B testing tools like Optimizely or VWO make testing easy, and that’s about it. They’re tools to run tests, and not exactly designed for post-test analysis. Most testing tools have gotten better at it over the years, but still lack what you can do with Google Analytics – which is like everything. Keep reading »
I remember the first time that a client told me how much analytics had helped their business.
They were able to increase their sign up rate for their product by 22% while reducing their marketing costs. It wasn’t magic or fancy tactics. They simply used their analytics data to make informed decisions.
They didn’t have to guess or take huge bets. They knew exactly what was working and what they needed to do more of.
This is power of analytics and more specifically, product analytics.
From the outside, it seems like data is impartial. It’s cold, objective, accurate.
In reality though it’s more complicated. In the hands of someone with an agenda, data can be weaponized to back up that viewpoint. Even in the hands of someone benevolent, data can be misinterpreted in dangerous ways.