CRO & Testing

Beyond "One Size Fits All" A/B Tests

If you’re invested in improving your A/B testing game, you’ve probably read dozens of articles and discussions on how to plan and run A/B tests.

In reading advice about how long to run a test or what statistical significance threshold to use, you probably saw claims like “Always aim for XX% significance” or “Don’t stop a test until it reaches YYY conversions” – where XX% is usually a number higher than 95%, and YYY is usually a number higher than 100.

You might also have heard it’s best to come up with many variants to test against the control to improve your chance of finding the best option.

No matter what rule is offered, such advice seems to rest on the assumption that there is a one-size-fits-all solution that works in most situations.

Keep reading »

How to Segment A/B Test Results to Find Gold

You run an A/B test, and it’s a winner. Or maybe it’s flat (no difference in performance between variations). Does it mean that the treatments that you tested didn’t resonate with anyone? Probably not.

If you target all visitors with the A/B test, it merely reports overall results – and ignores what happens in a portion of your traffic, in segments.

Keep reading »

Do Review Stars on Google Help Click-Through Rate? [Original Study]

You know when you search for something on Google sometimes you see review stars next to a search result?

Like here:

Does it work to attract more clicks?

Inspired by our study Which Types of Social Proof Work Best?, we set out to quantify review stars as a way to increase click-through rates (CTR) in search engine results pages.

What kind of improvement in CTR can we get from including review stars in search engine results, if any? What does that mean for application in your business? We attempt to answer these questions with hard data in this CXL Institute study.

Our research was performed in collaboration with Belron® International, a automotive glass replacement and repair group.

Keep reading »

5 Hardest Things in Conversion Optimization

Conversion optimization is hard; it’s constantly changing and you need to know a lot about a lot. Keeping up with the technology changes and managing business’ expectations can be tricky.

Here’s what some of the top experts in the field are saying about the top challenges in conversion optimization.
Keep reading »