The Discipline Based Testing Methodology

The Discipline Based Testing Methodology

This is the methodology that I have developed over 12 years in the industry and working with over 300 organizations. It is also the methodology that has been used to have a near perfect test streak (6 test failures in 5.5 years), even if most others do not believe that stat. Read post

Can You Run Multiple A/B Tests at the Same Time?

Can You Run Multiple A/B Tests at the Same Time?

You want to speed up your testing efforts, and run more tests. So now the question is – can you run more than one A/B test at the same time on your site?

Will this increase the velocity of your testing program (and thus help you grow faster), or will it pollute the data since multiple separate tests could potentially affect each other’s outcomes? The answer is ‘yes’ to both, but what you should do about it depends. Read post

How to Come Up with More Winning Tests Using Data

How to Come Up with More Winning Tests Using Data

While testing is a critical part of conversion optimization to make sure we actually made things better and by how much, it’s also the tip of the iceberg of the full CRO picture. Testing tools are affordable (even free), and increasingly easier to use – so pretty much any idiot can set up and run A/B tests. This is not where the difficulty lies. The hard part is testing the right things, and having the right treatment.

The success of your testing program is a sum of these two: number of tests run (volume) and percentage of tests that provide a win. Those two add up to indicate execution velocity. Add average sample size and impact per successful experiment, and you get an idea of total business impact.

So in a nutshell, this is how you succeed:

  1. Run as many tests as possible at all times (every day without a test running on a page/layout is regret by default),
  2. Win as many tests as possible,
  3. Have as high impact (uplift) per successful test as possible.

Executing point #1 obvious, but how to do well for points #2 and #3? This comes down to the most important thing about conversion optimization – the discovery of matters.

Read post

Lies Your Optimization Guru Told You

Lies Your Optimization Guru Told You

Before you get out your pitchforks, I want to stress that this article does not represent Peep’s views.

The easiest lies to believe are the ones we want to be true, and nothing speaks to us more than validation of the work we are doing or what we already believe.  Due to this we become naturally defensive when someone challenges that world view.

The “truth” is that there is no single state of truth and that all actions, disciplines, and behaviors can and should be evaluated for growth opportunities.  It doesn’t matter if we are designers, optimizers, product managers, marketers, executives, or engineers, we all come from our own disciplines and will naturally defend to the death if we feel threatened even in the face of overwhelming evidence.

Read post

Conversion Feud – Live Entertainment Show at ConversionXL Live 2015

At ConversionXL Live fun is a serious business.

This year we tried something never done before – we played a Family Feud style game show we called Conversion Feud. We had two teams of speakers, trying to guess what the actual conference audience (who were surveyed before) answered to questions asked from the contestants.

Here’s a recording of it:

See you at ConversionXL Live 2016! (Save the dates: March 30 – April 1 2016)

10 Best Practices for Better B2B Website Experience

10 Best Practices for Better B2B Website Experience

Best practices are starting points: if you have no data, start with these. They are not what you should end up with, but it’s where you start (the optimization). That’s an important distinction.

Here are some ideas about of how you can apply 10 Jakob Nielsen Usability Heuristics to lead generation websites in the B2B or high consideration B2C realm, where there isn’t necessarily any transactional functionality, e.g. e-commerce, user registrations, etc.

Read post

Lies Your Designer Told You (or Data vs Design)

Lies Your Designer Told You (or Data vs Design)

Designers versus data more than ever deserves its place in the pantheon of great conflicts: the Hatfields vs. McCoys, Android vs. iOS, Social Media Marketing vs. Results, Athens vs. Sparta, the Doctor vs. Daleks, Auburn vs. Alabama, and Fox News vs. reality.

We make this out to be some great collision of disciplines when in fact they are not opposites and they can and should work together. Read post

5 Insights from Every Speaker of ConversionXL Live 2015

5 Insights from Every Speaker of ConversionXL Live 2015

I’ve been to a lot of conferences. A lot. Most of them are mediocre. I made it my personal goal to deliver an amazing conference.

I took inspiration from the good things I’ve seen at other conferences, made sure I avoided the bad things – and so ConversionXL Live 2015 was born. We had 245 attendees from 23 countries. The crowd was very diverse, very high level (~75% of attendees were CRO professionals). So we needed high level content to match the audience + deliver a kickass experience.

So how did it go?

Here’s what Andre Morys, CEO of Web Arts thought:

Here’s what the Conversion Scientist told me over email:

massey

And lots of other feedback similar to this. Thank you everyone who took part of our very first ConversionXL Live. It meant a lot to me. You made it a success.

Check out the photos from the event here.

Read post