Conversion optimization with A/B tests

I’ve been thinking a bit about conversions and A/B tests lately. I’ve recently worked with a client on helping them pick imagery for their new website. In the end, we ended up with two different hero images that we all seemed to agree aligned with the company’s values and what we think will speak to potential customers.

The decision was then to A/B tests the two images to see which one converts better. While this is great, I’m wondering how one could create a third option. In order to create an A/B test, you need to run an additional script on your site (so 50% sees images A and 50% sees image B). That script - like any script - adds additional loading time. Ideally I’d like to A/B test two images, but I’d also like to A/B test two versions - one with the script and one without the script.

To understand how much time scripts add to a loading time, try visiting USA Today’s new “European Union Expierence” (e.g. without scripts and tracking).

Booking.com A/B tests everything. If something cannot be A/B tested, Booking.com won’t do it. There’s more than 1,000 A/B tests running at any time.Living a Testing Culture

Get more writing like this

Sign up and get new writing, just like this, every other two weeks. Unsubscribe any time (I'm not a dickhead).

Latest writing

The Cost of Lies

Big Mood Machine

Simplicity is a war

The next iPhone

Working as a UX-lead

Leadership or management

Everyone should own a dog

Silence is gold

Cameras that understand

Humans, not users

Keeping AI Honest

Right to privacy

2018 in review

What’s my location?

The State of UX in 2019

Why scrap scrappy?

I’m taking a break

Organized for browsing

Stay humble, stay eager

The iPhone Franchise

Why Small Teams Win

Back to Work!

The Bullshit Web

Just keep at it

Let them eat cake

Netflix Culture

Skype

Unfoundered

Vanity Metrics

Tech is not Neutral

Productivity

Whose risk?

Why Small Teams Win

Phone Bored

Karim Rashid

Dieter Rams

Bleeding Out

Fake News is spam

Conversational Design

Dropbox

Bye bye Facebook

Cuba

The seat at the table

Givenchy

Love letters to trees

Pricing Philisophy

Specialize

Personas

Make me think

The Future of Retail

Hawaii Missile Alert

2017 review

Why Design Systems fail

What You Build

Checkout for Winners

Living a Testing Culture

What do you do?

Creative Class

How To Predict Your Future

Carpe Diem UX-designers

What´s Good Design?

Chasing Growth

Github

Medium

A Redesign

Design quotes

Enough

Why?

ARKit

Designing for Mobile

Is Less More?

Why Simple is Hard

Pricing It Perfectly

Failure, Reflect, Renew

Trusting Your Gut

Built to last

An Eye on the Future

Growth

Working with me

UX Design explained

Great user experience

Naming your icons

Conversations

Want a UX-course in your inbox? Get it for free!

close