Confirmation Bias in Design
June 25, 2018
I’ve recently been reading a book called The Black Swan by Nassim Nicholas Taleb and it got me thinking about our confirmed way of thinking. The book focuses on the extreme impact of certain kinds of rare and unpredictable events and how we strive to find simplistic explanations for these events later on. The problem, as Nassim explains, is that we place odds on past events repeating themselves even if they are rare, unpredictable, and - most of all - unrepeatable.
He calls these events Black Swans, a reference to a 17th century philosophical thought experiment. In Europe, anyone could have told you the ‘fact’ that “all swans are white” since that is all they’d seen. So what was the chance of seeing a black one? Zero? Just like imagining a green swan today, seeing black swans were beyond rare events until 1697 when explorers found black swans in Australia.
Nassim argues that most of the really big events in our world are rare and unpredictable, and thus trying to extract generalizable stories to explain them may be emotionally satisfying, but it's practically useless. September 11th is one such example, and stock market crashes are another. Or, as he puts it, "History does not crawl, it jumps."
Four hundred years ago, Francis Bacon warned that our minds are wired to deceive us. "Beware the fallacies into which undisciplined thinkers most easily fall--they are the real distorting prisms of human nature." Chief among them: "Assuming more order than exists in chaotic nature." Now consider the typical stock market report: "Today investors bid shares down out of concern over Iranian oil production." Sigh. We're still doing it.
Forecasting is not just at the heart of Wall Street, but it’s something each of us does every time we make an insurance payment or strap on a seat belt.Chris Anderson
I’m fascinated by this line of thought and try to view it through the lens of my daily work. What black swans are hidden in the work we do? Perhaps because of the fact that digital products have evolved so quickly, we are even more prone to accept ‘facts’ that are in front of us. You and I need to accept our lives are loaded with confirmation biases.
People generally see what they look for and hear what they listen for.Harper Lee, To Kill a Mockingbird
Confirmation bias is everywhere
Consider how common smoking in public places like airplanes and restaurants was just 20-30 years ago. It’s not that strange considering in the 18th and early 19th centuries, tobacco smoke was considered good for your heart and lungs. All of tobacco’s health ‘benefits’ were explored and some were outright strange. Tobacco enemas were so popular that they were placed along the banks of the river Thames to help drowning victims! This is a perfect example of confirmation bias at work.
Confirmation bias - our tendency to accept evidence we agree with at face value and dismiss information we don't agree with unless the evidence is overwhelming. Confirmation biases limits our ability to seek out and uncover the truth.
I see this over and over in my own work and in other’s everyday. We run A/B tests until they show the impact that we were hoping for and stop there. Even when the tests aren’t showing us the result we were hoping for, we make up stories for the failure and why our original theory still stands true. Self-validation. Confirmation bias.
Don’t build solutions in search of a problem. Just because you had an idea doesn’t mean someone needs it. The mere existence of a solution doesn’t validate the existence of a problem.
Josh Pigford
Michael Aagaard talks about this in great detail and suggest that, rather than testing our ideas, we should do detective work to find out what our customers really need and how they talk about it. We can use this new information to A/B test against our previous data and see success. This may change everything about how we develop products.
Overcoming confirmation bias
This is something I’ve experienced many times. Here are a few things I try to keep in the front of my mind:
-
People generally don’t know what they want. They know what they have and what they don’t like about it. Finding the solution to their problem is your work.
-
People usually say one thing, but act very differently. This is why the best user research is multi-faceted: talking to users, observing users, analyzing statistics, and sometimes trying crazy things. User action is much more relevant than user feedback. Feedback from users is great for understanding their line of thinking, but not great for understanding their actions. Words are their idea of what they do, actions are the reality. It’s not uncommon that these two don’t align.
-
Statistics are a great tool, but always remember that statistics are only relevant to the actions currently available. You can only draw insights from what you currently have in that moment. It’s not a great metric for looking at what people want and certainly can’t predict the future.
Our brains are wired for narrative, not statistical uncertainty. And so we tell ourselves simple stories to explain complex thing we don't--and, most importantly, can't--know. The truth is that we have no idea why stock markets go up or down on any given day, and whatever reason we give is sure to be grossly simplified, if not flat out wrong.Chris Anderson
How to overcome confirmation bias? Like most things in life, it starts with accepting the fact that you could be wrong. Seek out a different perspective. Why? Because being biased towards information that confirms what we already believe often leads to errors in judgment and costly mistakes in marketing, something I’m guessing none of us wants.
I’ve previously written of how I think more UX-designers - and people in general - should be more comfortable with the words ‘I don’t know’. Accepting that there is so much in this world that we simply cannot explain much less replicate is key. Nassim argues that this is why one shouldn’t read the news. The more we think we know, the less likely we are to be open to unpredictable events. Reading the news simply gives us an idea of what has happened and it’s in some extent naive of us to assume that this is related to what will happen.
To sum up, confirmation bias is a very real part of our lives, both work and personal. Through skills like observation, communication, and analysis of the information in front of us, we can begin to sort out our personal “black swans”.
You need to confirm your email to confirm your subscription.
-
March, 2024
-
February, 2024
-
January, 2024
-
December, 2023
-
November, 2023
-
October, 2023
-
September, 2023
-
August, 2023
-
July, 2023
-
June, 2023
-
May, 2023
-
April, 2023
-
March, 2023
-
January, 2023
-
December, 2022
-
November, 2022
-
September, 2022
-
August, 2022
-
July, 2022
-
June, 2022
-
May, 2022
-
April, 2022
-
January, 2022
-
December, 2021
-
November, 2021
-
October, 2021
-
September, 2021
-
August, 2021
-
July, 2021
-
June, 2021
-
May, 2021
-
April, 2021
-
March, 2021
-
January, 2021
-
November, 2020
-
October, 2020
-
September, 2020
-
August, 2020
-
June, 2020
-
May, 2020
-
April, 2020
-
March, 2020
- Regarding Zoom
- Why wireframes are becoming obsolete
- Get static
- Emotions and work - know yourself
- All books are now free
- Wireframes are too concrete
- Stuck at home
- What Great Managers Do
- From Error to Understanding: The Importance of Brand Voice When Things Go Wrong
- Answering your question - How I design
- The Sliding Scale of Giving a Fuck
- Hard startups
-
February, 2020
-
January, 2020
- Debbie Millman - Time Well Spent
- The last tracker was just removed from Basecamp.com
- Fathom Analytics
- Redesign to learn
- How putting a price on speed helped one retailer increase mobile revenue in just 2 months
- Accessibility drives aesthetics
- Smart people use simple words to make others feel smart.
- The great paradox of our time: everything is both better and worse than ever before
-
December, 2019
-
November, 2019
-
October, 2019
-
September, 2019
-
August, 2019
- How we work with microcopy
- Measuring UX with HEART
- Mobile E-Commerce UX: Deemphasize ‘Install App’ Ads or Avoid Them Entirely
- Analytics are reshaping fashion’s old-school instincts
- What to Do When You Feel Uninspired at Work
- Stay in your lane and outlast your competition
- A Mindful Approach to Technology
- “I Just Knew I Was Going to Surpass These Guys I Was Working For”
- People Are Starting to Realize How Voice Assistants Actually Work
- Fast Software, the Best Software
- Data-Driven Design Is Killing Our Instincts
- Freelance and Business And Stuff
- UX can’t be defined by one set of "rules"
-
July, 2019
- 5 Years - 300+ Posts!
- Superhuman and email privacy
- Why Consultants Quit Their Jobs to Go Independent
- Give them candy: small details make all the difference
- Your inbox is spying on you
- On Modus: It’s Time for a Code of Ethics for Designers
- Frank Chimero on causing ’good trouble’ and re-imagining the status quo to combat achievement culture
- Advertising: contextual vs. behavioral and why it matters
-
June, 2019
- Citrix improves UX and cuts costs by 65%
- Delight Comes Last
- Tim Cook’s Stanford Commencement Address
- You care more about your privacy than you think
- The Cost of Lies
- Let’s assemble like the Avengers and... do work
- Big Mood Machine
- Simplicity is a war
- How Notion Is Going After Atlassian and Why It Just Might Win
- Hiring a Management Consultancy for Digital Is a Mistake
- Just write: why Product Designers should write, and how to get started
- Dos and dont’s on designing for accessibility
- I’ve redesigned my website and it looks exactly the same
-
May, 2019
-
April, 2019
- Scapegoating User Experience Design
- Clip sharing with Overcast
- Why don’t we just use Material Design?
- Accenture sued $32m+ over website redesign for Hertz
- Venture capital money kills more businesses than it helps
- Creating a UX Strategy
- The elegance of nothing
- Amazon Workers Are Listening to What You Tell Alexa
- Working as a UX-lead
- Gumroadday: Get my books at -17% discount
-
March, 2019
- Working as a UX designer
- Meet Q: The First Genderless Voice
- It Doesn’t Have to Be Crazy at Work
- How Notion pulled itself back from the brink of failure
- What’s the meaning of work?
- Wireframes are becoming less relevant — and that’s a good thing
- Neurodiversity and the Digital Divide: how our neurological differences shape the way we experience the web
- Accessibility, a powerful design tool
-
February, 2019
-
January, 2019
-
December, 2018
-
November, 2018
-
October, 2018
-
September, 2018
-
August, 2018
- Living among baby robots
- Yuval Noah Harari on what the year 2050 has in store for humankind
- Voice Input’s Effect on Social Norms
- How I kicked my email compulsion
- Facebook's struggle to moderate itself
- The Secret to Ant Efficiency Is Idleness
- Google Employees Are Organizing To Protest the Company’s Secret Search Engine
- Why Small Teams Win
- Back to Work!
- The Bullshit Web
- Nikhil Sonnad on the banal evil of Facebook
-
July, 2018
- Five questions UX employers should be asking
- Just keep at it
- Yes, Alan, There Is An ROI For UX Design
- High Fives, AI, and Connecting the Dots: MailChimp’s VP of Design on What Business can Learn from Design
- Rands Information Practises
- The Race to a Trillion
- What Elon Musk Should Learn From the Thailand Cave Rescue
- Cheap Shower Curtains
- Tech Sector Values are Broken?
-
June, 2018
- Confirmation Bias in Design
- Rise of the machines: has technology evolved beyond our control?
- Good product writing is conversational
- Retail is Not Dying, But it Has to Evolve
- The Netflix Binge Factory
- We are all trapped in the “Feed”
- Stop “feeding” your users
- Turn off your push notifications. All of them.
- From the Drawing Board to the Board Room
- Think inclusively at every step
- No classes, no professors: the alternative to business school
- Designer Ethics & The Moral Implications of our Apps
- Conversion optimization with A/B tests
-
May, 2018
- AI Ethics - A New Skill for UX-Designers
- Netlify now shows your deploy status on its favicon
- Let them eat cake
- Netflix Culture
- Skype
- How do you learn UX?
- The New Google Assistant
- What Happened to Apple’s Whimsy?
- Who would you trust more with your data, Apple or the government?
- Unfoundered
- Microcontent: A Few Small Words Have a Mega Impact on Business
- Twitter logged all user’s passwords in plain text
- Requests for Personal Data From Apple, Google, and Facebook Compared
- What’s in a pattern name
- GDPR is ruining my life
-
April, 2018
- A Modest Guide to Productivity
- Google Debuts a Standalone To-Do App, Google Tasks
- Apple Should Make an Instagram Clone
- Vanity Metrics
- Tech is not Neutral
- Facebook to exclude North American users from some privacy enhancements
- Netflix has to "produce great content, market it well, serve it up beautifully."
- Sen. Blumenthal: “Your business model is to maximize profit over privacy.”
- Productivity
- My #1 Piece of Advice to Freelancers: Lean Into The Moment
- Design Systems: Better UX through Defined Standards
- Tim Cook - We care about the user experience
- Europe’s tough new data-protection law
- The Real Technology Problem
- Why Small Teams Win
- Whose risk?
- Phone Bored
- Karim Rashid
- Creative Class is open
- Dieter Rams
- Being cash-free puts us at risk of attack: Swedes turn against cashlessness
- What’s a ‘User Experience’ Anyways?
-
March, 2018
- Fake News is spam
- Bleeding Out
- How Tech Giants Design For Transgender Users–Or Don’t
- Don't use the F word (freelancer)
- Dropbox
- Conversational Design
- Everyone Is Going Through Something
- It Doesn’t Have to Be Crazy at Work
- Flight Crews Don’t Decide Where To Fly
- New Tools Don’t Always Equal Productivity
- The seat at the table
- Why Can Everyone Spot Fake News But YouTube, Facebook And Google?
- Cuba
- Bye bye Facebook
- Why I hate your fake redesign
- Givenchy
- Diversity in the design industry
- Your competitors don’t matter
- Apple’s "Sound on the Go" Strategy
- The Most Important Design Skill For An AI-Dominated World
- Love letters to trees
- Amazon has a fix for Alexa’s creepy laughs
- You have to make sure that you’re focused on the thing that matters.
- Voice Input is the Next Big Thing - Or is It?
-
February, 2018
- Specialize
- Pricing Philisophy
- AMP for email is a terrible idea
- Is this Finnish school the perfect design?
- The #1 reason Facebook won’t ever change
- A Year of Learning and Leading UX at Google
- C.A.R.E - A simple framework for user onboarding
- Inside Facebook´s Hellish Two Years
- A better user experience...or?
- Personas
- Reflections on working on an iPad
- Everything Easy is Hard Again
- How to succeed at freelancing
- The iPhone X is Apple’s underrated masterpiece
- Make me think
-
January, 2018
-
December, 2017
-
November, 2017
-
October, 2017
-
September, 2017
-
August, 2017
-
July, 2017
-
June, 2017
- The Why before the Why
- No Share Buttons on Mobile Sites
- Groundwork for Creating Great User Experiences
- ARKit
- 4 Reasons Why Your Body Text Should be Bigger
- Now that Apple is talking about AR and VR, should we be too?
- Think like an artist to create better designs
- Investing in businesses and products
- 10 Reasons Why All Designers Should Start Writing More
- Become a better UX-designer with these three words
- Vox Media Accessibility Guidelines
- Writing for UX: some practical tips
-
May, 2017
-
April, 2017
-
March, 2017
-
February, 2017
-
January, 2017
-
December, 2016
-
November, 2016
-
October, 2016
-
September, 2016
-
August, 2016
-
July, 2016
-
June, 2016
-
May, 2016
-
April, 2016
-
March, 2016
-
February, 2016
-
January, 2016
-
December, 2015
-
November, 2015
-
October, 2015
-
September, 2015
-
August, 2015
-
July, 2015
-
June, 2015
-
May, 2015
-
April, 2015
-
November, 2014
-
April, 2013