The Broken Binoculars: Why Market Research Misleads CRO Strategy
Most CRO programmes start with asking customers what they want. Surveys. Focus groups. User testing sessions where participants narrate their experience. The assumption is that customers can tell you what would make them convert.
They cannot.
People do not think what they feel, say what they think, or do what they say
EDavid Ogilvy identified this problem decades ago: the trouble with market research is that people do not think what they feel, they do not say what they think, and they do not do what they say. This is not dishonesty. It is the fundamental nature of human cognition.
Rory Sutherland extends this insight. People simply do not have introspective access to their motivations. When asked why they abandoned a checkout, they will give you a reason. That reason might be 'shipping was too expensive' or 'I wanted to compare prices'. These are plausible rationalisations, not actual causes.
The actual cause might be that the checkout felt unfamiliar. Or that lack of payment options created uncertainty. Or that the absence of social proof triggered doubt. The customer does not know this. They cannot tell you. Asking them produces confident answers that are confidently wrong.
.png)
Why asking customers what they want produces unreliable answers
Lets talk about a Rory Sutherland example. Consider the penguin nightlight versus the £1,000 energy prize. Customers entered a draw for free energy worth over £1,000 at a rate of 67,000 entries. The same customers entered a draw for a £15 penguin nightlight at a rate of 360,000 entries. One customer turned down a £200 bill refund, preferring the penguin.
sk those customers why they preferred the penguin and they could not tell you. The rational mind cannot access the emotional calculation. An evolutionary psychologist might suggest that a penguin nightlight for one's child activates different emotional circuits than a cash reward for oneself. But the customer experiences this as 'I just liked the penguin better'.
CRO programmes built on customer feedback inherit this blindness. They optimise for what customers say they want rather than what actually drives behaviour. This is why so many programmes fail: they are solving the stated problem rather than the real problem.
Observing behaviour versus accepting stated preference
Effective CRO starts with behaviour, not stated preference. What do visitors actually do? Where do they actually drop off? What patterns emerge in the data that visitors themselves would never articulate?
Session recordings reveal hesitation that surveys miss. Heatmaps show attention patterns that users cannot describe. Funnel analysis exposes drop offs that customers rationalise away when asked.
This does not mean qualitative research is worthless. It means qualitative research must be interpreted through understanding of behavioural psychology rather than accepted at face value. When a customer says shipping was too expensive, the question becomes: what made shipping feel expensive? Was it comparison to a competitor? Unexpected addition at checkout? Lack of context for the value received?
The 'real why' often differs from the 'official why'. CRO programmes that acknowledge this distinction succeed where programmes that take customer feedback literally fail.
Removing the Last Reason to Say No
The most useful framing for CRO is not 'how do we persuade more people to buy' but 'how do we remove reasons not to buy'. The distinction matters because it shifts focus from adding persuasion to reducing friction.
Visitors who reach your checkout have already decided they want your product. They have navigated to your site, found a product, added it to cart, and begun checkout. The sale is theirs to complete. Your job is not to persuade them further. Your job is to avoid giving them reasons to stop.
This reframing explains why small changes can have disproportionate impact. A confusing form field does not just add friction. It creates a moment of uncertainty that triggers reconsideration of the entire purchase. The visitor was not weighing form complexity against product value. They were on autopilot until something disrupted the flow.
The most effective CRO programmes identify these disruption points and eliminate them. They do not add more reasons to buy. They remove the last reasons not to.
The Psychology of Friction: What Behavioural Science Teaches Us About Conversion
Behavioural science provides frameworks for understanding why friction affects conversion. These frameworks transform CRO from guesswork to systematic improvement.
Loss aversion: why a 1% chance of nightmare dwarfs a 99% chance of gain
Daniel Kahneman and Amos Tversky demonstrated that humans weight potential losses more heavily than equivalent gains. The pain of losing £100 is psychologically greater than the pleasure of gaining £100. This asymmetry affects every conversion decision.
A 1% chance of a nightmarish experience dwarfs a 99% chance of a 5% gain. This explains why customers struggle to switch banks even when offered higher interest rates. It explains why people resist changing broadband providers. It explains why visitors abandon checkouts at the first sign of unfamiliarity.
Men ordering cocktails at bars exhibit the same psychology. They avoid ordering cocktails when uncertain what glass the drink will arrive in. The small possibility that it arrives in a hollowed out pineapple is enough to make them order beer instead. The potential embarrassment outweighs the potential enjoyment.
For CRO, loss aversion means reducing uncertainty matters more than increasing appeal. A checkout that feels risky will underperform a checkout that feels safe, regardless of how compelling the product or price.
.png)
Uncertainty as the hidden conversion killer
Consider the flight departure board. 'BA 786 Frankfurt DELAYED' creates more distress than 'BA 786 Frankfurt DELAYED 70 minutes'. The second message is worse news objectively. But the first message creates uncertainty that the second resolves. This is one of Rory Sutherland’s best analogies.
The passenger facing a 70 minute delay can make phone calls, get a coffee, adjust plans. The passenger facing unknown delay is trapped in uncertainty. They do not say 'I am unhappy because inadequate information has left me powerless'. They say 'I am angry because my plane is late'. But the anger is about powerlessness, not lateness.
Ecommerce creates countless moments of uncertainty. Will this fit? When will it arrive? What if I do not like it? What if there is a problem with delivery? What if my card is declined? Each uncertainty is a potential conversion killer.
Effective CRO systematically identifies and resolves these uncertainties. Size guides that actually help. Delivery estimates that are specific. Return policies that are prominent and clear. Payment security that is visible. Progress indicators that show where you are in checkout. Each resolution removes a reason to hesitate.
Social proof that works versus social proof that backfires
Robert Cialdini identified social proof as one of the fundamental principles of influence. We look to what others do to determine what we should do. This makes testimonials, reviews, and popularity indicators powerful conversion tools.
But social proof can backfire. Research shows that revealing minority behaviour can increase that behaviour. Telling people that most visitors do not convert may normalise not converting. Showing low review counts may signal unpopularity. Empty 'people are viewing this' notifications may reveal they are fabricated.
Effective social proof requires attention to what it actually communicates. A single five star review is not social proof. It might even be negative proof, suggesting nobody else has purchased. Hundreds of four star reviews signal genuine popularity and realistic expectations. The implementation details determine whether social proof helps or hurts.
Timing matters too. Social proof early in the journey helps discovery. Social proof at checkout helps final decision. Excessive social proof throughout the journey creates noise that dilutes impact.
Building a Testing Programme That Compounds Gains
CRO is not a project. It is a programme. One off audits and improvements deliver one off gains. Ongoing testing programmes compound improvements over time.
A testing programme that delivers 2% conversion improvement per quarter compounds to over 8% annual improvement. Run that for three years and you have more than doubled your baseline conversion rate. The mathematics of compounding makes sustained testing programmes dramatically more valuable than isolated improvements.
The structure of effective testing programmes matters. Hypothesis development should be grounded in behavioural insight rather than random ideas. Test design must ensure statistical validity. Implementation requires technical precision. Analysis must distinguish genuine improvement from noise.
Most importantly, effective programmes capture learning. A test that fails to improve conversion but reveals why visitors hesitate creates value. That learning informs the next hypothesis. Over time, the organisation develops deep understanding of its customers that competitors cannot replicate.This learning compounds alongside the conversion gains. Year one testing is largely exploratory. By year three, testing is informed by accumulated insight that dramatically improves hit rate. The programme gets better at improving conversion as it accumulates knowledge.
Scientific rigour matters throughout. Only validated improvements get implemented. This prevents the common failure mode of implementing changes that 'feel right' without evidence, then wondering why conversion did not improve. Discipline in testing creates confidence in results.
Where to Start: The Highest Impact CRO Opportunities
Not all CRO opportunities are equal. Some pages and elements disproportionately affect overall conversion. Starting with these high impact areas accelerates results.
Checkout is almost always the highest priority. Visitors who reach checkout have demonstrated clear purchase intent. Every checkout abandonment is a sale lost. Small improvements here directly impact revenue in ways that homepage changes rarely match.
Product pages are the second priority for ecommerce. This is where purchase decisions are made. Information architecture, imagery, trust signals, and calls to action all influence whether visitors add to cart.
Landing pages for paid traffic deserve dedicated attention. These pages receive traffic you are paying for. Improving their conversion directly improves return on advertising spend. A landing page that converts 20% better effectively reduces your cost per acquisition by 20%.
Forms warrant specific focus. Every form field is potential friction. Form optimisation often delivers surprisingly large gains because forms create the uncertainty and effort that loss aversion makes disproportionately painful.
Mobile experience requires separate attention. Mobile conversion typically lags desktop. Mobile users have less patience, smaller screens, and different contexts. What works on desktop often fails on mobile. Mobile optimisation often reveals the largest gaps between current performance and potential.
Begin with audit. Understand current performance, identify drop off points, and quantify opportunity. Then prioritise based on impact and effort. Quick wins build momentum. Strategic improvements build sustainable advantage. The combination creates programmes that deliver both immediate results and long term value.
.png)
.png)





.png)