The Teleological Fallacy: Why Planning Gets Innovation Wrong
We write the history of innovation backward.
After the iPhone succeeded, we tell the story: "Apple identified the smartphone market and created a revolutionary product." Clean, linear, intentional.
The actual history: Steve Jobs had intuitions about design and technology. Apple experimented with products. Some failed. Some worked. The iPhone emerged from this process, not from a market analysis that said "this is what consumers need."
But the backward narrative makes it sound like success came from planning.
This is the teleological fallacy: the belief that successful outcomes resulted from intelligent forward planning, when actually they resulted from trial-and-error, luck, and emergence.
Why We Write History Backward
After-the-fact, successful outcomes seem inevitable. We fill in the narrative.
"Of course the iPhone was a success. Jobs was a genius. He saw what consumers needed before they did."
But before the iPhone, market research said consumers wanted physical keyboards. Consumers didn't know they wanted touch screens because touch screens didn't exist yet.
Jobs didn't see the future. Jobs built something, the market responded, and afterward we narrate it as if it was planned all along.
This narrative bias is powerful. It makes us think the world is more predictable than it is. It makes us think planning is more effective than it is.
The Research Example
Academic research funding often requires researchers to specify in advance what they expect to discover.
"What hypothesis are you testing? What outcomes do you predict? How will you measure success?"
This sounds sensible. It's actually the teleological fallacy baked into the funding process.
Real innovation often comes from: noticing something unexpected, following the surprise, discovering something useful that wasn't the original objective.
Penicillin wasn't discovered by researchers who planned to discover antibiotics. It was discovered by Fleming noticing a contaminated petri dish, following the surprise, and finding something unexpectedly useful.
But the funding process demands a plan. So the grants go to researchers who plan to confirm hypotheses, not to researchers who tinkering and notice surprises.
We systematically fund the hypothesis-confirmation process and not the discovery process. Then we're surprised that most university research produces incremental papers rather than breakthrough discoveries.
The Market Research Trap
Companies spend millions on market research: focus groups, surveys, demographic analysis.
"What do customers want?"
The answer is always: they want a better version of what already exists. Consumers can articulate preferences for things they've already experienced.
They cannot articulate preferences for things that don't exist yet. When asked about a touchscreen phone without physical keys, they said: "No, I want keys."
Companies that follow market research get correct answers to the wrong questions. They build what consumers say they want, which is an improved version of what exists.
The innovators don't ask the market what it wants. They build something unexpected. Sometimes it fails. Sometimes the market adopts it.
Backward, this looks like: "We identified the market opportunity." Forward, it looked like: "We're building something odd and hoping it works."
The Startup Narrative
The classic startup narrative: Founder saw a problem, built a solution, grew the company.
The actual narrative often: Founder built something, it wasn't what they intended, customers used it for something unexpected, they pivoted to the actual use case, and that's what scaled.
Instagram: started as Burbn, a check-in app. The photo feature was a side feature. Users only cared about the photos. The founders noticed this and pivoted. Instagram became a photo app.
This wasn't the plan. This was noticing what actually worked and adapting to it.
But the backward narrative: "The founders identified the photo-sharing market opportunity and created Instagram." Sounds planned.
The Danger
The danger of the teleological fallacy is that it makes us think we can predict innovation.
If success comes from planning, we should systematically identify opportunities and fund them. But success doesn't come from planning. It comes from exploration, surprise, and adaptation.
By believing the backward narrative, we fund planning-based innovation (which rarely works) and discourage exploration-based innovation (which actually works).
Real Innovation Process
What does actual innovation look like?
- Someone has an obsession or notices a frustration
- They tinker with solutions
- Most solutions fail
- One solution sort of works
- They refine it based on feedback
- Slowly, it becomes something useful
- Backward, we narrate it as planned all along
This process is messy, unpredictable, and can't be planned. But it's how actual innovation works.
The planning process is: identify opportunity → allocate capital → execute → measure. It's professional and measurable. It's also mostly wrong about what will work.
Breaking the Pattern
How do you avoid the teleological fallacy?
First: Recognize that backward narratives are biased. The success story doesn't tell you why it actually happened.
Second: Study failures more than successes. Failures reveal what doesn't work. Successes might just be luck.
Third: Support exploration and tinkering, not just planning. Give resources to people to explore dead ends. Not all of them will work, but the ones that do will come from exploration, not planning.
Fourth: Be suspicious of business plans. Markets change. Plans don't. The best companies adapt as they learn, not execute a pre-set plan.