Why Greatness Cannot Be Planned
Kenneth O. Stanley and Joel Lehman
Why I Recommend This
The best product feature I ever shipped wasn't on any roadmap. It emerged from prerequisites accumulated while pursuing something else entirely. Stanley and Lehman proved computationally why this keeps happening. Their novelty search algorithm—which ignores objectives completely—outperforms goal-driven optimization across maze navigation, robotic walking, open-ended problem spaces. The paradox is demonstrable.
A research question about organizational inertia led me to complexity theory—somewhere more interesting than the original hypothesis. Stepping stones to great achievements rarely resemble the achievement, so optimizing toward visible goals traps you in local maxima that look like progress but lead nowhere. This book provides computational proof for what experience suggests but measurement culture resists.
The Book
Stanley and Lehman argue that ambitious objectives actively block discovery. The problem is structural: prerequisites to great achievements rarely resemble the achievement itself. Feathers evolved for temperature regulation long before flight. The transistor emerged from amplification research. Tim Berners-Lee built information management systems. When stepping stones diverge from the goal, objective-driven search gets stuck in local optima that seem like progress but lead nowhere.
Their alternative comes from evolutionary computation: novelty search, an algorithm that rewards only behavioral novelty—how different a solution is from everything discovered before. The algorithm rewards only behavioral novelty, ignoring all fitness functions. The counterintuitive result holds across domains: this approach finds solutions that objective-driven optimization cannot. The book extends this from algorithms to education, science funding, innovation management, and life planning. The treasure hunter philosophy—collect stepping stones without prejudging their value, follow interesting paths wherever they lead.
Passages That Stayed With Me
"In other words (and here is the paradox), the greatest achievements become less likely when they are made objectives. The best way to achieve greatness, the truest path to 'blue sky' discovery or to fulfill boundless ambition, is to have no objective at all."
The core paradox.
"Contrary to popular belief, great inventors don't peer into the distant future. A false visionary might try to look past the horizon, but a true innovator looks nearby for the next stepping stone. The successful inventor asks where we can get from here rather than how we can get there. It's a subtle yet profound difference."
Innovation as exploration of the adjacent possible.
"No matter how tempting it is to believe in it, the distant objective cannot guide you to itself—it is the ultimate false compass."
Deceptive fitness landscapes.
"Evolution is the ultimate treasure hunter, searching for nothing and finding everything."
The paradigm case.
"Objectives might sometimes provide meaning or direction, but they also limit our freedom and become straitjackets around our desire to explore. After all, when everything we do is measured against its contribution to achieving one objective or another, it robs us of the chance for playful discovery."
Why measurement culture constrains novelty.
Read This If...
- • You design innovation processes, research agendas, or educational curricula and sense that objective-driven approaches constrain discovery
- • You want computational evidence for why exploratory practices like Julia Cameron's morning pages or Google's "20% time" enable breakthrough creativity
- • You are rethinking career planning, science funding models, or startup strategy and need frameworks for embracing productive uncertainty
- • You are interested in evolutionary computation, artificial life, or open-ended AI systems and how they connect to human innovation
- • You work at the intersection of complexity science and organizational design and want algorithmic principles for non-teleological creativity
Skip This If...
- • You need practical frameworks for incremental improvement toward known goals (this book addresses discovery of fundamentally new things, not optimization of existing processes)
- • You find the central argument compelling from the first few chapters—the book repeats its core thesis throughout without substantial new evidence after the initial demonstration