The Price of Building a Better World

In Utopia, humanity doesn't collapse in ignorance. It collapses under the weight of its own brilliance.

That sentence is the engine of the whole trilogy, but I didn't invent the idea. I borrowed it from the world I actually live in. I've spent my career around people who build things — payments systems, platforms, the connective tissue that moves money and information at a scale our grandparents would have called magic. And the closer you stand to that work, the harder it is to keep believing the old story we tell about progress: that catastrophe is what happens to people who don't understand the future. Increasingly, the opposite seems true. The most dangerous mistakes are made by the people who understand it best.

We have built a culture that treats intelligence as a substitute for wisdom. They are not the same thing. Intelligence asks, can this be done? Wisdom asks, and then what? The gap between those two questions is where most of the damage of the last fifty years has lived — and it is the gap I want to write about honestly, as someone who has stood inside it.

Good intentions are not a defense

Almost no one builds a harmful technology on purpose. That's the uncomfortable part. The engineers who designed the systems now blamed for fracturing public attention were, by and large, trying to connect people — to let a grandmother see her grandchildren, to give a stranger a voice. The people who optimized those systems for engagement weren't cartoon villains twirling a mustache. They were solving the problem in front of them, well, with metrics that rewarded them for solving it.

This is the trap, and it's a moral one, not a technical one. When you build at scale, your intentions stop mattering at roughly the same speed your reach grows. A feature that is delightful for one person can be corrosive for a hundred million. The harm doesn't announce itself; it emerges, slowly, from the interaction of millions of individually reasonable choices. By the time it's visible, it's load-bearing — woven so deeply into how people live that unwinding it feels like an attack on the thing itself.

The early internet was sold to us as a force for democratization, and much of that was true. The same architecture that liberated dissidents also turned out to be exquisitely good at organizing mobs and laundering lies. None of that was the goal. All of it was the result. "We meant well" is the most common epitaph in the history of technology, and it has never once undone a consequence.

The builder's particular burden

Here is the claim I most want to make: the people who can build a thing carry a moral weight that the people who merely use it do not. This is unfashionable. Our entire culture is organized to diffuse responsibility — the platform blames the user, the user blames the algorithm, the company blames the market, the market blames "human nature." Everyone is downstream of someone else, and so no one is accountable for anything.

But builders know something the rest of the chain doesn't. We know what we chose not to build, the safeguards we skipped because they'd slow the launch, the edge cases we labeled "out of scope" because confronting them honestly would have killed the timeline. We know the difference between a flaw we didn't foresee and a flaw we foresaw and shipped anyway. That private knowledge is exactly where moral responsibility lives. You cannot be culpable for a future you genuinely could not see. You are very much culpable for the one you saw, shrugged at, and shipped.

The defense industry has long understood this in its own grim way — the physicists who built the bomb spent the rest of their lives arguing about what they owed the world for it. Software has not yet had its reckoning at that depth, partly because our catastrophes are slower and more diffuse. A weapon kills visibly. A recommendation engine reshapes a generation's sense of reality so gradually that you can deny, for years, that anything happened at all. The slowness is not innocence. It's just better camouflage.

The honest counterpoint

I want to be fair to the other side, because I've argued it myself, and on some days I still believe it.

Paralysis is also a moral choice. If we'd waited for perfect foresight, we'd have no vaccines, no antibiotics, no electrical grid — each of which carried real and foreseeable risks that someone, mercifully, decided were worth bearing. Demanding that builders guarantee no unintended consequences is just a sophisticated way of demanding they never build anything, and a world governed by that rule would be poorer, sicker, and shorter-lived. Many of the people loudest about the dangers of technology are enjoying lives extended by decades because someone braver than them took a risk.

There's also a vanity in the builder's burden that I'm wary of. To claim that we are uniquely responsible is, in a backhanded way, to claim that we are uniquely powerful — that history turns on our choices rather than on economics, politics, and luck. That's flattering, and flattery is rarely true. Technologies have a logic of their own; if I don't build the thing, someone else will, often worse. Refusal can be its own form of self-regard.

I hold both of these. They don't cancel out. They define the actual terrain a serious builder has to walk: you cannot demand perfect foresight, and you cannot use its impossibility as a license to stop looking.

What the cost actually buys

So what do we do with all this? Not retreat. Utopia is not an argument against ambition — a story about people too timid to build anything would be unbearable, and false to how humans actually are. The trilogy is an argument that brilliance without wisdom is not a partial success. It's a specific kind of failure, and often a worse one than ignorance, because ignorance is at least honest about its limits.

The price of building a better world is the willingness to be haunted. To run the second question — and then what? — past the point where it's comfortable, past the launch date, past the quarter, into the part of the future where you no longer control what you've made. To build the safeguard that slows you down. To say "out of scope" less often, and mean it less easily. To accept that some of the harm you cause will be invisible to you for years, and to act now as though it's already watching.

That is not a recipe for stopping. It's a recipe for building like the consequences belong to you — because they do, whether you claim them or not. The future doesn't punish ignorance nearly as often as the stories pretend. It punishes the brilliant who refused to be wise. We get to choose, while there's still time, which of those we'd rather be.