The Virtue of Restraint
Updated: 7 minutes ago
What Would a Technologically Mature Civilization Look Like?
Find Part One <here>
Find Part Two <here>
In the first part of this Thought Project, I asked whether humanity might eventually reach a point where technological capability begins to exceed our ability to responsibly manage it.
In the second, I arrived at a more difficult problem. Pandora's Box is already open. We cannot undiscover what we have learned, and increasingly powerful technological capabilities may become available to progressively smaller groups of people.
That leaves us with a question that may be much older than technology itself: what ultimately restrains a human being who possesses the power to do something?
Law? Fear of consequences? Professional ethics? Religion? Culture? Conscience? Character?
Probably some combination of all of them. But I increasingly suspect that a technologically mature civilization would require something that cannot simply be written into a regulation.
It would require virtue.
You Cannot Legislate Morality
There is an old political expression that you cannot legislate morality. The phrase has appeared in various forms throughout American political history. Whatever its origins, the underlying argument is familiar: government can regulate what people do, but it cannot necessarily determine what people believe to be right or wrong.
Martin Luther King Jr. addressed precisely this argument during the civil-rights movement. King acknowledged the limitation but rejected the conclusion that law was therefore unimportant. In one formulation, he observed that while morality may not be legislated, behavior can be regulated — the law can't make a man love me, he said, but it can keep him from lynching me, and that is pretty important.
King was speaking about civil rights, of course, not technological development, and I don't want to remove his words from that historical context. But the distinction he drew is useful.
Law can regulate behavior without necessarily creating virtue. A law can prohibit an experiment. A regulation can establish safety requirements. A treaty can restrict a weapon. A court can impose liability. A government can restrict access to dangerous materials. All of those things may be necessary.
But none of them can manufacture wisdom. A regulation cannot make a scientist humble. A statute cannot make an entrepreneur care about consequences that may occur decades after a product is released. A treaty cannot eliminate ambition between nations. A licensing requirement cannot create character.
Law can establish boundaries. But something else influences what people choose to do when those boundaries are unclear, when enforcement is impossible — or when no one is watching.
When No One Is Watching
There is another familiar expression, often attributed to legendary UCLA basketball coach John Wooden: "The true test of a man's character is what he does when no one is watching."
The attribution to Wooden is widespread, although the precise origin of the saying matters less to me than the idea behind it.
What happens when no one is watching? That may become an increasingly important question in a technologically powerful civilization.
What happens when the law hasn't caught up with the technology? What happens when the technology is so new that society hasn't even decided what the rules should be? What happens inside a private laboratory? What happens when a powerful capability exists on an ordinary computer? What happens when enforcement is practically impossible — and the person holding the capability knows perfectly well that no one else will ever find out?
At that point, regulation has reached its limit. The final safeguard may simply be the character of the person making the decision.
A researcher might think: I could conduct this experiment. A programmer: I could build this system. An executive: I could release this product. A government: We could deploy this capability.
And perhaps the most important question comes next: should I?
Or even: I could. No one may be able to stop me. But I won't.
That is something different from compliance. That is restraint.
Obedient to the Unenforceable
King used another phrase that may be even more relevant to this thought project.
Speaking at Southern Methodist University in 1966, King said that if the problem of racial injustice was ever to be solved, every person would eventually have to "rise to the majestic heights of being obedient to the unenforceable."
That phrase wasn't original to King. It was coined more than forty years earlier by the British judge Lord Moulton, in a 1924 essay describing three domains of human action. The first is Positive Law: what we must do because it is legally required. The second is Free Choice: what we may do because no one has any claim on it at all. But between them, Moulton argued, lies a third domain, governed by neither law nor pure preference — the space in which a person does the right thing simply because no one is making them. He called that domain the domain of Obedience to the Unenforceable.
King, a preacher steeped in moral philosophy as much as theology, invoked the phrase deliberately. That lineage — an English judge coining the term, an American civil-rights leader reaching for it four decades later to describe what justice would ultimately require — is part of why it has stayed with me.
Civilization contains countless things that cannot realistically be enforced at every moment. Successful societies therefore develop norms. Some come from religion. Some from philosophy. Some from family and community. Some become professional ethics. Some arise from custom, reputation, honor, shame, duty, or conscience. Some eventually become law.
Not all of those norms have been good — history contains plenty of cultural expectations that were unjust, discriminatory, or destructive. Tradition alone does not make something virtuous. But the underlying mechanism matters: human civilization has never survived through enforcement alone. It has also depended on people internalizing expectations about how they ought to behave.
Perhaps technological civilization eventually needs to develop something similar. Not merely technological laws. Technological virtues.
What Would a Technological Virtue Be?
We normally think of virtue in terms of qualities such as honesty, courage, justice, patience, humility, and temperance. Those qualities describe character rather than capability. Perhaps technological power introduces another dimension to them.
Consider humility. Technological humility might mean recognizing that our models are imperfect, our knowledge incomplete, and complex systems capable of behaving in ways we did not anticipate.
Consider responsibility. Technological responsibility might mean accepting that responsibility for an invention doesn't necessarily end when the invention works as intended.
Consider stewardship. Technological stewardship might require considering consequences for people, communities, future generations, and the natural world — rather than simply the immediate user or customer.
And then there's restraint: the willingness to possess a capability without assuming that possessing it creates an obligation, or a right, to exercise it.
That may be one of the most important technological virtues of all.
"I Can" Is Not "I May"
Modern technological culture understandably celebrates capability. We admire people who accomplish what others thought impossible — the scientist who discovers something, the engineer who builds something, the entrepreneur who brings something new to market, the explorer who goes farther, the programmer who makes something faster, the researcher who breaks through a limitation.
There is something deeply human about that impulse. Curiosity, imagination, and ambition have carried us from stone tools to spacecraft. I don't want humanity to lose that.
But perhaps technological maturity requires another idea to stand alongside it: possessing the ability to do something does not automatically create the justification for doing it.
There are really several questions.
Can I do it? That is largely a question of capability.
May I do it? That is often a question of law.
Should I do it? That is a question of judgment.
And sometimes there is a fourth: even if I can, may, and would personally benefit from doing it — should I nevertheless choose not to?
That is where restraint begins to look less like limitation and more like character.
The Old Virtue of Temperance
There is an old virtue that may provide a useful model: temperance.
Temperance doesn't require the absence of appetite, ambition, or opportunity. It means possessing them without being controlled by them.
Perhaps a technologically mature civilization would develop something analogous — call it technological temperance: the ability to possess technological power without feeling compelled to exercise every capability that power provides.
Technological temperance might mean delaying deployment until consequences are better understood. It might mean accepting additional testing when competitors are racing ahead. It might mean choosing a less powerful technology because it's more controllable. It might mean maintaining meaningful human involvement even when complete automation is possible. It might mean abandoning a profitable opportunity. It might mean a scientist ending promising research because the potential consequences can no longer be responsibly contained.
Sometimes restraint would mean not yet. Sometimes, not this way. And occasionally, no.
None of those answers necessarily represents failure. Perhaps sometimes they represent maturity.
Restraint Is Not Fear
This distinction matters because the argument can easily go too far.
A civilization obsessed with avoiding technological risk could become stagnant. Or worse, authoritarian. Throughout history, people in authority have claimed that certain ideas were too dangerous to discuss, certain knowledge too dangerous to possess, and certain questions too dangerous to ask. A Technological Reformation that gave some central authority unlimited power to determine what humanity was permitted to discover might create dangers as serious as those it attempted to prevent.
There will always be risks in discovery. There will always be unintended consequences. And humanity will sometimes make mistakes. If eliminating risk becomes the goal, technological progress becomes impossible. That is not what I am proposing.
Technological restraint should not mean fear of discovery. It should mean proportionality between power and responsibility.
A technology whose failure is local and reversible shouldn't necessarily face the same scrutiny as one whose failure could affect millions of people, or alter something that can't be restored. Greater consequence should invite greater care. Greater irreversibility should invite greater humility. Greater power should carry greater responsibility.
That is not opposition to progress. It may be what allows progress to continue safely.
We Already Expect This of People With Power
None of this is entirely new. Civilization already expects certain professions to exercise powers they possess responsibly.
Physicians possess knowledge that can harm as well as heal. Engineers make decisions affecting public health and safety. Attorneys hold confidential information and exercise specialized powers within the legal system. Military officers may control weapons capable of extraordinary destruction. Scientists work with hazardous materials and organisms.
We don't rely exclusively on criminal law to govern those professions. We also expect professional ethics. In other words, we already accept the principle that specialized capability creates specialized responsibility.
Perhaps the difference in the future is that specialized capability becomes less specialized. Artificial intelligence already allows people to perform tasks that once required significant training. Computing power that once belonged only to governments and universities is commonplace. Other technologies may follow the same trajectory.
If increasingly consequential capabilities become broadly available, technological ethics can no longer belong only to scientists and engineers. Perhaps technological responsibility eventually becomes part of ordinary citizenship.
Could Restraint Become Admirable?
This may require changing what technological culture celebrates.
Today we celebrate firsts. First to discover. First to market. First to achieve. First to cross some technological threshold.
Imagine also celebrating something very different. A research team discovers an extraordinary capability and concludes that pursuing it further presents risks they cannot responsibly justify — and society respects them for stopping. A company develops a revolutionary product but delays its release because its wider consequences remain poorly understood — and investors don't automatically punish the decision. A nation develops a powerful new capability and deliberately limits its use because deploying it would destabilize everyone else. A scientist becomes respected not only for what she discovered, but for recognizing the limits of what should be done with the discovery.
Could restraint become admirable? Could walking away from technological power sometimes carry the same prestige as acquiring it?
If so, that would represent a profound cultural change.
Perhaps Reformation Begins With Culture
And perhaps this is how something resembling a Technological Reformation would actually occur.
Not with a single law. Not with a treaty signed on a particular day. Not with a declaration announcing that humanity has entered a new technological era.
Perhaps it happens gradually. The language changes. Education changes. Professional ethics change. Expectations change. Universities ask different questions. Scientists develop stronger norms around consequential research. Investors begin considering risks that extend beyond the next quarter. Consumers become somewhat less impressed by technological novelty merely because it's new. Religious traditions, philosophers, and ethicists wrestle more seriously with technological power. Parents teach their children not merely how to use technology, but what responsibilities accompany its use.
Eventually some of these cultural expectations become laws. And perhaps law, in turn, reinforces some of the cultural expectations. The relationship would likely move in both directions.
But underneath it all would be a fairly simple idea: technological capability carries moral responsibility.
There Will Never Be Complete Agreement
Of course, humanity will never agree perfectly about what responsible technological behavior means. We don't agree perfectly about morality now.
Different cultures will emphasize different values. Scientists will disagree about acceptable risk. Nations will pursue different interests. Corporations will compete. Religious and philosophical traditions will reach different conclusions. One person's prudent restraint may look like unnecessary obstruction to another.
That may mean a Technological Reformation could never consist simply of a universal list of technologies humanity agrees not to pursue. Perhaps it would instead involve broader principles for approaching technological power: humility, responsibility, proportionality, stewardship, respect for human dignity, consideration of future generations, recognition of environmental consequences, acceptance of uncertainty, and restraint when potential consequences greatly exceed our ability to control them.
Those principles would not eliminate disagreement. But perhaps they would change the nature of the disagreement. Instead of debating only what technology makes possible, we would also debate what responsible people ought to do with that possibility.
Powerful Is Not the Same as Mature
When I began thinking about the future technology of Horizon Lost, I instinctively imagined technological maturity in terms of capability. A mature civilization would have extraordinary machines. Advanced medicine. Artificial intelligence. Abundant energy. Spaceflight. Sophisticated infrastructure.
Perhaps all of those things will be true. But I now think that definition may be incomplete.
A civilization possessing extraordinary technological power but incapable of exercising restraint may not be technologically mature at all. It may simply be technologically powerful. Those are not the same thing.
Perhaps technological maturity should also be measured by whether a civilization can possess enormous capability without being compelled to exercise all of it. Can it tolerate uncertainty? Can it think beyond immediate advantage? Can it consider people who have not yet been born? Can it recognize when consequences may be irreversible? Can it voluntarily accept limits? Can an individual with extraordinary capability choose restraint when nobody else would ever know?
Can humanity become, in the phrase King made his own, "obedient to the unenforceable"?
The Next Measure of Progress
For most of human history, progress has meant overcoming limitations. We learned to travel farther. Build higher. Communicate faster. Live longer. Produce more. Harness greater energy. Manipulate matter. Manipulate life. And perhaps now, create forms of intelligence unlike our own.
There is something magnificent about that story. I hope it continues.
But perhaps the next stage of technological civilization requires us to add another measure of progress. Not merely what have we become capable of doing? But: what have we become wise enough to do — and wise enough not to do?
Maybe that is what technological maturity ultimately looks like. Not a civilization afraid of discovery. Not a civilization governed by technological prohibition. Not humanity retreating from progress. But human beings capable of possessing extraordinary power while understanding that power does not automatically justify its use.
The test may come precisely when the law cannot reach us, when the regulation has not yet been written, when the opportunity is irresistible — and when no one is watching.
Perhaps the Technological Reformation, if anything resembling it ever occurs, will ultimately be less about controlling our machines than about the character of the people who possess them.
And perhaps one of the clearest signs that technological civilization has matured will be something remarkably simple: restraint in the possession of power will no longer be regarded as a failure of progress. It will be recognized as evidence of our capacity to handle it.
~ Eric
Comments