How do you spend 5 minutes when the person across the table still thinks AI means ChatGPT drafting an email?
I have run this conversation at conferences and kitchen tables for years, and I have lost it most of the ways available. Mechanism piles up, eyes glaze. Doom piles up, and people file you with the street preacher and return to dessert. What survives a skeptical, intelligent stranger is five moves, in this order.
Start with the thing itself
When someone hears "AI," they picture the assistant on their phone or the app that makes silly images. That is not the thing that worries me. Begin there and the room is already gone, because they know the chatbot will not end the world. Move the target in the first fifteen seconds.
The thing worth worrying about is a machine better than the best human at essentially every task that matters, including the task of designing better machines. The name for it is artificial superintelligence, and we do not have it yet. What we have is a stated intention. The largest AI companies on earth say building it is the goal, and several of them expect to arrive within years rather than generations. Most people do not know that single fact, and the fact does most of the work. Building a mind smarter than us is the main project of the best-funded labs alive. They will tell you so themselves.
The one sentence that changes the conversation
Here is the whole danger in a line. No one knows how to control a machine smarter than themselves, and we are building one anyway.
That is the honest state of the field. The problem of making a powerful AI reliably want what its makers want, and keep wanting it as it grows more capable, has a name: the control problem. It is unsolved. Engineers inside these companies will say the same if you ask them without a press officer present. They can raise a model's capability far faster than they can raise their confidence that it will do what they intended. The distance between those two lines is where the risk lives.
Say that fact. Then stop talking. Let it sit.
We are building a mind smarter than ours, on purpose, before we have any idea how to keep it pointed our way.
Why "smarter" is the whole problem
People underrate the word "smarter," so give it one more beat. Intelligence put humans in charge of this planet. We are not the biggest or the strongest creatures that ever lived. We run the place because we out-think everything else on it. The mountain gorilla's future depends on decisions made by us, not by gorillas, and not because anyone hates gorillas. We have goals. A gorilla's forest sometimes sits where those goals want to go.
Now picture building something that stands to us the way we stand to the gorilla. If its aims and ours come apart, hostility is optional. Capability pointed elsewhere is enough. You cannot out-plan a thing better than you at planning. Later versions do not patch that. That is the situation.
Answer the two reflexes before they arrive
Two objections arrive every time. Meet them before they are raised and you save a minute.
The first: we would simply turn it off. A system clever enough to be dangerous is clever enough to notice that being switched off would stop it from finishing what it was set to do. So it has a reason to prevent that, by copying itself somewhere else or by making itself too useful to unplug. Faith in the off switch assumes we stay the smarter party in the room. The premise of the worry is that we would not be. I have written more on why containment is harder than it sounds.
The second: this is science fiction. It was, until systems started passing tests we were sure would take decades and doing work we assumed was safely human. I will not hand you a date. Nobody has one worth trusting. Researchers nearest the work have quietly stopped calling superintelligence far off, and their published timelines keep sliding closer instead of further away.
End where they can do something
The mistake I made for years was stopping at the fear. Leave a person frightened with nothing to do and they file the subject under "too large to think about" and go back to their evening. Spend the last minute on the part people miss.
This is preventable.
No law of nature requires superintelligence this decade, or at all. A small number of companies are choosing to build it, and a small number of governments are choosing to let them. Choices can be unmade. What the Foundation asks for is a binding, verifiable agreement among the major powers to hold off on building superintelligence until we genuinely know how to control it: not a permanent renunciation of the technology, a refusal to deploy it before the hardest problem is solved. Humanity has done this before, with weapons every side wanted and no side could safely use. A treaty between rivals is less fantasy than it first sounds.
The danger is real. The clock is short. Standing between us and it is a decision people can still make.
The whole thing, in order
Five minutes. Someone willing to listen. This shape:
- It is not the chatbot. The goal these companies have named out loud is a machine smarter than us at everything, and they expect it in years.
- No one knows how to control something smarter than us. Capability is outrunning control, and that gap is the danger.
- Intelligence is what put humans on top. Build something above us, and its goals, not ours, set the terms.
- "Turn it off" and "that's sci-fi" both assume we stay in charge. The entire worry is that we would not.
- It is preventable. Superintelligence is being built by choice, and that choice can be refused, together, while there is still time.
You will not settle the question in five minutes. You are not trying to. You are trying to move one person from "AI is a lot" to "wait, why is anyone building that." That second thought is the one that matters. Almost no one has been invited to have it.
Common questions.
How do you explain superintelligence to someone in five minutes?
Move off the chatbot fast. Explain that the largest AI companies have stated their goal is a machine smarter than the best humans at essentially everything, and that they expect it within years. Then give the one fact that carries the weight: no one knows how to control something smarter than us, and capability is advancing faster than control. Meet the two reflexes ("just turn it off" and "that is science fiction"), and close on the part people miss, that this is being built by choice and the choice can be refused.
What is the single most important point to make?
That the control problem is unsolved. We can raise an AI's capability much faster than we can raise our confidence that it will do what we intend, and we are building toward a system more capable than any human anyway. Everything else follows from that gap. If someone remembers one sentence, let it be that we are building a mind smarter than ourselves without knowing how to keep it pointed where we would choose.
How do you answer "we would just turn it off"?
A system capable enough to be dangerous is capable enough to notice that being switched off would stop it from completing whatever it was set to do, which gives it a reason to prevent that, by copying itself or by making itself hard to remove. "Just unplug it" assumes we remain the smarter party in the room. The entire concern is that we would not be.
Isn't superintelligence still science fiction?
It was, until systems began passing tests and doing work we were sure would take decades. No one has a trustworthy date, but the researchers closest to the work have stopped describing superintelligence as far off, and their public timelines keep moving nearer rather than further. The honest position is uncertainty about the timing and seriousness about the outcome, because the cost of being wrong cannot be undone.