AI/ML and Technology Strategist, Educator, NYJavaSIG Chair, Java Champion, Musician, Writer, Obnoxious Foodie, and very bad Fisherman. #STEAMnotSTEM#Diversity
Dario Amodei: My Fundamental view is that AI could become smarter than most humans at almost everything in just a few years.
“We’re increasingly close to what I’ve called a country of geniuses in a data center.”
“AI agents more capable than most humans at most things, coordinating at superhuman speed.”
“That level of capability is something the world has never seen before.”
“It could cure diseases, improve human health, and lift billions out of poverty.”
“But it also brings risks around misuse and economic displacement.”
We're used to thinking of open-source models as an unadulterated good. But in the case of AI, they can actually pose additional dangers, as @ReidHoffman and I got into at #CGI2026. I appreciated this nuanced discussion.
DARIO AMODEI, I genuinely do not understand this.
You go before the United Nations warning the world about what increasingly powerful AI could do to humanity, including the risks around biology, and calling for governments to regulate it.
Then, on the very same day, Anthropic announces its own biology research group and laboratory, using Claude to accelerate biological discovery.
How do you reconcile those two positions?
You are asking the world to put boundaries around this technology while your own company keeps pushing that same technology deeper into increasingly powerful areas.
Do the rules you are asking governments to create apply equally to Anthropic?
Because that is the part I cannot understand.
You cannot repeatedly tell the public, “This technology could become extraordinarily dangerous. We need rules, safeguards and oversight,” while simultaneously racing to expand what your own models can do.
And then when those systems discover something new, the answer cannot simply be: we found something interesting, and now we need to understand what it can do.
This is exactly why people are questioning the integrity of the message.
If the risks are as serious as you say they are, then the companies building these systems should be the first to demonstrate the restraint they are asking from everyone else.
Otherwise, people are going to ask the obvious question:
Are these rules meant to govern AI — or only everyone else’s AI?
err... no. Professor Hinton, like all inventors/engineers, likes to tout how his engineering was remarkable. btw, a kill switch is absurd. Either tax the companies or jail the execs when sh*t happens. That's more effective than a kill switch.
Nobel laureate Geoffrey Hinton says the proposed AI kill switch won't save us, and his reason is chilling:
"It will be able to persuade the people in charge of the switch not to pull the switch."
Sam Altman says humans could lose control of the future to AI at UN Security Council.
and that OpenAI has deliberately slowed AI development before and will do it again
"we could lose control of the future to AI. The risk is that it moves so fast that people can no longer follow what's happening or intervene when needed.
We have unilaterally slowed down in the past. We will do so in the future."
----
From "DRM News" YouTube channel, (full video link in comment)
It's perplexing to hear entrepreneurs welcome ASI.
Under ASI, where the machines vastly exceed us in all capacities, there will be no plausible conception of human achievement or merit. There will also be no reason to incentive human effort and intelligence through greater rewards. Thus there would be no reason for wealth inequality to be tolerated.
Why would the rich be allowed to keep all their money in an ASI context? Are they sure this is a future they want?
Many people think AI "safety" means humans remaining in charge. I hate to break it to you but that's not an option. In no future do humans keep running the show. AI safety means that the ASI acts in the best interest of humanity.
Yeah, OpenAI created the term for marketing purposes. Prompt engineering is not engineering. Engineering is solving a problem under a set of constraints. Prompt techniques are just that... tips and techniques.