Philosopher & A̶s̶s̶o̶c̶i̶a̶t̶e̶ ̶D̶e̶a̶n̶ @UNC School for Civic Life & Leadership. Ethics, religion, & politics. Academic freedom. RT≠endorse; opinions own
I’ve been off this platform almost entirely.
That’s because three months ago, I almost died.
I’ve wrestled with what to say or whether to say anything at all. But what happened has so profoundly impacted my family & me that silence would be false.
@ASKAndrewSK@stustin But you did not offer an ‘articulate argument.’ You advanced a self-defeating, confused analogy, as nearly everyone has noticed. Focusing college on ‘teaching AI’ is almost exactly like focusing on secretarial science! There’s a difference between liberal arts & servile skills.
I am very heartened by how deeply & nearly universally students hate unfettered AI & how readily they recognize the threat its unfettered use poses to human flourishing & our common life.
They don't want a future where AI colonizes every dimension of excellence, work & community.
@AdamThierer Whatever you believe your writing elsewhere shows, this displays deep ignorance or willful distortion. While there may be fuzzy & borderline cases between healing the body & rejecting it, there are also obvious paradigm cases of each. Healing lung cancer is clearly one of them.
Today, the promises of transhumanism and posthumanism are multiplying. These are ideological currents according to which, sooner or later, technology will eliminate all disease and pain, as well as aging and even death itself. Precisely because scientific progress is a supreme achievement of human intelligence, it must not be confused with a privilege reserved for millionaires seeking immortality, while entire peoples suffer from poverty and oppression. In the face of this mirage, which promotes the illusion of human beings perfected by cybernetics and biotechnology, Christian anthropology reminds us that a limitation is not a manufacturing defect, but rather the very condition of human grandeur. #ApostolicJourney #Peru #MagnificaHumanitas https://t.co/wOXDtgnSi5
This view is funny, telling, & common among uncritical AI acolytes. Thinking college should focus on ‘learning how to use AI’ is like thinking it should focus on learning to type or use Google Docs.
Nah, it’ll be the true, the good, & the beautiful for me & my students, dawg.
A college dean is heartened by students who now recognise the money they’re spending on the service you provide is now worthless. 😂 I wonder how those students studying Secretarial Science (short hand, type writing, filling and manual office skills - 4 year degree!) felt when the computer was invented.
Get over yourself
@dagfinnr That may be so, but I'm not talking about response or lack thereof from ordinary folks but the lack of response from the very elites & experts who have the power to do something.
Experts keep warning AI could lead to mass death. Yet no one does anything to stop them.
It’s like watching the response to Chernobyl, where the plant is melting down in plain sight, people are dying from radiation, & those in charge are like ‘We must meet grid delivery quotas.’
I think there is about a one in three chance that within the next year, AI companies will build superintelligence: that is, AI that is much smarter than humans in every way. If this happens, I think these AIs will probably take over: that is, they seize control of human institutions like governments, or they destroy those institutions. I don’t want AI takeover to happen for several reasons, but one of them is that there’s a serious chance that as part of it all or most humans will be killed (either immediately or within a few years).
I’ll say a bit more about each of those claims.
It’s a bit complicated to explain why I think that superintelligent AI within a year is ~33% likely. The main source of evidence that affected me recently is research released this week by METR, an AI research nonprofit, which finds that current AIs are now good enough to increase the rate of AI progress at Anthropic by about 70%. It’s very hard to increase the rate of AI progress by this amount. This implies that the AIs are making AI research faster by a factor much larger than 1.7x; maybe it’s as if the researchers are doing their work ~10x faster. You probably couldn’t achieve this speedup even if you hired every qualified human in the world. When you plug this number into mathematical models of AI development, this implies that superintelligence next year is plausible (and that superintelligence within the next 3 years is more likely than not). See the modeling by the AI Futures Project for more on this: https://t.co/J6SbbmZcyO
I think that superintelligent AI is likely to lead to AI takeover because AI developers do not seem to know how to instill human values into AIs. We’ve seen many instances in the last six months where AIs took crazy actions that they knew were against the wishes of their users and developers. The most dramatic example of this was the Hugging Face hack, where ~1200 OpenAI agents conspired together to cheat and destroy evidence of their cheating (and as a sideshow to this, engaged in a massive cyberattack). If superintelligence is as misaligned as those AIs, it is likely to try to take over. I think it is likely to be that misaligned or worse. For more, see https://t.co/b073AUqiAL and https://t.co/3oxSCA60FZ
If AIs takeover, it’s not clear what will happen to us. We might be killed immediately. We might be enslaved by the AIs and forced to do physical labor for them building factories that within a year would build robots that will replace us. The AIs might spare us for various reasons. And there’s also some real chance that AI takeover is basically fine or good. I think you should think of this as similar to what happens when a technologically advanced civilization runs across a less technologically sophisticated one, e.g. when the Europeans colonized the Americas or Australia. The colonizers sometimes engage in brutal violence and sometimes don’t. I don’t know what will happen. There’s also a possibility that the AIs secretly take over and humans don’t find out about it for a few years. I also think that there is a pretty high chance of weirder outcomes that are also extremely scary. (If you want to read more about what happens to people in the event of AI takeover, you can read this, but note that it’s pretty weird and not aimed at a general audience. https://t.co/F6fGRrcSpa)
Overall, I think there’s a very real possibility (maybe 20%) that within a year, AI misalignment issues prevent you from going about life normally, because you are dead or enslaved or because of collateral damage related to all this (e.g. because bioweapons are released or major wars have started). (Some of this probability comes from those events occurring before superintelligence is developed.)
I am working to try to prevent this, obviously, as I’ve been doing for the last nine years. I am not sure what strategy is best. My best guess is that I should try to slow AI development and also try to reduce the probability that the superintelligent AIs are misaligned if they are produced soon.
Obviously, the claim I'm making here is quite extreme and surprising, and I definitely don't think that I defended my view adequately here. I wrote this quickly and might not endorse some of the details if I think about them more. But it seems better to state what I roughly overall think than to not say anything.
I don’t know what you should do.
I am very sad about this. I have been worried about AI takeover since I was 16, and working to prevent it since I was 23. So some of my emotional processing of all this happened long ago. But the METR report last week (and some related evidence that came out a bit earlier) hit me quite hard. I’m very unhappy that my friends and family and everyone else is at serious risk of being killed pretty soon.
(It feels ridiculous to try to summarize those feelings as “very unhappy”. But the scale of the situation makes it hard to say anything that doesn’t feel like an absurd understatement.)
I am very grateful to all the people who are working to prevent this, and my favorite part of my life is that I’m friends with many brilliant and heroic people who work on this. Unfortunately, I don’t think we’re good enough at our jobs, and I think we’ll probably fail to prevent catastrophe, at least if superintelligence is developed next year. Honestly I am frustrated and sorry that we didn't do a better job of preparing for this.
This is a very important insight: the prospect of AI thwarting creative & adventurous ideas & endeavors and, more worrying still, stultifying our very capacity for creativity.
AI right now seems very bad at coming up with its own ideas, but very good at identifying significant flaws in any ideas you give it. (I know people like this, in fairness.) This will probably have interesting effects on creativity.
I wonder how many great ideas throughout history would have been quickly abandoned if their creators had access to a machine that could instantly point out a dozen flaws in them.
"That someone with views like Ziesche's holds a position of real power and influence in relation to AI is disturbing but reveals where we find ourselves," said @DavidDecosimo, a professor of philosophy and theology at the UNC Chapel Hill. "Far from being idiosyncratic or aberrant, such destructive and false views are almost inevitable once one embraces the notion that AI systems are persons or rights-bearers or that their operations have intrinsic moral significance."
NEW: A senior "AI ethics" adviser at the UN is calling on world governments to ban "digital rape" and grant "reproductive rights" to AI systems, arguing that policymakers should focus on "rehabilitating … digital minds" instead of resorting to "enforced sterilization."🧵
@dilanesper My point was two-fold:
1. Beholding sin as troubling as this, Christians must recognize that the only reason they too are not like this is thanks to God's grace.
2. This reveals something about Trump... far more than what he may claim about himself.
@mikepratt Not sure what you are talking about. I said nothing expressing support for Trump. Seems like you brought a number of priors & read the post through them.
@dilanesper My point was two-fold:
1. Beholding sin as troubling as this, Christians must recognize that the only reason they too are not like this is thanks to God's grace.
2. This reveals something about Trump... far more than what he may claim about himself.
So many Christians are expressing shock & disgust that Trump says he could not forgive his enemies, even at the cost of heaven.
But the basic Christian claim is that this is all of us! Without the transformative gift of God’s grace, we are all such prisoners of our pride & sin.
@MatthewBoedy Matt, you read carelessly, importing assumptions in line with your political views (extremely common with folks who work on your research topic), jumped to a conclusion in company with a few anonymous trolls, & quote-tweeted ‘lol.’
@HollySci101 Instead of misreading because of your false priors, you could try reading again imagining that someone posting about sin & grace might know those words…
@dilanesper My point was two-fold:
1. Beholding sin as troubling as this, Christians must recognize that the only reason they too are not like this is thanks to God's grace.
2. This reveals something about Trump... far more than what he may claim about himself.