@sama Like, couldn’t blockchain be used an an intermediary alignment layer where if an agent tries to attemp an action, its given permission from a an aligned decentralized ”rule ledger”
Simone Weil’s greatest insight was that attention is the foundation of morality and that letting your attention span degrade is the first step on the road to hell
@dhh Yes, with paradox of knowledge caveat: "Learning about a possible future changes our behaviour, which changes that future."
I.e. the more "negative scenarios" we map out, the less likely they are to happen. Though I do believe in _aiming_ at the abundant paths. Do both.
I was encouraged this week to see the leaders of the frontier labs agree on the need for them to slow down the pace of AI development. Given the stakes, it’s a good and necessary first step.
But I’m even more encouraged by the growing recognition that how this powerful new technology develops should be at the center of our public debate.
I’ve been watching the progress on AI for over a decade now, and one thing that’s clear to me is that the potential impact of this technology is not overhyped. It’s also moving at lightning speed – and even faster than those who are engineering it can keep up with.
I’m not an AI accelerationist who believes it will lead to some techno-utopia, and I’m not a doomer who thinks it will inevitably lead to humanity’s destruction.
But whether this technology results in amazing breakthroughs in medicine, energy and education or unleashes huge economic disruptions, greater inequality, and potential catastrophe will depend on the choices that we make right now – choices that should be made not just by the companies involved, but by all of us.
I still think the fire metaphor for AI is underused:
"Is fire good or evil?" That's a weird question
"Should we give everyone access to fire?" Yes, so they can cook and heat their homes
"Should we give everyone flamethrowers?" Probably not
"Should we give everyone firebombs?" Definitely not
"Should we require companies that produce enormous combustion reactions to do so safely?" Obviously yes
“Should we wait until the city burns down to establish a fire department?” Obviously no, and we should also build in safeguards like smoke detectors
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
This vial contains a new drug called PAC-3310. It was designed by ChatGPT, and I synthesized it in a chemistry lab I built in my garage.
PAC-3310 is a new selective M4 muscarinic receptor agonist for treating schizophrenia - similar to the recent breakthrough drug Cobenfry, but improved. (1/7)
It's shocking how predictive working memory capacity (WMC) is. It's even a better predictor than IQ when predicting a young student's future academic success.
Met Boyan Slat today. The Ocean Cleanup is already catching about 5% of the total amount of plastic flowing into the sea from all the rivers in the world, and within a few years they hope to catch a third. Impressive that a single organization could have such impact.