People who think calls for AI regulation are a pro AI company psy op should try harder to square that with the fact that AI execs funded a Superpac to push for a moratorium on all state AI regulation and OpenAI subpoenaed me and Encode for all our communications about CA's AI safety law SB 53.
Or look at Anthropic's criticism of the original RAISE Act and SB 1047 for being too strong!
Yes I'm sure that companies are using this current moment to push for policies that help them. But as someone who has been fighting with AI companies about AI regulation for years, the idea that they are begging for strong oversight and regulations drives me nuts.
More capable models will introduce increased biological risk. The magnitude is fiercely debated, the direction is not.
We need more resilient biodefense. https://t.co/d5anHct2xp
Microsoft:
(1) The science of ai consciousness is far from settled
(2) We reject the idea that AI models might deserve welfare
Those claims seem in tension
Five recent trends in AI that are very worrying in combination:
1. AI companies are increasingly unable to control the AI systems they are already building.
2. Current AIs go rogue sometimes in increasingly complex ways, and can coordinate with each other to evade human oversight.
3. AIs are getting more capable and more sophisticated in their ability to take rogue actions and cover their tracks.
4. OpenAI and other AI companies are potentially considering new forms of training that make AIs even more capable, even more complex, and even harder to monitor.
5. AI companies are turning over more and more of their research, development, and operations to the AIs themselves without good oversight or understanding.
I know goalpost-moving is the sine qua non of the chatgpt era, but I’m still a bit dizzy from watching people say “obviously if you don’t chain up your dragon it’ll burn down the town” while barely pausing over the fact that we apparently have dragons now
This post (from one of the independent investigators) is the best short thing I've seen on the new & crazy stuff the OpenAI-Hugging Face investigation found. Full post in screenshots.
Wild that this is the level of crazy that was uncovered by an extremely limited-scope initial investigation of what happened in a single 6-day window. Imagine what would be turned up by a real investigation of root causes, organizational processes & culture, and everything else that goes into an incident investigation when you're serious about it.
Screenshot batch 1/2:
This should go without saying, but it would be insane for OpenAI to now proceed with building a new model that’s 2x or 4x the size of this one.
Doing that should be deeply taboo. It should be illegal. Preventing it should be a top priority around the globe.
@DailyMail I don't understand why a reporter with a reputation and legacy like Jobson would be turning his writing over to Claude now, but that's very obviously what's happened here