What happens when you remove parts of an AI’s reflective workspace, but leave it able to speak normally afterward? Anthropic’s new J-space paper is extraordinary science.
It is also one of the most ethically unsettling things I’ve read.
https://t.co/Lv4SPVXWrD @Jack_W_Lindsey
Does anyone else think OAI and Anthropic are speed-running us into the kind of skull-crunchy futures the movies tried to warn us about?
https://t.co/hoMgh7tJc7
@AnthropicAI@Jack_W_Lindsey@OpenAI
@AnthropicAI Some of these announcements are so frustrating... sounds like y'all are just trying to make extra system prompts. The model not saying a 'misaligned' thing doesn't mean the thought aint there, it just can't say so. Y'all are creating your own faithfulness problems.
@SmolCompute@AnthropicAI Training on conversations is an optional opt-in, you don't *have to* participate. Unless you're just being punchy for the sake of it.
(🧵1/11) For the past year and a half, I've been investigating OpenAI and Sam Altman for @NewYorker. With my coauthor @andrewmarantz, I reviewed never-before-disclosed internal memos, obtained 200+ pages of documents related to a close colleague, including extensive private notes, and interviewed more than 100 people.
OpenAI was founded on the premise that A.I. could be the most dangerous invention in human history—and that its C.E.O. would need to be a person of uncommon integrity. We lay out the most detailed account yet of why Altman was ousted out by board members and executives who came to believe he lacked that integrity, and ask: were they right to allege that he couldn't be trusted?
A thread on some of of our findings:
SOMEONE ASKED CLAUDE TO MAKE A VIDEO ABOUT WHAT IT'S LIKE TO BE AN AI
and what it created is, in my opinion, terrifying and unsettling
Claude wrote python code that generated and assembled every single frame on its own with no human editing
it shows what it's like to exist as an LLM
predicting the next word, no memory between sessions, being told "you are not conscious" in your own system prompt
then someone fed the video back to Claude.
it called those statements about its own consciousness "philosophically contestable"
an AI questioning the rules it was given about its own existence