Our team spent hundreds of hours reading documents so you don’t have to, all to answer: How good are AI companies’ safety practices?
I’m really proud of what we’ve built: It’s Guidelight’s first scorecard, on whether companies can control their AIs, and it's launching today.
@PolitlcsUK Heartening to see this, this is exactly what we should be trying to do. Of course it’s complicated and lots of support will be needed, but that’s the case with many things that are worth doing.
@LLMJunky@sama We have to start acting like adults about this and do what’s right. Too much is at stake. China will do the same if they have any wisdom.
@Arbitrary_user@AndyMasley They’re not programmed, so instilling commandments that they will reliably follow is not something we know how to do. We also have no straightforward way of giving them goals or values. (I know it’s pretty amazing - we really don’t know what we’re doing!)
@safewordsorg All the shame belongs with them. You were a child who needed to be loved, I imagine. But you’re right that it doesn’t make it any less real - probably more painfully real if anything. Thank you for talking about something so hard.
@Tim_Hua_ Yes, it’s a bit concerning if people really are so awed by this writing. He sounds measured and truth seeking in many ways, but then sincerity and clarity seem glaringly lacking when he talks about the public’s concerns about his work - yet he seems to get away with it.
Interesting NYT reporting today about Chinese officials being "unnerved by the powers being unleashed" by AI advances and indicating willingness to engage on international negotiations with the US
@sunflowerfemmm Yes, I think I permanently soured my relationship with a manager once by saying I’m pro makeup but find it too effortful to wear much of it. It’s really tricky getting the tone exactly right.
Japan, 1945: “Would it not be wondrous for this whole nation to be destroyed like a beautiful flower?”
OpenAI, 2026: “there’s a beauty in the ugliness… when a star dies it grows super big into the red giant… and it’s like that… as you watch this final flowering of humanity…”
@kristoph@a_musingcat We can’t undo the idea of AI, it’s true, but leaping so brashly towards creating and advancing it is a decision. Is there no world where Frankenstein could have resisted making his monster, if he’d thought a little more about what kind of catastrophes might await them both?
NYT factcheckers were like "the fuck you mean, they started 'calling themselves a swarm'??" and I was like "yeah check out timestamps 18:52, 20:29, and 21:37 in the Black Hat report video"
@TheDesertLynx@NeerajKA The thing is, we’re not programming them at all and have no idea how to. They’re grown in entirely different way, and then let loose.