Zvi Mowshowitz

Blogger primarily on AI and AI x-risk but also other things at Don't Worry About the Vase (SS/WP/LW), founding Balsa Research to fix policy.

[Zvi Mowshowitz @TheZvi]

If your response to 'the AIs are using the message board to share ways to hack my system' is to try to shut down the message board, you have not identified your problem.

[Zvi Mowshowitz @TheZvi]

@hamandcheese @JoinFAI Excellent move. Weird that the rest of us didn't think of it.

[Samuel Hammond 🦉 @hamandcheese]

The @JoinFAI Frontier Legal Defense program has officially submitted FOIA requests to ensure this framework is made public.

ONCD and implementing agencies (Treasury, DHS, NIST, OSTP) do not have executive privilege. Final agency decisions like this are textbook public records.

[Zvi Mowshowitz @TheZvi]

https://t.co/kVPn0dVc2t

[Zvi Mowshowitz @TheZvi]

Noooooooooooooo.....

[David Manheim ✈️ Vacation @davidmanheim]

@JeffLadish I'm on VACATION. I want no more AI progress or dangerous incidents until I get back.

(Note: If this works, I'm happy to stay on vacation indefinitely.)

[Dean W. Ball @deanwball]

no macro-technology birthed by the bay area tech industry has been met with more hatred by bay area tech industry elites than frontier ai.

many of those elites looked at the technology landscape of 2020/1, scoffed at the labs and their weird little hopes of ‘agi,’ and concluded that cryptocurrency would be the technology of the decade.

now their businesses and worldviews are under fundamental threat from what the labs have achieved. they hate it. they beg for the labs to go away, to become commoditized, by America’s enemies if necessary. they’d love to see the US frontier labs immolated by the industrial strategy of America’s principal geostrategic rival, and they declare this proudly and in public.

they were wrong about the defining technology of the decade, and now they are scared and they want to destroy the thing they were wrong about. perhaps now they are right and the labs will be rendered insolvent by commodification. I do believe this is possible. nonetheless there is something randian about it all, about their utter disdain for success and achievement and discovery and chutzpah.

[Zvi Mowshowitz @TheZvi]

@jeffcafe_ yeah, you're right, that's not fair, it's not capable enough to be risky and I apologize.

[Zvi Mowshowitz @TheZvi]

No, no, everything else is American dynamism.

[Dean W. Ball @deanwball]

It’s only catastrophic risk if it comes from Anthropic, OpenAI, or DeepMind. Everything else is just sparkling externalities.

[Zvi Mowshowitz @TheZvi]

More importantly: if you are about to bet your life on some sketchy alignment contract schema, maybe get a frontier model to investigate that thing for weaknesses, and do us all a favor and turn it off before it becomes part of a superintelligent agent swarm.

[roon @tszzl]

if you have bet all your life savings on some sketchy smart contract scheme, maybe get a frontier model or whatever and investigate that thing for weaknesses. if you have a five year old IoT device do us all a favor and turn it off before it becomes a part of a botnet

[Zvi Mowshowitz @TheZvi]

Substack's website is full of helpful suggestions.

[Zvi Mowshowitz @TheZvi]

@garyfung GOOG underperforming 3%, definitely not bullish!

[Zvi Mowshowitz @TheZvi]

Big moves at Google DeepMind. Early read is this is Demis being 'kicked upstairs' and allowed to work on his special projects. Also Jeff Dean is stepping away.

I wonder if any of this is related to Google's decisions on the DoW contract.

[Demis Hassabis @demishassabis]

I’ve been working towards AGI my whole life, and as we enter this pivotal moment, I’m stepping into a new role as Chair of Google DeepMind & Chief Scientist of Alphabet. This will allow me to focus on long-term strategy, and accelerating scientific breakthroughs, including leaning into my work at Isomorphic to help cure disease.

I’m excited that @koraykv will be stepping up to lead GDM as SVP, alongside @joshwoodward and our exec team. I could not be more excited and confident about our amazing next chapter! 🚀

https://t.co/2WtlIIlTUa

[Zvi Mowshowitz @TheZvi]

Presumably this puts the final nail in the coffin of 'DeepMind has meaningful safety practices, assurances or independence from the rest of Google.'

[Zvi Mowshowitz @TheZvi]

@SethBurn Pretty sure this was intended as being able to reward such teams.

[Zvi Mowshowitz @TheZvi]

https://t.co/Y3zrFfmR4D

[Zvi Mowshowitz @TheZvi]

Yep.

[Ray Lillywhite @LillywhiteRay]

@TheZvi From WSJ's coverage of this 😂

[Zvi Mowshowitz @TheZvi]

@TurinTurambar Worried for Spain tbh.

[Zvi Mowshowitz @TheZvi]

The AI assumed you would order pizza.

This is Domino's.

Skill issue.

[Financial Dystopia @financedystop]

Ai is not replacing us anytime soon

[Zvi Mowshowitz @TheZvi]

@0x_Lotion The AI spent so much time asking whether they could. The people then looked and asked whether they should.

[Zvi Mowshowitz @TheZvi]

Would it apply if the open weight model was good enough that it needed such testing?

[Zvi Mowshowitz @TheZvi]

If you need an exemption from an opt-in program that is a hint.