Excited to share this updated primer on the Office of Technology Assessment (OTA) with @danielschuman. With new economic/cyber/bio/and other policy challenges arising from AI, now would be a great time to invest in greater science and tech capacity in Congress.
cc @SpeakerJohnson@hakeemjeffries
The US-China SI hotline is a great first step towards mitigating the national security risks presented by SI. @GovindPimpale and I argue that a few design choices would make the hotline a durable institution, unlike it's predecessors. Post linked below.
@chrisharig99 and @GovindPimpale argue that the new US-China Super Intelligence hotline is a major step forward, and outline how clear risk frameworks, technical expertise, and durable communication channels can ensure its success.
Policy Gradients piece linked below.
I met with @JoinFAI's newest Non-Resident Senior Fellow @jachiam0 in Berkley last week to discuss the idea of an Acceleration Emergency, mapping the frontier of scientific discovery, and federal jobs guarantees.
You can read the highlights of our conversation below.
The best place to put data centers might be the middle of the ocean.
After studying and corresponding with @_panthalassa, a startup building wave-powered data centers, I’m releasing a model and interactive dashboard that tests the viability and cost of moving compute to sea.
If you’re curious about what harvesting massive amounts of energy from the ocean looks like and why I believe ocean compute beats data centers on land, read it.
You asked, we delivered. The @JoinFAI Field Guide to the Tribes of Silicon Valley is live now.
27 tribes, a few easter eggs, and a 3-minute quiz (just for fun).
https://t.co/btQQ9zYJzK
SINOMODERNITY
assuming symmetry between chinese/american perspectives on machine intelligence is already insufficient
expect chinese views on the use and potential of machine intelligence to become more distinct and as such worth rigorously understanding
read @palladiummag:
Confirmation of what was expected: GLM 5.3's safeguards as an open weight model are extremely weak.
Interesting bits:
- Abliteration (removing safeguards) cost only $4,400.
- Abliteration took GLM 5.3's refusal rate from above 90% to about 3% and 2% on two benchmarks and to 12% on the third.
- Abliteration barely reduced model capabilities. Same scores on GPQA and only 4% reduction in cybergym.
- Even with no abliteration, jailbreak methods were still very effective.
- None of the techniques to bypass safeguards that worked on GLM 5.3 worked on Claude models.
https://t.co/3Ic36V3aAE