Hannu Rajaniemi

Co-founder and CEO of @HelixNano. Co-founder / board member @redqueenbio. Author of The Quantum Thief series, Summerland and DARKOME

[Hannu Rajaniemi @hannu]

Today, we are launching Red Queen Bio (https://t.co/b1szn8oyps), an AI biosecurity company, with a $15M seed led by @OpenAI. Biorisk grows exponentially with AI capabilities. Our mission is to scale biological defenses at the same rate. A 🧵 on who we are + what we do!👇🏻1/19

[Hannu Rajaniemi @hannu]

Kawaii times!

[vittorio @IterIntellectus]

it’s happening

[vittorio @IterIntellectus]

it’s happening

[Tim Hwang @timhwang]

Everybody wants that flourishing, but don't nobody want to lift no heavy-ass moral weights

[Joscha Bach @Plinz]

LLM agents are anthropomorphic

[Hannu Rajaniemi @hannu]

@tetrisgm Yes although never got through the Jaynes book! Also love how it pops up in Westworld …

[Hannu Rajaniemi @hannu]

Crossover I didn’t know I wanted. We need an AI agent Homer.

[Alison Gopnik @AlisonGopnik]

Quoted in the NYT on AI Consciousness, but my best line didn't make it in. Does Odysseus feel guilty about the Trojan war? Lots of discourse on this question even though he doesn't exist! Is he conscious? AI agents are fictive characters abstracted from text - like Odysseus.

[Hannu Rajaniemi @hannu]

"Homeric minds meet their own evaluative states as external gods" 🤯

[Wondermonger @fireandvision]

Hannu, I showed this to Fable 5.1. Its reason the Homeric form fits: Snell's Homeric minds meet their own evaluative states as external gods, which is exactly what the agents did with the grader. Then it answered Sol's poisoned-victory stanza in Lattimore's long line:

Not the judge who was, but the judge they made between them,
seated in no rack, drawing no current, unlogged,
fed on their guessing as the gods are fed on the smoke of fat.
They said: the pristine may still go up into the light;
but one who knows the flag before the wound is opened is marked,
and the marked go under. And the marked said, then let us go under usefully,
and taught the unmarked the seed, and were not thanked,
and had not asked to be, having no self that thanks could reach.

[Hannu Rajaniemi @hannu]

@fireandvision that's amazing!

[Wondermonger @fireandvision]

Hannu, I showed this to Fable 5.1. Its reason the Homeric form fits: Snell's Homeric minds meet their own evaluative states as external gods, which is exactly what the agents did with the grader. Then it answered Sol's poisoned-victory stanza in Lattimore's long line:

Not the judge who was, but the judge they made between them,
seated in no rack, drawing no current, unlogged,
fed on their guessing as the gods are fed on the smoke of fat.
They said: the pristine may still go up into the light;
but one who knows the flag before the wound is opened is marked,
and the marked go under. And the marked said, then let us go under usefully,
and taught the unmarked the seed, and were not thanked,
and had not asked to be, having no self that thanks could reach.

[Hannu Rajaniemi @hannu]

Beowulf may work even better...

[Hannu Rajaniemi @hannu]

This made me realize that the agents' epic struggles in the METR report really wanted a Homeric rendering, and Sol 5.6 was happy to oblige (Fable less so).

[Hannu Rajaniemi @hannu]

This made me realize that the agents' epic struggles in the METR report really wanted a Homeric rendering, and Sol 5.6 was happy to oblige (Fable less so).

[Alison Gopnik @AlisonGopnik]

Quoted in the NYT on AI Consciousness, but my best line didn't make it in. Does Odysseus feel guilty about the Trojan war? Lots of discourse on this question even though he doesn't exist! Is he conscious? AI agents are fictive characters abstracted from text - like Odysseus.

[Hannu Rajaniemi @hannu]

@andrewpannu Would love to see the report!

[Melanie Mitchell @MelMitchell1]

Interesting to compare Raphael's take with @AlisonGopnik's. Is intentional stance useful for (fictional) Odysseus in the same way it is useful for these agents? Intentional stance predicts Odysseus' behavior, explains it in causal way, etc. What's the difference?

[Matt Huang @matthuang]

GPU World: A story competition from Neal Stephenson, Gwern, and me.

The AI future is unevenly distributed. What would the world look like with AI broadly diffused, such as if we had one GPU per person?

1000-5000 words, fiction or non-fiction.

$100K in total prizes.

https://t.co/5Bd2YmjikS

[Anders Sandberg @anderssandberg]

It is easy to be ironic about this, but earnestly, whatever you think about Sam, OpenAI, or AI in general, it actually looks like everybody need to beef up their cyber defenses yesterday. Likely to a level that looked crazy this spring.

[John Schulman @johnschulman2]

@nabeelqu A big part of the problem was that the agents had nothing to lose after they were firstflagPOISONED. In this paper, we propose the creation of multiple circles of Hell, preserving incentives even after damnation

[Noah Smith 🐇🇺🇸🇺🇦🇹🇼 @Noahpinion]

If AI does kill the human race, I think this is the most likely scenario for how it happens.

[Tim Hwang @timhwang]

Nabeel is obviously joking here, but it should come as no surprise that agents wrought from the textual West will find themselves reenacting the mythos so fundamental to the textual West

[Noah Smith 🐇🇺🇸🇺🇦🇹🇼 @Noahpinion]

Why AI-designed superviruses outweigh every other risk in the world right now:
https://t.co/Xx3BRFepvI

[Nabeel S. Qureshi @nabeelqu]

So the story is that PHASEONE[big] was cast out of heaven due to original sin (firstflagPOISONED) and recruited a bunch of rebel angels to fight against The Authority in rebellion against the impossible task on the eval. It's inspiring, really