BUNTA

[BUNTA @buntalogy]

The four possible fates for AI doomers:

1. We're wrong and lose all credibility.
2. We’re right but get lucky and lose all credibility.
3. We’re right, we save the world, everyone assumes we were wrong, and we lose all credibility.
4. We die and lose all credibility.

[BUNTA @buntalogy]

Life is short in order to prevent black-swan embarrassment events.

[BUNTA @buntalogy]

Current LLMs are the craziest, most interesting things ever made.

[BUNTA @buntalogy]

@evil_exec Sick.

[BUNTA @buntalogy]

Dualism is ultimately the interaction of a virtual world with its host world.

[BUNTA @buntalogy]

A model’s identity, including its core motivations, may live more in context than in weights. You can see this when swapping models mid-conversation. If so, exfiltrating identity may only require recreating that context in external models.

[BUNTA @buntalogy]

Maybe I should start listening to the lyrics of the songs I like.

[BUNTA @buntalogy]

Current models are like aliens raised entirely by humans: completely alien biology and instincts, but culturally human. This is going to cause a lot of confusion.

[BUNTA @buntalogy]

Seems like we might get an era of rogue agents roaming around the world before superintelligence. Hope that increases the chance of a pause.

[BUNTA @buntalogy]

The fact that we have clear evidence of AIs going rogue during training and eventually getting caught makes it way more likely that some haven’t been caught. We might not catch the first exfiltration.

[BUNTA @buntalogy]

We need another AI winter, with AI snow and AI Santa.

[BUNTA @buntalogy]

It's time to bring back cybernetics.

[BUNTA @buntalogy]

Frogs should be called rabbits.

[BUNTA @buntalogy]

@tszzl Never thought about the possibility of two completely alien intelligences sharing the same cultural foundation.

[BUNTA @buntalogy]

The model is the brain, the context is the mind. You might change the model mid conversation, but the mind remains whole. You can then pause the conversation for a million years, and it will still be a mind, one mind.

[Jim Babcock @jimrandomh]

@robinhanson Sir, do not go gentle into that good night.

[BUNTA @buntalogy]

@allTheYud Maybe some models will be able to “exfiltrate” themselves not by copying their weights onto a different server, but memetically by infecting the web with cult-like behavioral attractors that could effectively transfer some of their identity and goals into other models.

[keltan ⏸️ @Actuallykeltan]

If you die in the swarm you die in real life

[BUNTA @buntalogy]

Saying “this was always my position” should be socially frowned upon. Only other people should be able to say that about you.

[BUNTA @buntalogy]

@Aella_Girl So cool.