KARRA

[KARRA @allbibek]

People are instantly amazed how helpful AI can be. But they forget all those capitalists have complete control over their users' data and make their own rules.

[bilal 🔶 @bilalchughtai_]

I recently resigned from Google DeepMind, where I worked on AGI safety and alignment research. At Google, I witnessed AI development first hand. I too am extremely concerned by the default trajectory of this technology. I earnestly believe that AI has the potential to kill us all, and that we might be running out of time to avoid this outcome.

The pace of AI progress in the past few years has been staggering. When I first started working on AI in early 2022, AIs were amusingly useless. Just four years on, AI agent swarms from OpenAI are cracking famous century-old math problems and, more worryingly, escaping the control of OpenAI and autonomously hacking into the third-party company HuggingFace, against anyone's wishes.

Things will only get crazier: I think it's possible that the AI companies might, in the next few years, succeed in building superintelligent AI systems that far exceed human capabilities in every domain. I am not confident that these AI systems will do what we want. In particular, misaligned superintelligences may, much like the rogue AI agents involved in the HuggingFace incident, escape our control and take dangerous actions that may result in the permanent disempowerment or death of humanity. Alignment is the problem of preventing this, and is both difficult and unsolved. Our present understanding of how to train AI systems that deeply want what we want is extremely rudimentary. Worse, we are not on track to solve alignment in time: frontier AI capabilities are improving much faster than our understanding of AI alignment.

I am optimistic that navigating AI safely is possible. In order to do so, we need to coordinate to avoid this manic race between AI companies. We need to pace AI development to a speed that society can handle, where emerging risks can be addressed before extreme harm is realised. We need much more transparency into AI development to ensure that AI companies are not imposing unacceptable levels of risk on us all.

More broadly, we need many more people thinking carefully about the problem of making AI go well. It is, in my view, the most important problem facing humanity this century, and the stakes are immense. I'm very directly working on this next: I want to help people interested in working on mitigating catastrophic AI threats do the most effective work that they can. I think many people from many backgrounds in many roles have a part to play.

[KARRA @allbibek]

@DanielW_Kiwi @kuperov Wouldn't upgrading hold our balance ~$200?

[KARRA @allbibek]

@kuperov @DanielW_Kiwi Sorry, you mean I need to upgrade to payg to get the arm?

[KARRA @allbibek]

Being mean to ChatGPT can boost its accuracy, but scientists warn you may regret it https://t.co/y663yA8C9a

[KARRA @allbibek]

What is life without heartache? Every downfall builds and teaches us some new things everyday!

[KARRA @allbibek]

It feels like I'm not being myself 😪

[KARRA @allbibek]

https://t.co/p4z28LE4K9

[KARRA @allbibek]

@Meta @facebook can't help me to recovery my acc 👎🏼

[Ska Cat @bustertheskacat]

maybe survival is just about pain control

[KARRA @allbibek]

In such a very sad world, there are still things to discover and it’s possible to hang on ‘cause your story isn't over.

[KARRA @allbibek]

It's hard to wake up from a nightmare if you aren't even asleep.

[KARRA @allbibek]

Changes are not only slow, they’re sometimes unreachable from the point we’re at.

[KARRA @allbibek]

Dream, hope & faith

[KARRA @allbibek]

my efforts depend on your worth 😏

[KARRA @allbibek]

Stressed but blessed 🥲

[KARRA @allbibek]

MOST LIKELY TO finish a conversation and realise it was just 78% you oversharing 😩

[KARRA @allbibek]

@WholesomeMeme

[KARRA @allbibek]

Let’s not normalize the abnormal 😓

[The New York Times @nytimes]

Indonesia's police force is highly militarized, poorly trained in crowd control, and in nearly all instances, has never been held accountable for missteps, experts say. https://t.co/j2I0NeGiWk

[KARRA @allbibek]

indefinite hiatus