James

#mancunian. co-founder // @lbsblockchain degen. building @beanhonest, @verifereum. do music. here to help the world for the greater good.

[James @2uttopassa]

stoked to receive a Notable Mention from the crüe @encodeclub especially against so many great entrants! DAOs are the future, that’s for sure.

[Encode Club @encodeclub]

🏅 CoffxDAO is a slide deck proposal for the initial DAO structure. A DAO with a social impact orientated mission statement. The aim is to disrupt the coffee industry & level the playing field for coffee farmers.

https://t.co/za0OsnNgty

[James @2uttopassa]

@FballGossips _classique_ Arsenal

[James @2uttopassa]

@Avis hi, I cannot get through to you via e-mail, DM nor on the phone (I’m struggling to hold on for more than 20 mins right now during the workday..), please could I actually get a response from someone? thanks

[James @2uttopassa]

@lauriewhitwell zero comms from Oliver as well while we were all scratching our heads in the stands! shocking all round.

[James @2uttopassa]

@AndyMitten shocker. en route home from OT. what time is your podcast live-streaming and where? class work with @UWSmag as always

[Dario Amodei @DarioAmodei]

We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.

Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.

You can read the full post here: https://t.co/OGyPb7yaYt

[James @2uttopassa]

never thought I’d agree with Musk

[Elon Musk @elonmusk]

Dario is right

[Geoffrey Irving @geoffreyirving]

I think we have a ~50% chance of all dying as a result of superintelligence, mostly due to actions in the next few to 10 years. I don't expect to have that resolved to below 10% or above 90% before we either make it through, or we don't.

We will have to act despite uncertainty.

[James @2uttopassa]

@laurashin damn … another really bad take

[James @2uttopassa]

@laurashin sadly, I think you’ve misunderstood the whole situation because of your prejudice in respect of EA (nobody is talking about EA here or conflating it with explicit AI safety risk)

[BBC Newsnight @BBCNewsnight]

“You just said that 10% doesn’t seem an unreasonable estimate that AI could kill all humans”

“Yes”

“Wow… oh my God.”

@vicderbyshire speaks to Nobel Prize Winner and so-called ‘Godfather of AI’ Geoffrey Hinton about predictions by an Anthropic researcher that there’s a more than 10% chance AI could kill all humans within a decade.

#Newsnight

[Eliezer Yudkowsky @allTheYud]

Happy Coxon Day to all who will one day celebrate it.

[Rob Miles @robertskmiles]

It's great to have Jacob's "AI is >10% to kill us and I'm quitting" at the same time as Evan's "AI is >10% to kill us and I'm staying", so we get to see all of the "If you really believed that, you'd stay" cope and the "If you really believed that, you'd quit" cope simultaneously

[Nate Soares ⏹️ @So8res]

As the AI situation becomes more and more clear, legislatures around the world are beginning to stir. Here's hoping they move fast enough.

[Benjamin Todd @ben_j_todd]

Why do people work at Anthropic even if they think AI might kill everyone? Outsiders assume it's hype, but that's because they can't inhabit the world view, which holds that even in the good case, our lives are about to be totally upended.

Imagine you run Anthropic. You believe we might reach AGI within a few years, kicking off explosive growth that might go seriously off the rails.

If you unilaterally pause, your company goes to zero, and you lose all influence. OpenAI (or China) win the race, which seems even riskier to you.

So you continue to push ahead, while also saying that AI is risky and we should coordinate to slow down.

Employees join to work on AI alignment / security / control / policy, hoping to minimise the chance of a bad outcome if such an agreement is not reached.

It's all internally coherent, and not marketing. But what's needed isn't to pour scorn on their "hype" but rather to try to understand why they're so worried, and how a slow down might be worked out.

[Tom Bibby @tombibbys]

This seems to be the most viral resignation yet.

Why? Because he said AI "could kill us all".

Not "concerns about safety".

Not "risks to society".

Not even "human extinction" (which can still sound abstract)

But "kill us all."

We always should have been this up front.

[Seán Ó hÉigeartaigh @S_OhEigeartaigh]

Of all the 38-word messages I'd choose for 100 million people to see, Jacob's below would be at the top. It is simply correct. The companies are racing towards something breathtakingly dangerous. They are gambling with our lives. They know it and are afraid. They feel trapped in a race and don't think they can stop.

Governments are horrifyingly far behind on this. There are no adults in the room handling it. I don't know what prevents this, but mass awareness, and sustained public pressure on our governments to act, will surely help.

[Congressman Greg Casar @RepCasar]

An Anthropic researcher just quit, warning they're racing to superintelligence.

An employee still there agreed, and put the odds of AI killing all humans above 10%.

This is an emergency. Congress must convene hearings and pass my and Bernie’s superintelligence ban.

[James @2uttopassa]

@HeidyKhlaaf yes, AI in lethal autonomous weapons is one way

[Greg ⏹️ Colbourn @gcolbourn]

Absolutely incredible how much coverage this is getting. All the major newspapers. It feels like a watershed moment. And to think - any one of you other "members of technical staff" at OpenAI, Anthropic, or Google could've had this amount of fame if you'd wanted it! ;) Seriously though, join Jacob and earn the respect and thanks of millions all over the world.