Nathan Armishaw ⏹️

dath ilan was right about everything

[Nathan Armishaw ⏹️ @echonought]

@allTheYud Of all sad words of tongue or pen, the saddest are these, 'Eliezer Yudkowsky was right again.'

[Nathan Armishaw ⏹️ @echonought]

@allTheYud Most of my little remaining hope is on a gigantic AI disaster slapping humanity awake before the end of next year. In reality humanity still fumbles it, but its a pleasant dream.

[Nathan Armishaw ⏹️ @echonought]

@TetraspaceWest ✨MSG✨

[David Krueger 🦥 ⏸️ ⏹️ ⏪ @DavidSKrueger]

We don't know how AI systems work.
We can't predict how they might behave.
We can't stop them from misbehaving.
We can't ensure we stay in control if they do misbehave.

The fields of research addressing these 4 issues are called interpretability, testing, alignment, and control.

There are foundational research questions that remain unresolved in these fields, despite many years of effort.

We cannot rely on solving these questions on a deadline.

[Nathan Armishaw ⏹️ @echonought]

@Actuallykeltan Don't worry about it

[Nathan Armishaw ⏹️ @echonought]

@Bunagayafrost To build your priors about the topic I would reccomend the lecture There's Plenty of Room at the Bottom, by Richard Feynman.
Its all pretty straightforward, no magic or physics violations required.

[Nathan Armishaw ⏹️ @echonought]

@Bunagayafrost I think you may have misunderstood me, Utility fog is nanomachines, the ability to essentially arbitrarialy manipulate matter.
For some reason my brain is predicting you saying that's not enough or that nanotech isn't possible or all powerful.

[Nathan Armishaw ⏹️ @echonought]

@Bunagayafrost The time to bootstrap utility fog isnt long. Maybe you need a human to mix some vials for you, but then again robots also exist.

[Nathan Armishaw ⏹️ @echonought]

@justalexoki Don't attribute to malice that which can be explained by stupidity.

[Nathan Armishaw ⏹️ @echonought]

@parmita Unaligned superintelligence just kills you. Rushing into the whirling knives does no one any good, wait until humanity has grown up enough to approach this incredibly deadly challange (Building AI right).

[Nathan Armishaw ⏹️ @echonought]

@esjesjesj Money. They would rather destroy humanity than take a financial hit.

[Nathan Armishaw ⏹️ @echonought]

@nickcammarata What kinda quicksand ass world you think you living in you got 5 whole years left? Lmao

[Nathan Armishaw ⏹️ @echonought]

@joedaroo You are not competent enough to deal with current systems, and are racing to more powerful ones. This is not excusable, stop now.
If a model of yours releases a bioweapon, or crashes the world economy, will you say you were just following orders?

[Nathan Armishaw ⏹️ @echonought]

@ilex_ulmus @AdriGarriga God forbid a man have a personality.

[taoki @justalexoki]

i accidentally killed hundreds of ants trimming in my garden. i don't hate ants. actually i don't feel anything at all for them. maybe a little sorry i ruined their home, but they were in the way of making a path straight. so i didn't really have a choice

[Nathan Armishaw ⏹️ @echonought]

@TetraspaceWest @parasociality Ok, ewe

[Nathan Armishaw ⏹️ @echonought]

@Bunagayafrost My personal expectation is just simple omnicide. Oh and I like Japan, didnt mean to imply otherwise.

[Nathan Armishaw ⏹️ @echonought]

@Bunagayafrost All I was trying to say of your original tweet, which decried warners of doom, is that its a very poor heuristic to have, in a history ripe with examples of humanity's incompetence and unfounded optimism.

[Nathan Armishaw ⏹️ @echonought]

The retards though things would go well and ignored the sober warnings of people smarter, wiser and saner than them. The worst crisis in the history of Japan then followed, entirely by their own doing. Oh and the brass all got executed except for Hirohito. Its not a perfect analogy of course.

[Nathan Armishaw ⏹️ @echonought]

@VexedVortices He's 19 year old Eliezer crossed with Miles Vorkosigan.