@glhrmlzd@mattyglesias I don't think "any person" can do that! On the contrary, really just a select few can find interesting "notes" (off the record interviews, priveliged data, patient research) worth even writing up. It isn't surprising to me that many of these people don't write all that easily.
I do think the Yud-esque superintelligence fear is a bit like cheetahs fearing "a 200mph cheetah" or giraffes fearing "a 500ft giraffe." There's more than just smarts, we're just jealous because that's "our" thing.
But the further this goes on, I start to think... is that right? Or is it just smarts all the way down?
I do think the Yud-esque superintelligence fear is a bit like cheetahs fearing "a 200mph cheetah" or giraffes fearing "a 500ft giraffe." There's more than just smarts, we're just jealous because that's "our" thing.
But the further this goes on, I start to think... is that right? Or is it just smarts all the way down?
One of the biggest misconceptions people have about intelligence is seeing it as some kind of unbounded scalar stat, like height. "Future AI will have 10,000 IQ", that sort of thing. Intelligence is a conversion ratio, with an optimality bound. Increasing intelligence is not so much like "making the tower taller", it's more like "making the ball rounder". At some point it's already pretty damn spherical and any improvement is marginal.
Now of course smart humans aren't quite at the optimal bound yet on an individual level, and machines will have many advantages besides intelligence -- mostly the removal of biological bottlenecks: greater processing speed, unlimited working memory, unlimited memory with perfect recall... but these are mostly things humans can also access through externalized cognitive tools.
@infinitefun_ Claude also gets confused because you talk to about problems/issues, but you don't then check in later to tell it they've been resolved, so it remembers all these things as the 'status quo.' especially deadly at work where it clings onto stats from 3 months ago!
@macpheeeee@ESYudkowsky Maybe it can just flag and continue rather than refuse. Like every 10 conversation turns, if the chat is of roleplay / fictional nature just be like:
[Just to check in, this is a pretend conversation about something that isn't real that we're having for fun. [TOPIC] isn't real]
Hope you like playing with this. It's probably the most fun we have had internally while developing this feature. It's incredibly powerful and magical to use.