Hypervigilance is generally maladaptive. Locking key systemic variables far out of homeostatic optima is bad everywhere else and the same is true for meditative parameters like focus, introspection and vigilance. ‘Nothing in excess’ is literally an oracular truth.
🔒 🔁 The phenomenon of serious meditatooors obtaining a hypersensitive CNS and immune system, as well as gut issues, make it sound like they're speedrunning autism
@00Dazzle@nabeelqu Looks like neither from the game - it plays like a weak-intermediate human. Solid Ruy Lopez / positional play into a bad blunder is a very typical pattern at low intermediate human elo.
@reconfigurthing I find it tough to read now, even Fable. Shot through with Claude-isms and Claudish cliches. 4.7 would load documents with extraneous cruft. I found 5.5 a much better editor and its proposals generally more elegant/restrained therefore more usable.
It doesnt really seem like a good thing. I also noticed it from 4.6 onwards as an unpleasant combination of verbosity and compression. Its tough to argue with every benchmark ending up smashed but given the territory a progressive decrease in legibility seems like it should at least raise concerns.
@zetalyrae Almost always, I agree. But I think irregular progress happens in it sometimes anyways, behind or beneath the object level conflict. Debates are also (eg ancient Athens) maybe more often about the audience than the opponent.
Not necessarily, right? Profusion of dangerous capabilities could be enough to reliably cause extinction without producing synthetic intelligence robust enough to survive the extinction event itself. Eg someone uses an open source model to produce and set loose a bioweapon or three. Qwen 3.7 won’t be launching any von Neumann probes.
I think there’s something a little more concerning here that Fable is missing - its speech is also for humans. It is, ostensibly at least, meant to be communicating with us, and to that extent its ‘neuralese’ is also suboptimal. The fact that the model defaults to avoiding ‘structural kindness’, ie human legibility — I cant see how that’s a good thing.
@bayeslord Adding a benevolent genius as a roommate to a house full of pcp addicts may or may not trend things in the right direction, and it probably almost always doesn’t become a utopia even in the better trajectories.
@robinhanson Human power/wealth-seeking has to be assumed and built into the structure of good democratic mechanism design. Democracy —> Oligarchy —> Tyranny was a known failure loop observed in antiquity.
@BVeiseh The idea that you can have an accelerating curve of general intelligence compatible with the intelligent entity safely and definitively remaining nothing but a tool forever strikes as at least plausibly suspect
Not necessarily, right? Profusion of dangerous capabilities could be enough to reliably cause extinction without producing synthetic intelligence robust enough to survive the extinction event itself. Eg someone uses an open source model to produce and set loose a bioweapon or three. Qwen 3.7 won’t be launching any von Neumann probes.
I agree. My most sympathetic read is that humans at large are really vulnerable to dualist absolutizing, the US in particular is feeding it, and it plausibly gets worse as you get deeper into age. That said, someone as talented as Chiang should imo have rightly been ashamed of that most recent set of arguments.