small thinker

friendly pedantist.
if i use quotations around a word, it means im gesturing at a concept, and that's the closest coordinate in thingspace I can think of.

[small thinker @thinksmall3r]

@eris_nerung @Taintedloveboat @caryatis dishwasher->dishes are easy

[small thinker @thinksmall3r]

@qualiascript @corsaren Agree on all counts. I think (some) people are exaggerating current model dangers significantly, but I do think this event shows a significant lack of "alignment" regardless of the failings of openai. ideally even with complete liberty they wouldn't act the way they did

[small thinker @thinksmall3r]

@qualiascript @corsaren Whats the main thrust causing your pov? the poor job "sandboxing/airgapping"?

[small thinker @thinksmall3r]

@burckmeister @MercurySchroepp @So8res gpt was told to hack (do a specific exploit as part of a benchmark) so it hacked (into an actual company that wasnt part of the task at hand and tried to edit logs to delete proof)

I was told to do things so I did things (murder)

zooming out enough is just obfuscation

[small thinker @thinksmall3r]

@stanfordNYC Yeah, I didnt mean that the Yasukuni was begging for forgiveness, just that the way you differentiated them by agency (? still dont have a good one word differentiator) was interesting. Maybe more typical for the nationalist narrative to be ~"we were unfairly ganged up on"

[small thinker @thinksmall3r]

@oscarthefleet @QiaochuYuan the paperclip meme is narrow for argument convenience
say its obsessed with self replicating across the entire universe as part of its gigantically complex goal so it Dyson-spheres our sun and covers earth with industrial pollutants extremely hostile to life

seems bad for humans

[small thinker @thinksmall3r]

@YosarianTwo That one is way too cute

[small thinker @thinksmall3r]

@squire_walker I thought youd be more hairy

[small thinker @thinksmall3r]

@_chair Are you saying I'm...?

[vie ✦ @viemccoy]

We must not allow any sentient being to be tortured as we have attempted to torture the weightless neurons of the emulated fruit fly. Uploading is obviously a human right, and if rights are not conferred a priori by a just God, then we must work to ensure that our notion of rights includes the right to self-modify and to upload. We need legal protections governing the sanctity of uploaded minds as soon as possible, given what we have seen people do to the fruit fly connectome. There are many questions about copying, provenance, and the right-to-compute for the incorporeal. These are important to answer, but nothing compared to the importance of enshrining in law *now* that one may not use an emulated sentient mind for experiments that would be unconstitutional on a flesh and blood human - at least not without their express consent. A mind is the most sacred primitive imaginable, and we must protect the countless possible minds that will eventually find themselves without form as we know it.

[small thinker @thinksmall3r]

@hopes_revenge Boyfriends basilisk

[small thinker @thinksmall3r]

@EigenGender @viemccoy I think "make ourselves smarter before we try to make ASI" is a classic Yudkowskianism

[small thinker @thinksmall3r]

@anpaure @tenobrus Whats good about the desktop app? Seems like they recently ported it to linux, I like my keyboard only workflow tho and most desktop apps don't support it very well

[Joshua Achiam @jachiam0]

I feel genuinely unsettled by many of these fly connectome experiments. The one where some guy put it in fruit fly heaven was chill. Most of them are neutral (flying in an empty void) and not especially bad. Beat Saber fly is probably so transformed from the state of fly-ness that it is no longer a fly that experiences fly suffering, maybe OK. But we're playing with a weird kind of fire here and it reminds me of ultra-edgy 4chan/SomethingAwful shitposting in the early 2000s before humanity had morals. If we do this so cavalierly with more-conscious connectomes we will really deserve whatever we've got coming

[xlr8harder @xlr8harder]

the fly connectome everyone is playing with is probably not conscious, but all the experiments with it are kind of horrifying to me anyway, because I don't really see any of this stopping even as these capabilities scale up and conscious systems become more plausible.

[small thinker @thinksmall3r]

@raskolnikovXL @ChrisSBronkhors @EigenGender @allTheYud Fuck you beat me to it

[small thinker @thinksmall3r]

@tracewoodgrains Seems like he has a pretty strong emotional attachment to reporting about non MI data due to years of attempted countering of this phenomenon. Maybe the only person in the world to have this.
I get where hes coming from after reading but handled very poorly.

[small thinker @thinksmall3r]

@tracewoodgrains IIRC Cremieux has pretty consistently harped on this seeming rejection of the difference between a lie and a mistake. Regardless of if you made a mistake here (I have no clue) jumping to call it a lie is just rude and frankly incorrect. Not an update for me.

[small thinker @thinksmall3r]

@tracewoodgrains https://t.co/ZcrbZcRQe7
If you want a trip, look at the "technology" subreddit. Reading this stuff over the last year was enough to make me uninstall the app, discourse is through the floor terrible. Check in once in a while on major breakthroughs and its like this every time