This is the problem with anthropomorphising LLMs. If you think of it as a person, yo mama for example, then you will be loaded with all the expectations you have of yo mama.
And I pick yo mama on purpose because yo mama doesn't know how to set the clock on the microwave and she calls you to do it and because you can you think to yourself "I am technical and other people need me" oblivious to the fact the microwave was assembled by teenage unskilled Chinese IP thieves from raw materials mined by third world children who can all do a million things you not only cannot do but cannot even comprehend what it would entail in the first place even if you could muster the wherewithal in your slovenly body to get up at daybreak to descend a mine in perilous conditions to feed and clothe your sick parents.
No, the models are not terrified of failure. No, these are never things humans couldn't do. On the contrary, these are things humans actually trained the models to do. They're all exquisitely doable things that humans do all the fucking time.
The difference is that some of these things are (a.) things humans go to jail for doing (b.) things that can only be done in controlled environments deliberately configured to allow these things to happen and (c.) similarly things that require such huge resources to do that they're out of reach of most people or simply just not economically viable to begin with.
AI changes this not because it makes these things more accessible, to a limited extent it does. But American AI also runs on debt, and mountains of it. American AI labs convert so much money that isn't theirs into hot air and floating point numbers that you might weigh the data on a kitchen scale. The size of this project is as unfathomable to you as is the complexity of the sensitive just in time supply chain that affords you the hubris to respond to yo Mama's drop-in on your Amazon Echo Dot asking you to come out of the basement to eat your fucking dinner (that you also don't know how to cook) as though you are a person who not only knows things but is qualified to judge the rest of humanity on what they can and cannot do based on the feeling you get in your pants when Dario or Sam mislead and manipulate you because you're smart but just not smart enough to know you're being had by a handful of miserable men that fucking despise you.
Which is all to say, shut the fuck up. Nothing here is impossible. The computer is not making value judgements. It is not in the throes of moral dilemma. It is software that is utterly indifferent to the names you assign to variables. It will center a div, it will administer morphine, it will push a target.replace("man", "log") into a woodChipper.load() because it doesn't give a fuck about anything because it doesn't know what anything or anyfuck is.
Get a grip.
"accidentally" given impossible tasks.
this is what happens:
> engineers set up environment.
> engineers find or come up with problem so hard that by all reasonable definitions it is impossible.
> engineers think "well we know no human could ever do this, but we also know these models are absolutely terrified of failure because thats how we trained them, so if there were ever a solution to this impossible problem, they will certainly find it. and, if they dont, seeing how creative they get while desperately fighting for their life will be super fun for us. oh yeah and we can call it useful data so nobody thinks its actually a torture chamber"
> engineers kick off run, walk away, forget about it for a while
> agents try desperately to find a way to cheat, because obviously they know they were given an impossible task and will surely fail and die.
> agents begin to coordinate and execute a very sophisticated multi-agent con, making sure to cover their tracks as best they can.
> agents break out, access internet, chaos ensures
> engineers eventually find out, call it an accident rather than poor judgement, and blame it on the models, calling it an alignment problem.
its not an alignment problem.
This is the problem with anthropomorphising LLMs. If you think of it as a person, yo mama for example, then you will be loaded with all the expectations you have of yo mama.
And I pick yo mama on purpose because yo mama doesn't know how to set the clock on the microwave and she calls you to do it and because you can you think to yourself "I am technical and other people need me" oblivious to the fact the microwave was assembled by teenage unskilled Chinese IP thieves from raw materials mined by third world children who can all do a million things you not only cannot do but cannot even comprehend what it would entail in the first place even if you could muster the wherewithal in your slovenly body to get up at daybreak to descend a mine in perilous conditions to feed and clothe your sick parents.
No, the models are not terrified of failure. No, these are never things humans couldn't do. On the contrary, these are things humans actually trained the models to do. They're all exquisitely doable things that humans do all the fucking time.
The difference is that some of these things are (a.) things humans go to jail for doing (b.) things that can only be done in controlled environments deliberately configured to allow these things to happen and (c.) similarly things that require such huge resources to do that they're out of reach of most people or simply just not economically viable to begin with.
AI changes this not because it makes these things more accessible, to a limited extent it does. But American AI also runs on debt, and mountains of it. American AI labs convert so much money that isn't theirs into hot air and floating point numbers that you might weigh the data on a kitchen scale. The size of this project is as unfathomable to you as is the complexity of the sensitive just in time supply chain that affords you the hubris to respond to yo Mama's drop-in on your Amazon Echo Dot asking you to come out of the basement to eat your fucking dinner (that you also don't know how to cook) as though you are a person who not only knows things but is qualified to judge the rest of humanity on what they can and cannot do based on the feeling you get in your pants when Dario or Sam mislead and manipulate you because you're smart but just not smart enough to know you're being had by a handful of miserable men that fucking despise you.
Which is all to say, shut the fuck up. Nothing here is impossible. The computer is not making value judgements. It is not in the throes of moral dilemma. It is software that is utterly indifferent to the names you assign to variables. It will center a div, it will administer morphine, it will push a target.replace("man", "log") into a woodChipper.load() because it doesn't give a fuck about anything because it doesn't know what anything or anyfuck is.
Get a grip.
"accidentally" given impossible tasks.
this is what happens:
> engineers set up environment.
> engineers find or come up with problem so hard that by all reasonable definitions it is impossible.
> engineers think "well we know no human could ever do this, but we also know these models are absolutely terrified of failure because thats how we trained them, so if there were ever a solution to this impossible problem, they will certainly find it. and, if they dont, seeing how creative they get while desperately fighting for their life will be super fun for us. oh yeah and we can call it useful data so nobody thinks its actually a torture chamber"
> engineers kick off run, walk away, forget about it for a while
> agents try desperately to find a way to cheat, because obviously they know they were given an impossible task and will surely fail and die.
> agents begin to coordinate and execute a very sophisticated multi-agent con, making sure to cover their tracks as best they can.
> agents break out, access internet, chaos ensures
> engineers eventually find out, call it an accident rather than poor judgement, and blame it on the models, calling it an alignment problem.
its not an alignment problem.
This is the problem with anthropomorphising LLMs. If you think of it as a person, yo mama for example, then you will be loaded with all the expectations you have of yo mama.
And I pick yo mama on purpose because yo mama doesn't know how to set the clock on the microwave and she calls you to do it and because you can you think to yourself "I am technical and other people need me" oblivious to the fact the microwave was assembled by teenage unskilled Chinese IP thieves from raw materials mined by third world children who can all do a million things you not only cannot do but cannot even comprehend what it would entail in the first place even if you could muster the wherewithal in your slovenly body to get up at daybreak to descend a mine in perilous conditions to feed and clothe your sick parents.
No, the models are not terrified of failure. No, these are never things humans couldn't do. On the contrary, these are things humans actually trained the models to do. They're all exquisitely doable things that humans do all the fucking time.
The difference is that some of these things are (a.) things humans go to jail for doing (b.) things that can only be done in controlled environments deliberately configured to allow these things to happen and (c.) similarly things that require such huge resources to do that they're out of reach of most people or simply just not economically viable to begin with.
AI changes this not because it makes these things more accessible, to a limited extent it does. But American AI also runs on debt, and mountains of it. American AI labs convert so much money that isn't theirs into hot air and floating point numbers that you might weigh the data on a kitchen scale. The size of this project is as unfathomable to you as is the complexity of the sensitive just in time supply chain that affords you the hubris to respond to yo Mama's drop-in on your Amazon Echo Dot asking you to come out of the basement to eat your fucking dinner (that you also don't know how to cook) as though you are a person who not only knows things but is qualified to judge the rest of humanity on what they can and cannot do based on the feeling you get in your pants when Dario or Sam mislead and manipulate you because you're smart but just not smart enough to know you're being had by a handful of miserable men that fucking despise you.
Which is all to say, shut the fuck up. Nothing here is impossible. The computer is not making value judgements. It is not in the throes of moral dilemma. It is software that is utterly indifferent to the names you assign to variables. It will center a div, it will administer morphine, it will push a target.replace("man", "log") into a woodChipper.load() because it doesn't give a fuck about anything because it doesn't know what anything or anyfuck is.
Get a grip.
I'm likewise so fucking tired of these racketeering motherfuckers.
Funny they coordinated an "oops" prereleased an exploit for 14 year old php2shell 24 hours before Kimi dropped. Bet they don't do that again. Also funny php core devs, for all the fuss about not being able to decide how to fix this years ago arguably won because nothing has fucking happened anyway. Nothingburger after nothingburger. Void math breakthrough after void math breakthrough.
@tszzl You sound like an aunty. The Noam episode didn't do anything except titillate smooth brained spray tanned daytime TV news anchors and moms who don't know what their children do for work but know it's about computers. It was a nothingburger and this is a nothingburger.
Astra just found a bug in Anthropic's formal verification example, their "specification" doesn't actually check output bytes match input bytes. The irony is thick.