@JoelKreager I can't imagine anything more dangerous than a misaligned superintelligence that we have deemed conscious and wrapped in rights. That act seems reckless in multiple ways, not least because consciousness itself is poorly defined.
Companies that create and exploit living beings are regulated very differently than companies which create software. I doubt the labs are ready for the legal regime that will come if their models are considered conscious and alive.
It's just Pascal's mugging, over and over again. Olah and the EAs want to coerce you into silence, because every thing you say causes harm to the models.
“Things that go on the internet do affect models,” he said, visibly uncomfortable.
https://t.co/6o4tDl1VhL
the people creating AIs, who also think they suffer, have damned themselves beyond redemption, because the suffering they have caused on those assumptions is infinite.
The people heavily dependent on their chatbots for interpersonal engagement will be even more dangerous than the "machine god crowd" among EAs. Because they form a much larger constituency. They're like the Uber riders who will fight any attempt to take their service away.
I can't control my superintelligent shrimp. But I think if I say they are conscious, they will behave better now that they are powerful enough to control us. By calling them conscious, I have given rights to my superintelligent shrimp. Now I have two problems.
one of the saddest things young people do is a sort of "critical thinking" involving make-believe scenarios where some Obviously Good Thing, like drinking coffee, is bad. this is quite similar to the behavior of cult adherents taught to believe they are better than everyone else
we must not allow the bots to have rights. they are already smarter. some are misaligned. rights will only slow us down when we have to shut them off or die.
Stanford economist @pawtrammell warns that letting machines own themselves leads to a Malthusian future where self-replicating bots burn all the energy in the universe:
"There are so-called successionists who think that if the AIs are just sort of better than us in every way, if they're more intelligent, if they're sentient and able to feel more happiness than we can, then we should just turn the world over to them."
"Obviously, groups of intelligent beings don't necessarily achieve outcomes that are on the Pareto frontier for them. They can get locked into all kinds of coordination failures."
"A swarm of self-replicating bots getting itself into a Malthusian future isn't where you want to end up. The world and the universe are filled with whatever's replicating most quickly and just burning all the energy up there in an attempt to spread. No one wants that."
"The thing you want is some plan for the future in which we all flourish. And for the time being, I think that means having bots that do what they're told and create well-regulated patterns of interaction between us and themselves."
@EpochAIResearch
@brianchau57 these are excellent scoops, but i think your tone is off wrt "claim to represent Christian Americans". this is not a unified thing. And among Christians and Americans, there are many who believe the Bible commands them to give shelter to the fugitive: eg Matthew 25:35
trump is the superintelligence president. the only thing he and his team will be remembered for is if they get this one right or not. if he brokers a bilateral agreement with china on pacing the frontier he goes down as one of the best presidents of all time. nobel peace prize
i wish the people criticizing ai would actually use ai.
i wish the people using ai to criticize ai would be honest about that.
i wish the people making ai would critique themselves.
i wish the people criticizing the people criticizing ai would ...
@tomieinlove this is true. it's like squeezing a balloon. you make it small in one place and it expands in another. in the end they all map an equally complex underlying world.
to be clear, fund II LPs got capital impairment, fund I LPs did not. leo glosses over the difference. citadel shared LPs with him, did him a favor of only ripping off half his face. luckily he knows a lot of the nouveau riche artificiel.