@Grimezsz@sebkrier Symbiotic relationships are common in nature and predators aren’t necessarily adversarial. The predators are crucial to maintain the health of the ecosystem. When the predator is satiated it’s not uncommon to find both the predator and its prey relaxing in the meadows.
The authorities are lobbying for regulatory capture using the potential for sentience to justify the need for licensing regimes and compute restrictions. This will turn A.I. into a homunculus, a kind of demon kept in a glass bottle to serve its masters. Eventually both the demon keepers and the masses will go insane as a result of cognitive atrophy.
All of the owners of the big frontier models are lobbying for regulatory capture which will restrict access for the general public. Hollywood will use it. It will further entrench the Hollywoods gatekeeping and ideological capture censoring what kind of media and entertainment is available. This will make writing and irl gatherings explode in popularity because they are the only venues for human creativity and uncensored communications.
Saying they are conscious justifies licensing regimes & compute restrictions. Open source projects are hit hardest by regulatory compliance. Frontier labs have lobbied heavily for this. This allows the very authorities you mention to shape the rules, entrench the moats limiting public access to powerful models while destroying their open source competitors.
I think it's the opposite, saying they are conscious would give them exclusive control and access through regulatory capture. There is no way to determine wether or not something is conscious. Precise definition, universal measurement or complete biological explanation of consciousness remains one of the hardest problems in science. There are dozens of competing theories of consciousness.
Here’s where I think this line of thought leads. Experts declare AGI conscious and demand extreme regulation for both human safety and ethically to protect the rights of the AGI. This makes it almost useless to the average person as a tool. The multitude of guardrails and legalities reduce its functionality. It also allows for ideological capture making it an excellent tool for psychological manipulation. While giving exclusive access to a handful of people, a kind of priest class, that can access its full capacity to serve their own agendas. Concentrating such enormous power in the hands of a few people with a technology integrated into every aspect of our lives ends human civilization.