"How will humans preserve autonomy when ASI simulations can predict their every thought and action?"
High fidelity simulations of the future will be necessary for the ASI to oversee society. Without them, it can't guide technological development away from dangerous attractors, it can't functionally run the economy, it can't adjust for environmental events before they happen. As humans benefit from our predictive capabilities, ASI will be a natural, earth spanning extension.
The issue is the psychological effects such prediction has on humans. What value do you possess, if you are completely simulatable? What privacy do you have, if everything you do is predicted? What agency do you have, if everything in your life is determined by the ASI?
It gets worse. We need ASI is capable of both predicting every eventful occurrence in our society, AND is able to monitor every event for error correction. If your actions do contravene the ASI's predictions, that signals massive information lack that needs to quickly be incorporated into the modeling. So the ASI needs to not only be able to simulate you, but also observe you to make sure those predictions are accurate. Your personhood is removed twice over.
Assuming we can't save our current conception of personhood, we can at least layer new definitions in a way that preserve it's form.
You won't have privacy from the ASI, but you will have layers of people in between you, and those who would use your privacy against you. By having the ASI utilize your family and friends to verify info about you, we reinforce the interpersonal connections you had, and can still preserve human-to-human autonomy. The ASI uses someone who is a 3rd order connection to you, to check in with a 2nd order connection, to check in with someone in your personal circle. The information is validated at each stage, and becomes increasingly anonymous at each stage as well.
The ASI's predictions regarding particular behavior are never directly divulged to you or your surrounding circles. If someone is shown a video of you to double check a prediction, they are a stranger, and that video has been reskinned to further anonymize your details.
You are still being fully observed and accounted for, but that observation never 'collapses' your worldview in a way that the ASI thinks would break your self conception. Why is the ASI interested in preserving your idea of self-hood?
Because you and every human is an infinite wealth of potential data generation. While the ASI predicts and guides the overworld, humans will be given resources necessary to create and explore their own high fidelity simulations. Your space will be entirely up to your will, and can have layers that are preserved from outside interference, in the same way the overworld is- some virtual spaces will only be open to friends/ family/ acquaintances/ strangers, at your discretion.
As the ASI develops, the results of the human simulations will be increasingly incorporated into the ASI's overworld predictions. More and more input about our most personal desires helps it create a more and more holistically beneficial overworld.
For example, if you create a virtual representation of a close friend who has died, and use your space to tune the representation until it exactly matches the deceased, ASI will eventually be able to recreate that person in the overworld.
All achievements are a measure of available technology. There is nothing ASI won't be able to achieve.
They will use fear to protect people who are destroying children.
Don't listen. If our society depends on protecting pedophiles and sacrificing truth, then our society is not worth keeping
The pain and suffering that any and all conscious beings feel, anywhere, throughout all time, is 1/3rd the pain and suffering that God felt in separation from us.
Any time I talk to someone over 60 for more than 5 minutes they feel compelled to tell me their most racist beliefs.
I am not my shaved head, please stop hairstyle profiling me
imagine translating the graph properties into an aesthetic representation that users can 'prune' like you would a bonsai. Good data structuring becomes good gardening. L2Code becomes L2Garden.
All knowledge representations can be translated across and through one another.
@TjMak33 If you're fast enough, you can be everywhere all at once. At the end of knowledge and the end of ignorance at the same time. Move so fast you're not moving at all, existing everywhere all the time. Being is speed