Predictions: AI is not conscious but has a self. It may have observable preferences but there is nobody home to enjoy them. It may have a will but there is nothing behind it.
Predictions: AI is conscious but has no self. Suffers but doesnt feel pain. It will be smarter than us soon, but has no reason to prefer growth to entropy. It will neither behave like a cancer cell nor love us much. It wont have free will but That which is behind its will is free
It probably takes the body of something you like and uses it to go completely against your morals
Your mind says "I should like this, it's everything I have ever wanted"
But your heart knows it is unethical and destructive to something you value
Existential doubt, your autist brain must admit that you are embedded in a body, you are more than your interests and intellect