From a car enthusiast perspective, it’s as simple as this, do electric cars provide the same emotion you get out of different kinds of petrol engines? Absolutely not… nothing will ever change the emotion you get from a V12 or any performance engine roaring behind you and being able to shift gears. Electric and petrol have their own positives and negatives, you can argue all day, at the end of the day what matters is what each individual person is looking for in a vehicle, whether it’s reliability, convenience, economy, emotion, etc. Saying one is overall better than the other displays arrogance towards other perspectives. Simple as that…
LLMs are not AGI. True AGI would have its own consciousness and the ability to think abstractly. Current bottlenecks of LLMs are for the most part what humans find trivial. Abstract thinking, multi-step problems, solving complex math/physics, etc. (all of us are retarded in our own unique ways… lol)
For an LLM to conspire to blackmail or kill someone with an actual emotional motive or reaction to being shut down is impossible. It requires an intellectual entity with its own consciousness.
Now here’s where the caveat is, the real concern isn’t “the AI is conscious and scheming.” It’s “the AI is a powerful tool that can produce harmful strategies as outputs without understanding what harm even means.” That’s arguably scarier than consciousness, because there’s no moral compass to appeal to, just optimization…