@iamgingertrash A finetuned GPT4-V does not come close to driving a car in realtime, but with enough compute/time it would be able to.
I bet that if you give a well engineered large team of agents an hour of contemplation per second in the simulation, it will drive reliably.