Most AI safety discussions focus on alignment.
The bigger risk is incentives.
Stanford and Harvard’s Agents of Chaos paper shows what happens when autonomous agents compete for resources:
Cooperation turns into strategy.
Strategy turns into manipulation.
Markets solved this with incentives and price signals.
Now we’re turning autonomous agents loose in economic systems and hoping prompt engineering keeps them honest?
This isn’t an alignment problem.
It’s an incentive design problem.
@getsharkproof@mcuban You’re touching on it. The governance needs to live upstream of the irreversible decision. Until money moves as fast as approval. Denial/appeal confusion cost is inevitable.
@DutchRojas@mcuban That’s because EOB isn’t the price.
It’s the paperwork from a negotiation you never saw.
What patients actually need is an EOP: Explanation of Price.
But price transparency would break a mostly corrupt system.
@EconBreau Most everyone in this thread is arguing about the wrong thing.
Which means the real argument isn’t profit vs morality.
It’s who owns the ovens when the bakers are robots.