The hard way was beautiful.
The hard way is also done.
On mastery, grief, and what happens when your hard-won skills become abundant. https://t.co/COV8sOcK7G
I feel this is an example where AI assistants won't be as effective as human.
If a human EA deflects me, there's enough room for error I could believe the lie that the EA messed up.
If someone's robot deflects me, I assume that they put me in the Not Important bucket. The accountability falls straight through to the human directing the machine.
Sure, agents mess up a bunch now. But to be trusted for the masses, they're going to have to mess up a lot less. And at that point "the robot ignored my instructions" becomes less of a believable lie.
Indeed, you're not alone.
I'm unclear if it's commerically viable to find our way to a Harvard arch. Possibly given what is practically exploitable now? depends on economic impact of breaches.
Traditionally we've done a poor job holding companies accountable so they aren't incentivized to spend much on improvements that only give them a more secure baseline.
@nichochar Yeah, I'd agree, they've been the most consistent on their position and goals over the years.
just a hard thing to market without creating confusion.
The goal of resilience engineering and security isn't to prevent every failure or breach. That's not possible. It's to limit downside + give you a path to fast recovery, within acceptable financial bounds of your business.
I am beginning to think shit just goes down all the time and we tend to ignore it because we aren't primed to panic that its the beginning of something bigger as we are now with AI
@nichochar you're right, though I'd say it's more than slightly dystopian
mostly interested in how the cat and mouse will evolve as people game the systems.
better attribution going to become critical
Tapping my sign. Some words to live by:
"Risk will never be eliminated from high-risk systems....stop trying to fix the systems in ways that will only make them riskier."
https://t.co/yYoWidARFF
@timnitGebru To be fair, this has always been true with SaaS systems. Many 3P APIs change behavior in a way that breaks your internal assumptions.
I've seen Stripe, Salesforce, SAP, Incident IO, Notion, etc updates take down critical biz systems.