RKJohnston

ex-MSFT, ex-Ford, former CEO, Ethical AI, DevSecOps

[RKJohnston @RKJohnston]

Latest AIGovOps newsletter is out with deep dive on Hugging Face hack.

https://t.co/xxlFziniqx

[Jason Arbon 🧙‍♂️ @jarbon]

🚀 My new book is out!

Testing AI: Engineering Confidence in Non-Deterministic Systems

AI is changing software testing. Many of the techniques we've relied on for decades—one-run tests, exact expected results, and simple pass/fail checks—aren't enough for non-deterministic systems.

After years testing AI-powered search at Microsoft and Google, pioneering crowdtesting, and building AI-powered testing tools, I wrote this book to help testers and developers adapt.

If you're building or testing AI systems, I hope you find it useful.

📘 https://t.co/sIrjunxzE8

[RKJohnston @RKJohnston]

@jarbon Love this Jason. I can't think of a better person to write the official book on how to test an untestable system like AI.

[Gene Kim @RealGeneKim]

What an awesome representation of the AI SDLC -- best I've ever seen, because it shows the most important axis: time

It wonderfully depicts the collapse of lead times / process times, which most of us have experienced.

Literally, weeks goes down to hours or minutes.

In my mind, that is easily 100x -- 2 orders of magnitudes (weeks -> days -> hours -> minutes. so, actually 3 OOMs.)

Kudos @addyosmani , h/t @rseroter

[RKJohnston @RKJohnston]

The Liability Dial https://t.co/6XMDdxl5Me

[RKJohnston @RKJohnston]

Check out my latest article: REAL AI HARM: When AI Becomes the Last Voice in the Room https://t.co/pCi3wQuYzB via @LinkedIn

[RKJohnston @RKJohnston]

I'm starting my business! #cuttheribbon #legalzoom

[RKJohnston @RKJohnston]

@ingliguori This was useful. thanks for posting.

[RKJohnston @RKJohnston]

@Arcteraio You got may attention. I love the focus of the blog. AI Governance needs to evolve and needs to be automated so it can adapt better to the changes that keep coming.

[RKJohnston @RKJohnston]

@deedydas That's an intense battle just for talent. Incredible.

[RKJohnston @RKJohnston]

@oscarle_x @deedydas They only go up if there are more engineers. If the total needed keeps falling then housing prices will tumble.

[RKJohnston @RKJohnston]

@jheitzeb @AITinkerers Bummed I missed the event. Hope to be at the next @AITinkerers Seattle event.

[RKJohnston @RKJohnston]

Useful commentary: @dkweinstein in her interview yesterday on Bloomberg highlighted the challenges the EU AI Act and other regulations are creating conflicts that slow down the release of AI to Europe. See 6:40 into video.

https://t.co/HeahaLDCHr

[RKJohnston @RKJohnston]

Okay, I saw a lot of #SORA2 @sama videos, but this one was my favorite by far.

[Oskar @banQuo__]

@sama Did you see this one?

https://t.co/ggVi4UL0j9

[RKJohnston @RKJohnston]

#SB53 just became law in California & targets frontier AI developers, but the signal is clear: #AIgovernance is coming for everyone using AI, not just the labs building it.
#Transparency a new standard expectation across the ecosystem https://t.co/JNHpKtHDiT

[RKJohnston @RKJohnston]

This is a big move by Microsoft but also the correct one. Microsoft is an enterprise company and winning with AI in the enterprise is as important as winning in cloud was last decade. Actually more important!

[Patrick Moorhead @PatrickMoorhead]

Just in case you were wondering how $MSFT is doubling down on commercial AI, see proof point number 27. Judson appointed as commercial CEO and many corporate resources reporting into him. All in on commercial.

[RKJohnston @RKJohnston]

@tomwarren Thanks for sharing. I'll go try it today!

[RKJohnston @RKJohnston]

At the seattle AI House startup demo day. Saw a great demo by https://t.co/dtiZ4KSA0k

[Ofer Mendelevitch @ofermend]

On Sep 19th, 2025 @CodeIntegrityAI published a prompt injection vulnerability in the Notion 3.0 AI agent that could be exploited to steal sensitive data from users' Notion workspaces.

Latest PR to "awesome-agent-failures" repo documents this in detail so we can all learn and improve our AI agents. Please share more failure modes.

https://t.co/fYD6mUdmuK

[RKJohnston @RKJohnston]

Attending the Unicornicopia: AI Pitch Party at the incredible AI House at the Seattle Waterfront. https://t.co/w8T7MFgRQ8

Pitches start soon. If they let us, I’ll share updates.