Ben Zorn (he/him) https://aka.ms/zorn

Partner Researcher, RiSE group, Microsoft Research, Redmond. Interests include programming languages, spreadsheets, responsible AI, generative AI, CRA-Industry.

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

My paper with @ReshabhSharma01 and @shraddha_96, “Willful Disobedience: Automatically Detecting Failures in Agentic Traces”, will appear this month in the First ACM Conference on AI and Agentic Systems (CAIS 2026). https://t.co/xQMO55b7q6

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

It explores verifying the behavior of agents and proposes an AI-based approach to extracting specifications from agent system prompts and using them to evaluate agent trajectories. We have also released our project as open source here: https://t.co/3B4wUwrU6M

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

My paper with @ReshabhSharma01 and @shraddha_96, “Willful Disobedience: Automatically Detecting Failures in Agentic Traces”, will appear this month in the First ACM Conference on AI and Agentic Systems (CAIS 2026). https://t.co/xQMO55b7q6

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

Working with @pelikhan and @dsymetweets, we published the blog post on our experiences structuring repositories to support agentic development. https://t.co/7gb1ntFQFL #agents #AI #softwaredevelopment #softwareengineering #artificialintelligence #agenticsoftware

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

@ReshabhSharma01 , Peli de Halleux, and @shraddha_96 and I have written a new blog post, https://t.co/YpaY2UNgBU, where we say that testing AI software requires innovative new methods. #SoftwareTesting #SoftwareDevelopment #ArtificialIntelligence #SoftwareTools #LLMs #AISoftware

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

#ArtificialIntelligence #SoftwareDevelopment #SoftwareEngineering #LLMs #Prompts #Testing

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

With Reshabh K Sharma, Peli de Halleux, and Shraddha Barke, we just released "PromptPex: Automatic Test Generation for Language Model Prompts"(https://t.co/h3RJ9YEGiT).
Repo: https://t.co/tiCLgQBEAG. PromptPex is a tool to generate and evaluate unit tests for an AI model prompt.

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

@senderPath @UCBerkeley I'd love to learn more about Vision Pro. If you are interested in scripting AI, I suggest you check our my open-source project GenAIScript, a JavaScript-based scripting language to easily leverage AI models in small programs. https://t.co/VCYtGyTj4N

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

I'm working with the MS AI Red Team and looking for summer intern candidates interested in AI Security. PhD candidates with experience and skills in #ML, #security, #LLMs apply:
https://t.co/cnxcFZUdj9

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

Looking for summer intern candidates interested in building tools to help author, test, debug, and deploy AI model prompts. PhD candidates with experience and skills in #ML, #RL, #NLP, #LLMs, & SE apply: https://t.co/HTAjPbWVFe #AI #SoftwareEngineering #LLM #PromptEngineering

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

I just co-authored a blog post arguing that #LLM #prompts are programs and require new research from #ProgrammingLanguages and #SoftwareEngineering. We need to rethink our #SoftwareTools to work for prompts https://t.co/yuC4FmIreJ

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

GenAIScript is open source. Try it out now! https://t.co/VCYtGyTj4N

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

Thrilled to see my collaborator, Peli de Halleux, describe our project GenAIScript, a programming language for easily leveraging hashtag#GenAI in you scripts. #generativeAI #AI #scripting https://t.co/X4VS4KK0qH

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

Very happy to see my CRA colleagues Michaela Taufer and Holly Yanco also named as @AAAS Fellows!
CCC Council Members named 2023 AAAS Fellows - https://t.co/tdY4nqDA54 via CCC Blog

[Aws Albarghouthi @awsTO]

I'm coediting the SIGPLAN blog with Adrian Sampson.

New post by @benzorn and @emeryberger makes the argument that "AI Software Should be More Like Plain Old Software"
https://t.co/u6KGlUMTSd

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

Just co-authored a blog post with @emeryberger arguing that #AI requires dramatic changes in #computingsystems research. #programminglanguages #computingresearch #LLMs #ML #computers https://t.co/XPeqfxlL6D https://t.co/HMwl57YkvU #POSW #AISW

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

I am extremely honored to be named a Fellow of the American Association for the Advancement of Science (AAAS). It is a lifetime dream to be recognized for my contributions by this esteemed organization!

[Microsoft Research @MSFTResearch]

Ben Zorn, Partner Researcher, has been elected as an @aaas Fellow for his distinguished contributions to programming language design and implementation, and volunteer leadership in the profession.

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

Prompts are the new programming language, #LLMs are the new hardware architecture, and AICI is the new LLM ISA that guides the LLM to generate correct content. #ArtificialIntelligence #LargeLanguageModels

[Ben Zorn (he/him) https://aka.ms/zorn @benzorn]

Exciting developments in engineering the interface to #ArtificialIntelligence #FoundationModels #LLMs from @MSFTResearch.
AI Controller Interface: Generative AI with a lightweight, LLM-integrated VM https://t.co/v4XhTTkOzy

[Microsoft Research @MSFTResearch]

The AI Controller Interface helps researchers and developers to efficiently implement existing strategies for controlling LLMs and invent new ones, enhancing LLM generation through improved accuracy, privacy, and compliance with formatting standards. https://t.co/hbY3arAgw7