Active Site

Measuring frontier AI in synthetic biology

[Active Site @ActiveSiteBio]

@ShenZhouHong @alexjkleinman @alymathiowetz @adamhowes @xave_rg @lucafrighetti @fmf_org @ClaireQureshi @PackardFdn You can read more here:
📝arXiv preprint: https://t.co/XJK0tkwyzK
📔Blog post: https://t.co/eZCccTE9rt
🔮Predictions from @Research_FRI: https://t.co/Iv7re2AQpx

[Active Site @ActiveSiteBio]

@ShenZhouHong @alexjkleinman @alymathiowetz @adamhowes @xave_rg @lucafrighetti @fmf_org @ClaireQureshi @PackardFdn You can read more here:
📝arXiv preprint: https://t.co/XJK0tkwyzK
📔Blog post: https://t.co/eZCccTE9rt
🔮Predictions from @Research_FRI: https://t.co/Iv7re2AQpx

[Active Site @ActiveSiteBio]

We ran a randomized controlled trial to see if LLMs can help novices perform molecular biology in a wet-lab.

The results: LLMs may help in some aspects, but we found no significant increase at the core tasks end-to-end. That's lower than what experts predicted.

Our findings 🧵

[Active Site @ActiveSiteBio]

Shout out to @ShenZhouHong, @alexjkleinman, @alymathiowetz, @adamhowes, @xave_rg, @lucafrighetti, Joe Torres, Julian Cohen, Suveer Ganta, Deepika Pahari, Alex Letizia

Thank you @fmf_org , @ClaireQureshi, and @PackardFdn for supporting our work and to our advisory board.

[Active Site @ActiveSiteBio]

We're actively hiring for scientists and operators!

We especially want to find a Head of Ops to help build an engine to repeat this study regularly and develop entirely new ones.

https://t.co/5UTjlNOsgH

[Active Site @ActiveSiteBio]

Importantly: this is a snapshot of mid-2025 novice and LLM performance.

Results could change as new LLMs become more capable, easier to use in the lab, and as average elicitation skill improves.

As models evolve, we aim to continue tracking how people use frontier AI in biology