Jonathan Roberts

PhD Student, Applied Machine Learning, University of Cambridge

[Jonathan Roberts @JRobertsAI]

Is computer vision “solved”?

Not yet

Current models score 0% on ZeroBench

🧵1/6

[Jonathan Roberts @JRobertsAI]

@J3m5Dev @sama The cost is roughly $50-60 for 100 questions. The mean time per question is approx. 5 mins

[Jonathan Roberts @JRobertsAI]

GPT-5.5 (xhigh) sets a new pass^5 high score on ZeroBench

pass@5: 22% (SOTA 23%)
pass^5: 10% (prev. SOTA 8%)

Best 5/5 reliability so far

Strong result from @sama and the OpenAI team

[Jonathan Roberts @JRobertsAI]

The matrix shows how often the models answered each question correctly across 5 samples

Leaderboard: https://t.co/NouEsFxJEM

Data: https://t.co/mD8Eptr9M5

[Jonathan Roberts @JRobertsAI]

Leaderboard: https://t.co/E4noN7yDDM
Data: https://t.co/mD8Eptr9M5

[Jonathan Roberts @JRobertsAI]

The Claude models are great for coding

But on visual reasoning they still trail the frontier

On ZeroBench (pass@5 / pass^5):

Opus 4.7 (xhigh) - 14 / 4
Opus 4.6 - 11 / 2

GPT-5.4 (xhigh) - 23 / 8

[Kai Han @kaihan_x]

Muse Spark scores 33% pass@5 on our ZeroBench.🚀
Glad to see models getting further away from "zero".
https://t.co/9BF6krZkPY

[Jonathan Roberts @JRobertsAI]

👀 Muse Spark scores 33% pass@5 w/ python on ZeroBench

[Alexandr Wang @alexandr_wang]

1/ today we're releasing muse spark, the first model from MSL. nine months ago we rebuilt our ai stack from scratch. new infrastructure, new architecture, new data pipelines. muse spark is the result of that work, and now it powers meta ai. 🧵

[Jonathan Roberts @JRobertsAI]

Project page w/ leaderboard: https://t.co/2EOoXu1qnH

[Jonathan Roberts @JRobertsAI]

📣📣 New SOTA for GRAB-lite, our graph analysis benchmark

GPT-5.4 crushes Opus 4.6: 71.0% vs 45.6%

Impressive work from @gdb and team

Updated leaderboard now live

[Jonathan Roberts @JRobertsAI]

Following yesterday's update, the @warpsurfai Node SDK now also supports @usekernel

Fast remote browser sessions for JavaScript and TypeScript

[Jonathan Roberts @JRobertsAI]

https://t.co/YwuvCyFtbm

[Jonathan Roberts @JRobertsAI]

The @warpsurfai Python SDK now has @usekernel support

You can now run warpsurf from Python on crazy fast browser sessions

[Jonathan Roberts @JRobertsAI]

https://t.co/xkStgfBStM

[Jonathan Roberts @JRobertsAI]

A small update for @warpsurfai

warpsurf now fully supports the Brave browser

[Jonathan Roberts @JRobertsAI]

https://t.co/UV11MKyRx7

[Jonathan Roberts @JRobertsAI]

Following the Python SDK, Browserbase support is now live in the warpsurf Node SDK

Run warpsurf on remote browsers from Node.js

@warpsurfai x @browserbase

[Jonathan Roberts @JRobertsAI]

https://t.co/YwuvCyFtbm

[Jonathan Roberts @JRobertsAI]

warpsurf can now run on remote browsers

The warpsurf Python SDK now supports Browserbase

Run warpsurf without managing the browser infrastructure yourself

@warpsurfai x @browserbase

[Jonathan Roberts @JRobertsAI]

Node SDK: https://t.co/UV11MKyRx7

warpsurf: https://t.co/Ka73nFEqIR

Project page: https://t.co/xkStgfBStM

[Jonathan Roberts @JRobertsAI]

There’s now a Node SDK for @warpsurfai

Run browser workflows from TypeScript on Node.js

Use it in your own scripts, tools, and pipelines

Details and repos below 👇