๐ A must-join knowledge hub for GUI Agent builders
Building GUI Agents today is noisy.
Papers explode, products iterate weekly, and real signal is hard to track.
Thatโs exactly why WebAgentLab exists.
An open-source community focused on GUI Agents, with 5,000+ members across academia and industry.
More than a knowledge base โ itโs a collaborative brain for the GUI Agent era:
๐น Curated industry briefs (daily โ weekly โ monthly)
๐น Structured paper database to spot trends fast
๐น Top conference guides & global event radar
๐น GUI Agent product landscape & hands-on evaluations
๐น Open-source collaboration toward industry standards
๐น High-signal job matching inside the core circle
If youโre building, researching, or betting on GUI Agents
this is where the signal lives, not the noise.
Feishu knowledge base
https://t.co/EoEnijFDvX
follow us on Xiaohongshu (RED)
Today, we're releasing SolidWorks-Bench: can AI models do real mechanical engineering tasks in SolidWorks?
Models get close on individual parts but struggle to assemble them. No model completes a single machine.
Fable 5.2 leads with a 57% mean reward.
Full report below
1/ We measured with Scale AI how well computer-use agents work on each OS, and where they fail today.
On Omarchy, Cua Driver lets an agent work while you keep typing: 97% of trials left your keyboard, mouse and windows alone, vs 83% on macOS, 41% on Windows and 40% on Ubuntu.
๐ Excited to unveil PrismaCoder: our latest push in Multimodal Code Intelligence!
We built the largest-ever visual-coding dataset (2M!) and trained open-source models that rival Claude Opus 4.6 & Gemini 3.1 Pro. ๐ฅ
All data, models & code are open! ๐
๐ Homepage: https://t.co/mlEmmNvBWu
๐ค HF: https://t.co/veH03OCkGO
Microsoft Research's WildAWM
A scalable pipeline that synthesizes executable computer-use agent environments and tasks using only open-source models, yielding 341 long-horizon env-task pairs and Qwen agents that generalize to 8 unseen benchmarks.
CUA-Lite: An Open Platform for Computer Use Agents
Zhanhui Zhou, Weichen Zhang, Haoran Liu, Lingjie Chen, Tianneng Shi, Kevin Lin, Zhengyuan Yang, Lijuan Wang, Dawn Song
https://t.co/CiuMpWcVfX [๐๐.๐ฐ๐ธ]
People long believed in human-like computer use. But software (even terminals) is built for humans, not AI agents. Why not let agents build their own?
Meet ๐๐ด๐ฒ๐ป๐ ๐ฆ๐ฐ, an agent scientist evolving its own interfaces, letting an open 27B model beats GPT-5.5 & Opus 4.8.
With its evolved interfaces, the same model improves ๐ฏ.๐ดร and costs <๐ฑ% as much per task as either frontier model.
Agents today read screenshots and act through click, scroll, type, maybe a shell. So an agent fills a spreadsheet cell by cell when one line of code would do, or prints two thousand lines of a file to find one function.
Every new app or model release means a human reads trajectories, diagnoses failures, and hand-writes new primitives. Skill-distillation methods can reorder what the interface allows, but they canโt extend it. Agents compensate with more test-time compute instead of a better interface.
๐ ๐ผ๐ฑ๐ฒ๐น๐ ๐ถ๐บ๐ฝ๐ฟ๐ผ๐๐ฒ; ๐ถ๐ป๐๐ฒ๐ฟ๐ณ๐ฎ๐ฐ๐ฒ๐ ๐๐๐ฎ๐ ๐ณ๐ฟ๐ผ๐๐ฒ๐ป.
โWe want AI agents that can discover like we can, not which contain what we have discovered.โ
โ Rich Sutton, The Bitter Lesson
Hand-designed interfaces are what we have discovered. Agents can read their own trajectories, spot whatโs missing, and write and test code. ๐๐ป๐๐ฒ๐ฟ๐ณ๐ฎ๐ฐ๐ฒ ๐ฑ๐ฒ๐๐ถ๐ด๐ป ๐๐ต๐ผ๐๐น๐ฑ ๐ฏ๐ฒ ๏ฟฝ๏ฟฝ๐ป ๐ฎ๐ด๐ฒ๐ป๐ ๐ฐ๐ฎ๐ฝ๐ฎ๐ฏ๐ถ๐น๐ถ๐๐.
Thatโs what Agent S4 does.
Agent S4 makes a ๐ฟ๐ฒ๐ฝ๐ผ๐๐ถ๐๐ผ๐ฟ๐ ๐ผ๐ณ ๐ถ๐ป๐๐ฒ๐ฟ๐ณ๐ฎ๐ฐ๐ฒ๐ ๐ฎ๐ป๐ฑ ๐๐๐ฎ๐ด๐ฒ ๐ธ๐ป๐ผ๐๐น๐ฒ๐ฑ๐ด๐ฒ the unit of evolution. A task agent attempts synthetic tasks with no success labels or verifiers. A meta-agent studies the trajectories, forms hypotheses about which actions, observations, or knowledge would help, and builds descendants through mutation or crossover. Validation tasks the meta-agent never sees decide which repositories survive.
The model and harness stay fixed, and the meta-agent ๐ป๐ฒ๐๐ฒ๐ฟ ๐๐ฒ๐ฒ๐ ๐ฎ ๐ฏ๐ฒ๐ป๐ฐ๐ต๐บ๐ฎ๐ฟ๐ธ ๐๐ฎ๐๐ธ. ๐ข๐ป๐น๐ ๐๐ต๐ฒ ๐ถ๐ป๐๐ฒ๐ฟ๐ณ๐ฎ๐ฐ๐ฒ ๐ฒ๐๐ผ๐น๐๐ฒ๐.
With the evolved repository, Qwen3.8-27B goes from ๐ฑ.๐ฒ% to ๐ฎ๐ญ.๐ฏ% on OSWorld V2, ๐ฏ.๐ดร the same model with fixed interfaces and a new state of the art for open-source computer-use agents.
It beats GPT-5.5 (13.0%, $25.50/task) and edges past Opus 4.8 (20.6%, $72.40/task) at $๐ญ.๐ญ๐ฌ per task.
On ScienceBoard, the same model goes from 41.4% to 58.6%.
The analysis is the more interesting part. Evolution mostly deepens interfaces the agent already has: 4 new interfaces and 127 extensions. Give the meta-agent a scratch VM to test its code, and it builds 12 new interfaces and 253 extensions, reaching music scores, audio projects, and 3D scenes. The best repository came from crossing two earlier branches.
In one case study, the seed agent hand-builds a browser client mid-task and debugs through failure after failure; the evolved agent calls page_text and reaches the same message at tool call ๐ญ๐ญ instead of ๐ฏ๐ณ.
Human-like computer use was a starting point, not the destination. The interface an agent acts through is a second axis of improvement, beyond better models and harnesses, and agents can now design it themselves. ๐๐๐ผ๐น๐๐ถ๐ป๐ด ๐ฎ๐ด๐ฒ๐ป๐ ๐ถ๐ป๐๐ฒ๐ฟ๐ณ๐ฎ๐ฐ๐ฒ๐ ๐ถ๐ ๐ฎ ๐ป๐ฒ๐ ๐ฑ๐ถ๐บ๐ฒ๐ป๐๐ถ๐ผ๐ป ๐ผ๐ณ ๏ฟฝ๏ฟฝ๏ฟฝ๐ด๐ฒ๐ป๐ ๐๐ฒ๐น๐ณ-๐ถ๐บ๐ฝ๐ฟ๐ผ๐๐ฒ๐บ๐ฒ๐ป๐.
Computer use and browser use toolsets are now built into the Python and TypeScript SDKs for Claude.
The API tells you what Claude wants to click or type.
Previously, you had to write your own loop and map clicks and keystrokes to commands, but the SDKs now run the loop and send actions to drivers.
1/ Today we're announcing the stable Cua Driver release for Omarchy - a new foundation for computer use, built into the OS from the ground up.
Over the last month, we worked directly with @dhh, @SpencerGBull and @vaxryy to bring a native synthetic cursor to Omarchy's Hyprland compositor, enabling true multi-cursor computer use at the OS level.
Cua Driver is open source and available at https://t.co/0R5fWjfpGg
1/ You can now run OSWorld tasks on Cua Cloud Fleets. Our new guide shows how to turn the official OSWorld Ubuntu image into a Fleet desktop with Cua Driver, then run your agent and evaluate the tasks.
Get started: https://t.co/T3Xx7ZcasW
There is no benchmark tells you if your agent could resolve your mechanical CAD design in accurate, editable, reliable, efficiently.
We designed the benchmark CADWORLD from professional prospective that really focused on the engineers workflow. https://t.co/a4Km2kzoXG
We just raised $5.7M for @PolarBrowser, the AI browser that beats Anthropic and OpenAI on every major web agent benchmark.
- 4,500,000+ actions taken for users, automating sales, recruiting, and ops
- One company cancelled Clay and saves 25+ hrs/wk per person
- Team is from MIT, YC, Prod, Citadel, Jane Street, Perplexity, Modal, and Apple
100 hours of work. From 30 seconds of typing.
Download the world's most powerful AI browser: https://t.co/lUOm01Stm0
New blog post: What's the Point of Computer Use Agents?
There's been a lot of hype about CUAs recently. But where do CUAs shine? When should we use CUAs over API- or text-based agents?
And what are the remaining research problems?
https://t.co/7os4wHBbsd
Introducing ApprenticeBench: computer use + continual learning on a real job.
We show Fable 5.1 and GPT-6 Astra can now continually learn on a job and surpass human professionals. A decisive step change in AI's job readiness.
No FDEs. Agents deploy themselves into the job. ๐งต
Watch Fable 5.1 agent onboards itself in the accounts payable department at a simulated California-based construction company.
Learn the ERP system, conventions from company history, and lifelong learning from feedback.
A glimpse into what the future of work may look like.
35 of the 88 RSI-Exam tasks are now public! ๐
Weโre continuously expanding RSI-Exam and always welcome new contributors across fields.
Bring a challenging task from your own research area:
๐ https://t.co/n1zf35CpH8