Multi-agent systems are now routine, but one decision goes unmeasured: when an orchestrator hands a subtask to a peer model, does it pick the right one?
We built DecisionBench to score the handoff itself, not just the final answer, across an 11-model, 7-vendor pool over 23,375 task instances. The headline finding: there is enormous performance left on the table. A perfect-delegation ceiling sits 15 to 31 points above where today's systems land, on every benchmark we ran. That gap is the prize, and skill-aware orchestration is how you capture it.
Read more about it in our blog post:
https://t.co/U8dbTlWMNF
As LLMs become increasingly powerful, the ability to effectively delegate and collaborate with other models may itself become a critical capability for long-horizon agentic systems.
It was a lot of fun working with these passionate young researchers on DecisionBench! @MichaelYGao@meganwxng@YYL_GB
Your multi-agent system might be delegating to the wrong model on every single subtask, and your eval would never tell you 🧵
Introducing DecisionBench: the first benchmark that measures whether agents actually delegate well, not just whether the task got done.
https://t.co/rRQbP930OB
Super excited to share what our team has been working on! We have developed a new approach called IntelligenceArena that redefines how we evaluate AI systems in production.
Instead of asking which model is best, IntelligenceArena measures how much useful intelligence is delivered per token across real-world conditions, incorporating quality, cost, latency, and reliability into a single quantitative framework.
Chain degradation is killing your agent's pass rate. Most teams don't measure it.
We help you solve this issue.
Opening OpenMesh beta to 50 teams this month.
Sign up at https://t.co/jKy3Qhfgyb
Today we’re introducing OctoMesh.
The world’s first task-level model routing system for AI agents.
Instead of running an entire workflow on one expensive model, OctoMesh breaks it into steps and automatically selects the best model for each task.
Deploy AI models in seconds (literally).
No cloud setup. No infrastructure headaches.
Zygma gives you the fastest, easiest endpoint for AI to be used in
• agent frameworks
• AI copilots
• automation tools
• research workflows
• large-scale inference pipelines
One API. Production ready.
Try it now: https://t.co/zYXYrxMKI6