Albatross

Open source agentic coding harness where local and frontier models live in harmony.

[Morgan @morganlinton]

I am going to start to share the leaderboard at VulcanBench more regularly.

VulcanBench is the only benchmark I know that benchmarks across effort levels, on an eval suite of 100% real engineering tasks.

Getting ready to sunset eval suite 3 and eval suite 4 is almost ready to go.

Here's the current leaderboard for Eval Suite 3, Grok 4.5 High is the highest scoring model still with Fable 5 Low, yes Low, right behind it.

What I've been able to uncover with VulcanBench is that way too many people are running models at Max effort, thinking that buys them more accuracy, when really it just costs more and uses more tokens so takes more time.

If you're still in the mode of, tell my agent to do something then go get coffee, you're probably still living in the past. You can move faster, with higher accuracy, the key is not thinking you need Max effort all the time.

[Albatross @albatrosscode]

@jpschroeder Agreed.

[Albatross @albatrosscode]

@EXM7777 @orca_build Super interesting, thanks for sharing.

[Albatross @albatrosscode]

@kimmonismus Yeah, was very bummed to see this 😞

[Albatross @albatrosscode]

@bindureddy How do you know that 5.6 is cheaper, faster, and more pragmatic? Did you get early access?

[Albatross @albatrosscode]

Super interesting to see how strong the adoption curve has been with GLM 5.2

[OpenRouter @OpenRouter]

GLM 5.2 vs DeepSeek V4: share of tokens on OpenRouter

GLM 5.2 has had a very fast uptake relative to most open-weight launches

[Albatross @albatrosscode]

@OpenRouter Very interesting to see, and not surprised given how well GLM 5.2 is benchmarking.

[Albatross @albatrosscode]

@daniel_mac8 Ohhh, this is neat.

[Albatross @albatrosscode]

@ollama Yes! 🙌

[Albatross @albatrosscode]

@nicdunz Totally wild.

[Albatross @albatrosscode]

@Hesamation @burkov @PatrickToulme Hearing really good things about GLM 5.2

[Albatross @albatrosscode]

@elonmusk 🎯

[Albatross @albatrosscode]

@ThePrimeagen Great minds think alike!

[Albatross @albatrosscode]

@rileybrown Do it!

[Albatross @albatrosscode]

@rauchg Agreed.

[Albatross @albatrosscode]

@stepango Yes!

[Albatross @albatrosscode]

@0xSero @thekitze Exactly

[Albatross @albatrosscode]

@dabit3 Yes! 🙌

[Albatross @albatrosscode]

@morganlinton 🚀

[Albatross @albatrosscode]

One of the best small models out now.

[Bindu Reddy @bindureddy]

Gemma 4 is a very good small model that punches above it's weight class

Gemma is a 31B model that is as good as other very large MoE models

It's the best in the world for it's size 👏👏