Chicou

[Chicou @ChicouTiMix]

@0xSero How much concurrencies

[Harvey @harvey]

We partnered with @FireworksAI_HQ to train open-source models for legal. Here's what we found:

1) Hybrid legal agents can beat frontier models on quality and cost by routing selectively to a frontier advisor.

We tested a hybrid setup where GLM 5.1 served as the primary worker, routing tasks to Opus 4.7 as an advisor when needed.

GLM invoked Opus sparingly, just 0.83 times per task on average.

The hybrid setup beat Opus on both quality and cost: 18% all-pass vs 14%, at $368 vs $954 across the same 100 tasks.

2) Post-training can push open models to frontier-level legal performance.

On a 100-task slice of our Legal Agent Benchmark (LAB), SFT moved Kimi 2.6's all-pass rate from 11% to 15%, beating Opus' 14%.

But the cost gap was even more striking: $84 vs $954 across the same 100 tasks, or ~11x cheaper.

We're excited to continue working with @FireworksAI_HQ on the next generation of open-source legal agents.

[Chicou @ChicouTiMix]

@bnjmn_marie Agreed need to benchmark it on rag

[Chicou @ChicouTiMix]

@0xSero Need to benchmark it

[Chicou @ChicouTiMix]

@stevibe @danielhanchen Congrats Dan !

[Chicou @ChicouTiMix]

@ivanfioravanti Token seconde ? Same than the spark ? What do you think guys ?

[Chicou @ChicouTiMix]

@LottoLabs Open …. Ai 🤖 lol

[Chicou @ChicouTiMix]

@TeksEdge Best bandwidth than the spark ? Better for speed ?

[Chicou @ChicouTiMix]

@0xSero @badlogicgames @ain3sh Can we prune and just keep coding experts ? With reap ?

[Chicou @ChicouTiMix]

@0xSero Ds4 q2 is sill good in coding and logic ?

[Chicou @ChicouTiMix]

@LottoLabs Almost 30 on the spark gguf llama cpp

[Chicou @ChicouTiMix]

@MrPeterLMorris Exactly

[Chicou @ChicouTiMix]

@0xSero Hf link :) ?

[Chicou @ChicouTiMix]

@ivanfioravanti Let us know if it works well

[Chicou @ChicouTiMix]

@0xSero Is cerebras is going to explain how to prune ? Reap ?

[Chicou @ChicouTiMix]

@jedisct1 Cool I’ll try it on my spark . Did you prune all except coding knowledge ?

[Chicou @ChicouTiMix]

@spark_arena Coool

[Chicou @ChicouTiMix]

@Alibaba_Qwen Hope to be the one in 🇲🇨

[Andrej Karpathy @karpathy]

Personal update: I've joined Anthropic. I think the next few years at the frontier of LLMs will be especially formative. I am very excited to join the team here and get back to R&D. I remain deeply passionate about education and plan to resume my work on it in time.

[Brett Adcock @adcock_brett]

We got bored. Time for Man vs. Machine https://t.co/HIqPGygWnF