I'm grateful to @richhickey for creating Clojure. Working with Clojure was the best decision in my career.
What did I learn with CLJ?
- prefer simple tools rather than full-featured frameworks,
- read docs & source code,
- start with data modeling,
- hammock time is essential.
Wow, the @huggingface Harness Leaderboard is the #2 trending Space this week 🤯
So glad to see it being useful to so many people, and right behind my colleagues' Ultimate MoE Training Handbook!
For newcomers: the leaderboard shows which coding-agent harness gets the most out of an open model. It compares 9 harnesses on 3 open models by score, cost and time, and every trajectory is public.
Thanks for all the likes, shares and feedback 🤗 More is coming, starting with a new harness later today 👀
https://t.co/AiWiQtBOz5
This is a very good approach. Doing the same with https://t.co/VR5PgOLbmA. Can’t wait to see people switching from SKILLS to 🐍 enhanced workflows. Congrats!
With Opus 5.5 on max, Claude Code gets 64.85% on Terminal-Bench 4.0 and costs $14.30 per task. Unharnessed gets 71.2% and costs $12.19.
The model is the same, only the harness changes. You can read every turn of the run here: https://t.co/lSgt07jNO4
With Opus 5.5 on max, Claude Code gets 64.85% on Terminal-Bench 4.0 and costs $14.30 per task. Unharnessed gets 71.2% and costs $12.19.
The model is the same, only the harness changes. You can read every turn of the run here: https://t.co/lSgt07jNO4
One default cost @openclaw 16 to 21 points on DeepSeek-V4.1-Flash: 8,192 tokens per reply.
OpenClaw asks for at most 8,192 tokens per reply when a model's config sets no output limit. Mine set none.
DeepInfra, the provider serving the model, cut its thinking at 4,916 tokens, 60% of 8,192. The model kept thinking in the visible reply.
When a reply hit 8,192 tokens, OpenClaw took the half-finished sentence as its final answer and stopped.
On DeepSWE, a benchmark of code changes in open-source repositories, that ended 57% of its runs at low reasoning effort and 69% at high. 3 of those 419 runs passed.
Version 0.1.6 of the @huggingface Harness Leaderboard, my comparison of ten coding agents on the same open models, passes each model's own limits.
GLM-5.3-Flash, whose provider ignored the limit, gained nothing.
If you evaluate agents, log why each reply ended. These runs threw no error. Only the finish reason "length" showed the cut.
Also in v0.1.6:
- Hermes Agent by @NousResearch is no longer first on DeepSeek-V4.1-Flash. Its old score counted DeepSWE passes that looked answers up online, which my setup allowed until October 23. It still shares first place on GLM-5.3-Flash and Flint.
- A cheating policy: reading the hidden tests, the reference solution or an outside answer counts as a fail. That adds 38 fails: Hermes Agent 15, OpenClaw 12, Kimi Code 6, Qwen Code 5.
- Image input now works in eight harnesses. Scores barely moved.
- Harnesses whose scores are statistically tied now share a rank. On DeepSeek-V4.1-Flash, six share first place.
Thanks to @TheZachMueller and @LambdaAPI for compute for the DeepSeek-V4.1-Flash evaluation.
Leaderboard: https://t.co/AiWiQtBOz5
@joelniklaus@joelniklaus are you accepting the new harnesses submissions?
I did some bench already here for vis, but would love to see it in your leaderboard:
https://t.co/oOoPV1Cutm
Here is the link to harness.
https://t.co/VR5PgOLJc8
@ChShersh One language is enough. Just install Emacs and start from elisp. Once you know elisp switching to anything is a walk in a park.
I’m no longer using emacs, but this editor taught me to:
- read the documentation,
- read other people’ code,
- stay humble.
🔥 #Bybit x Arcana Network: 13,000,000 $XAR Up for Grabs!
To do:
1. Follow the @Bybit_Official and @ArcanaNetwork
2. Quote/Re-tweet this post.
3. Follow the steps in Event 1 in the announcement link to win
💫 Join Event: https://t.co/r33TFI8kzD
#TheCryptoArk#BybitListing
🔥 #Bybit x Arcana Network: 13,000,000 $XAR Up for Grabs!
To do:
1. Follow the @Bybit_Official and @ArcanaNetwork
2. Quote/Re-tweet this post.
3. Follow the steps in Event 1 in the announcement link to win
💫 Join Event: https://t.co/r33TFI8kzD
#TheCryptoArk#BybitListing