Small Harness

An open source coding harness where local and frontier models jam together. Just 'brew install small-harness' and rock on 🤘 Created by @morganlinton.

[Small Harness @smallharness]

@0xSero Excited to see what you come up with here.

[Small Harness @smallharness]

@nutlope Very impressive.

[Small Harness @smallharness]

Small Harness v1.0.3 is now live on Github, more details in the tweet below.

This is the first of many moves to help move the industry away from using LOC and number of tokens, as a success metric.

[Morgan @morganlinton]

Shipped a feature to @smallharness this week that I think can hopefully get us further away from measuring lines of codes, or tokens used, as a success metric for engineers.

Still ideating, but wanted to get my first idea out there. The goal is to judge the quality of a pr, and I'm doing this through a new command, /scorecard.

Here's how it works:

1. You work on a branch, successful turns accumulate under the current repo/branch (tokens, sessions)

2. You close the unit, usually via /ship pr, or manually with /scorecard close "My PR title"

3. Quality is scored at close from a local shipcheck snapshot:

- Ship readiness (ready / needs review / blocked)
- Whether tests passed, failed, or weren’t run
- Whether the PR was opened via gh (for /ship pr)
- Blockers and warnings from the ship flow

You get a grade, score out of 100, letter grade, and whether it counts as a quality PR (default: score ≥ 80, tests passed, PR command succeeded, not blocked).

Updated in 1.0.2 and 1.0.3, here's details on the new commands and what's new in each specific version.

And I don't think this is close to perfect yet, but I do think it gets at least me, mentally closer, to a way to track progress that isn't counting lines of code or tokens, which I think is so important we move far, far away from.

Pushing engineering teams to " write more code!" or telling them to "use more tokens!" is ridiculous, we can, and should do better.

Small Harness is a free, open source harness that plays nicely with both local and frontier models. Link to Github repo in first comment below.

[Small Harness @smallharness]

@HixonStudio @UnslothAI @Zai_org Haha, I know the feeling.

[Small Harness @smallharness]

@jun_song Soooo jealous.

[Small Harness @smallharness]

@leyten @Zai_org That is awesome to see, but for me, 30 tok/s is still too slow. Of course, it's amazing to run this locally at that speed, but I do think it needs to be faster to truly compete with frontier models.

Also, isn't this a $60,000+ build? 😳

[Small Harness @smallharness]

@UnslothAI @Zai_org Wild to think you can run this locally.

[Small Harness @smallharness]

@jun_song Now all I need is $10,000 so I can buy 2x DGX Sparks 😜

[Small Harness @smallharness]

Big morning 🚀

[Cursor @cursor_ai]

We're excited to join forces with @SpaceX to advance the frontier of useful AI. Expect significant improvements to Cursor soon.

[Small Harness @smallharness]

@therealkamba @morganlinton @thsottiaux Try it, free and open source, gh link in the bio here!

[Small Harness @smallharness]

@naxx014 @jun_song Yeah, feels like it would get too hot

[Small Harness @smallharness]

@DataChaz Yes!

[Small Harness @smallharness]

@mr_r0b0t 🤩

[Small Harness @smallharness]

@plutos_eth It’s beautiful 🥹

[Small Harness @smallharness]

Well this should be interesting 👀

[Small Harness @smallharness]

@rodydavis @GoogleDeepMind Congrats Rody!

[Small Harness @smallharness]

Fable 5 has been distilled.

[Jacky Chou (buying online businesses up to $1m) @indexsy]

Holy crap they already distilled Fable 5

[Small Harness @smallharness]

@onusoz Totally wild.

[Small Harness @smallharness]

@AbuKhadeejah Yes Arsalan!