hiddenweights

[Ihab Ilyas @ihabilyas]

Super proud of the work we’ve done at @hiddenweights with @rox_ai to fine-tune an outbound reward model, achieving high accuracy at a fraction of the cost. Great collaboration!

[Rox @rox_ai]

Coding agents got good by writing code, getting feedback, and improving thousands of times.

Agents doing commercial work never got that loop, until today.

With @hiddenweights, we trained an Outbound Reward Model on real cold emails + the edits sellers make to AI drafts before they hit send.

The reward model:

- Is 5x faster and up to 30x cheaper than an LLM judge
- Picks the seller-edited draft 80% of the time
- Gets 1.75x the avg reply rate on top-scored emails

🧵 on how we did it: