“Program-as-Weights”
LLMs are great at fuzzy functions like log triage, JSON repair, and intent classification, but calling a big model on every input is slow, expensive, and not local.
This paper compiles the fuzzy function once from a natural language spec into a small neural program, a pseudo-program plus a LoRA adapter.
A frozen 0.6B interpreter then runs it locally, matching Qwen3 32B prompting on FuzzyBench while using about 50x less inference memory and running around 30 tok/s on a MacBook M3!
"Is One Layer Enough? Training A Single Transformer Layer Can Match Full-Parameter RL Training"
RL post-training usually updates every Transformer layer, but the gains are not spread evenly through the model.
Especially with how most of the improvement comes from a few middle layers, sometimes training just one layer matches or beats full-parameter RL.
So this paper turns it into a simple recipe. By training or boosting the high-contribution middle layers, they show that you can outperform standard full RL with fewer changes.