Lee Butterman

🏳️‍🌈 · 🚴 · 🏞️ · 🏜️ · ⦿⪥ · 🤖🧠

[Lee Butterman @leebutterman]

@simonw I’ve got text embeddings of Wikipedia for semantic search in the browser at https://t.co/MycZ6RSjIi

[Lee Butterman @leebutterman]

@dbreunig @isaacbmiller1 Sounds cool! I’ve found DSPy and GEPA super productive and very excited about RLMs https://t.co/BoWcFiz3ao

[DSPy @DSPyOSS]

https://t.co/6WF3RfTi0d

[Omar Khattab @lateinteraction]

exciting talks on dspy in production from dropbox and shopify teams at the next DSPy SF meetup!

[Lee Butterman @leebutterman]

@jeffreyhuber Upper right is Deep Research

[Farouk @FaroukAdeleke3]

Open sourcing Microcode! Microcode is a context-efficient, general purpose terminal agent fully powered by a packaged `dspy.RLM()` program. Set your own OpenRouter API key via and choice of models. Supports MCP servers too with @MaximeRivest mcp2py.

Because the CI/CD of the RLM engine is exposed through @modaicdev, per-user or per-codebase prompt optimization is plug and play.

If you set the --verbose flag, it pretty prints the RLM's trajectories as reasoning or code within it's REPL.

[Lee Butterman @leebutterman]

@nbaschez We’ve also found that giving Claude access to start and stop an app with multiple daemons and access to read logs is crucial for longer self directed exploration. Any reason you like pm2 over docker?

[Lee Butterman @leebutterman]

@lateinteraction 💯. Python is often my object code, and my human intention from reading and writing in the multi turn code agent setup is the only important part and is often lost in PR comments.

I know I especially don’t record praise of what the agent got right that I was worried about

[Misha @drethelin]

I’ve heard of boba tea, but there’s a new place in the neighborhood that sells something they call Kiki tea, so I got some to try

[Salah Alzu'bi @salahalzubi401]

Also a big fan of GEPA! If you’re optimization runs are taking a long time you should take a look at our k-way proposal function called GEPA+. It reduces metric runs by 30-40% while improving relative accuracy by 2-5% depending on tasks!

https://t.co/603AmYLSOD

[Vaibhav (VB) Srivastav @reach_vb]

This! Sometime last year I made the switch, the default is greyscale and it automatically turns to colour when I’m looking at photos and back when I close it!

100% would recommend

[Christopher Potts @ChrisGPotts]

A clip from my practice run of this talk, providing more context for this slide:

[Lee Butterman @leebutterman]

@chrisbolas @noah_vandal @DSPyOSS

[Lee Butterman @leebutterman]

@chrisbolas @noah_vandal @DSPyOSS As I’d explained a bit farther down, you want a dense model if you only have 8GB before you hit slow disk (micro sd), and gpt-oss is a MoE, most of your experts aren’t going to mix in, so a dense model like Qwen3 4B Thinking 2507 utilizes memory more

[Lee Butterman @leebutterman]

@JoshPurtell I have found that GEPA is extremely sample efficient. I got from 7% to 50% accurate on chat to sql for qwen3 0.6B on a MacBook in a day. And 7% to 28% in one pass through my <300 item dataset with a Qwen3 4B reflection LLM https://t.co/dwt6WBKWhf

[DSPy @DSPyOSS]

DSPy on a Pi: Cheap Prompt Optimization with GEPA and Qwen3

“It took me about sixteen hours on a Raspberry Pi to boost performance of chat-to-SQL using Qwen3 0.6B from 7.3% to 28.5%. Using gpt-oss:20b, to boost performance from ~60% to ~85% took 5 days.”

[DSPy @DSPyOSS]

https://t.co/6WF3RfTi0d

[Lee Butterman @leebutterman]

@noah_vandal @DSPyOSS With under 1GB to spare! But gpt-oss:20b (in Ollama) has weights of ~12GB and takes another few gigs of inference memory so I mostly had my four cores going full time on the 16GB Pi 5. Qwen 4B optimizing Qwen 4B would be even smaller. On a MacBook it is within an afternoon :)

[Lee Butterman @leebutterman]

@karanjagtiani04 @DSPyOSS No manual tuning! That’s the whole point :) I just made a pretty basic prompt with some bland facts about the data (multiple rows per paper, one per author, read only, call out content policy violations) and GEPA did the rest, and DSPy was super easy to use to separate concerns

[DSPy @DSPyOSS]

DSPy on a Pi: Cheap Prompt Optimization with GEPA and Qwen3

“It took me about sixteen hours on a Raspberry Pi to boost performance of chat-to-SQL using Qwen3 0.6B from 7.3% to 28.5%. Using gpt-oss:20b, to boost performance from ~60% to ~85% took 5 days.”

[Lee Butterman @leebutterman]

@lmeyerov Those piles of boring features that are getting automated are all closer to each other than making the initial proofs of concept so it’s easy to imagine that coding agents will get better at them, and that iterative polish is an iceberg of work, esp re compliance

[Lee Butterman @leebutterman]

@charles_irl These flow charts https://t.co/gM1RRTQqi4

[Lee Butterman @leebutterman]

For this reason, I’ve heard tech “debt” referred to as a “unhedged call option”: the downside of the loan is unknown when you take it out. Who knows what’s lurking in that code no one understands. https://t.co/vEr1oNoKQW

[Jeremy Howard @jeremyphoward]

@MarkovMagnifico Because of the interest-on-interest, you really shouldn't leave it indefinitely. You will pay, eventually.