Shoham Shitrit

Engineering @percepta | prev @microsoft

[Shoham Shitrit @ShohamShitrit]

Never thought a model that fits on a CPU could impact patient lives so much. This is just the start!! 🚀

[Thomas Mathew @tmathew0309]

At Percepta we build decision making systems for the hardest operational problems at a business. Running them at scale gets expensive fast, so @shohamshitrit, @AlbertYZuo and team built infra to make private evals for our customers and then hillclimb the pareto frontier of cost vs accuracy.

In our latest example, we built a system that reads the full clinical timelines of 100k patients every day and picks the next best actions for each one.

The task is prohibitively expensive even with Gemini Flash models, so we trained a distilled 0.8B open model that beat every frontier model we tested at >20x lower cost.

[Thomas Mathew @tmathew0309]

Michael (@michaelvartikar) on our team recently built Kaizen - a tool that helps us build private evals for our customers and then hillclimb agents against those evals 🧵

[Athul Paul Jacob @apjacob03]

1/ We built a compiler that turns arbitrary programs into transformer weights. You give it C code, it produces a standard transformer that executes that program step by step.

[Shoham Shitrit @ShohamShitrit]

@kimmonismus Cool test. Perplexity on free tier got it right!

[Cousin Larry OB ☘️🏆 @AndrewDoxy]

If I had a nickel for every time Payton Pritchard checked in for a half court buzzer beater in the NBA Finals…I’d have…two nickels, which isn’t a lot, but it’s weird that it’s happened twice

[Marc Randolph @marcrandolph]

I’m Marc Randolph, co-founder of Netflix & 6 other companies.

This is my definition of success:

[Kevin O'Connor @KevinOConnor]

Luka Magic right there!

[Kobe Bryant @kobebryant]

Continuing to move the game forward @KingJames. Much respect my brother 💪🏾 #33644