Chris E

[Chris E @cte]

@communicating @roocode @Zai_org @openrouter Here are the programming exercises for our evals suite: https://t.co/IfWVZeJlPs

Full results here: https://t.co/NEeYO8Ah4g

[Chris E @cte]

@artificialguybr @roocode @Zai_org @openrouter https://t.co/NEeYO8zJeI

[Chris E @cte]

Your take isn't spicy enough!😂

My sense is that there are trade-offs with all of these tools and in the long run I wouldn't bet against giving these models more tools and letting them judge which is most appropriate given the constraints.

It would be nice to have some eval data backing these takes (we're working on that).

[Chris E @cte]

@AlexGrama @roocode On it! https://t.co/JqBtZtMUDX

[Chris E @cte]

@pingToven 😬 Agreed... I'm trying to implement caching for the Gemini provider in Roo Code and I'm sure that I'll get it wrong on the first attempt.

[Chris E @cte]

@soyhenryxyz @GosuCoder This is amazing. The next big push on evals is going to testing various orchestration configurations and show some data that backs our intuition about it, so I'd love to help.

[Chris E @cte]

@jpeg729 Our evals framework is open source here: https://t.co/1Lot8b3PKt - we're working on better documentation for running it yourself locally.

[Chris E @cte]

@sachasayan ❤️

[Chris E @cte]

@GosuCoder @bindureddy I just updated the Roo Code evals - https://t.co/NEeYO8Ah4g - o4 Mini (High) doesn't come near the top-tier of coding models but the price to performance is reasonable.

[Chris E @cte]

@soyhenryxyz @roocode Totally agree; I’d love to come up with a new set of benchmarks that are designed to show off the strengths of subtasks.

[Chris E @cte]

@setkyarwalar @roocode Nano... 🙈😬

[Chris E @cte]

@LeaderOnePro @roocode Trying to get it out today!

[Chris E @cte]

@cdossman @roocode I think it's on pace to be slightly below Sonnet 3.7 and Gemini 2.5. The price to intelligence ratio of 4.1 mini seems to be trending really well...

[Chris E @cte]

@mattpocockuk The Aider polyglot benchmarks are a good start. I wired up the Cursor-like product I’m working on to run the benchmarks and see how it compares to the publicly available scores.

[Louis Virtel @louisvirtel]

I love how Mitt Romney reappears once every three months to outshine the entire Republican Party by doing the absolute least.

[Carol Leonnig @CarolLeonnig]

Real journalists provide facts to inform the public, not to lead them astray or put them in danger.

[Ryan Chapline @ryanchapline]

“I perceive the necessity... the necessity for haste.” - George “Maverick” Washington #RevolutionaryWarAirportStories

[Pete Buttigieg @PeteButtigieg]

Amazingly, the chyron is not the most foolish thing about this picture.

To get ahead of a potential refugee crisis caused by great suffering in Central America, it would make sense to use our resources to help reduce that suffering.

This is self-defeating.

[Jacob Soboroff @jacobsoboroff]

EXCLUSIVE: DHS test of steel prototype for border wall, Trump's preference, showed it could be sawed through.

We've obtained a never-before-seen photo.

Our report, with @JuliaEAinsley. https://t.co/VfRTSt36mr

[Robert Reich @RBReich]

Let me get this straight: Trump wants the federal court to postpone indefinitely hearing a case claiming that he is illegally profiting from his Washington hotel, because the government shutdown, created by Trump, prohibits his attorneys from working.

https://t.co/VuZejVDCoP