roshan

making evals accessible @evaris_ai | hmu for adding evals in your agent for free

[roshan @pucchkaa]

@samlambert I believe the goal was to build a Vitess like product for the Postgres world which enables sharding. Their tweet doesn’t mention that which is sad.

[roshan @pucchkaa]

@blublubluberri For people who don’t know, its a cauliflower steak with a sauce and its frickin good

[roshan @pucchkaa]

@charles_maddock Refactored from monolith to separate components

[roshan @pucchkaa]

the timing of this is pure comic

[37signals @37signals]

We're still investigating the trouble with @heyhey and now with @basecamp for some of our users. We will keep you posted here and at our Status Site: https://t.co/dUBiOXffmi. We're so sorry, folks.

[roshan @pucchkaa]

@rauchg Congratulations

[voxium @v0xium]

I am done with this shit. It is over. The state of engineering right now is horrible. It has been half a month since I started a new role at a big company. Nobody knows anything here. The specs, code, tests, PRDs, tickets, resolution of those tickets, reports, etc., everything is made by Claude Code. Nobody on my team likes this. They are being forced to ship as much as they can. I have heard multiple times from higher management that pushing code is not a bottleneck, so why are we slow? People are working 12 to 13 hours a day just to press enter. Nobody is reading anything. Humans in corporate are doing nothing on their own. Everyone, literally everyone, from an L1 to an L7 engineer here is doing the same thing. Talk to Claude. There is no sense of victory. Nobody is resolving bugs. In reality, nobody is thinking anymore. Everything is done by LLMs. It is so soul-sucking. I would not mind it, to be honest, if we were at least given the time to check out the code and see what is going where. But no, the goal is to just ship. No matter what happens.

[roshan @pucchkaa]

If you want to setup this evals workflow on your products, you can do it super easily with https://t.co/mAysO7bN4x

Just login, copy the skill and get your evals workflow setup within 5 mins.

[roshan @pucchkaa]

Ran some evals on Jev vs GLM-4.6 on Healthbench and got some crazy results.
jev in terms of -
accuracy : statistically same
latency : 100x faster
cost: 100x cheaper
parse failures: 0 on both models

@typesafeai @CompleteSkeptic

[roshan @pucchkaa]

LLM Judge alone super easily at roughly around ~10% of the cost.

Running evals will be so so cheaper now, that shouldn't give people any excuse in their workflows.

Loved what the @typesafeai team did.

Benchmark done using inspect-ai : https://t.co/oK4nWXRz9v

[roshan @pucchkaa]

@IndiaToday “Hit and Run” itself is a serious offence even if he did unintentionally (which is a lie), and by law is punishable.

[roshan @pucchkaa]

@evaris_ai hey @AISecurityInst would like if you guys wanna checkout the platform. It powers inspect-ai based evals in CI.

[roshan @pucchkaa]

If you haven't setup evals for your product or are looking to explore evals, you can try out @evaris_ai . It helps you setup evals using inspect-ai and evaris platform and takes hardly 1 min.

You can quickly setup evals in your CI using our Agent skill.

Its simple. Try it.

[roshan @pucchkaa]

Currently, the platform is in alpha release so its free for use.

[roshan @pucchkaa]

https://t.co/mAysO7bN4x

[roshan @pucchkaa]

@shrey_sancheti @arpit_bhayani The word “editor” means being able to edit. What does a “read only editor” mean??

[roshan @pucchkaa]

Just use neovim bro

[Arpit Bhayani @arpit_bhayani]

I hate when VS Code eats up 1GB and takes 7 seconds to start, so I built https://t.co/BcvoimKiLJ, which does the same things in 20MB of RAM and starts in 1ms.

The last time we edited code in an IDE was in 2025, so our IDEs should become read-only but fast.

Give it a shot.

[Cheng Lou @_chenglou]

Petition to replace all white rice with biryani

[Sonam Wangchuk @Wangchuk66]

IT'S A VICTORY OF DEMOCRACY
direct democracy... straight from the streets.
It's a victory of peace, patience & persévérance.
Congratulations CJP, Gen Z of the nation and thank you all citizens for shedding fear and the fear of fear and rising up from every corner of the nation.

FROM ACCOUNTABILITY, NOW TO REFORMS