Judgment Labs

Improve your agents from production data.

[Judgment Labs @JudgmentLabs]

Built for long-horizon agents.

Monitor agents against your own criteria.
Search and investigate patterns at scale.
Benchmark improvements and regressions before rollout.

https://t.co/EIFfrfR72q

[Alex Shan @alexshander03]

Today, @JudgmentLabs opens for general access.

We believe long running agent systems will generate more exhaust data than the world can currently process.

Hidden within agent traces are rich records of how to make these systems better: what users ask for, when agents stumble, and how agents interact with the external world.

Judgment is the most performant monitoring and improvement layer for long-horizon agents.

We’re excited to see what you build!

[Judgment Labs @JudgmentLabs]

Its a beautiful day for a scoop 🧡

[Mercor @mercor]

Join us tomorrow in San Francisco for a free scoop of @Mercor mocha ice cream.🍦

Congratulations @JudgmentLabs on releasing general access and thanks for the sweet treat.

500 Howard St.
San Francisco
Wednesday, October 28, 11AM-1:15PM

[Ara @arafatkatze]

Agent trace telemetry is one of the most critical parts of the RSI loop.

Back when I did an RSI loop on Cline to make it automagically improve the harness over a 17 hour long running agent run I found that parsing good signals and iterating on it with the analyser agent could fix an agent response and rerun to hill climb agentic evals. Until it reaches the models peak possible score without some tricky reward hacking.

This is just one part, now imagine if the agent failures at the peak become filtered to become proper post training signals and trajectories of growth, wouldn't that be amazing?

Now lets go one step further, if you are an enterprise with tons of confidential data that AI just messes up because its too much context to get it all right at once what do you do? You take a smaller model and get agent telemetry and post train models and get higher perf.

The future is a world of smaller post trained models curtailed to specific enterprise use cases working in tandem with behemoth trillion dollar models as agent orchestrators but it all has to start somewhere.

[Josh @joshjwilkin]

Super proud of the team, it's been a grind in the weeks and months leading up to our public launch!! Excited to see what folks build w/ @JudgmentLabs

[Tarun Ajjarapu @tarajj00]

excited to share what ive been working on this past few months!

Judgment Labs is now open for general access ‼️

it's been an insane journey building at the frontier of AI agents. ignore the orange suit at the start (that aint me, trust 😭)

[Justin Sheu @justinsheu1]

A year and a half in the making with a wonderful team. Excited for you guys to see what we have been building!

[Alex Shan @alexshander03]

@andrew_li03 knows the dark arts of having to read traces. a lot of them.

[Shun @22uenos]

Designed a new website for @JudgmentLabs! Check it out https://t.co/d2TltO12i0 :)

[Sobhan Nejad @sobhan_nejad]

awesome launch lfg!

[ahh @abhishekg999]

Check us out!

[sailesh @Unhingexd]

I reached out to @JSCamyre in February after one of the Judgment engineers happened to like one of my linkedin posts
I believed back then that companies would need a dedicated platform to handle the scale of data that agents would produce
Try out what I’ve been a part of for the past 8 months

[Alex Shan @alexshander03]

The @JudgmentLabs free ice cream truck is back in SF.

Tue, Wed, Thu this week. Go get some 🍦

Thank you to our partners! Today, we're serving @typesafeai jev jam, @modal À La Modal, @ExaAILabs EXA-presso.

[Luciano Arroyo @LucianoArroyo_]

Back in January, @carloagostinel2 introduced me to @alexshander03, @JSCamyre, and @andrew_li03.

From the first conversation I knew this team was onto something special. 10 months in and it’s been an incredible journey helping customers build evals across all kinds of agents. This team works harder than any group I’ve been part of, and I’m incredibly proud of what we’ve built. 🧡

Now we’re live for general availability. Give the platform a try: https://t.co/hGW74bZRSR

[Henry Xiao @henryxiao7]

This is an incredible milestone for the team. We’ve doubled headcount the past year and are growing at a historic rate across all fronts.

If your team is building agents and want to improve them through production data, you can try our platform at https://t.co/lIWC5ZxDD9.

And if you’re interested in building the infrastructure for the agent world, send me a dm. We’d love to chat

[Andrew Li @andrew_li03]

Working on data and evals at Together, I spent a lot of time reading through AI traces. That gave me a real appreciation for how much this data tells us about how AI works, where it fails, and how to improve it.

As long-horizon agents take on more work, the data they generate will far outpace what people can make sense of by hand.

We’re building Judgment to help teams store, process, and analyze that data at scale. Excited to keep building the data infrastructure for a world powered by AI agents.

[Seb from Clera @_sebastianscott]

@alexshander03 @JudgmentLabs happy customer!

[Florian Juengermann @florian_jue]

@alexshander03 @JudgmentLabs finally GA! Is been great working together

[kirandarisi @kirandarisi]

Congrats @JudgmentLabs and @alexshander03 on GA!

The team was in our Slack shipping features at 4 AM. That's the kind of partner you want. Great integrating Judgment into our stack at Atomicwork, and looking forward to building more together.

[Judgment Labs @JudgmentLabs]

Start today by giving your agents better Judgment.

https://t.co/KnKyYNeObW

[Judgment Labs @JudgmentLabs]

Built for long-horizon agents.

Monitor agents against your own criteria.
Search and investigate patterns at scale.
Benchmark improvements and regressions before rollout.

https://t.co/EIFfrfR72q

[Alex Shan @alexshander03]

Today, @JudgmentLabs opens for general access.

We believe long running agent systems will generate more exhaust data than the world can currently process.

Hidden within agent traces are rich records of how to make these systems better: what users ask for, when agents stumble, and how agents interact with the external world.

Judgment is the most performant monitoring and improvement layer for long-horizon agents.

We’re excited to see what you build!

[Judgment Labs @JudgmentLabs]

Connect your agent, send your first traces, and start exploring your data.

https://t.co/uA2MofDqtR