Datacurve

Research and data to advance frontier models.

[Datacurve @datacurve]

Opus 4.8 is now on DeepSWE.

On the default high thinking effort, it scores 6% higher than Opus 4.7 xhigh, while also lowering average cost per task.

[Datacurve @datacurve]

@winkey_h 🫡🫡

[Datacurve @datacurve]

@bmptrsn @winkey_h W animated graph 📊

[Datacurve @datacurve]

Full deep dive coming soon.

Check out the full benchmark here → https://t.co/tqvBb5vzG7

[Datacurve @datacurve]

Opus 4.8 is now on DeepSWE.

On the default high thinking effort, it scores 6% higher than Opus 4.7 xhigh, while also lowering average cost per task.

[Datacurve @datacurve]

Opus 4.8 delivers efficiency gains by solving tasks in fewer steps, directly reducing the total number of input tokens required per task.

[Matthew Berman @MatthewBerman]

DeepSWE reflects what I’m hearing from engineers better than any other benchmark.

They took the hard path to build a good one.

[Datacurve @datacurve]

@cbovolo @Neesh774 ok. https://t.co/V3LIf3Wt6G

[Datacurve @datacurve]

@Neesh774 lots of love put in here! @bmptrsn @shiqyy @LeonardMainnet & albert 🩵

who said data has to be boring

[Garry Tan @garrytan]

This is the new standard for engineering evals

[Serena Ge (Datacurve) @serenaa_ge]

Today we’re releasing DeepSWE, a new standard for agentic coding benchmarks.

On public leaderboards, top models often look relatively close in capability. DeepSWE shows where they actually diverge, reflecting the realistic experience of developers in their day-to-day work.

[Serena Ge (Datacurve) @serenaa_ge]

I presented today at Demo day Day 2 and @TechCrunch featured us @datacurve! Just been reading TC and listening to TC Daily Crunch since high school mornings... a surreal feeling to see us on it. Also, post-demo sadness cuz now YC is coming to an end