ecnerwala

Building @cognition_labs || Competitive Programming enthusiast || I stream sometimes too @

[ecnerwala @ecnerwala]

Finally able to show off what I've been working on: the world's first AI software engineer.

Devin's the first agent capable of doing a full edit-compile-test-debug loop, meaning it can actually iteratively build and debug real projects.

It's pretty amazing what Devin can do, check out the thread for some crazy examples.

[Cognition @cognition]

Today we're excited to introduce Devin, the first AI software engineer.

Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork.

Devin is an autonomous agent that solves engineering tasks through the use of its own shell, code editor, and web browser.

When evaluated on the SWE-Bench benchmark, which asks an AI to resolve GitHub issues found in real-world open-source projects, Devin correctly resolves 13.86% of the issues unassisted, far exceeding the previous state-of-the-art model performance of 1.96% unassisted and 4.80% assisted.

Check out what Devin can do in the thread below.

[ecnerwala @ecnerwala]

Streaming now at https://t.co/NjlPzS3gNR! Finishing up hard problems from recent programming contests!

[ecnerwala @ecnerwala]

Streaming now at https://t.co/NjlPzS3gNR! Gonna work on my competitive programming template code

[ecnerwala @ecnerwala]

Streaming AtCoder Regular Contest 111 virtual participation at https://t.co/NjlPzS3gNR!