Dan Kondratyuk

Co-Founder at Prev. @LumaLabsAI (Realtime Video World Models), @GoogleAI (VideoPoet). Let's automate research!

[Dan Kondratyuk @hyperparticle]

We sent a swarm of AI agents to solve Karpathy’s NanoChat benchmark, and they crushed SoTA in 3 days.

We built our own harness on top of a graph database to do auto-autoresearch, each iteration learning from mistakes to do research better.
The team wrote >15,000 entries. 🧵

[Dan Kondratyuk @hyperparticle]

@KaiavRNihalani Come join us on discord with all your ideas, we are pretty active there! https://t.co/NfwLkztk72

[Dan Kondratyuk @hyperparticle]

Most agent demos stop working when you close the chat. Ours accumulates knowledge even when we sleep.

@venkatGoku used our OSS autoresearch harness to research a better C++ factory scheduler. It beat an expert-designed solver on 29/30 fresh problems and runs with no LLM.

[Dan Kondratyuk @hyperparticle]

The solver, tests and research record are open source.
https://t.co/zkG6leIWkD

Join our Discord, we collaborate with scientists here to make this open research possible: https://t.co/NfwLkztRWA

[Dan Kondratyuk @hyperparticle]

In one case, figured out how to use 10 trucks instead of 30. The agent's solver found a legal plan the reference never considered.

Built with agent harness `sagent` and knowledge graph `trackinizer`:
https://t.co/a8bWTDBI2i
https://t.co/9HDLKFHnyd

[Rui Wang @RRicefan]

We're introducing TasteBench, a new standard to measure Research Taste on real world ML tasks.

Existing benchmarks have limited datasets and eval data ultimately becomes part of training data. In TasteBench, we continuously generate new ML tasks on OOS data no model has trained on.

[Dan Kondratyuk @hyperparticle]

We also OSS the code here: https://t.co/ZLtnxp6je9

[Dan Kondratyuk @hyperparticle]

OSS code: https://t.co/8IoNm3zSa5

Here is a full unbroken run of an agent beating the game after 5k moves.

[Dan Kondratyuk @hyperparticle]

Experts doubted a small neural net could beat Craftax without an LLM's knowledge.
​
Our agent meta-harness built one in 3 weeks. The 15M-param agent beats the final boss 44% of the time, costing a cent, and 10 seconds.
​
GPT-6 Astra won 1%, taking 24 hours and $83. 🧵

[Dan Kondratyuk @hyperparticle]

rekursiv at every level: agents run the research, the learner restarts from its own best moments, and each generation's games train the model that teaches the next.

📖 Full story: https://t.co/Z1r0WDq4WE
💬 Join our Discord: https://t.co/NfwLkztk72

[Dan Kondratyuk @hyperparticle]

OSS code: https://t.co/8IoNm3zSa5

Here is a full unbroken run of an agent beating the game after 5k moves.

[Dan Kondratyuk @hyperparticle]

We got agents to train a 15M-param RL agent which solves Craftax, a 2D Minecraft-inspired game.

Here are 5 fun expert-level strategies the model learned, all on its own. We OSSed the model trainer on github.

1. It jails monsters in tiny stone cells and leaves them there.

[Dan Kondratyuk @hyperparticle]

Experts doubted a small neural net could beat Craftax without an LLM's knowledge.
​
Our agent meta-harness built one in 3 weeks. The 15M-param agent beats the final boss 44% of the time, costing a cent, and 10 seconds.
​
GPT-6 Astra won 1%, taking 24 hours and $83. 🧵

[Dan Kondratyuk @hyperparticle]

5. It goes back upstairs for groceries.

The Fire Realm has no food/water, so it climbs back up a floor to drink or hunt bats, then comes back down.

[Dan Kondratyuk @hyperparticle]

@Taodav The improvements proposed by the agents were fairly general, not task specific. E.g., representing the input board as a 2D grid and using CNNs. The agent mentioned it was inspired was inspired by works like VARC https://t.co/WGkHlssNbY

[Dan Kondratyuk @hyperparticle]

Huge shoutout to @daphnesolves and @puffer_ai for their work on PufferLib, which is an awesome piece of software! It's what inspired us to try the challenge. And big thanks to @creus_roger for writing out a detailed summary of GPT-6 Astra solving Craftax.

[Dan Kondratyuk @hyperparticle]

Experts doubted a small neural net could beat Craftax without an LLM's knowledge.
​
Our agent meta-harness built one in 3 weeks. The 15M-param agent beats the final boss 44% of the time, costing a cent, and 10 seconds.
​
GPT-6 Astra won 1%, taking 24 hours and $83. 🧵

[Dan Kondratyuk @hyperparticle]

The "3 weeks" here is also a bit conservative. The campaign actually beat the game in a few days, the rest of the time was spent performing ablations to improve the score, and get the meta-harness to discover their ideas faster.

[Dan Kondratyuk @hyperparticle]

@ta_eis_eauton We OSS the engine powering it, trackinizer: https://t.co/9HDLKFHnyd