Fork-and-Flush: help your agents escape Idea Basins!!
I love thinking of AutoResearch as Idea Descent: a metric of interest goes down, as a function of ideas/experiments, where the agents get pulled towards one idea or another. But we've seen very often an agent develop this weird tunnel vision, and honing in just one type of "idea", kinda like GD stuck in a local minimum.
We studied this and seems we can fix it with Fork-and-Flush, a super simple and kinda cute idea. Every so often, fork the agent into T copies in the same workspace but empty the context, let them run for a bit, and continue from the best one.
If you like the GD analogy, it's basically basin hopping https://t.co/NOzpRGT3It.
BTW we found a silly way of also plotting "idea basins": an LLM rewrites every experiment as a spec and answers a few thousand binary queries "is Experiment A closer to B or to C?". Then we embed this NXN matrix into 2D and indeed see in many cases that each run saturates into a small region and keeps polishing it.
We call these idea basins!
At equal compute Fork and Flush beats single runs and best-of-N on 12/13 long-horizon tasks (some 4+ days), and in my own research projects it's been working really well!
BTW we only use it at test time, but it could also be part of training or RL.
Led by @jackcai1206@christos_ziakas during Jack's internships with us, along with @vkontonis@ShivamGarg91462@Tea_Pearce Sid Sen and Akshay Krishnamurthy.
花费16天,我用 Opus 5.5 将小王子的故事制作成了3D剧情游戏
结合Tripo+Blender,Opus 5.5 将小王子故事中的每一个星球变成了可探索的3D场景
希望大家能支持一手,后续会开源整个游戏,以及详细制作流程
Welcome to The Little Prince: Across the Stars✨:https://t.co/qr4wR0jLu3