@chem_safety Won’t we reach a point where AI could create RL envs for itself to train on? Just like how we humans can create RL envs without knowing a solution, but instead with just the ability to verify any solution.
@SavannahFeder@JohnKocdr@KehrerHidde A “master” agent that coordinates tasks across all agents works better. That way you can make sure that the tasks that interfere with each other are managed properly.
Inspired by @Shopify's pi-autoresearch, I built something similar for claude code users: https://t.co/KNad0BsLA9
Using this, you can ask claude code to optimise anything: ML models, build time, passing tests, memory footprint etc. It runs unattended until it succeeds, or hits the configured max iterations.
You can check progress via the dashboard command:
@catmanyau@Shopify Metrics are defined by you during setup. Regressions are caught by the agent since it calculates the metric after each iteration. It keeps the changes (git commit) if the metric moves towards the target else discards the changes (git reset)