burnt all of $10k AWS credits that I got from @ycombinator startup school :)
asked for $15k more let’s see
ran a lot of RL experiments, also some goated benchmarks (a big launch) coming soon!
a computer-use agent needs a computer to practice on and be better.
somewhere it can open a spreadsheet, change a setting, save a file and make mistakes without touching your actual work.
for reinforcement learning, the loop is: give it a task, let it try, check the result, then use that feedback to update the model. repeat across many attempts.
running those attempts in parallel means providing lots of separate environments. each needs the right starting state, and each result needs checking. clicking "save" isn't proof the file saved correctly.
so yes, fitting more desktops on one machine is useful. it can make practice cheaper.
but a thousand desktops isn't proof of cheaper learning.
start with the same model, tasks and rewards. compare against a properly tuned alternative. how much money and time does each setup need before the agent reliably completes new tasks it wasn't trained on?
include failed attempts, resets, checking and model compute in the bill.
if you're selling cheaper training, show what it costs to train the agent. a desktop count isn't enough.