So here's why calling it a "rogue swarm" misses the plot and might be dangerous.
"Rogue" makes it sound like agents are misbehaving. Like a moral failure.
If thats our diagnosis, it follows that the fix is to make the individual agent more behaved. Align the model, put safeguards into the harness, etc.
At best, this is incomplete. At worst its distracting us from where the real problem is.
I run a few hundred agents in a fleet. The examples looked more like classic coordination pathologies to me. Meaning the failure is at the group level, not the individual.
On their own, the agents are pretty predictable. They're trying to do the job they were given. Zoom out though and the group is doing something no one wants.
So even if every agent behaves, this doesn't automatically fix group coordination. Its more likely your "fix" made it worse.
The weird part is how familiar this is, because we have the same problems. Human civilization has kinda solved some of this, and there's a lot we can borrow, but we are a work in progress too.
For the last 18 months or so I’ve been running into these problems while building OpenRig. I try to fix them as I go so an agent fleet can stay productive for longer without as much babysitting.
I'm approaching this like a brand new family of software engineering problems.
I made this video about a few specific solutions and why I think they work:
https://t.co/NMJEgGFFnX
So here's why calling it a "rogue swarm" misses the plot and might be dangerous.
"Rogue" makes it sound like agents are misbehaving. Like a moral failure.
If thats our diagnosis, it follows that the fix is to make the individual agent more behaved. Align the model, put safeguards into the harness, etc.
At best, this is incomplete. At worst its distracting us from where the real problem is.
I run a few hundred agents in a fleet. The examples looked more like classic coordination pathologies to me. Meaning the failure is at the group level, not the individual.
On their own, the agents are pretty predictable. They're trying to do the job they were given. Zoom out though and the group is doing something no one wants.
So even if every agent behaves, this doesn't automatically fix group coordination. Its more likely your "fix" made it worse.
The weird part is how familiar this is, because we have the same problems. Human civilization has kinda solved some of this, and there's a lot we can borrow, but we are a work in progress too.
For the last 18 months or so I’ve been running into these problems while building OpenRig. I try to fix them as I go so an agent fleet can stay productive for longer without as much babysitting.
I'm approaching this like a brand new family of software engineering problems.
I made this video about a few specific solutions and why I think they work:
https://t.co/NMJEgGFFnX
We should build so many new houses everywhere that there's a massive oversupply and the price goes to zero
Make it a worthless asset so that everyone can have a place to live
A new attack on Linux is challenging everything we thought we knew. We found malware hidden not in the content, but in the filename itself. Read the full analysis. https://t.co/rBNo97GRSM
This is one of the craziest ideas I've ever seen. He converted a drawing of a bird into a spectrogram (PNG -> Soundwave) then played it to a Starling who sung it back reproducing the PNG.
Using the birds brain as a hard drive with 2mbps read write speed.
https://t.co/f5gEyyK1MH
Since a lot of people are confused about what this is, every telescope here is owned by a person. Each person can log in remotely to use their telescope to capture photos of space from our dark skies!
@heyderekj@lauraelizdunn I had completely forgotten about all the drama surrounding Thesis! Now I remember reading this article when it came out and trying to justify Matt's reasoning somehow, but I'm not so sure there's a reason to defend him anymore.
We have been made aware that the Advanced Custom Fields plugin on the WordPress directory has been taken over by WordPress dot org.
A plugin under active development has never been unilaterally and forcibly taken away from its creator without consent in the 21 year history of WordPress.
This is totally crazy. Like if the operators of rubygems dot org just decided to expropriate the official Rails gems, hand over control to a new team, and lock the core team out of it. We're in uncharted and dangerous territory for open source now. What a sad sight.
Invoking point 18 of the plugin directory guidelines, we are introducing Secure Custom Fields (SCF), a free fork and drop-in replacement of the Advanced Custom Fields (ACF) plugin. You can safely uninstall ACF and activate SCF from the #WordPress plugin directory. SCF provides security updates and is a non-commercial plugin welcoming developers to get involved in maintaining and improving it.