I've got an agent in a loop optimizing a renderer with the goal to minimize frame times (and tests to measure). It got times down from 88ms to 2ms and allocations down from ~150K to 500. Sounds good, right? Wrong. This is exactly why agent psychosis is a big fucking problem.
As an experiment, I rewrote the Ghostty core render state in Go, with access to identically laid out data structures as Ghostty and the exact same validation tests. I made a purposely naive renderer (simple, correct, but slow). 88ms per frame with 150,000 allocations (horrendous, lol)!
I then kickstarted a Ralph loop to bring the frame times down. I told it it can't modify input data structures or the public API or tests (they're correct), but it can do anything else it wants. It got to work.
It has worked for about 4 hours. I've spent around $350 on this experiment so far. The results?
88ms => 1.5ms
150K allocs => ~500 allocs
Incredible right? Nope.
My hand-written renderer I ported has frame times (same benchmark) of ~20us (0.020ms) and 0 allocations in the update path.
This is the problem with psychosis and lacking systems understanding. If you don't understand the system, you're going to accept that this is an incredible result. If you understand the system, you'll see better solutions immediately and can do roughly 75x better on throughput.
The people who blindly trust agent output are in the former camp. They're sheeple, overdrinking from a fountain of mediocrity.
Standard disclaimer: I use AI all the time. I like AI. The point I'm making is to not blindly accept results. Think. Analyze. Learn.
@t3dotgg Actually, it's not Drupal's fault. It was inevitable that some devs would have been hurt sooner or later. Here is my detailed response to the original tweet. https://t.co/OB7ygyyYx2
I've worked with PHP & Drupal since PHP v4 and Drupal v4 days to the latest versions of both. Based on my experience with both, I would say it’s not entirely a fault of Drupal here, but it was almost inevitable because of PHP situation 15 years ago. (1/24)
I am not active PHP/Drupal dev anymore. Not because I hate PHP/Drupal, but my new assignment has different needs. Maybe now Drupal also needs GoDrupal10 initiative similar to GoPHP5. (24/24)
I've worked with PHP & Drupal since PHP v4 and Drupal v4 days to the latest versions of both. Based on my experience with both, I would say it’s not entirely a fault of Drupal here, but it was almost inevitable because of PHP situation 15 years ago. (1/24)
major updates with dramatic breaking changes have consequences for years and years. we can all think of some frameworks/libraries that did that. here's a new story I didn't know about drupal
So switching from Drupal 8 to 9 and 10 was pretty smooth for the most. The documentation should be more organized though. But it is also getting better, since the number of docs contributors are also growing. (23/24)