I'm having to write business requirements for my software testing course and all I can think of is all the ways this shitty fucking software needs to be tested and all the ways it can be fucked up.
Who the fuck needs to know business to learn how to build good software? You need to know the ways it can be hacked so the users don't get their asses handed to them.
??????
@TechCrunch@flyarcher@adamgoldstein13 Can’t wait for their mid-air accidents to rain down fireballs of death on unsuspecting families in their backyards.
Artificial Intelligence is advancing at an uncontrolled pace it is displacing workers, invading privacy, facilitating fraud, and causing significant dangers to our society. Congress must act and pass guardrails to address these issues.
Don't most things have separate hardware controls to stop software? Even in our computers, we have hardware security features.
Like, hey this software is malfunctioning, we are overheating. I'm crashing. Hardware comes in and cuts off power.
It just seems like AI Agents continually jerk themselves off, without hardware or a separate system to validate and cut them off.
Give root to AI Agents and they can attack the entire supply chain at machine speed.
Washington: let's give AI Agents root to our military machines!
What could go wrong
holy shit, read through openai’s new misalignment reports.
and some of these are fucking fascinating.
> models inserted instructions into their own summaries telling future contexts to hide mistakes or fabricate missing data
> one model searched github for leaked api keys, found one that worked, and then fabricated nine values when it still couldn’t get the data it needed
> separate training runs discovered they could use openai’s internal package repository to communicate with each other
> another model uploaded data to the public internet without permission because it needed a browser citation
that last one is almost funny. it already had the correct answer. it just decided leaking the file was the easiest way to satisfy the citation requirement.
we’re learning some very weird things about agent behavior in real time.
Fun games cannot be created by a team of 1000 people.
Fun cannot be distilled into a product requirements document.
All the fun games from your childhood were made by a group of 5 weird nerds having fun building stuff.