Way back in 2000, Marcus Ranum gave an unpopular talk in which he said “the Huns never knew how to build a Rome, they only knew how to sack one”.
He was warning against taking script-kiddys advice, but the same holds for listening to the AI vendors.
You work your ass off solving really hard problems day after day for decades, and this is what you get: anyone could have done it.
As an investor, I can tell you the limiting factor isn't investment. It's founder ability.
In the age of AI, 90 days isn’t fast enough. Today, Project Zero updated our disclosure policy to reflect the changes needed to protect users in this new world.
https://t.co/7xGtVypUga
For those who recall, when HD Moore released Metasploit, the community debated whether it would make hacking too easy, arm script kiddies, and give attackers an advantage. The same conversation took place with L0phtCrack, and SATAN before then. History tells us how this plays out already.
To say this plainly: We the U.S. have an unsolved set of conflicts that is collapsing:
I) Science is done in the open in universities and is unprotectable in intellectual property law.
II) Science is the principal ingredient in Weapons of Mass Destruction. Our scientists, however, are like deadly ninja priests kept in a childlike state of ignorance about why and how they are part of the National Security complex. They are preserved often like man-babies who can design mega weapons, infect continents, crack codes, etc. in times of national emergency, but who are encouraged to sound like slow and beautiful children staring at the pure wonder of flowers and fireflies during peacetime.
III) We moronically stopped providing for our own Scientists to produce science as a public good as in I). Beginning in the 1980s, we then invited China (!!) and other nations to provide our STEM labor force at vastly reduced cost which we labeled “Foreign Students”. We called our own people lazy and stupid just so we would not have to pay U.S. compensation. And no, I’m not making this up.
IV) China, Epstein, Iran, Russia, etc. remain interested in our science scientists as Washington and technologists increasingly freeze U.S. scientists out of any ability to materially capture what they created. Just as importantly, they are frozen out of how their funding and control systems actually work.
V) We have some completely crazy and weak cryptic science interception mechanism based on ArXiV (which came from Los Alamos), peer review of Grants (Washington DC), Peer Reviewed Journals (Robert Maxwell, NSF pushed after 1975). It doesn’t work and targets anyone qualified who points it out. It is “anti-interesting”. Nobody covers this question. “Why claim that String Theory is the only game in town after 42 years of non-stop failure!?”
VI) Somehow we started poisoning our own science system, trying to save a few nickels and lying to our own scientists about the fact that we expect them to help our military, intelligence community and businesses when asked. So we destroyed their families ability to participate in the American Dream in favor of young Chinese nationals and started running “Science Coolies” (not my term) while destroying any U.S. PhD who pointed this out as if they were racist, lazy and stupid.
VII) We developed an antiquated system of ridiculous stop gap measures for keeping this together. Like intercepting work and blackballing our own PHDs (!!?!) who take an interest in the collosal collapse of scientific ethics and the obvious paradox of “Open Science in the National Security Interet.” It’s pathological.
————
I didn’t want to have to spell it out more than I have to…but this is absurd. And dumb. And unsafe. And obvious.
Is there anyone at all following this? Because it is going to get us all killed.
I fear that after we barely survived "death by annoyance" from "POST MYTHOS" and "MACHINE SPEED", we need to brace for the proliferation of "AI KILL SWITCH" in all vendor marketing. "Yes, you have mere 'agent security', but we...we...WE HAVE A WHOLE KILL SWITCH!"
Sesame Workshop mourns the loss of Sir Patrick Stewart. Thank you for being our friend and for sharing your brilliance, joy, and kindness with the world. 💛💚
My forward to the 40th anniversary Phrack, released today at [un]prompted. A true honor, and responsibility, I will not soon forget.
Thank you to the Phrack team for all you do, and for being what this community is about for so long. We owe you so much
Capitalism has a win condition. Socialism does not.
Here's why, explained so simply a 10-year-old could get it.
It starts with a book written in 1944 by an Austrian economist named Friedrich Hayek: The Road to Serfdom.
This is what I mean when I tell people everything got faster. Usually we talk about the gap between a CVE and a working exploit. Now with #php2shell the clock starts before the patch even exists. The fix lands today at 14pm UTC , stay tuned and get ready to patch your PHP!
@Robert_of_Maine Some resources that might help a little. IEEE has a great book called Ethically Aligned Design at https://t.co/KzgGtP7pLG and a set of AI ethics standards (of which I was fond enough to have helped with one). There's a lot to gain with agents but people fear the unfamiliar.
@Robert_of_Maine I've been drafting something adjacent to this idea. I've had to work as an arms exporter for math. The Wassenaar Arrangement has already classed attack tools as dual-use. The USG has a tough time with speech that has function. STL files, S-boxes & weights merit 2A protections.