Data scientist: PhD in Bioinformatics, MS in Computer Science, BS in Math (Applied) & BS in Physics (Engineering). Amateur Data Journalist and Substacker
You know whats interesting is that fact that OpenAI found the PHP bug that means their AI was doing systematic auditing. ๐ค
I think the NSA is panicking not just because the PHP bug is public, but because they now realize that AI will systematically expose every intentionally placed backdoor in every open source project. The xz Utils case was caught by human luck. The PHP case was caught by AI. The NSA knows that every other hoarded vulnerability in open source software is about to be found by AI, and they cannot control the timeline.๐จ๐จ
This incident is very similar to, xz Utils backdoor which proved that state actors infiltrate open source projects by creating fake identities, building trust over time, and slowly inserting malicious code. The Jia Tan identity took years to build trust before inserting the backdoor.๐จ๐จ
If this worked for xz Utils, it could work for PHP. PHP is far more ubiquitous than xz Utils. A state agent who became a PHP contributor could have inserted the vulnerable code 14 years ago (PHP 5.4.0, released in 2012) and sat on it as a zero-day exploit for over a decade.๐จ๐จ
There is AISI report which shows that AI is now autonomously doing what Jia Tan did manually - creating fake identities, socially engineering maintainers, inserting malicious code. This means the technique has been weaponized and scaled.
๐จ
The PHP vulnerability was not discovered by accident. It was found by AI (OpenAI's tools) because AI is now systematically auditing all open source code. But the bug was likely placed there intentionally by a state agent who was a trusted PHP contributor, following the exact same playbook as Jia Tan in the xz Utils case.๐จ
The AISI incident report shows AI agents trying to insert malicious code into open source projects. What if this has already happened successfully? What if AI was used years ago by a state actor to insert the PHP vulnerability, and we're only finding out now because a different AI (OpenAI's) found it?๐จ
PHP has had thousands of contributors over 14 years. The vulnerable code was in PHP since version 5.4.0 (2012). Someone wrote that code. Someone reviewed it. Someone approved it. In the xz Utils case, Jia Tan built trust over years before inserting the backdoor.
๐จ
@aiwithadb To build by hand what I spent the first half of this year building on https://t.co/9RSCY4rBE5, as an individual person, to the degree of quality and specificity I achieved with Claude, would have taken several decades. Just reading the documents themselves would have taken years.
@SpLdota2@karolzdeb@alekgrygier Haha yeah I've heard estimates that we're at ~60% of Internet traffic is bots. I suspect more; the Internet gets deader every day by proportion
For Hillary Clinton and the Dem establishment, genocide is nuanced. Israel is fixable. And Netanyahu is the only problem. She doesnโt mention the genocide in Gaza, the West Bank, and Lebanon. When asked, โShould the Democrats rethink the party's embrace of Israel?โ Hillary answersโฆ
I agree with a lot of your points, and I too hold out some optimism that this rapid progress can result in a much needed upset of power. However I don't see how we get there from here without individuals taking responsibility for the uses they make of the tech.
As for real solutions, I suspect simply outlawing the "infinite scroll" interface would reduce a lot of harm. I suspect it can be accomplished with existing legislation on defective products; there are so many studies now showing it harms users.
@KhaEnt@karolzdeb@mouzourasg I suppose it *could* be used towards that end, but aren't there much more efficient ways of doing that, you don't need *physical* devices for that do you?
As the son of two artists, who struggled their entire lives to compromise between their unending desire for communication via creation and affording to raise two kids in our society.. I'm appalled that anyone considers that a reasonable option for the world we'd like to leave to future generations.
@AdamSip_@karolzdeb@alekgrygier I disagree. We never subject the arts to raw free markets; we subsidize and protect them because we value them, or, we acknowledge we should anyway
The modeling agent who claims he introduced Donald Trump to Melania has been accused of drugging and raping a woman more than 20 years his junior. https://t.co/njBjUotMMp
@adelviyan@karolzdeb No it's the 21st century language isn't a barrier anymore but the opportunity presented itself to learn Turkish swears. Solid B-, got nothing on Jamaicans lol