How much is an AI token worth? We fit scaling laws to find out!
In August 2026, Pangram labels 31% of FineWeb-filtered web tokens as AI-generated, up from 10% in June 2024.
We pretrained 800 LMs (19.9M–973M params) on mixes of human and AI web text to measure what it does to pretraining 🧵
Reminder: #SaTML2027 has a Call for Competitions and Workshops! Both are due one week from today (August 28).
Please submit your proposals and join us in beautiful Reykjavik!
https://t.co/hN4m8M3o32
https://t.co/fksvbfFLyj
Recent research shows GenAI leaderboards are vulnerable. In our recent paper accepted to IEEE S&P ’26, we uncover additional weaknesses in how these leaderboards are designed and used.
Poisoning papers are everywhere, but we rarely ask how a poisoned model can actually reach victims at scale.
Our recent work, accepted to IEEE S&P ’26, shows how leaderboards can be one practical route. 🧵 (1/8)
Finally happened! Excited to launch the AI Security Lab with the bright minds at @manningcics and collaborate with the community on GenAI vulnerabilities.
Test-time scaling has driven the success of recent LLMs like o1 and r1. However, these LLMs are vulnerable to an "overthinking" attack: decoy tasks, when inserted into input context, cause them to spend way more reasoning tokens than needed, without any impact on model output!👇
How Sudokus can waste your money? If you are using reasoning LLMs with public data, adversaries could pollute it with nonsense (but perfectly safe!) tasks that will slow down reasoning and amplify overheads 💰 (as you pay but not see reasoning tokens) while keeping answers intact
Can attackers detect sensitive documents in your RAG system using natural questions 😈? YES! - with 76× stealthier probes than existing methods, all while costing <2 cents per document 💸! (1/6) 🧵
🧙 I am recruiting PhD students and postdocs to work together on making sure AI Systems and Agents are built safe and respect privacy (+ other social values). Apply to UMass Amherst @manningcics and enjoy a beautiful town in Western Massachusetts. Reach out if you have questions!
@wendyrsherman Ms. Sherman, congratulations in advance on your upcoming inauguration. It's been a long time since Iranian students are not allowed to get Visa appointments in the US embassies in Turkey and Armenia. Please help us with this issue. Our admissions are at risk.#Iranian_Students
@ABlinken Mr. Blinken, congratulations in advance on your upcoming inauguration. It's been a long time since Iranian students are not allowed to get Visa appointments in the US embassies in Turkey and Armenia. Please help us with this issue. Our admissions are at risk.#Iranian_Students
@usembarmenia Please help Iranian students. We do not have the option to join the online classes and begin our semester remotely. Now that the situation in Armenia has improved, please specify some time for student visa interviews.
#Iranian_Students_Visa_Appointments
@usembarmenia Many Iranian students have been waiting for several months to schedule an appointment at the U.S. embassy in Armenia. Please re-open the embassy for F1 interviews. We have deferred our admission once and we are losing our admissions.
#Iranian_Students_Visa_Appointments
@usembarmenia Many U.S. embassies around the world have resumed their services even in countries with high COVID rates like India. Please specify some time for the F1 interviews. We are losing our admissions. Please help us.
#Iranian_Students_Visa_Appointments
@usembarmenia COVID-19 cases in Armenia have decreased significantly. We have been waiting for several months to be interviewed. Please resume student visa services.
#Iranian_Students_Visa_Appointments