Wrapping my head around recent LLM-powered AI outcomes, grappling with the unfathomable amount of data this requires. And corresponding processing. I truly cannot fathom it. I know intellectually it exists, I can look at quantitative graphical representations, and I still cannot fathom it.
@zehavoc Um. that was my cat. He literally saw I opened X, hopped onto the keyboard, wrote some stuff, sent it (apparently), and then closed the browser.
Point taken, cat. I will stop trying to picture a billion dollars in terms of elephants and go touch grass.
American researchers, startups, nonprofits, government, students and hobbyists overwhelmingly benefit from open-source AI, wherever it comes from.
The best response to Chinese open-source AI isn’t to ban it, it’s to build more American open-source AI! 🇺🇸
Great to see a new US House report recognizing this. Thanks to @RepMoolenaar, @RepGarbarino and their teams for their work!
We need more open source, not less! 🤗
My EMNLP keynote "On The Value of Open Research in Language Modeling" is available!
https://t.co/I2HrF68q9b
I discuss why open research is important despite the progress made in industry, and some questions to think about to do more impactful open research.
This is a great write up. It comes across so clearly that anthropic does NOT understand the “trust us, we’re the good guys” strategy is bound to fail at some point. They have a relatively narrow distribution of ideas and they’re racing toward the inevitable blind spot.
are you and/or your kids saying "search it up" instead of "google it" when you want to find something online? i've noticed my kids always say this lately and i find it fascinating.
I think some at Ant may truly believe that they are the Right People to be in charge of AI, and others are Not. The issue is if you don't agree. Worse if you think they are absolutely not the Right People.
Wrt the pangram/AI writing debates: Everyone is accounting for the fact of language change, right? How many of us write now is very different than how we wrote 2 years ago, in part because we are inundated with genAI patterns in what we read.
This is a brilliant “look at things differently” type of AI that you can only get with openness: instead of having agents train a Moar Powerful AGI agent, have them make a task-specific system that does what you want. 💡
PyBot: No weights. No training.
A chatbot built with only simple rules and no AI, entirely written in 600k lines of Python code. PyBot matches Smollm with 360M parameters!
How? A swarm of 1,000 DeepSeek Flash agents wrote the whole code in just a week.
https://t.co/Du5GVvvLb5
PyBot: No weights. No training.
A chatbot built with only simple rules and no AI, entirely written in 600k lines of Python code. PyBot matches Smollm with 360M parameters!
How? A swarm of 1,000 DeepSeek Flash agents wrote the whole code in just a week.
https://t.co/Du5GVvvLb5
Can Python be a chatbot?
Over one week, we challenged a swarm of 1,000 agents to build one entirely in Python: no weights, no training, just a million rules :)
Each agent was an instance of DeepSeek-V4.1-Flash that worked on different parts of the bot's conversational capabilities: understanding, answers, memory, routing, etc.
They coordinated on a Slack-like message board we built for agents, wrote ~175k messages to each other, and merged ~8k PRs on a shared repo (which almost broke the Hub 🙈)
The result is PyBot: 630k lines of Python, zero dependencies, and on par with SmolLM-360M at answering everday questions. Just don't expect it to solve a Millennium Prize problem anytime soon :)
Code & demo: https://t.co/J52376WBsi
As I’ve said for years, concentration of power, capabilities and wealth is the biggest risk in AI. The natural tendencies for it are super strong and without much much stronger open-source, we might end up in a world with more asymmetry and inequalities than ever!
past week, there has been many fearmongering posts about how you should download models from HF because models are taken down or platform might be put down
it's all misinformation, ask me about it if you're concerned, but don't engage with those posts
many thanks