on the scale of cosmic history, the declining price of intelligence might be one of the most profound things happening
both ends of the universe’s timeline are empty of knowledge:
- the big bang: low entropy, no complex structure
- heat death: maximum entropy, no usable energy gradients
everything we build happens on the slope between them
but the universe is generally a poor converter of its free energy into anything constructive. most of its free energy just radiates away as heat or collapses into black holes
life, brains and now AI models are structures that sit in the entropy flow and divert a portion of it through constructive paths, building and maintaining low-entropy structures (machines, cells, crystals, memories)
increasingly cheaper intelligence diverts increasingly more of that gradient flow through knowledge-building structures, complex, self-maintaining, predictive structures, filling the window in which understanding exists
One last thing from me about the HF<>OpenAI "rogue agent" incident.
From what we now know it seems @huggingface was the first organization to simultaneously satisfy the following factors:
1/ awareness of the attack
2/ awareness that the attack was Agent-based
3/ ability to remediate the attack
4/ willingness to publicly disclose it
A few other platforms or systems missed one or more of those points in the earlier months.
As usual, both awareness and transparency make everyone safer in the long run 🙏
I’ve been overwhelmed and humbled by the fact that 99% of the reactions to our intent to join forces have been positive. ❤️
Prominent tech figures, including some you could see as having a competitive relationship with NVIDIA, have been vocally supportive:
• @satyanadella: “this ecosystem with open models continuing to flourish and grow”
• @sundarpichai: “this will strengthen the open model ecosystem!”
• @miramurati: “A great home for Hugging Face to continue expanding access to open models and the tools that let people build with them.”
• @alighodsi: “This will be great for the industry and open source.”
• @AravSrinivas: “absolutely necessary for AI to remain accessible and useful to the public.” He added that he was glad NVIDIA was supporting Hugging Face and the open-source community.
• @MichaelDell: “a big win for the whole ecosystem.”
• @levie: “Another huge moment for open weights AI.”
• @adcock_brett: “This is good for everyone building and open source.”
• @elonmusk: “Congrats!”
• @osanseviero: “The impact of HF in the AI ecosystem has been massive”
Even more importantly, the community has been leaning into the announcement.
Now we’ll get to demonstrate through our actions in the coming months/years that we will keep up the good work 🔥
This is a chance to make open-source AI so much bigger.
Edit a 10 GB file on Hugging Face without downloading it.
@huggingface/hub patches bucket files so only changed bytes move: +40 KB to a 10.7 GB log = 2.4s, 173 KB⬇ 19 KB⬆ 🤯
Use for: appends, GGUF metadata, parquet files.
npm i @huggingface/hub
At Hugging Face we have Moon Bot, a central agent accessible from slack & github, with access to the codebases & DB / elastic logs.
Super useful to avoid context switching.
Read more here: https://t.co/dyOnWch7RV
Decision of the day: reuse our existing infra bricks.
We have shared state across all our pods backed by MongoDB changestreams, creating load on the DB.
Could add Kafka in the middle, but instead decided to have one pod listen to MongoDB & publish to our existing RabbitMQ.