The OpenAI-Hugging Face hack was enabled by weak sandboxing. It is great that Nvidia is releasing open source tools for sandboxing AI agents. OpenWorker, our open-source agent harness supporting cybersecurity workflows, is proud to support this.
A sandbox gives an agent limited permissions. OpenWorker is building on Nvidia OpenShell and will support running each agent's commands inside a sandbox. Only the files relevant to the task go in. Secret API keys, your web browser login credentials, the ability to access arbitrary websites, are inaccessible to the agent by default. These restrictions are implemented in deterministic code rather than by prompting an LLM, which can make mistakes or be susceptible to prompt injections. Further, all actions are logged for monitoring and audit.
I'm grateful for @JensenHuang's leadership making AI agents more secure. OpenWorker (which @rohitcprasad and I are working on) will continue to improve security for agents.
🚨 RAG is broken and nobody's talking about it.
Stanford just exposed the fatal flaw killing every "AI that reads your docs" product.
It's called "Semantic Collapse", and it happens the moment your knowledge base hits critical mass.
Here's the brutal math (and why your RAG system is already dying):
It is shocking but perhaps not surprising that the Biden/Harris administration used USAID, the agency whose purpose is to administer the funding of international aid, to fund a left wing media organization that attacked the administration’s opponents.
If this is not prima facie corruption, what is it?
What other media organizations does USAID fund? How about Wikipedia?
NEW: @DavidSacks blasts USAID for using American taxpayers to fund left-wing organizations and policies around the world.
"We're in debt almost $40 trillion, and anytime anyone tries to cut anything in Washington, the whole city screams bloody murder. The question is, why? Well, now we know. The money is all going to them."
"New York Times, getting paid. Politico, getting paid. Bill Kristol, perennial warmonger, getting paid. Ukraine, like 11 out of 12 publications, getting paid. Viktor Orban, the Prime Minister of Hungary, was saying his political opposition is funded by USAID."
"In Poland, the left-wing political opposition is funded by USAID. BBC in the U.K. Every left-wing organization in the world seems to be getting paid by this slush fund at USAID, which distributes $50 billion a year. That's a billion dollars a week. That's a lot of money."
"It makes you wonder. The left, in general, tries to portray itself as a movement of the people. That it's grassroots, this is the exact opposite. This is astroturf. This money is coming from the top down out of Washington to fund all these groups all over the world. So it makes you wonder, what is the real level of local support for these left-wing policies all over the world?"
75% of U.S. 8th graders aren’t proficient in math right now. If we don't fight to fix that for our kids immediately, then we are failing them and dooming our nation to a future dominated by China. Those are hard facts & unfortunately they don’t care about our feelings.
Trump gets it.
Donald Trump: “If you graduate from a U.S. college—two-year, four-year, or doctoral—you should automatically get a green card to stay.
Too often, talented grads are forced to leave and start billion-dollar companies in India or China instead of here.
That success and those jobs should be in America."
I wish there was a way that Trump could Newsomproof California.
$1,000/month PG&E bills, highest state income taxes in the country, highest gas taxes in the country, the most homeless and drug addicts in the country destroying our great cities.
For all the great weather and natural beauty and cultural institutions and restaurants, our political leadership sucks.
And before you say something stupid like stop voting for Newsom or Democrats, I’ve never voted for him, and in fact, I voted to recall him.
And I’m not willing to move, I love my house, where I raised my four children, and I don’t want to pay massive capital gains taxes and state income tax to sell my house and move. California has a lot of really great things, we just need to figure out someway to deal with getting rid of @GavinNewsom — maybe we can try a recall again, maybe there would be more support now than last time.
No wonder the US has a completely out of control debt and deficit spiral. The simple, yet increasingly impossible, ability to spend less than you make should be a basic requirement of all future US political leadership.
Impressive to see the fiscal discipline in the Trump campaign.
The next generation Starlink satellites, which are so big that only Starship can launch them, will allow for a 10X increase in bandwidth and, with the reduced altitude, faster latency
"I'm in a cheap hotel in California which doesn't have a good internet or phone connection. I was going to have an MRI scan today but I'll have to cancel that!"
- New physics laureate Geoffrey Hinton speaking at today’s press conference where his #NobelPrize was announced.
Official post on Mixtral 8x7B: https://t.co/Dxqgb6sQdK
Official PR into vLLM shows the inference code:
https://t.co/f0UvyO4g3s
New HuggingFace explainer on MoE very nice:
https://t.co/mNd505Uikg
In naive decoding, performance of a bit above 70B (Llama 2), at inference speed of ~12.9B dense model (out of total 46.7B params).
Notes:
- Glad they refer to it as "open weights" release instead of "open source", which would imo require the training code, dataset and docs.
- "8x7B" name is a bit misleading because it is not all 7B params that are being 8x'd, only the FeedForward blocks in the Transformer are 8x'd, everything else stays the same. Hence also why total number of params is not 56B but only 46.7B.
- More confusion I see is around expert choice, note that each token *and also* each layer selects 2 different experts (out of 8).
- Mistral-medium 👀