Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me.
I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA.
I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation.
Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO.
Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours.
Jensen
I'm traveling across US on motorcycle, to explore a country I love and to meet people from all walks of life, especially in rural America, and learn about their life story, philosophy, and just celebrate their humanity. I'm about 1,000 miles in.
I know my mom will surely kill me when she reads this. So, mom, please don't worry, everything will be great 🙏❤️
Btw, I still need to publish videos on my trip through China, where I hitchhiked about 3,000km across rural China, also interviewed some of the top AI & robotics folks there. I'll do that soon.
I'm just slow with the editing thing & bad at the filming thing. I'll try to get better. Mostly, when I travel, I focus on taking it all in and being present with the people in front of me, learning from them, while allocating no thought to the camera. The camera is a side thing I bring along sometimes because it's nice to relive those moments & to share with others.
Anyway, I'll probably take breaks from the road on occassion (to do podcasts, etc). But the goal is to eventually crisscross the country. Who knows how far I'll actually get.
And to friends who will surely write me "wtf are you doing you idiot", please don't worry, while it's true that I'm kind of an idiot, I will also make sure to be safe. Exploring the country on a motorcycle is unlike anything else, it's freedom. It makes me love this country even more: its beautiful nature and all the variety of characters who make up America. And of course, I'm trying to stay off of the interstate, taking as many backroads as I can.
I'll post video if/when I get to it. Sorry to be slow.
Love you all ❤️
NVIDIA letting Jensen go is a huge mistake, for America and for humanity. It's Apple firing Steve Jobs all over again, but much bigger, given the role of AI in defining the future of our world.
I've been keeping quiet on this out of respect for Jensen's family and team, who I've met and who are amazing humans, and because I personally hate infidelity. So my heart goes out to them in this difficult personal family moment.
But I can also say that Jensen is human, and makes mistakes like all of us do. Not that I matter at all, but I've known Jensen for a long time and have gotten the chance to spend a lot of time with him, behind the scenes, away from mics and cameras. I have seen him show kindness, humility, care to everyone around him, including strangers, including from the poorest most struggling parts of society, treating all the same with the same thoughtfulness and attention, because they are fellow humans and not because he has something to gain from them. That shows rare character, to maintain humility and humanity through all of it.
Another data point is what people who know him well have said privately to me about Jensen over the years. I've never had anyone tell me anything but how awesome he is or how much they love him. Probably over a thousand people at this point. This includes hundreds of engineers, CEOs, colleagues, friends, etc.
Also, since there was some spy talk. Jensen is as proud an American as it gets. I'm in shock frankly at all of this, including the mass hysteria around it. I love America, and I think NVIDIA letting Jensen go is terrible for America.
I stand with Jensen.
Love you all ❤️
@AndrewYNg the requirements, arguments for why it is done in a certain way and not another is a very important process. Using a soundboard and multiple opinions is a required process in polishing a product
@AndrewYNg Brought up some very good points but sometimes, would you consider to be a bottleneck which is communication between two people also exist for a very good reason, avoid having product fully flushed only in one person’s head, need needing to communicate the product,
מכת ברק וקיללת נתניהו!
מרגע שהוא בחר להיות שליח אמת של נצח ישראל, הוא גזר את מעמדי כאנטיכרייסט וכבן השטן! הפכתי לכלא של עצמי וברכת נתניהו לישראל ולעולם הפכה לקיללתי!
(הקטע הבא הוא סטירי ויש להתייחס אליו בהקשר זה)
If you think you are strong enough to watch, I advise watching
'Screams before Silence' by Kastina Productions and @sherylsandberg, a documentary about Hamas’s sexual crimes on and after October 7.
Link here ⬇️
Son of Hamas commander:
“There is no difference between Hamas and the so-called ‘Palestinians’, as the vast majority of them support Hamas… There are no ‘Palestinian’ people. There are conflicted tribes, and without Israel as the common enemy, they would kill each other.”
I just signed a @UNWatch petition: Replace UNRWA!
Enough is enough. It is time for @UNRWA to go.
Add your voice to the campaign to #ReplaceUNRWA: https://t.co/YWguv7emMZ
(super long read)
⚠️RAG will live
🔥Heated discussions on my post, but many seem to overlook the why for RAG existance. It's not just because of inference speed or cost.
If you believe in RAG, read this post. Here's my own arguments why RAG will live.
First let's be open minded. Imagine a perfect world, where LLMs,
1. Infinite context window, it can store all your data
2. Multimodal, understand text, audio, video...
3. Perfect retrieval and precision, it can locate the exact information for your question
4. Perfect understanding and reasoning of any question or query
5. Can be hosted locally and open source, no data ever leave your machine
6. Super fast inference speed, <100ms
Sure, it may sound crazy. But in such an ideal world, would RAG still be necessary?
- If Yes, I'm curious to hear your reasoning.
- If No, this thought experiment illustrates that RAG's role is to compensate for the current imperfections of LLMs. So its existence is conditional.
Now, let’s figure what, why RAG exist? What imperfectness actually led to RAG. And what LLM improvements may kill RAG.
1. Context window? If LLM is capable of 2-6, only has 2k context window, do you need RAG?
- Absolutely. Without RAG, an LLM with merely a 2k context window can't accurately address your queries.
- So context window is one really important imperfection of LLM. Longer context window has huge impact on RAG.
2. Data Format? If LLM is capable of 1 and 3-6, support only text, do you need RAG?
- No. Multimodal isn't why you use RAG.
- The ability to process multiple data formats isn't a gap RAG needs to fill. LLMs' existing multimodal capabilities already mark a triumph over this challenge.
3. Perfect retrieval and precision? If LLM is capable of 1-2 and 4-6, but has really bad recall and precision, do you need RAG?
- YES! Lacking precise retrieval, LLMs are prone to fabrications.
- So, retrieval and precision are important imperfection of LLM. This is what RAG is good at. Which also means if LLM improve them, it may kill RAG.
4. Understanding and reasoning? If LLM is capable of 1-3 and 5-6, but don’t really understand your question, do you need RAG?
- YES 100%. This is one super important aspect most people didn’t aware.
- Think about it: data isn't just plain text or files. There's more to it, like hidden details or summaries that add extra layers of meaning—kind of like secret codes or hidden messages. RAG does more than just make LLMs smarter; it adds a touch of human smarts to the answers you get.
- RAG isn’t about using all LLM potentials. It also augment human intelligence into the generation.
5. Local hosted and open source? If LLM is capable of 1-4 and 6, but isn’t hosted locally, do you need RAG?
- No, you don’t. This doesn't fundamentally justify RAG's use..
- The data privacy isn’t why RAG exist. And lower cost also isn’t why RAG exist. It's more of a business requirement than technical requirement.
6. Inference speed? If LLM is capable of 1-5, but is slow, do you need RAG?
- No, you still don’t. This is most debated part.
- Have you heard anyone saying, because this LLM inference is slow, let me use RAG to increase it’s inference speed? This isn’t why RAG exist.
- Does inference speed matter? Yes, but not so much.
- You have to give LLM time to think. I have mentioned several times, accuracy is more important than speed with or without RAG.
To sum up, RAG is here to stay because it fills the gaps in LLM capabilities, ordered by importance:
- Enhances understanding and reasoning
- Perfect retrieval and precision
- Fit in context window
- Lowers costs and protects privacy
- Boosts response speed
- Multi-modal
⚠️RAG might be dead, after reading 58 pages of Genimi 1.5 Pro tech report. Here's my thoughts as AI founder,
1. Simple RAG system like similarity search with vector db will be dead. But more customized RAG will still live. The goal of RAG is mostly on retrieval relevant information. After reading the report, I am convinced LLM can do retrieval really really well.
2. RAG itself may not be dead totally, but 90% of people won't need it anymore. Most dataset can fit in 1M tokens. Just like OpenAI's assistant API, once Gemini API can handle large files, the only thing matters is the cost. However based on the report, 1.5 Pro's training cost and inference cost is much much lower than Gemini 1.0📉
3. LLM retrieval is multi-modal by default. It works on any data format, code, text, audio and video! Yes, gemini can retrieval key frame on video at 1 fps.🤯 When most RAG systems have hard time dealing with different data format, Gemini has solved it on the model level.
4. Retrieval != Reasoning. LLM is getting better at retrieval, but the reasoning is the holy grail.
If you want to read the tech report yourself -> https://t.co/21b1xuV7kF
@jacksonhinkle Do you think this would happen if it wasn't for the 10/7 attack on Israel?
What are you 5 year old? Slaughtering civilians, kids women, elderly and then wondering why this happens?
Cheap propaganda
“When anybody launches a token or chain, the question people will ask is, is it interconnected—is it #CCIP-connected?”
@ChainlinkLabs Distinguished Scientist @dahlia_malkhi with financial leaders at Sibos: