A graduate asked me today how do I manage people?
The answer I give is very simple: I hire the best people I can possibly find so I don’t need to manage them.
I mean, we found a way to condense information to a level that’s extremely efficient, to the point where we can capture all the known knowledge humanity has ever created into a tensor with various weights, and have a very nice way of interacting with it through matrix operations.
If you really think about the implications of this alone, it means that all the distillation work, the so-called review papers, summaries, or even ideas that are essentially just doing A plus B, can largely be solved.
It’s almost like having a fantastic note-taker working with us. And by us, I mean humanity. We no longer need to worry so much about collecting and summarizing information. What really important is original ideas and original sources.
This is where I think the biggest contribution of the current wave of AI lies.
Can we all agree that, first of all, pretty much all software will eventually be written by AI? And writing software by hand will become more like a hobby. It’s like painting pictures or something. People can still do it for fun, but it’s not going to be a professional service anymore.
The reason I see this coming is that the increasing sophistication of cyberattacks will put enormous pressure on us to write high-quality, reliable software.
And this might sound a bit controversial right now, especially with people talking about AI slop, how AI coding assistants don’t really work, how the code AI wrote isn’t scalable, and things like that.
But I do believe we’ll reach a point where the only way to ensure software is properly engineered, secure, and reliable is to have it written and reviewed by AI.
We’re facing something similar to what happened during the Industrial Revolution. Think about handloom weavers in the textile industry. Before mechanisation, people made fabrics by hand. Then machines came along and automated the process at a much lower cost. Hand weavers couldn’t compete, their wages came under pressure, and eventually much of that work was replaced by machines.
I think we’re going to see something very similar in software engineering. As AI becomes capable of producing better software at a fraction of the cost, the economic pressure to replace human programmers will become almost inevitable.
Software engineering in its current form will almost go extinct.
there is no replacing a founder like Jensen.
There never has been, and there can never be, a true succession for a founder like him. Nvidia ends today, and is replaced with a thing cosplaying nvidia. It will be run by custodians trying and failing to preserve the flame he ignited
NVIDIA letting Jensen go is a huge mistake, for America and for humanity. It's Apple firing Steve Jobs all over again, but much bigger, given the role of AI in defining the future of our world.
I've been keeping quiet on this out of respect for Jensen's family and team, who I've met and who are amazing humans, and because I personally hate infidelity. So my heart goes out to them in this difficult personal family moment.
But I can also say that Jensen is human, and makes mistakes like all of us do. Not that I matter at all, but I've known Jensen for a long time and have gotten the chance to spend a lot of time with him, behind the scenes, away from mics and cameras. I have seen him show kindness, humility, care to everyone around him, including strangers, including from the poorest most struggling parts of society, treating all the same with the same thoughtfulness and attention, because they are fellow humans and not because he has something to gain from them. That shows rare character, to maintain humility and humanity through all of it.
Another data point is what people who know him well have said privately to me about Jensen over the years. I've never had anyone tell me anything but how awesome he is or how much they love him. Probably over a thousand people at this point. This includes hundreds of engineers, CEOs, colleagues, friends, etc.
Also, since there was some spy talk. Jensen is as proud an American as it gets. I'm in shock frankly at all of this, including the mass hysteria around it. I love America, and I think NVIDIA letting Jensen go is terrible for America.
I stand with Jensen.
Love you all ❤️
my opinion: no one asked for it but in the world of "islands" where people get away with horrible things, as well as tech founders who had worse scandals, I cannot comprehend this psyop against Jensen
I got a 1.9B model to watch a restaurant camera and tell staff which tables need cleaning 🍽️
It runs on my laptop. No cloud, and it generates zero tokens.
Built over a weekend with @liquidai d1-2B
1. AI 的重要贡献可能是前所未有的知识压缩与整合能力,大幅降低已有想法之间组合、尝试的成本。
2. 仅把 A 和 B 拼接、写成论文发表,不应成为研究的终点;科研应回到解决问题与探索未知。
3. 当常规组合更容易被探索,人类可能被推动去追问更根本、有意义的问题。这是认知上的解放,而不仅是生产效率提升。
Own your evals, folks!
I have nothing against public benchmarks; they are still important for research and public discussions.
However, the only way to truly trust which models to use in prod is to build your own evals.
And it's not just about measuring reliability and model picking; evals are now crucial for unlocking new use cases and, eventually, RSI.
Evals will be a key part of how any business will optimize with RSI. You don't want to rent this. You want to own this. Start building that expertise in-house.
That is why, at @dair_ai, we have started an effort to help companies build these internally.
I've changed the way I read books. Even long before AI, we were being told not to read books from start to finish. I usually just go to the sections that interest me most and start from there.
But now I literally just go to AI, give it the book title, and ask about the things I care about.
For example, I'm reading Volatility Trading by Euan Sinclair. My first question is basically: "In Volatility Trading by Euan Sinclair, what method does he use to calculate volatility? Give me the formula he uses and show me which section of the book discusses it."
And I'll go from there. So now the book mainly serves as a reference. AI has actually become my starting point for reading.