I think many of us working in tech tend to forget that the reason software engineering vs other engineering fields pays (a lot!) more, is a lot more flexible (WFH/remote), and has better perks:
Because this field changes much faster than other engineering fields. The premium is because fewer people are able/willing to pick up new technologies, methodologies so quickly.
But the field had ~10-20 years of stability, and so lots of folks forgot this is why a premium exists. And that AI is just another tech wave: software engineers who pick it up and master it will generally fare better; those not will struggle a lot more.
Getting my first real exposure to multi-agent development workflows recently and… well, nothing I say will be new, but:
1) This is clearly the future.
2) Oh we’re going to buy so much inference.
3) Barely feels like software engineering but I end the day intellectually spent.
Your greatest advantage over LLMs is your long-term memory. You can efficiently move new information into your weights. They can't. They basically have dementia and use an elaborate system of sticky notes like that movie Memento.
The way you hardwire information into your long-term memory is by doing your damn reps. If there's knowledge that you need to build on top of, then you better do your manual reps until mastery. Otherwise you'll never consolidate it into long-term memory and you'll never be able to incorporate it into your systems thinking.
Imagine if everything you know about your best friend was not hardwired into your brain, but rather dumped into some markdown document system that gets bigger and bigger as your relationship gets deeper and deeper. Even with a million token context window, that would place an extremely shallow limit on your relationship with them.
That is today's reality for anyone trying to use LLMs in any serious capacity. When you are doing something serious, you are developing a relationship with it that is as deep as a human relationship with a true best friend. You go through so much shit together, you have thousands of inside jokes, millions of things that nobody else knows, uncountably many bytes of rich context... all with this serious thing that you're doing.
The only system that can absorb and integrate all that information is your literal biological brain. The information in your biological brain is what determines the ceiling of your capabilities.
Cheterson's fence - a rule of thumb that says you should never remove a fence, rule, or tradition until you understand why it was put up in the first place.
Jensen recommends three books on NYTimes podcast:
"Well, I’ve read a lot of books. The book that made a huge impact on me was “Computer Architecture: A Quantitative Approach” by John L. Hennessy and David A. Patterson. It was the first computer architecture book that reduced the complexity, the abstract idea, of computer architecture down to engineering. And I love it when people take complicated concepts and reduce them to something that you could do something about.
No. 2, I really loved “The Innovator’s Dilemma” by Clayton Christensen. Clayton’s passed, but his book on how industries evolve over time and how to see emerging technology and how to set proper expectations about it and how to extrapolate, maybe, its future impact.
I really loved Al Ries and Jack Trout’s book “Positioning: The Battle for Your Mind.” It’s a really wonderful book about marketing strategy. More than that, actually, it’s a book about strategy and how people see the world and how people see products, and how you present products and how you see your own strategies. I thought that was a really thoughtful book, and really easy to understand."
My nutrition coach often reminds me - "सारे ऊंट एक साथ नहीं बैठते"
Expecting that you'd eat right, exercise right, sleep right, and will be stress free on most days is a recipe for slipping back into the comfort zone of not doing anything at all.
North Indians getting worked up about 'tu' vs 'aap' reminds me of Richard Feynman's experience learning Japanese (from his excellent book, Surely You're Joking, Mr Feynman)
tl;dr we don't have time for your bullshit