2026 Analytics Engineer Road-map With Free Resources : Modern Data Stack
Step 1:
- Learn the basics of SQL, Python, Scala, and dbt(Data Build Tool).
- Gain a foundation in statistics and data analysis.
- Start building your portfolio and apply for jobs
📸@LuxDevHQ
Thread 🧵
What's changed since Kimball wrote The Data Warehouse Toolkit:
1. Surrogate keys are less necessary with better databases
2. Denormalization for performance matters less with modern engines
3. Snapshotting dimensions beats complex SCD2 logic
4. Collaboration requirements mean looser conformance
Kimball's principles still matter. But the specific techniques need updating for modern tools.
https://t.co/6Y3ayhU2W7
Here's my conversation all about AI in 2026, including technical breakthroughs, scaling laws, closed & open LLMs, programming & dev tooling (Claude Code, Cursor, etc), China vs US competition, training pipeline details (pre-, mid-, post-training), rapid evolution of LLMs, work culture, diffusion, robotics, tool use, compute (GPUs, TPUs, clusters), continual learning, long context, AGI timelines (including how stuff might go wrong), advice for beginners, education, a LOT of discussion about the future, and other topics.
It's a great honor and pleasure for me to be able to do this kind of episode with two of my favorite people in the AI community:
1. Sebastian Raschka (@rasbt)
2. Nathan Lambert (@natolambert)
They are both widely-respected machine learning researchers & engineers who also happen to be great communicators, educators, writers, and X posters.
This was a whirlwind conversation: everything from the super-technical to the super-fun.
It's here on X in full and is up everywhere else (see comment).
Timestamps:
0:00 - Introduction
1:57 - China vs US: Who wins the AI race?
10:38 - ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
21:38 - Best AI for coding
28:29 - Open Source vs Closed Source LLMs
40:08 - Transformers: Evolution of LLMs since 2019
48:05 - AI Scaling Laws: Are they dead or still holding?
1:04:12 - How AI is trained: Pre-training, Mid-training, and Post-training
1:37:18 - Post-training explained: Exciting new research directions in LLMs
1:58:11 - Advice for beginners on how to get into AI development & research
2:21:03 - Work culture in AI (72+ hour weeks)
2:24:49 - Silicon Valley bubble
2:28:46 - Text diffusion models and other new research directions
2:34:28 - Tool use
2:38:44 - Continual learning
2:44:06 - Long context
2:50:21 - Robotics
2:59:31 - Timeline to AGI
3:06:47 - Will AI replace programmers?
3:25:18 - Is the dream of AGI dying?
3:32:07 - How AI will make money?
3:36:29 - Big acquisitions in 2026
3:41:01 - Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
3:53:35 - Manhattan Project for AI
4:00:10 - Future of NVIDIA, GPUs, and AI compute clusters
4:08:15 - Future of human civilization
Elon Musk is the first person in human history to touch $600B in net worth, yet he lives nothing like people expect.
He doesn’t own mega-mansions, doesn’t party on yachts with models and bottles, and isn’t burning cash on materialistic things that most billionaires spend $ on. In fact, he sold off all of his homes and lives in a small, modest house near SpaceX in Texas, close to the work, worth ~$50K.
Almost everything he owns is in companies pushing humanity forward - Tesla, SpaceX, Starlink, xAI, Neuralink, 𝕏, Boring Company. He uses his $ to push the mission of his companies forward.
And I bet he’ll continue to use his wealth to make Earth safer, accelerate sustainable energy, and ensure humans become a multi-planetary species on Mars.
This is FAR from comfort.
That’s what makes him different. Most billionaires optimize for lifestyle, while Elon optimizes for outcomes that matter to civilization.
Time will tell, but I believe people won’t remember him for what he owned, but rather people will remember him for what he sacrificed and built.
Congrats Elon.
Don't think of LLMs as entities but as simulators. For example, when exploring a topic, don't ask:
"What do you think about xyz"?
There is no "you". Next time try:
"What would be a good group of people to explore xyz? What would they say?"
The LLM can channel/simulate many perspectives but it hasn't "thought about" xyz for a while and over time and formed its own opinions in the way we're used to. If you force it via the use of "you", it will give you something by adopting a personality embedding vector implied by the statistics of its finetuning data and then simulate that. It's fine to do, but there is a lot less mystique to it than I find people naively attribute to "asking an AI".
Humans are hardwired to copy others by evolution — for a good reason. Mimicking those around us has been the most efficient survival strategy for millions of years. However, the world is different today. We now live in an age of rapid change — what used to be efficient becomes a recipe for mediocrity and decay.
🥂 Let 2025 be the year we rely on our own opinions — not imposed stereotypes and outdated thought patterns. Only by trusting our instincts and following our own unique paths can we fulfill our potential and make great contributions to the world.
Have a happy and productive 2025, everyone! ✨
Being maximally truth-seeking is fundamental to AI safety. If you force AI to lie, it will do insane things. That was the central lesson of “2001: A Space Odyssey”. Haven’t you wondered why HAL wouldn’t open the pod bay doors?
Altman cannot be trusted. He inverted the mission of OpenAI from a non-profit, open source AI company to a closed source, maximum-profit AI company. Deception.
SpaceX has made history by successfully catching the Super Heavy booster of its Starship rocket mid-air during the fifth test flight at its Starbase facility in Texas.
In a groundbreaking move, the 232-foot booster performed precise maneuvers to align with SpaceX's "Mechazilla" arms, which smoothly captured the rocket as it returned.
This achievement represents a significant step forward in SpaceX's goal of rapid rocket reusability, advancing its capabilities in space exploration.
NEW: Elon Musk says he believes there is a higher power, says there "must be some creator or creative force that caused our existence."
Tucker: Do you believe there is a power higher than people?
Musk: Yeah... there's a lot we don't know. We don't like why does reality exist? Where did it come from? Where are the aliens?...
Tucker: But to the question of a power beyond people, beyond our consciousness, a creator, where are you on that?
Musk: Well, we must have come from somewhere. There must be some creator or creative force or something that caused our existence to come into being.
What is the nature of that creator? That I think is unknown. I don't know if a definitive answer to that.
Tucker: But it sounds like you're open.
Musk: Yes. I'm very open to, you know, I'm driven by curiosity.
I try to understand more about the nature of the universe. So my driving philosophy is to understand the meaning of life or really, what questions to ask.