Founder & CEO @ScyMed Inc Developing medical Apps @ intersec Med Biz Tech. EIC killerapp MediCalc® & Synt®. Internist/Hospitalist @ CHI Baylor St Luke's Med Cen
New 3h31m video on YouTube:
"Deep Dive into LLMs like ChatGPT"
This is a general audience deep dive into the Large Language Model (LLM) AI technology that powers ChatGPT and related products. It is covers the full training stack of how the models are developed, along with mental models of how to think about their "psychology", and how to get the best use them in practical applications.
We cover all the major stages:
1. pretraining: data, tokenization, Transformer neural network I/O and internals, inference, GPT-2 training example, Llama 3.1 base inference examples
2. supervised finetuning: conversations data, "LLM Psychology": hallucinations, tool use, knowledge/working memory, knowledge of self, models need tokens to think, spelling, jagged intelligence
3. reinforcement learning: practice makes perfect, DeepSeek-R1, AlphaGo, RLHF.
I designed this video for the "general audience" track of my videos, which I believe are accessible to most people, even without technical background. It should give you an intuitive understanding of the full training pipeline of LLMs like ChatGPT, with many examples along the way, and maybe some ways of thinking around current capabilities, where we are, and what's coming.
(Also, I have one "Intro to LLMs" video already from ~year ago, but that is just a re-recording of a random talk, so I wanted to loop around and do a lot more comprehensive version of this topic. They can still be combined, as the talk goes a lot deeper into other topics, e.g. LLM OS and LLM Security)
Hope it's fun & useful!
https://t.co/75mXcUBI8L
@Papa_Heme I don’t agree. I think medical books, UpToDate and OpenEvidence are complements depending on your needs. Sometimes we need to learn or review the basics, the whole organized chapter on x disease, sometimes we need the answer for a specific patient condition.
@Acyn@drnic1 Agree with @SecKennedy. The decrease in morbidity and mortality seen in the past century was mainly due to improvements in urbanization, sanitation and basic medical interventions. The contribution of Antibiotics, vaccines and more advanced med treatments is much smaller.
Changes in Time Expenditure and Visit Quantity With Artificial Intelligence–Powered Scribes https://t.co/RdYB8ipz1C
3.0% relative decreases in total EHR time and 10.0% relative decreases in documentation time. Meaning, AI Scribes have a long way to go…
No shit. We have little control over longevity. We have maximized lifespan. Genetics and environmental factors play in different proportions in different individuals. We have, though, some control on healthspan (how healthy we live). https://t.co/4SSRfsv568
@ValerieAnne1970 It was a fiasco! Yes, the most stupid request of the Century! It was NY governor Cuomo who requested 20 or 30 thousand Ventilators. Haha. It’s beyond comprehension.
@SecKennedy Congratulations and thank you Mr @SecKennedy , Mr @SecRubio and Mr @POTUS .
Good riddance! The WHO is a bureaucratic, incompetent, corrupt and politicized organization.
Next step is to make them accountable.
@PeterDiamandis More hype & pipe dreams…
NONE of it is happening!
For AGI you need to change course, follow @ylecun advice.
Singularity bet 2029: Mitch Kapor wins easily.
For Biology and Longevity, well, take a deep breath and think, today, we can’t even cure a common cold!
FDA is now open to Bayesian statistical approaches. A leap forward!
Bayesian statistics can help:
✅ Clinical trial design
✅ Finding the optimal dose
✅ Extrapolation to children
✅ Leveraging phase 2 results in phase 3
These Guidelines return us to the basics. American households must prioritize whole, nutrient-dense foods—protein, dairy, vegetables, fruits, healthy fats, and whole grains—and dramatically reduce highly processed foods. This is how we Make America Healthy Again.
https://t.co/wZZOfT5P1d
Well done Mr. President! @realDonaldTrump
The best « wise men present » for the American continent.
(El mejor regalito de Reyes para toda América)
;-) 🤘
"The United States of America has successfully carried out a large scale strike against Venezuela and its leader, President Nicolas Maduro, who has been, along with his wife, captured and flown out of the Country. This operation was done in conjunction with U.S. Law Enforcement. Details to follow. There will be a News Conference today at 11 A.M., at Mar-a-Lago. Thank you for your attention to this matter! President DONALD J. TRUMP"