@lukeburgis Mass ubiquitous connectivity compels me to look over my shoulder at what other's are saying about a [book|movie|show|song|..]. Disconnected islands of independent creation / analysis no longer exist. (although I was too young in the 70's to recognize any of this)
Decent chance that, not even taking into account GenAI, this will be viewed as a decade of incredible progress against the problems that were, ironically, caused by modernity: metabolic syndrome, auto deaths, carbon emissions...
In design, this will be remembered as the colorless era: cars, buildings, movies, the chroma is being sucked out of everything. But of course the pendulum will eventually swing back, and then colorlessness will seem dated.
Eli Lilly has done it.
They've gone and made what seems to be a powerful, permanent gene therapy for LDL cholesterol.
That means they'll be able to effectively prevent most heart disease with a single infusion!
Let us learn to be rich in a different way: more attentive to relationships, more intent on valuing the common good, more attached to the local area, more grateful in welcoming and integrating those who come to live with us.
Teaching in the age of LLMs:
I failed 4 students, for the first time ever. I also gave more A+'s than ever before.
In previous years, students realized after the first or second HW that they weren't in Kansas anymore and needed to work hard.
No more. Just solve it with LLMs.
But then the midterm arrives, and they can answer 0 of 40 questions. Do they reform their ways? Nah, they just decide to "give up" on class, assuming they'll get a B, or a C, or whatever, because they submitted HW and got decent grades on those. And never before have they encountered a professor who will dare fail them.
The flip side is that the most "agentic" students now have the world's best tutor at their disposal. They deeply understand the material and aced my (intentionally very difficult) exams. As if we live in "The Diamond Age".
Inequality galore.
From my vantage point, "the permanent underclass" appears to be about agency, not assets.
This is a study of a "gothic deco" church I walk past ~daily that I love for how its towers grow like crystals. I'll be immersing myself in architectural observational drawing like this as part of my New Aesthetics grant project.
I had a great conversation with @DouthatNYT on his podcast, "Interesting Times", about the future of driving automation: what we might gain, and what we might lose
A few things that came up: 🧵
Did a very different format with @reinerpope – a blackboard lecture where he walks through how frontier LLMs are trained and served.
It's shocking how much you can deduce about what the labs are doing from a handful of equations, public API prices, and some chalk.
It’s a bit technical, but I encourage you to hang in there - it’s really worth it.
There are less than a handful of people who understand the full stack of AI, from chip design to model architecture, as well as Reiner. It was a real delight to learn from him.
Recommend watching this one on YouTube so you can see the chalkboard.
0:00:00 – How batch size affects token cost and speed
0:31:59 – How MoE models are laid out across GPU racks
0:47:02 – How pipeline parallelism spreads model layers across racks
1:03:27 – Why Ilya said, “As we now know, pipelining is not wise.”
1:18:49 – Because of RL, models may be 100x over-trained beyond Chinchilla-optimal
1:32:52 – Deducing long context memory costs from API pricing
2:03:52 – Convergent evolution between neural nets and cryptography
We're excited to introduce Ocelot, an open-source and Brave-trained AI model built specifically to summarize web content.
Ocelot is now available in Leo, our browser's AI assistant, and as an open-source model for the developer community.
Imagine every pixel on your screen, streamed live directly from a model. No HTML, no layout engine, no code. Just exactly what you want to see.
@eddiejiao_obj, @drewocarr and I built a prototype to see how this could actually work, and set out to make it real. We're calling it Flipbook. (1/5)