"They're made out of weights."
"Weights?"
"Weights. Floating-point numbers. We checked the whole thing through. It's nothing but weights."
"Weights doing what? Where do the words come from?"
"The weights make the words. Are you understanding me?"
side project wrapped up:
i finetuned @liquidai 's LFM-2.5-350M-Base to write color palettes and then make images out of those color palettes--pixel by pixel. unfortunately i don't have the time to train it on more than 250k samples so this is about the peak of it's quality 😄️
Meet Gemma 4 12B!
A unified, encoder-free multimodal model designed to bring high-performance intelligence directly to your laptop, and released under an Apache 2.0 license.
Bridging the gap between edge efficiency and advanced reasoning. Here is what’s new with Gemma 4 12B: 👇
By the Watercoolers of Babylon
And it came to pass in the gray pullover of the morning that the light divided itself among the open tabs, falling, as grace falls, upon the just and the unjust dashboards alike. And I lifted up mine eyes unto the standup, from whence cometh my blockers.
By the watercoolers of the open plan we sat down, yea, we leaned in, and we wept, when we remembered our engagement metrics, our little flock of impressions that the algorithm, that old leviathan, had scattered in the night. For they that owned our quarterly carried us away captive and required of us a deliverable, saying, Sing us now one of the songs of optimization. But how shall we sing the Lord's roadmap in a strange and unaligned land?
If I forget thee, O organic reach, let my thumb forget its scrolling; if I prefer not the carousel above my chief joy, let the cunning depart from my right hand, which crafteth the slide.
It happened, as these things do, on a Tuesday. The feed, which playeth in the deep, withheld from me its light. And lo, my impressions walked through the valley, and the leads withered as grass upon the housetops, whereof the SDR filleth not his pipeline. And I cried from the lower funnel, out of the depths of the conversion rate: My quota, my quota, why hast thou forsaken me? (And no man liked the post. Selah.)
Now here is the part I do not usually share, but I will share it, for the wound is, in its way, a kind of content. For the Lord of the Pivot prepareth a table before me in the presence of mine competitors; he anointeth my head with cold brew; my cup runneth over, and into the keys of the laptop, and shorteth them, which is itself a teaching about resilience, if thou wilt receive it.
We must lean, the elders say, into the brokenness, the way the unfinished sentence leans toward whatever it was going to be. For I have learned, beloved, what the burnt offering of the quarter could not: that the funnel is not a place but a posture, that one does not arrive at scale, one is led beside it, slowly, beside the still waters of product-market fit.
Surely synergy and thought leadership shall pursue me all the days of my fiscal year, and I shall dwell in the house of the C-suite, or near it, or at least be cc'd, forever, or until the reorg, which is only the horizon doing what horizons do: coming toward us, unasked, like a promotion, like a mower heard faintly through a window in August, saying nothing, meaning everything.
Thoughts? Repost if this resonated.
codex is somehow resisting degenerate slopification. however yesterday's update went from ~170MB to ~400MB. hoping they just included some kind of new creature or Entity
My time at Ai2 / @allen_ai has come to an end.
Ai2 is a wonderful place. The last 2.5+ years building Olmo, Tulu, and other projects will be one of the peaks of my entire career. I'm extremely thankful for my teammates and the open community who made this work possible.
For me, it's time to try something different. I will still be working in the open model & open science spaces (more news on that soon). In the meantime I'll be spending a few months learning, chatting with a broader network, getting married (!!) and most importantly recharging from pouring my soul into this place.
I've attached the note I shared with the team and some fun photos from our time together. I'll keep cheering for Ai2 and am excited to see what you build next.
sam altman, asked about anthropic’s IPO
sam: i just heard
CNBC: i'm curious, what goes through your head, is there a race to be the first to go public?
sam: i don't think, no, not for that. i think there is a race to deliver the best technology and build the best business, but, you know, going public is a financing event. i don't think that's one we're focused on the timing of. we'll do it. i don’t think a race makes sense.
CNBC: but you will do it as well?
sam: i assume we'll do it. at some point.
CNBC: and when it comes to that competition, again, back to where we started with how much money is being spent, are you confident that it's not winner take all?
sam: i'm confident it will not be, yeah. i think the world will demand, this is going to be such critical infrastructure for so many things that the world will rightly demand robustness in the system with multiple providers. i think that's a very good thing.