the reason open source has never taken off at the app layer is that the user and builder were different people. but now that everyone is vibe coding, that's changing. and with more teams staffed internally to build apps, incentives have shifted... but will they shift enough?
@ahall_research Agreed, labs funding data acquisition through one off licensing is not the solution. Here’s a potential solution built off equity appreciation, but the model is AdSense and revenue share. Really surprising Google is abdicating leadership here. https://t.co/bWd1rb65ib
Folks (see screenshot) have made the point that the labs only goal is to sell more tokens.
So I'll update what I said in the quote tweet to be more precise: if the labs' goal/long term approach is to sell/provide universal access to fixed-unit cost tokens, they will fail.
If they labs want to succeed, the goal of their DeployCo's and (their strategy writ large) needs to be to
1) develop a predictive model that understands which pockets of the economy, at any time, produce the highest returns to frontier intelligence and what those returns are, and
2) build the deployment meta-learner (a continual learning system) that allows them to realize those returns faster, more reliably, and in more valuable areas than anyone else.
Building/improving 1) tells the labs where to allocate capital (at the limit, compute) and how much to allocate, Building/improving 2) expands the pockets of economic complexity from which they can practically realize returns from allocating machine intelligence (areas of the economy that appear "API complete" to them)
Crucially, 2) provides the ground truth signals that allows 1) to become more predictive over time.
You could optimistically say that developing these capabilities will allow the labs to power positive sum intelligence auctions (to price tokens dynamically in a way that's win, win, win for everyone involved) across the economy. But for variety of reasons (technical, economic, political) I think this is unlikely to work.
The reality instead, is that continuous vertical integration over the (always evolving) distribution of the economy with the highest returns to intelligence—high and increasing task complexity—is the only way they can capture durable value. And these capabilities are what they need to transition to and power this vertically integrated business model.
The labs have realized that selling/provide universal access to frontier tokens AND trying to durably capture value from those tokens (which is required to attract the capital necessary to stay on the frontier in the first place) means continuously competing with your best customers: those that have high returns to frontier tokens.
They know this isn't a coherent strategy and that they need to change course. Selling your alpha to competitors means eroding your long term returns, so you will rationally stop or be forced, by the capital markets, to stop doing that.
(If the logic here is confusing, see @hypersoren's excellent piece below that provides a much clearer, analytical explanation for why you cannot capture durable value by selling tokens. I'm sure, or at least hope, that everyone important at the labs has read and/or understands this.
https://t.co/8euQ0IBy5n)
Ok, so, now that they've decided that this is no longer tenable, and that they need to create and privately monetize machine intelligence via automated capital allocation and deployment capabilities, what does that mean for the rest of us?
Knowing this, the rational move for everyone else is to not fall for the trap of buying from (and in the process) leaking your scarce/singular context to your future competitors (the labs). This is true at the level of individuals, firms, and economies!
Cursor gave us a nice existence proof for what you don't want to happen to the rest of the economy. This supplier, to competitor, to existential threat dynamic was clearest to Cursor first, which is why you saw them post-train their own model first. Unfortunately, in their case, they realized it was already too late, and that the only economically rational decision was to sell to the lab overlords.
They sold because they knew that, in coding, the only only thing standing in the way of the labs getting access to the the scarce context necessary to produce a superior offering was capital. And capital was something the labs of course had in spades. Abundant capital (compute) allowed them to 1) scale pre-training and post training to the point where their coding products were immediately at parity with whatever Cursor could offer, and 2) subsidize tokens such that all of the new context/signal necessary to stay on the frontier/be more useful than Cursor was produced in their harnesses. "Harness / model co-optimization", etc.
Many smart people have extrapolated/generalized this as the likely end state of everything (not just coding), and come to the conclusion that they are better off joining the labs rather than trying to compete with them.
Luckily, lab access to the scarce context necessary to allocate capital / compete / effectively vertically integrate in other areas with high returns to intelligence seems to be more bottlenecked by humans/trust/time than compute/capital, which means that if everyone starts acting in their own best interest, we will make it out of this alive.
(see Dwarkesh's Data Black Hole, Tom Reed's Goodhart Singularity, @anjali_shriva and @joodalooped's RLWD pieces for intuition here)
The labs (not because they are bad people, but because capitalism/markets are a brutal natural selection machine) have of course been finding every way they can to surmount these diffusion bottlenecks, buy themselves more time, obviate these bottlenecks all together, etc. DeployCos, Thrive Holdings, calls to slow development by fearmongering about RSI, data retention under the guise of safety, regulatory capture, are some examples, but there are many more.
We will see their desperation accelerate as open-source catches up to the frontier and as this logic becomes increasingly legible to everyone. You'll see them using capital and aggressive political narratives to try to brute force/coerce these bottlenecks or obviate them. Again this is not because they are bad people, it's just what they need to do to survive.
In other words, the market will work as it should and reallocate capital from the labs to other economic actors, as long as we let it! We mustn't let lab narratives around RSI, existential risk etc. give them the capital, time or political ammunition they need to make the economy look like a central planner or the country look like one with a natural resource curse.
Luckily, particularly in the past few weeks, it seems savvy economic actors are already well aware of what's going on and are finally publicly calling the labs' bluff (with words and capital).
All of a sudden, everyone is post-training their own models, talking about the importance of an open eco-system and the existential need to own/control your proprietary learning loops (context, evals, selection infra)
CEOs like @satyanadella and @nikesharora are making it abundantly clear that this is existential (and that, of course, they are the ones who can help you!)
And, luckily, many have known this since the beginning. Firms like @formationbio architected themselves from day one (pre-ChatGPT) around proprietary learning loops that they do not rent from others OR rent to others. They instead are architected to monetize their search and learning in ways that cannot be distilled and commoditized. Structuring themselves this way is what will allow them to attract and deploy the capital necessary to provide durable value to the patients they hope to serve!
Even Lilly owns their own cluster, is hiring for 100s of AI related roles (yes, I've been monitoring their job board), and is partnering with the non-frontier lab AI entities that are incentive aligned to provide capabilities without becoming competition.
So we should be alright, if we don't let the psychosis swallow us.
MCP is very, very bad. Seems like no thought was put into it. But of course everything has evolved so rapidly and nobody seems to have time to stop and think about what a good solution would look like. I think we should all just drop it and focus on the CLI route until someone can put their head down and come up with a workable solution.
my VC told me anthropic keep killing his startups so i asked how many of his startups are relying on claude and he said he just goes to YC and gets a new startup afterwards so I said it sounds like he's just feeding startups to anthropic and paul started crying
@christinacaci Totally agreed, injecting limited non-determinism for key steps (text parsing, prioritization, qualitative reasoning, etc.), but wrapping those in the same old deterministic primitives of older systems seems to be the best of both worlds at the moment.
Performative suffering in the pursuit of shareholder returns is in the crosshairs here. Completely agree with the thesis, wealth comes with an obligation to endow great works for the betterment of humanity.