Every prompt you send ends at a chip. That chip costs more than the building and the land combined.
Companies lease because owning sinks returns. Countries can't think that way. They need jurisdiction, not hardware.
Rent what depreciates.
Own what endures..
So who actually owns AI infrastructure - the companies renting it out, or the countries that can't afford not to control it?
Open-source AI models do not threaten frontier lab profitability.
The most valuable sectors of the economy - investing, product development, war, cybersecurity, even scientific discovery - are adversarial and competitive in nature.
You pay to win, or someone else will.
astra is a powerful model and we are working to make it generally available.
we do not think it is a good strategy to keep powerful models to a chosen few.
given its cyber capabilities, we need a little big longer to do do this safely. but hopefully not too long!
I also want to give a huge thanks to the incomparable @JeffDean after an incredible 27-year run at Google. He’s off to start his own public benefit corporation with @Sanjay_Ghemawat focused on accelerating discoveries across ML, science, & engineering. @Google will support as a founding investor and Cloud partner. On a personal note, it’s been a privilege to work with Jeff and Sanjay, and I wish them all the best. Thank you for everything!
We're starting to leave the territory where you'd test an LLM by e.g. "create an svg of pelican on a bicycle". As one idea to generalize it, I was interested what Opus 5 would do if I gave it the first paragraph of the Lord of the Rings, a 1M token budget (~$10) and asked for three js render of it. Opus went off for ~2 hours and wrote 5500 lines of code that (procedurally) rendered the story. It's kind of janky but fun. But it's a bit mindboggling that the LLM has to place and orchestrate various polygon assets in (x,y,z) coordinates and write code that animates it all, and that it even does anything at all.
I also like this kind of examples because no one in their right mind would ever spend the time to write something this custom but LLMs have all the stamina and patience in the world, so it's an example where we go from "no one would ever do this" to "sure, why not, it's ~free". There might be a lot more. But I'm excited about creating hyper custom worlds that you can imagine dropping players into, e.g. here to participate in the LoTR story as a spectator NPC, or one of the characters, or etc. Something like an ephemeral GTA of X on demand.
Last thought is that the domain of worlds/games exposes a weakness in LLMs: they can't easily audit their work because they aren't able to efficiently and natively perceive videos or play games within them. Here, Opus 5 had to very slowly and painstakingly take screenshots at different points, and it messed up a few times and created a bunch of jank. An example of raw capability (multimodal, gameplay) that I think is still quite lacking.
Just finished reading this article on syncing databases in microservices.
Didn't realize system design was this deep. Every topic opens the door to five more.
#SystemDesign#Microservices#DistributedSystems
Getting the feeling that companies now are not as bullish or as aggressive about AI as they were a few months ago.
Looks like the following things have compounded enough and have gone out of bounds.
- unnecessarily sloppy code
- unreliability in systems
- rising token costs
- agents breaking outside happy paths
- products not delivering enough value
Markets being this volatile and engineers not caring enough about systems is not helping either.
Companies might be realizing that AI is a great assistant and aid, and that the narrative around it replacing "everything" was an oversell and an overestimation.
Or maybe I am reading it all wrong :)
cool use case of chatgpt work i heard last night:
connect your family calendars and explain your kids' interests.
every morning for the drive to school, have it make a podcast that talks about one kid's soccer game that afternoon, one kid's upcoming birthday, some news, etc.