There seems to be widespread understanding that the inference market is huge & growing but more limited understanding of how technically challenging it is to support low-latency, highly reliable inference at scale. Go rebuild k8s in a weekend; hope your coding agent had its coffee.
Lots of VCs kindof sound like this: "Your basketball team doesn't have a moat, any healthy human can throw the ball into the basket thingy. "
People who have not run companies before don't understand how much the team matters more than some imagined structural moat.
This is serious.
I just saw with my very own eyes that even non-technical people can exploit CVEs like PHP2Shell using certain AI models and I am actually frightened.
Once you figure it out, it is downright trivial to do. The digital infrastructure of the world is at risk.
Inception just dropped Mercury 3, a model 4-8x faster than Luna / Haiku for the same price and benchmark performance.
In real world use, OpenRouter shows that it’s effectively 2-4x faster and 2-4x cheaper effective price.
The time for diffusion language models is finally here!
Notion AI lead @sarahmsachs argues that a lot of what runs on GPUs today should actually run on CPUs:
"We have a strong perspective at Notion that a lot of things should be served on CPU that are served on GPU. There’s a lot of benefit and determinism in executed code."
"Agents don’t need LLMs to reinvent that process every time, and that’s super token exhaustive, it’s super slow, and there’s no observability or determinism in it."
"Giving the agent a local file system to store local thoughts, to write short Python scripts, that’s really important when there’s so much information. That has been probably one of the most important tools outside of edit and search that our internal agents rely on."
@NotionHQ
Oxide co-founder @bcantrill believes every VC wants to be contrarian, but most get cold feet when an actual contrarian bet is staring them in the face.
"Everybody loves contrarian. But no one actually wants a zero."
@tanayj@a16z Wait SiriusXM still exists?! I thought that just came with a new car…then it expired when you realized no one listens to Howard Stern anymore