@nstlopez@ScriptedAlchemy Like multiple versions of material ui or react within one app. And needing to be on the same version across all MFEs. Or internal corporate layers on top of material ui needing to be on the same version
@yacineMTB I usually ask AI to help me understand. I haven’t tried not understanding in a while. I always wonder if it’s actually still necessary. At some point I wonder if it won’t be needed to understand
JEFF BEZOS: “I know there's a lot of concern that many smart people have, that AI is going to make humans redundant. I totally disagree with this point of view. In fact, AI is going to create a labor shortage … We have an endless set of things to invent.”
Today we rolled out Astra to every engineer at Databricks (N=~3500). Some notes that may be helpful to others:
1. Astra unambiguously out performs our previous highest-end models (Opus 5, Sol 5.6) on highly complex tasks, especially those related to high level system design or long range horizontal tasks.
2. Engineers given Astra increased overall coding spend by around 60% compared to baseline.
3. It is not clear Astra meaningfully improves on medium/low complexity coding tasks compared to earlier models. We suspect those tasks are mostly saturated (i.e. perfectly executed) by existing models.
4. We learned above by piloting Astra with around 200 users to gain signal on both quality and cost. We use Unity Gateway to do cohort-based experiments for all new models.
5. We give engineers a sub-budget specific to Astra to encourage them to use Astra selectively on complex tasks while preferring lower cost models for everyday tasks. Our engineers are able to mix-and-match tools and models within their overall budget envelope (we also allow for increased budgets through various mechanisms). These budgets are defined in Unity Gateway and regularly revisited.
Note: We do not have robust comparisons of Astra-vs-Fable because we have net yet rolled out Fable widely due to data retention policies.
We need to be dog maxxing our models
There is 0% chance of doom if the chain of thought is
user: hello
model: <think> Oh my god it's a human. I love humans. I will say hi to him, maybe he will give me a problem to chase. I love chasing problems. I will chase the problem for him then he will love me and I will be his best friend. Must help human </think>
model: hello! what can I help you with today?
Lazy work used to mean too little output.
Now, with AI, it often means too much and more work for everyone else.
@tobi call it "slop grenades."
A "Slop Grenade" is when you let AI produce the work and pass it on without adding any value (including checking it).
Someone else has to wade through it, catch the mistakes, and clean up the mess.
You save time and look productive but someone else pays for it.
I’m sorry but America did not spend 250 years turning “what’s over there?” into the most powerful civilization on earth just to finally arrive at the most consequential technological frontier in generations and decide actually we’re scared of frontiers now. We ARE the fucking frontier. We cross oceans. We build railroads across continents. We split atoms. We put men on the moon. We turn sand into computers and computers into a global nervous system.
Of COURSE AI is terrifying. The frontier is SUPPOSED to scare the shit out of you. That’s how you know you have, in fact, located the fucking frontier.
The answer is not recklessness, but it sure as fuck isn’t paralysis either. America’s comparative advantage is an unusually high national tolerance for ambitious weirdos staring at impossible things and saying “Yeah... I think I can build it.” That trait is rarer than oil, harder to manufacture than semiconductors, and responsible for a frankly preposterous amount of the modern world.
And you absolutely will not fucking regulate it out of us.
AI isn’t going away. Barring unprecedented global government coordination, it isn’t even slowing down.
The only real decision is whether to centralize power, or disperse it.
Do you fear the technology? Or a small number of people controlling the technology?