@demystifysci Farming out kids used to be alot easier when there were lots of kids around. Seems so much more isolating these days. Gotta find a neighbor with 5 kids. They're like momma ducks at that point and they know everything.
@aphysicist@jasminewsun@killahtcell You might want to hope the laptop class stays at their ceremonial posts. They're a real PITA when they get into industry. See Canada.
@aphysicist@sama I mean they have one. I'm not going to say it's a good one. Pretty outdated. But you also need decent programmers that understand the systems there working with and don't create a bunch of unnecessary code/break points. POS do this well for restaurants/cashiers.
π¨ MICROSOFT JUST MADE EXPENSIVE AI CLOUD BILLS OPTIONAL.
The paper dropped 48 hours ago. Almost nobody has read it.
MICROSOFT JUST TAUGHT AI HOW TO FORGET. AND IT CHANGES EVERYTHING.
Right now every AI has the same fatal flaw. The longer it thinks, the heavier it gets. The heavier it gets, the slower and more expensive it becomes. Eventually it runs out of space entirely.
This is why running powerful AI costs so much. You are basically renting a warehouse to store everything the AI has ever thought about.
Microsoft just made the warehouse irrelevant.
Their new paper is called MEMENTO. And the idea is almost embarrassingly simple.
Instead of remembering everything, the AI takes notes on itself, then deletes its own memory.
It thinks in small chunks. Summarizes the key logic from each chunk into a tiny compressed note. Then wipes the chunk completely. Only the note travels forward.
The results are not small:
β³ Context length compressed by 6x
β³ Active memory usage cut by 2.5x
β³ Zero drop in math, science, or coding accuracy
Here is what that actually means for you.
Big tech has been charging businesses and developers by the token for massive memory they do not actually need. That entire pricing model just broke.
A regular computer running a free open source model can now reason through complex multi-step problems indefinitely. No cloud fees. No enterprise contract. No API bill at the end of the month.
The solo operator running agents locally just became as capable as the company paying thousands a month for cloud infrastructure.
We spent two years trying to give AI a bigger memory.
Turns out the smarter move was teaching it what to forget.
@demystifysci New Mexico? I don't know what the music scene is like but the housing looked reasonable and there were lots of flights. Beautiful landscape.
@insidebajwa@RichardDias_CFA@PictetAM I would argue low oil prices in the past 10 years hasn't been great for the economy either. But what does a modern economy even mean anymore?