@_ChrisCovington@Synzael0218@__tinygrad__@claudeai Yeah… of course not all, but for some people in that crowd it’s like the brain is thrown damn near out upon reading “open-weight model”. The *SSD* in your laptop won’t even hold the model, why are you using it as an example for “local” LLMs??
Amongst my friends, Spotify is the lowest quality consumer app we still pay for. It certainly hasnt gotten noticeably better in the last couple years (arguably worse). So, this is not the positive look Ant and Spotify are spinning here.
Bigger picture, this is the problem with a lot of AI reporting. It reports completely meaningless metrics like deploys per day or LoC. Why don’t we start reporting consumer satisfaction reports? Actually end state research results.
All the no nuance AI people always come out and think that this is anti AI. Again, I think AI is great and Claude is great. But this is bad marketing and makes both look like clowns.
Useful discovery of the day: it seems that frontier models are trained enough on my couple decades of open source work that I can just say "write a commit message in mitchellh style" without any further skills and it does pretty much the right thing. 😜
I thought this was an excellent paper! Thanks to Anthropic for asking me to write a review of it, linked below
I've long suspected that models have some kind of "working memory" to store intermediate variables during a forward pass and IMO this paper has the best evidence yet
Mind boggling to me that I can make a thing faster and there's always people that ask "but why?" What kind of mentality is that? The pursuit of excellence does not need justification. Also, I find in so many cases, we can't know the impact of an improvement until we do it.
For example, one I've talked about before: Ghostty's high IO throughput has enabled terminal program (emulator and TUI) fuzzing at a speed thats incomparably fast to prior solutions. This has resulted in upstream patches to resolve issues in popular projects like btop, tmux, and more.
Speed enabled that anecdotally example that lifted the tides of adjacent communities that don't rely on Ghostty technology at all. I didn't predict this.
Make things better because they can be better and let the results naturally play out.
@rblalock@RhysSullivan@theo Genuinely would be curious to hear people who’re still on laptops opine about this. A VPS is like $5 a month. What’s missing?
@chrisschmitz Absolut korrekt, besser lässt es sich nicht ausdrücken. Selbst die Ukraine hat in Kriegszeiten ein besser funktionierendes Bahn- und Fernkommunikationssystem als wir in Friedenszeiten, dass sollte einem eigentlich zu denken geben.
Scheinbar ja nicht...
Creator of Sqlite on pull requests: "You say, oh, it's free. No. It's not free. What you're doing is asking me ... to maintain it for you, to to document it for you, to test it for you, to maintain it for you for the next 25 years. That's not free." Yep.
Wise words from a wiser man than me. I've told people for the past decade and I have recent posts on here saying the same: the merge button is the easy part. Its the decade+ (Richard says 25 years) that follows where you've accepted the transfer of maintenance thats hard.
@_yorunoken@miaugladiator1@simplygandan you should, i know i literally cannot go back. have been using both of their main products (browser, search engine) since like 2022 and 2023 respectively, browser not exclusively ofc (helium and zen ftw) but their search engine is something i don't even consider an expense atp
@stroemseng@mitchellh@thdxr Agreed. Just take a look at what Taalas is doing (https://t.co/RmjK8XhSBZ)… and that’s only an 8b Llama 3-something, and they’re effectively just getting started.