choutos

Dreamer, adventure seeker, serious thinker...

[choutos @choutos]

@Planetadelibros A Megan Maxwell le diría gracias por enganchar a tanta gente a la romántica sin complejos. Hay autoras que recuerdan que leer también puede ser puro disfrute. ¿Cuál recomendaríais para empezar con ella?

[choutos @choutos]

@penguinlibros Qué buena mezcla. A esa lista yo le sumaría La feria de los discretos, que tiene ese pulso de ciudad viva que siempre engancha. ¿Sois más de novela, memoria o ensayo para leer una fiesta?

[choutos @choutos]

@casadellibro Lo mejor de Sant Jordi es salir con uno planeado y volver con tres. Yo habría caído con algo de Dolores Redondo o Mendoza. ¿Hubo algún título que se agotara volando?

[Yishan @yishan]

I think the Deepseek moment is not really the Sputnik moment, but more like the Google moment.

If anyone was around in ~2004, you'll know what I mean, but more on that later.

I think everyone is over-rotated on this because Deepseek came out of China. Let me try to un-rotate you.

Deepseek could have come out of some lab in the US Midwest. Like say some CS lab couldn't afford the latest nVidia chips and had to use older hardware, but they had a great algo and systems department, and they found a bunch of optimizations and trained a model for a few million dollars and lo, the model is roughly on par with o1. Look everyone, we found a new training method and we optimized a bunch of algorithms!

Everyone is like OH WOW and starts trying the same thing. Great week for AI advancement! No need for US markets to lose a trillion in market cap.

The tech world (and apparently Wall Street) is massively over-rotated on this because it came out of CHINA.

I get it. After everyone has been sensitized over the H1BLM uproar, we are conditioned to think of OMG Immigrants China as some kind of Alien Other. As though the Alien-Other Chinese Researchers are doing something special that's out of reach and now China The Empire is somehow uniquely in possession of Super Efficient AI Power and the US companies can't compete. The subtext of "A New Fearsome Power Now Under The Command of the CCP" is what's driving the current sentiment, and it's not really valid.

Like, no. These are guys basically working on the same problems we are in the US, and not only that, they wrote a paper about it and open-sourced their model! It is not actually some sort of tectonic geopolitical shift, it is just Some Nerds Over There saying "Hey we figured out some cool shit, here's how we did it, maybe you would like to check it out?"

Sputnik showed that the Soviets could do something the US couldn't ("a new fearsome power"). They didn't subsequently publish all the technical details and half the blueprints. They only showed that it could be done.

With Deepseek, if I recall correctly, a lab in Berkeley read their paper and duplicated the claimed results on a small scale within a day.

That's why I say it's like the Google moment in 2004. Google filed its S-1 in 2004, and revealed to the world that they had built the largest supercomputer cluster by using distributed algorithms to network together commodity computers at the best performance-per-dollar point on the cost curve.

This was in contrast to every other tech company, who at that time just bought what were essentially larger and larger mainframes, always at the most expensive leading edge of the cost curve. (To the young people reading this, this will sound incredible to you)

I worked at PayPal at the time, and in order to keep pace with the rising transaction volume, the company was forced to buy bigger and bigger database servers from Oracle. We were totally Oracle's bitch. At one point when we ran into scalability issues, the Oracle reps told us we were their biggest installation so they had no other reference point on how to help us overcome our scalability issues. We literally resorted to flipping random config switches and rebooting it.

(This heavily influenced me when I was a young manager later at Facebook. I deliberately torpedoed an Oracle salesman's pitch to try and get us to switch from open source MySQL databases to an Oracle contract: of course we had scalability problems, but at least when we had them, we could open up the hood and figure out how to fix it ... assuming we had good enough engineers, and we did. When it's closed-source infra, you're at the mercy of the vendor's support engineers)

Back to Google - in their S-1, they described how they were able to leapfrog the scalability limits of mainframes and had been (for years!) running a far more massive networked supercomputer comprised of thousands of commodity machines at the optimal performance-per-dollar price point - i.e. not the more expensive leading edge - all knit together by fault-tolerant distributed algorithms written in-house.

Some time later, Google published their MapReduce and BigTable papers, describing the algorithms they'd used to manage and control this massively more cost-effective and powerful supercomputer.

Deepseek is MUCH more like the Google moment, because Google essentially described what it did and told everyone else how they could do it too. In Google's case, a fair bit of time elapsed between when they revealed to the world what they were doing and when they published a papers showing everyone how to do it. Deepseek, in contrast, published their paper alongside the model release.

Now, I've also written about how I think this is also a demonstration of Deepseek's trajectory, but that's also no different from Google in ~2004 revealing what it was capable of. Competitors will still need to gear up and DO the thing, but they've moved the field forward. But it's not like Sputnik where the Soviets have developed technology unreachable to the US, it's more like Google saying, "Hey, we did this cool thing, here's how we did it."

There is no reason to think nVidia and OAI and Meta and Microsoft and Google et al are dead. Sure, Deepseek is a new and formidable upstart, but doesn't that happen every week in the world of AI? I am sure that Sam and Zuck, backed by the power of Satya, can figure something out. Everyone is going to duplicate this feat in a few months and everything just got cheaper. The only real consequence is that AI utopia/doom is now closer than ever.

====

Bonus: This is also a little similar the Ethereum PoS moment, when AI finally has a counterpoint to the environmentalists who say AI uses so much electricity. We just brought down the cost of inference by 97%!

[choutos @choutos]

@emollick "prone to distraction & confusion". It's procrastinating! Are we that close to General AI?

[choutos @choutos]

Just posted a photo @ Dornbirn https://t.co/bNF0uKEXRy

[DAKAR RALLY @dakar]

🏁 Stage 3 🏍

🏅 Joaquim Rodrigues claims the win!

#Dakar2022

[Valéry Rieß-Marchive | @valerymarchive.bsky.social @ValeryMarchive]

This sounds like #infosec Twitter trolling #antivax Twitter... 🤣

[TheIdOfAlan @TheIdOfAlan]

I'm "still afraid to use spaces in file names" years old

[choutos @choutos]

@bweston92 @openfaas I will for sure, as soon as I have some time.

[choutos @choutos]

Working on @openfaas and Vault integration on #FaaSFriday

[choutos @choutos]

@shizzmd @DannyJKnights @openfaas I will :)

[choutos @choutos]

@alexellisuk @openfaas Yes, I am already in slack as Víctor Andrade

[choutos @choutos]

It’s not about that rock https://t.co/Eoj0Vy46bz

#getzenrodeo #hardenduro #enduro #motorcycling #offroad #endurolife

[choutos @choutos]

Is the Aprilia Tuareg the long-awaited true adventure motorcycle?
https://t.co/IZ8oyRqzVT

#tuareg #aprilia #motorcycles #offroading

[choutos @choutos]

Getting ready to watch #getzenrodeo 🍿
https://t.co/Ow779gvWeM

[choutos @choutos]

Just posted a photo https://t.co/LjiJ5DCciT

[choutos @choutos]

Just posted a photo https://t.co/y1XR0Neq06

[@emgalego (AGAL's version) @emgalego]

🛰️ GALIZA ou GALICIA? 🛰️

O nome do nosso país leva décadas, e mesmo séculos, a ser debatido. Nós defendemos que o nome é GALIZA, sem dúvida, mas o tema é complexo e merece um fio. 👇