Stephane Moracchini

Product Builder | Software Leader | Lifelong Learner | Corsican in London 🌍 - I love 📐 design, 🚀 startups, 🍷 food & wine, 🌟 self-improvement VP @Lyst

[AYi @AYi_AInotes]

全网都在吹的LeCun新论文，90%的解读都是错的。

他们说生成式AI是死路，说过去三年花的几百亿全白费了，说15M参数的小模型就能吊打万亿大模型。

这些全是营销号的夸张，
我觉得这篇论文的真正分量比他们吹的还要重。

Yann LeCun团队这次解决了JEPA困扰了好几年的表征坍缩问题。

以前的世界模型，学着学着就会把狗车人都压成一模一样的向量，什么都学不到。

这次他们只加了一个极其优雅的数学正则化器SIGReg，
没有复杂的trick 和六个超参数要调，训练稳得离谱。

单张GPU几个小时就能训完，在机器人控制任务上，规划速度比巨型世界模型快48倍，成功率还更高。

最厉害的是它的隐空间里天然就编码了物理规律。
不用教，它自己就知道物体不能瞬移，知道速度和位置的关系。
能瞬间检测出物理上不可能发生的事。

这不是啥范式革命，也不会让GPT和Claude明天就死掉。
语言和创意生成，依然是自回归大模型的天下。

但它打开了一扇全新的门，
原来懂物理不需要万亿参数，不需要云端超算。
原来世界模型可以小到跑在机器人的本地芯片上。

过去三年，整个行业都在一条路上狂奔，堆参数，堆算力，堆数据。
所有人都以为只要足够大，就能懂世界。

现在我们终于知道，还有另一条路，一条更高效，更优雅，更接近真实世界运行方式的路。

生成式AI不会死，
但未来的智能体不会是只会聊天的大模型，
它会是一个懂物理的小世界模型，加一个大语言接口，

这才是这篇论文真正的意义所在吧 hhh

[Yann LeCun @ylecun]

Dario is wrong.
He knows absolutely nothing about the effects of technological revolutions on the labor market.
Don't listen to him, Sam, Yoshua, Geoff, or me on this topic.
Listen to economists who have spent their career studying this, like @Ph_Aghion , @erikbryn , @DAcemogluMIT , @amcafee , @davidautor

[Paul Graham @paulg]

I meet a lot of founders who are worried by the rapid rate of technological change. They shouldn't be. It may feel uncomfortable, but techno-turbulence is net good for startups. They're much more likely to adapt successfully to some big change than incumbents are.

[Mark Suster @msuster]

This resonates.

As Gen X we had this all backward.

This era is more enlightened.

Also, I should have just listened to my wife 20 years earlier

[Paul Graham @paulg]

My take on whether Tylenol causes autism is why is the government refusing to release the Epstein files? Who are they protecting?

[Prof Francois Balloux @BallouxFrancois]

H5N1 bird flu has a mortality rate close to 100% in chicken. When the virus is detected in a chicken farm, all animals are being euthanised to reduce their suffering and limit the risk of spread to other animals and humans.
1/

[Stephane Moracchini @sMorac]

Had a blast for lunch with these two star wines #pataille #burdungy #aligote #pinotnoir

[Stephane Moracchini @sMorac]

@AnthropicAI hey! My company Lyst is trying to renew a paid subscription to https://t.co/kwfQIx2rrY , the payment fails and we are struggling to get support. How can we handle this please ?

[Peter Yang @petergyang]

Nvidia ($960B) is now worth more than:

- Facebook ($665B)
- Tesla ($618B)
- Netflix ($168B)

This is a company that started 30 years ago at Denny's and was for decades only a video game chip maker.

Here's why Nvidia is surging:

[Michael Seibel @mwseibel]

Scaling pre-product market fit is the number 1 killer of startups - in other words - the fastest path for your investment to be worth nothing.

[d@x @groktheworm]

I'm speechless.

Not peer-reviewed yet but a submitted paper.

The 'presented images' were shown to a group of humans. The 'reconstructed images' were the result of an fMRI output to Stable Diffusion.

In other words, #stablediffusion literally read people's minds.

Source 👇

[Dr Rachel Clarke @doctor_oxford]

He blames the NHS, GPs, care workers, Kate Bingham, his scientific advisers, his cabinet colleagues. Yet - guess what - he gets every single big call right.

I read Matt Hancock’s Pandemic Diaries so you didn’t have to. And they’re absolutely nauseating.
https://t.co/I0MPxdxi0S

[Stephane Moracchini @sMorac]

@JeremyMJordan @brauhala is there a way to buy a video recording of Carry On in the UK? I love it at the London concert 🤩

[Ian Kettlewell @kettlecorn]

This website was built by ChatGPT.

I spent the last few hours making a detailed initial message that transforms ChatGPT into a friendly helper.

It asks you a series of questions and then hands you the HTML.

I'm blown away. Try the prompt for yourself: https://t.co/2k6PSAxJyf

[Stephane Moracchini @sMorac]

@NotPatrick “However both terms are accepted and used interchangeably across the country” it does sound like an AI trying to start a war…

[Henrique Olifiers @Olifiers]

The current definition of metaverse is an MMO where instead of being a hero, you're a consumer.

[Jana G. Pruden @jana_pruden]

Offering kids the choice of candy or a potato this year because I saw a meme about it. And honestly it’s super funny to see their reactions.

[Stephane Moracchini @sMorac]

@brauhala Shouldn’t you bring just one outfit and stock up on more Disney merch on the ship?