Chang Lan

RL @AnthropicAI

[Chang Lan @chaanglan]

@karpathy welcome welcome!

[Chang Lan @chaanglan]

@gu_xiangming @OpenAI It seems that the initial <start> token still exhibit large activation outliers, even with learnable key bias. Do you observe the same?

ref: https://t.co/VB3YZ6qGPs

[mark bissell @MarkMBissell]

@Guangxuan_Xiao Do you know why the very first <start> token still has massive activation norms?

I'd always assumed this was related to the first token being an attention sink, but maybe there's something else going on

[Ruoming Pang @ruomingpang]

In this report we describe the 2025 Apple Foundation Models ("AFM"). We also introduce the new Foundation Models framework, which gives app developers direct access to the on-device AFM model.

https://t.co/nEbtxuGrjD

[elie @eliebakouch]

Pre-training is not dead

[Ruoming Pang @ruomingpang]

At WWDC we introduce a new generation of LLMs developed to enhance the Apple Intelligence features. We also introduce the new Foundation Models framework, which gives app developers direct access to the on-device foundation language model.

https://t.co/SnjCXrIyYj

[Ruoming Pang @ruomingpang]

Proud to share our report on AXLearn (https://t.co/pI155U7Ikt), the code base for building Apple Foundation Models: https://t.co/e2JdQS9UyP.

[Chang Lan @chaanglan]

@cnPhil @Google xmsl!

[Chang Lan @chaanglan]

@cnPhil 有意思！道还是正式的行政区划吗，还是已经像x州一样变成地名的一部分了

[Chang Lan @chaanglan]

@cnPhil 挺好的，现在看起来后面那句建议应该是暗示。

[Chang Lan @chaanglan]

@cnPhil 办好单次签证了，准备走起。

[Chang Lan @chaanglan]

@cnPhil 没有都是旧闻，9月初开始不需要跟团就可以旅游签了，不过还是要 ERFS，可能10月就不用了

[Chang Lan @chaanglan]

@lidingchatroom 作者当年是游泳去香港的，后来又是建制派，很有风向标意义

[Chang Lan @chaanglan]

@taniarascia @CatChen On a positive note though, smaller blast radius when poop hits the fan.

[Chang Lan @chaanglan]

@mathena To some extent I think there was still some truth in your statement.

What people usually think of Robinhood:
Product: Commision-free trading
Customer: Retail traders

What Robinhood really is:
Product: Retail traders
Customer: HFTs

[Chang Lan @chaanglan]

@weiwei9 刚去完 Glacier 然而 Going-to-the-sun Road 没有开…

[Chang Lan @chaanglan]

@JiaZhihao @CSDatCMU @SCSatCMU @matei_zaharia Congrats! 🎉

[Chang Lan @chaanglan]

Where is AIM

[Hacker News Bot @newsycombinator]

ICQ New https://t.co/Yj8lyYns50

[Chang Lan @chaanglan]

@MarisaVeryMoe Rematerialization in compiler optimization; also called RDD lineage in Apache Spark.