GaLore
Memory-Efficient LLM Training by Gradient Low-Rank Projection
Training Large Language Models (LLMs) presents significant memory challenges, predominantly due to the growing size of weights and optimizer states. Common memory-reduction approaches, such as low-rank
哥飞发现一个找真实AI需求的好地方,全球最大的AI导航站,月访问量500万的 There's An AI For That 上线了一个AI需求频道,人人都能发帖说出自己的需求,其他人可以回复符合这个需求的AI产品。
现在上面有340条需求,大家可以去看一看,说不定能够找到自己能做的需求。
网址直达: https://t.co/cG6HWj3AQR
OpenAI Sora 团队成员的 X 账号清单:
研发负责人:@billpeeb@_tim_brooks
系统负责人:@cmikeh2
贡献者:
Clarence Wing Yin Ng
David Schnurr @_dschnurr
Eric Luhman
Joe Taylor @JMT3
Li Jing @jingli9111
Natalie Summers
Ricky Wang @ryw999
ryan o’rourke
Troy Luhman @LuhmanTroy
Will DePue @willdepue
Yufei Guo
大家可以持续关注 OpenAI 员工列表:https://t.co/JFe1nLBX3g