wmlu

Founder of an AI engineering startup; a technologist in cybernetics, ML foundations/interpretation, RL, scalable AI, LLMOps, Robust AI, and AI engineering

[wmlu @wmlu]

AI Compute Scaling Laws as Envisioned by Nvidia

Nvidia recently illustrated two distinct AI scaling law curves: the first one featured in their blog post (2025-02) and a second curve by Jensen at his 2025 CES keynote (2025-01). The latter might align more with the realities...

[wmlu @wmlu]

Check out my latest article: Opportunities in Agents after GPT-4 Turbo https://t.co/5mAsKMjoOL via @LinkedIn

[wmlu @wmlu]

@Francis_YAO_ 2) Another possibility is a disruptive development in the direction suggested by LeCun in his tweets: "There *will* be better systems that are factual, non toxic, and controllable. They just won't be auto-regressive LLMs." (2/2)

[wmlu @wmlu]

@Francis_YAO_ Data might not be an issue:
1) LLMs could be made self-improving by, e.g., generating training data, and the trick of self-play as done with AlphaZero etc. (1/2)

[wmlu @wmlu]

@Francis_YAO_ 2) Another possibility is a disruptive development in the direction suggested by LeCun in his tweets: "There *will* be better systems that are factual, non toxic, and controllable. They just won't be auto-regressive LLMs." (2/2)

[wmlu @wmlu]

It's only fitting that we reflect on Rich Sutton's piece "The Bitter Lesson" at this moment：https://t.co/sFAo8qwHrh

[Sergey Levine @svlevine]

I was invited to give a talk about how AI can lead to emergent solutions. Not something I talk about much, so it was a challenge: a reflection on "The Bitter Lesson", ML with Internet-scale data, and RL. I figured I would record and share w/ everyone: https://t.co/sxpfdcwvgS

[wmlu @wmlu]

@svlevine Great reflection! It's quite serendipitous that I also wrote a cursory reflection recently on "The Bitter Lesson." https://t.co/sFAo8qwHrh

[wmlu @wmlu]

@percyliang Scale matters as I stated in the article: The Scale Advantage of ChatGPT: Reflections on ‘The Bitter Lesson’ #ChatGPT #LLM #ScaleAdvantage #ScalingLaws #Emergence： https://t.co/sFAo8qwHrh

[wmlu @wmlu]

@percyliang Agree. Though such emergent behaviors as in-context learning and CoT reasoning abilities are not fully understood yet, DNN-based language models are basically instilled with broad data (human knowledge/experience); the "magic" is their abilities to retrieve them efficiently.

[wmlu @wmlu]

@Francis_YAO_ 🤝The Scale Advantage: https://t.co/UvpuQlJYEY

[wmlu @wmlu]

I just published The Scale Advantage of ChatGPT: Reflections on ‘The Bitter Lesson’ #ChatGPT #LLM #ScaleAdvantage #ScalingLaws #Emergence https://t.co/EJGICQBVe3

[wmlu @wmlu]

@shwnhll @jimboot ChatGPT is free, right? Are you using GPT-3 via OpenAI APIs?

[wmlu @wmlu]

@borrowed_ideas

[wmlu @wmlu]

I am going to give a webinar on "Foundations of AI Applications" to a group of Silicon Valley IT professionals at 7:30pm on the next Monday (June 27, 2022). You can then access the webinar directly via the Zoom link: https://t.co/c1XOJPsP3E;

[wmlu @wmlu]

Webinar: The Foundations of AI Applications https://t.co/XxpqcrRuZo #Meetup via @Meetup

[wmlu @wmlu]

Webinar: The Foundations of AI Applications https://t.co/XxpqcrRuZo #Meetup via @Meetup

[Yi Ma @YiMaTweets]

Mine is too free for download at: https://t.co/yYOTz4F6T9 but your time of reading books is not free, even more costly if got misled… So be sure you choose the right books to read.

[wmlu @wmlu]

Answer to India has the Taj Mahal. What does your country have? by Lin Zexu https://t.co/weeuhTratR

[ICRC @ICRC]

We’ve received thousands of questions on the Geneva Conventions.

So, we’re going to break down the rules of war you need to know right now.

All states have signed these – and are legally obligated to follow them.

Thread 👇

[wmlu @wmlu]

How the Ukraine Crisis Ends https://t.co/69oxIWH1T6 via @bloombergdotorg

[XPENG @XPENG_Global]

XPeng P5, the world's first mass-produced #SmartEV with urban-road Navigation Guided Pilot and Valet Parking Assist, powered by auto-grade LiDAR tech. Game changer. Coming soon. #AutonomousDriving