Sr. Scientist @amazon | Computer Science graduate from @OhioState | Linguistics, ML and #NLProc | Social Media analysis... | Opinions my own, not my employer's
My new blog post discusses the physical reality of computation and why this means we will not see AGI or any meaningful superintelligence: https://t.co/jsAKQ6T3gC
@MichaelVaughan Clearly, clickbait headline. There was no "bizzare tirade". Asking for consistency in the use of technology is not bizzare. Neither did he say it wasn't out?
Burnout happens when there is no progress. Burnout also happens when you have no visibility into how dots will connect in the future. Burnout is about not being able to close the loop after putting a ton of effort and not seeing enough results.
There are 2 mistakes you can make about LLMs:
① Thinking everything LLMs say is correct, they can reason, and with a bit more scale they’ll get us to superintelligence
② Thinking LLMs are good for almost nothing—they are FAR better at all #NLProc tasks than previous methods
While GenAI is fun, I think its economic value is grossly over estimated, because it’s unreliable, risky and expensive to make and serve. It’s fine for creative tasks, but not (yet) autonomous agents
In AI at least, the real 30 under 30 imo you have never heard of. They are 5 layers down the org chart from the CEO. They are usually not on Twitter, they have an unmaintained LinkedIn, they don’t go on podcasts, and they maybe published at one point but don’t do so anymore. They are today’s Einsteins and directly invent and build miracles. I wish they weren’t hidden inside big tech and startups in return for very large paychecks but here we are.
ACL has removed the anonymity period.
This means that ACL submissions can be posted and discussed online at any time, although extensive PR is discouraged.
https://t.co/F7xVdCEoyY
My prediction: in 2024, most companies will realize that smaller, cheaper, more specialized models make more sense for 99% of AI use-cases. The current market & usage is fooled by companies sponsoring the cost of training and running big models (especially with cloud incentives).
@GuggerSylvain All the very best for what comes next, Sylvain! I learnt a lot from your initial notes and lectures on the HF website when things were just picking up.