iamr0b0tx

Working on ML models that can learn online

[iamr0b0tx @iamr0b0tx]

"Developing models that move beyond pattern recognition to true logical reasoning is the next big challenge for the #AI #community."

💯

[Mehrdad Farajtabar @MFarajtabar]

12/ Understanding LLMs' true reasoning capabilities is crucial for deploying them in real-world scenarios where accuracy and consistency are non-negotiable—especially in #AI_safety, #alignment, #education, #health_care, and #decision_making systems. Our findings emphasize the need for more robust and adaptable evaluation methods. Developing models that move beyond pattern recognition to true logical reasoning is the next big challenge for the #AI #community.

[iamr0b0tx @iamr0b0tx]

Modern AI is the new dialogflow

[Ilija Lichkovski @carnot_cyclist]

https://t.co/6knNaJYCxn

[iamr0b0tx @iamr0b0tx]

@carnot_cyclist Nice post. I completely agree. I've been obsessed with continual learning since 2018 and started writing a little about it recently https://t.co/LwozKLWdEZ.

I'm curious what you think about back propagation as a learning method to achieve continual learning?

[iamr0b0tx @iamr0b0tx]

LLMs are method actors that never go off the clock

[iamr0b0tx @iamr0b0tx]

What is the opposite of AI? HI or NI?

[iamr0b0tx @iamr0b0tx]

What I look forward to the most is the ability to continually learn capability. Instead of reinforcing signals, they "invent" them. Unlocking this would take us from the era of training to era of teaching

[Mira Murati @miramurati]

We started Thinking Machines to advance human-AI collaboration, and this is our first bet on what that looks like. Most labs treat autonomy as the goal and interactivity as scaffolding around a turn-based core. We think the way we work with AI matters as much as how smart it is. Interactivity has to be in the model, and it has to scale with intelligence rather than trail behind it.
https://t.co/U4c0uC7tnT

[kache @yacineMTB]

you can outsource your thinking
but you cannot outsource your understanding

[iamr0b0tx @iamr0b0tx]

https://t.co/MhNNW9k1mB

Says a lot about love and friendship

[iamr0b0tx @iamr0b0tx]

Once we become successful with world models the importance of online learning will become apparent

[Yann LeCun @ylecun]

Dario is wrong.
He knows absolutely nothing about the effects of technological revolutions on the labor market.
Don't listen to him, Sam, Yoshua, Geoff, or me on this topic.
Listen to economists who have spent their career studying this, like @Ph_Aghion , @erikbryn , @DAcemogluMIT , @amcafee , @davidautor

[François Chollet @fchollet]

AGI will make its own harness (or whatever else it needs to solve a new problem). As long as you need a human engineer to handcraft a task-specific harness/system for each new problem, AI isn't general. It's an automation tool to be wielded by software engineers.

Harness-related research is important and valuable -- as a vector of better automation. But I don't think it gets us closer to general intelligence. General intelligence is when you can adapt on your own.

[iamr0b0tx @iamr0b0tx]

source: https://t.co/hSkGJiiPQZ

[François Chollet @fchollet]

The bottleneck of current AI is simple: the techniques we use are still predicated on pattern memorization and retrieval, and thus they need *someone* to tell them which patterns to memorize (training data, RL envs...)

That role cannot yet be played by AI in a truly open-ended and autonomous way. We can't yet remove the humans in the loop. In that sense, current AI is still purely a reflection of human cognition (both in terms of which tasks/goals it pursues and the patterns it uses to solve them). It isn't yet its own thing.

[iamr0b0tx @iamr0b0tx]

@folaoftech Hey philomena

[iamr0b0tx @iamr0b0tx]

@Substack Can you please restore this option to read a third party domain substack in the substack reader. Some of them don't support dark mode and this option lets us read with the native substack reader that supports dark mode. Thank you

[dex @dexhorthy]

Here’s what’s gonna happen:

- you replace your code review with feedback loops (sentry, datadog, support tickets, etc)
- you stop reading the code
- software factory fixes everything
- one day something breaks at 3am, agent can’t fix it
- nobody’s read the code in 3 months
- you have 3 weeks of downtime trying to re-onboard and fix it
- you lose significant % of your contracts and users
- your company is now dead