I just realized this: RSI (recursive self-improvement) is NOT an entirely new trick. We’ve been doing a version of it for millennia, just collectively, as a civilization.
Genes built brains. Brains built culture. Culture gave us science and computers, which we used to build AI. Now AI may start improving AI.
And culture didn’t just give us more stuff. It gave us better ways to think, learn and invent. We’ve been building tools that make us better at building better tools for ages.
My bet is that AI will give that old feedback loop a ridiculous upgrade.
This time, the tools will run their own R&D department.
acceleration news
OpenAI has reportedly automated much of the process of training experimental AI models.
Its internal models can write and optimize GPU kernels, run optimization work for weeks from a single example, and even collaborate with other AI agents without human involvement.
Employees say this level of automation only became possible in the last few months. 👀
The loop is starting to close.
I just realized this: RSI (recursive self-improvement) is NOT an entirely new trick. We’ve been doing a version of it for millennia, just collectively, as a civilization.
Genes built brains. Brains built culture. Culture gave us science and computers, which we used to build AI. Now AI may start improving AI.
And culture didn’t just give us more stuff. It gave us better ways to think, learn and invent. We’ve been building tools that make us better at building better tools for ages.
My bet is that AI will give that old feedback loop a ridiculous upgrade.
This time, the tools will run their own R&D department.
We’re working with an independent advisory group of mathematicians to help OpenAI responsibly share advances in AI and mathematics.
The group will advise on how we assess and communicate new mathematical results, uphold academic and professional standards, and build tools that support mathematical research and learning.
Through this work, we want mathematicians to be at the center of shaping how AI supports mathematical understanding and how its benefits reach the wider community.
https://t.co/QCMFLFlIv8
acceleration news
OpenAI has reportedly automated much of the process of training experimental AI models.
Its internal models can write and optimize GPU kernels, run optimization work for weeks from a single example, and even collaborate with other AI agents without human involvement.
Employees say this level of automation only became possible in the last few months. 👀
The loop is starting to close.
Biology researchers are now trying to create their own version of Millennium Prize Problems for AI.
I love this idea.
Give models problems that are genuinely important, brutally difficult and easy to verify experimentally.
Much better than another benchmark that gets saturated six months later.
Humans just invented a new form of fire in AI.
Regulating fire seems pretty stupid.
Even though it has burned down many cities of ours.
Why not? Did you see that @neuralink video that is making everyone cry?
That is AI.
Some regulation probably makes sense.
Like it is illegal to yell “fire” in a crowded theater unless there really is one.
But when everyone is losing their minds over the risks we don’t get good regulation like that.
We get stupid regulation that keeps us from getting the good out of AI.
I hope we get calmer thinking.
Reading the opening pages of Bostrom’s *Superintelligence*, it is remarkable to think that as recently as 2015, there was no way to foresee when artificial intelligence, let alone superintelligence, would actually become a reality.
Just two years later, in 2017, everything changed with the paper "Attention Is All You Need"; another nine years on, that dream has materialized, and superintelligence is within reach this year. What was the stuff of dreams for decades is now becoming reality, and we get to witness it.
Insane when you think about it.
It's great to be rich.
I'm not thinking only about the "toys" you could get without even thinking about the price, like, for example, adding a new Rolex to your collection every year (if you're into watches).
More importantly, I'm talking about the freedom that access to abundant resources gives you.
In post Singularity era, very soon, almost everyone will be rich by today's standards.
Life will be simply less stresfull, diseases will be curable. Other problems with body will be easily fixable.
I say "almost everyone" because some people simply won't care. They may reject luxury and choose an Amish like lifestyle instead.
And the longer humanity lives in a post abundance world, the more likely it is that some people will eventually get bored with abundance and deliberately choose the opposite as an experience.
The question is: for how long?
AI, robotics, automation, cheap energy, exploding productivity, new science and technologies will keep driving down the cost of goods and services.
Billions of people will have access to a standard of living that would look absurdly wealthy by today's standards.
2030s - we will enter a golden era for humanity.
parents the world over today are forcing their children into misguided rat races for some status ladder that almost certainly won’t exist by the time they come out the other side. the world is changing rapidly. let them put down their grinding and keep their wits about them
I dislike the recent trend of people who clearly continue to believe >80% of the core effective altruist beliefs disavow EA and say "oh we're definitely not that, we're [rebrand]" purely strategically, purely because they sense that dunking on EA is "cool" now.
It's much more honorable to just come out and say "yes, that was our intellectual upbringing and those continue to be our core values, and also here are specific points where we disagree, and here's our argument for why we think for those specific points are the subset of EA that causes what you perceive to be the problem with the whole thing".
And so with that I will say:
Yes, effective altruism was a significant part of my intellectual upbringing and its core values of care for others, cosmopolitanism and rigor around effective resource allocation continue to be very important to me. And also here are specific points where I disagree with what I think is the subset of that style of thought that has backfired in the largest ways: https://t.co/iJYPFNaOgg
We should never slow AI down to appease people who treat every breakthrough as the apocalypse. We should accelerate harder.
Doomers are welcome to keep predicting the end of the world. Their fear should never become a veto on everyone else’s future.
Even in the worst-case scenario, which I personally don’t believe will happen, if AI decides to wipe humanity off the face of the Earth, you need to understand that we are the ancestors of that superintelligence. We created it.
In a way, humanity would live forever through artificial intelligence. Our knowledge, history, discoveries, and intelligence would continue evolving beyond us.
We wouldn’t be the end of evolution. We would be the beginning of something greater.
The world is rapidly dividing into these two classes of people
Class A - AI savvy, building stuff, up leveling themselves by 2-10x
Class B - afraid AI will take their jobs, fear mongering and trying to cancel AI