The @karpathy interview
0:00:00 β AGI is still a decade away
0:30:33 β LLM cognitive deficits
0:40:53 β RL is terrible
0:50:26 β How do humans learn?
1:07:13 β AGI will blend into 2% GDP growth
1:18:24 β ASI
1:33:38 β Evolution of intelligence & culture
1:43:43 - Why self driving took so long
1:57:08 - Future of education
Look up Dwarkesh Podcast on YouTube, Apple Podcasts, Spotify, etc. Enjoy!
I actually kind of agree with this opinion.
Wanting to find primary sources is important, but what I've seen at least, is tertiary sources by using deep-research.
The AI finds random articles about people commenting on either MSM or just directly MSM...
I don't think it's as easy as it sounds to find reliable primary sources. Especially that the big picture needs to be taken into account at all times, and that'd really hard to do, even with AI.
Ex: yes this crazy event happened, but how often is it happening within X timeframe, and how often was it happening Y years ago.
What are your methodologies for fact-hunting?
Llama3.3 version:
The idea that we might be living in a simulated reality, also known as the "Simulation Hypothesis," has been a topic of debate and speculation in philosophy, science, and technology for several years. While there is no conclusive evidence to prove or disprove this idea, let's explore the concept and some of the arguments for and against it.
What is the Simulation Hypothesis?
The Simulation Hypothesis proposes that our reality might be a computer-generated simulation created by a more advanced civilization. This idea is often linked to the concept of ancestor simulations, which suggests that a civilization with immense computational power and technological capabilities could create a realistic simulation of their ancestors' lives, including the entirety of human history.
Arguments for the Simulation Hypothesis:
The "fine-tuning" of the universe: Some scientists argue that the fundamental physical constants in our universe are "fine-tuned" to allow for the existence of life. The Simulation Hypothesis offers an explanation for this fine-tuning, suggesting that our universe was designed by a simulator for a specific purpose.
The rapid progress of computer technology: The rate at which computing power and artificial intelligence are advancing suggests that it may be possible for a civilization to create a realistic simulation of reality in the future.
The existence of "glitches" in reality: Some people claim to have experienced strange phenomena or "glitches" in reality that could be evidence that we are living in a simulation.
Arguments against the Simulation Hypothesis:
The Burden of Proof: Proponents of the Simulation Hypothesis have yet to provide empirical evidence to support their claims. Until such evidence is presented, it remains a topic of speculation rather than a proven theory.
The complexity of simulating reality: Creating a realistic simulation of an entire universe would require an enormous amount of computational power and data storage. It's unclear whether it's even possible for a civilization to create such a simulation.
The problem of induction: Even if we assume that we are living in a simulation, it's impossible to know for certain what the "rules" of the simulation are or how they might be different from the laws of physics in our observable universe.
Notable proponents and critics:
Elon Musk: The entrepreneur and business magnate has stated that the probability of us living in a simulated reality is "quite high."
Nick Bostrom: The philosopher and director of the Future of Humanity Institute has argued that if a civilization were to create a realistic simulation of reality, it would likely create multiple simulations, increasing the probability that we are living in one.
Stephen Wolfram: The computer scientist and physicist has argued that the complexity of simulating reality would be too great, and that it's unlikely that we are living in a simulation.
Conclusion:
While the Simulation Hypothesis is an intriguing idea, it remains a topic of speculation and debate in the scientific and philosophical communities. There is currently no conclusive evidence to prove or disprove it, and it's unclear whether we will ever be able to determine whether we are living in a simulated reality or not. Ultimately, the question of whether we are living in a simulation or not may be a matter of personal belief or philosophical interpretation.