karpathy says we’re a decade away from AGI, because we don’t yet know how to make systems learn continuously.
the deeper problem is that we’ve built this entire field on metaphors, not mechanics.
we keep saying AI can think, reason, remember, create. but those are human verbs, not model capabilities.
AI isn’t intelligent. it’s efficient.
it doesn’t reason . it pattern-matches.
it doesn’t remember. it reconstructs.
it doesn’t reflect.
it re-runs.
we confuse language with understanding. just because a model can describe thought doesn’t mean it’s having one.
real intelligence has intent. it knows why it’s thinking. AI predicts what comes next. and yet, even without intent, these systems are starting to functionally mimic cognition. they reason, recall, and reflect. not consciously, but effectively.
that’s why both statements can be true.
AI is a bubble. because capital, hype, and valuations have outpaced genuine capability. but it’s also here to stay. because the direction of progress is right.
the crash will clear the noise.
what remains will be systems that truly learn. memory that compounds, feedback that refines, intelligence that grows by living inside workflows.
we’ll look back on this phase the way we look at the early web: messy and magical.
the beginning of machines that finally learn, not just perform.
Many people think CS is just DSA.
It's not.
My CS curriculum had:
0. Data Structures and Algorithms
1. Calculus
2. Linear Algebra
3. Physics
4. Mathematical Physics
5. Differential Equations
6. Theory of Functions of a Complex Variable
7. Theory of Probability and Mathematical Statistics
8. Calculus of Approximations
9. Functional analysis
10. Numerical Methods
11. Optimisation Methods
12. Cryptography
13. Compression Algorithms
14. Game Theory
15. Algebra and Geometry
16. Discrete Mathematics
17. Automata-based Programming
18. Formal Language Theory
19. Compilers and Interpreters
20. Computational Complexity Theory
21. Math Logic
22. Type Theory
23. Lambda Calculus
24. Functional Programming
25. OOP Design Pattern
26. Machine Learning
27. AI
28. Hardware Architecture
29. Java
30. C++
31. C
32. Computational Geometry
33. Operating Systems
34. Computer Networks
35. Databases, Relational Algebra, and SQL
36. Parallel Programming
37. Economics
38. Organisation and management of business processes
39. History
40. Philosophy
41. English
42. Health and Safety Training Course
43. PE
@SchmidhuberAI@JFPuget@ylecun The Neocognitron was trainable, but not via backpropagation. It used analogue threshold units, not ReLU, sigmoid, or tanh. CNNs became scalable and trainable with backpropagation, notably through LeNet.
If Claude is really doing so much of the coding for Anthropic, why haven't they used it to create a fucking ui for Claude Code?
It's 2025. Why the fuck am I forced to use a cli for everything as if it were 1995?
Out last week in @cogsci_soc!
@samhforbes and I ”urge extreme caution in the use of LLMs in classrooms lest we further normalize: pupils losing their privacy, reducing contact between learner and educator, deskilling teachers & polluting the environment”‼️
PDF/DOI links below.
@JeffDean Yes I can; as can you. But I'm primarily interested in what's widely available in the community, where a single 4090 GPU machine is already a very rich investment.
Remember also that 3090s were the last consumer card with nvlink, so 4090 and 5090 cards aren't good at multi gpu
Neural networks don’t have to be distilled into other neural networks. They can be distilled into decision trees or sets of rules. And then interpretability becomes dramatically easier.
Our team at Microsoft Research India is looking for a Research Intern for a 6 month position. The position will be on-site in BLR. You will get to work on multilingual data, modelling and evals. Please DM me with a short blurb about yourself and your CV/Resume.
Can we enhance interoception by controlling the heart? Thrilled to share our new study, led by @AshleyTyrer, where we use computational modeling to show that blockading peripheral noradrenaline uniquely alters awareness of heart rate & breathing!
https://t.co/zs4iQbp3Wq 🧵👇