I have spent my entire life working on this and thinking about this for the past 4 years. I don't know what will happen in 20 years, but I can promise you that on the 5-10 year timescale, scientists are not out of their jobs. AI is going to massively accelerate the pace of science, increase productivity, let individual scientists make way more discoveries way faster, and is going to make science overall more fun. But the model is going to be collaboration between humans and AI, not replacement.
The key difference here between science and e.g. software engineering is that science is not verifiable in any rapid/convenient way (unlike software), unlike programming. We still need humans for their scientific taste.
Mythos is not a bad name for a model but it would be better if Anthropic switched to using famous Claudes. Monet, Debussy etc. The final model that achieves AGI would obviously be Van Damme
Google has an internal "let it break" essay about a hero engineer whose hard work ends up being a net negative (by masking the underlying issues). My manager sent me that essay when I was trying too hard to get the collective TensorFlow unit test suite green.
Gradients are energy-inefficient due to long-range dependencies, yet we lack a viable alternative. What if we crowdsource the discovery of what's next?
Starting a weekly in-person reading group in SF. WebGPU, online learning, Hinton. Email [email protected].
I got to see my two yo and two months old nephews for her first time. One’s running full on RL. The other one is sft +rl sometimes hf.
The 2 yo is a full human with an exceptionally good command of language. Looking for some cognitive experiments to run with him :))
AI is cool and all... but a new paper in @ScienceMagazine kind of figured out the origin of life?
The paper reports the discovery of a simple 45-nucleotide RNA molecule that can perfectly copy itself.
First month in the bay. Lots of buzzwords flying around. Not much substance.
People are either new ish to ML and use buzzwords or old timey and like simple concepts.