In our blog post, you can interactively explore the reasoning effect of token cues and RL on base models!
📎 paper: https://t.co/5vn7v5GW8b
✍ blog: https://t.co/O84Sn5GC4F
💻 code: https://t.co/tLW37QsQJw
Can “chicken” make a base model reason? 🐔
Yes!
Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too.
blog: https://t.co/O84Sn5GC4F
If AI mapped a cure for terminal pancreatic cancer I don't think anyone would dare complain about its effects on medical unemployment.
But people are upset that AI can solve math problems and cause unemployment in performative mathematics.
Fuck them.
@torgeirlysen i did this with a couple of courses and it nearly destroyed me and my GPA💀💀
leveled up a fuckton though, and now I'm taking it easy on myself (still taking 'tough' courses, but also doing side stuff thanks to my earlier suffering😭)
Neural networks might speak English, but they think in shapes.
Understanding their rich *neural geometry* is key to understanding how they work – and to debugging and controlling them with precision.
Starting today, we’re releasing a series of posts on this research agenda. 🧵
Oh no no, when I say it didn't 'hit as hard', I meant that it wasn't as punchy or impactful as I was hoping it would be. But nonetheless, Soviet books have a special place in my heart. Heck, I literally repaired my foundational understanding of Probability Theory with Wentzel and Ovcharov's Applied Problems in Probability Theory book.
After this book, apparently some problem books which I wanted to explore problem-solving in Probability with (like Mosteller's book for eg) turned out to be a highly recommended prep book for quant interviews. But, indeed, I was simply looking to have fun with Mosteller's '50 Challenging Problems' book and I give my thanks to Wentzel and Ovcharov's books for it!
At the end of the day, Soviet books will always have a special place in my heart❤️❤️ (Mir Publishers is goated for putting up a lot of their catalog btw!)