Totally agreed. One direction I'm excited to try is to see what happens as we make lightweight specifications a thing that you can write down in the signature of an individual module. The direction there is rather than trying to specify a system from the top down, you'd slowly build in more specifications and properties from the bottom up. I'm very curious to see what people do with that kind of system.
As a long time Signals and Threads listener, I was really excited to have this opportunity to talk about the work our team has done over the past ~4 years. Hope you enjoy π
Signals and Threads episodes are bangers, but this may be the first to become part of my PL course's "text". About 50% is a compressed version of my GC lectures, about 30% is modern updates, and 20% is @yminsky doing his thing w/ Stephen Dolan. (-:
https://t.co/iaqIPsWEiR
@ShriramKMurthi That was a fun bit of the interview. I really learned a lot on that one! That's also really the first time I understood why stack allocation is so much more efficient than allocating on the minor heap.
Signals and Threads episodes are bangers, but this may be the first to become part of my PL course's "text". About 50% is a compressed version of my GC lectures, about 30% is modern updates, and 20% is @yminsky doing his thing w/ Stephen Dolan. (-:
https://t.co/iaqIPsWEiR
@JulesJacobs5@JAldrichPL I worry that we're purposely teaching LLMs to act as if they might be conscious, in a way that will confuse us into concluding they are. And that confusion in its full form would put a heavy (and arguably wrong!) thumb on our moral calculus.
@JulesJacobs5@HerrDreyer@ArjunGuha@krismicinski Which raises the interesting question of whether models are presently good at checking proofs. I wonder if there are any benchmarks of this kind out there.
@JulesJacobs5@HerrDreyer@ArjunGuha@krismicinski My guess would be that RL with lean as the validator is a big part of how the models get good at math, whether or not they use lean for a given proof.