This has been a really fun project to be involved with, and it's the beginning of a big change in how we write programs. It's the first work I'm aware of that moves beyond the paradigm of isolating LLMs from program state and communicating purely through serialization.
🦜✨Nightjar ✨makes your prompts first-class code in your Python programs: Your prompts read and write program variables, compute with program objects, and implement program control flow. 🧵(1/n)
⚡️Come check out how we scale LLM decoding parallelism! Excited to present learned asynchronous decoding with @ellieyhc for DLCT @ml_collective tomorrow at 10am PST! Thanks to @jasonyo@savvyRL for organizing.
Just landed in Vienna for ICML and can’t wait to share what @JesseMMichel, @alex_renda_ , @mcarbin, and I have been working on! The main idea is to use hypernetworks to compile programs to neural networks. (1/N)
Just landed in Vienna for ICML and can’t wait to share what @JesseMMichel, @alex_renda_ , @mcarbin, and I have been working on! The main idea is to use hypernetworks to compile programs to neural networks. (1/N)
Let me know if you’re at ICML and would be interested in talking about deep learning for code! @JesseMMichel and I will be presenting our poster on Tuesday at 11:30am-1pm. (N/N)
Just landed in Vienna for ICML and can’t wait to share what @JesseMMichel, @alex_renda_ , @mcarbin, and I have been working on! The main idea is to use hypernetworks to compile programs to neural networks. (1/N)
We instantiate a neural surrogate compiler as a hypernetwork, CompNet, that is 1.9-9.5x as data-efficient, trains 4.3-7.3x faster, and produces visual results that are 1.0-1.3x more similar to ground truth. (5/N)
If you have a natural transformation between two interpretation functors, does that signal anything of interest? For the example I'm thinking of, it seems to show the source functor is "finer-grained" (separates more programs), but not sure in general.
For anyone who has experience with theorem provers and is interested in learning Lean 4, I'd recommend the slides and associated exercises here: https://t.co/B2Q6EUgfWR