Can we teach small, local LMs to *use* large, remote LMs as *tools*? Papillon with @Sylvia_Sparkle & team shows that this can be very consequential for privacy.
Using DSPy optimizers, we can teach Llama3-8B to reach 86% of frontier LLMs' quality while hiding your private data!
🌱 excited to share small updates to ChatGPT (while we also work on bigger things)!
Here are some B-tier visuals for each new thing.
1. Prompt examples (let us know if you have suggestions on what should go here!)
StackOverflow should deploy its own AI model to automatically answer questions.
The community will still vote for the best questions. People coming to the site will get the best possible answers (regardless of whether a human or an AI model produced it.)
(The voting system will be fantastic feedback to improve the model!)
They shouldn't stop there.
They can have another model that improves human answers by including missing context, fixing issues, and removing toxicity.
The last part is probably the most crucial idea of this post: StackOverflow's problem is not AI; it's how toxic it is, especially for newcomers!
All of this is doable.
But they went the opposite way and banned AI-generated answers.
That was a mistake.
The ball is in their court.