Distillation has been on the news (!) due to @deepseek_ai. The paper https://t.co/fRbFdfoHT1 was actually rejected from NeurIPS 2014 due to lack of novelty 🧐 (true-ish), and lack of impact 🙃.
Thanks reviewer#2 (literally), and thanks for @arxiv!
@geoffreyhinton@JeffDean
Complete hardware + software setup for running Deepseek-R1 locally. The actual model, no distillations, and Q8 quantization for full quality. Total cost, $6,000. All download and part links below: