I can now confirm that yes, you have AGI at home w/ Deepseek R1.
Running locally on CPU and RAM with llama.cpp after much trial, getting apx 3.4 tokens/sec.
AGI at home
Running DeepSeek R1 across my 7 M4 Pro Mac Minis and 1 M4 Max MacBook Pro.
Total unified memory = 496GB.
Uses @exolabs distributed inference with 4-bit quantization.
Next goal is fp8 (requires >700GB)
Foundations of LLMs
This amazing new LLM book just dropped on arXiv.
200+ pages!
It covers areas such as pre-training, prompting, and alignment methods.
It looks like a great intro to LLMs for devs and researchers.
If you’re a hardcore software engineer and want to build the everything app, please join us by sending your best work to [email protected].
We don’t care where you went to school or even whether you went to school or what “big name” company you worked at.
Just show us your code.