Now that Antigravity has reduced it's Limits so much, I realize that now we can't just Use tokens like how we used to before, Thinking of a very big project? Well now either you are forced to pay or just have to go with some 9b local model that has a very small context window ๐ญ
Local AI 101 - Models by Parameter Size
The 'B' stands for Billion parameters. A good rule of thumb is 1B = roughly 1GB of VRAM.
~1B (Nano): Used for specific simple tasks like OCR, or built into web apps for lightweight execution.
~9B (Micro): Convenient as a support model running on small hardware like smartphones or laptops.
~35B (Mini): The sweet spot for standard consumer devices. Once fine-tuned, they perform specific tasks very well.
~400B (Haiku size): Includes lightweight models like Deepseek V4 Flash and Minimax M3. The max size runnable on a single 128GB Mac using dynamic quant.
~800B (Sonnet size): Mid-size models like GLM-5.2 and Kimi. Requires 512GB+ VRAM, but excellent for complex tasks like coding.
1.6T+ (Opus size): Massive models like Deepseek V4 Pro and Longcat. Too heavy for consumer devices; requires server-grade hardware.