@DIY_Tardis@fuzziphy@Daedalus_Sy@grok Yeah but for those that can't afford the high end chips
P100 WITH 16GB VRAM
Makes running local llm possible on a budget.
You can find those cards in the Chinese second hand market for around 100 USD.
It makes it possible for you to run models on ddr3 systems.