@sarlev_@RyanLeeMiniMax At Q4 nearly half would fit on your video card and the rest in system ram, I bet you would get like 15 to 20 token per second decode.
@TeksEdge@martinmose I just tested the Unsloth and I think it would fit (I don't have a Spark).
- Repo: unsloth/MiniMax-M3-GGUF
- Quant: MXFP4_MOE
- Size: 238.86 GiB
@MachDominus In case anyone wanted a translation:
Sustenance: Adequate?
Nutrients: Adequate.
Reallocation: logistics error.
Sustenance: blessed bellies.
Praise to Cook.
@MartianSurveyor@NashvilleZoo There are 27 datacenters in Nashville already, including a Lumen datacenter about 1/2 a mile northwest of the Zoo right now. You can't speak sense into these people.
@emiliaempathy@BasedDragoon@LegalYookay Hold on a second, you're able to make the first division from "People" to "Men" commit the most crimes... But not then sub-divide the group "Men" any further? 🤣
@Tom_A_Lynch@0xSero@atl_flaneur All of the people using tailscale don’t understand networking that’s why. Just thinking about the overhead from all those individual tunnels pains me, not to mention the fact it’s a centralized service.
@idare@0xSero Yeah, 1 of 10 is a crazy claim. I have 2 racks full of equipment in my bonus room right now, hundreds of TB of storage, about 4TB of RAM, 10g network (too poor for 25/100). Thinking of putting a minisplit in my garage to make use of my 240v outlets for some of those iNSPUR nodes.
@sheistytripp@Blueishsweatsh1 If we assume 40 million legal MX immigrants (official #) and 40 million illegal immigrants (not official, but probably right), that's 38% of the entire population of Mexico (132m current) now lives in the US. So 80m of 212m total live in the US with 80/340m making them your 23%.
@pureswasser@BullTheoryio You just don't understand, "wiping out trillions." Let's say I hold a stock that was valued at $100 and I could have sold it at that, after today that same stock can now only be sold for $70. $30 of value was "wiped" from my one share of stock. Realized with a sale or not.