@eevblog It is inefficient to self host. Scale brings down cost, and the price to start with 600B+ size models is high. Idle hardware is expensive.
The big closed models are significantly better for writing software, they are more accurate working on large complex systems.
@Tono_Ken3 Check board carefully, on mine it is seven x16 slots but one of the two NVME slots shares with a slot. It's possible with the right board but even server/workstation class systems do not have infinite lanes. There are PCIe bifurcation adapters though, with those I could run 14.
@lauriewired@DanielCluff I bought fairly cheap Rosewill rack cases and swapped the (terrible) fans out. But they are 4U. 2U and 1U are hard to save from jet engine Delta fans if you want something more powerful than a minipc.
@HalenMattison My expectation is they'll follow in Elio's footsteps. https://t.co/F1BcUILsAS
They don't need to announce products, they need to announce billions in financing deals.
Slate already had a huge hype cycle about a year ago, still no trucks. I would not hold my breath.
@amitbbb12@VideoCardz Perhaps system integrators building mini PCs, you affix a PCIe slot on the other end of the cables so it can be located anywhere you like--more flexible with case design. Or it is for people who use GPU docks, already fairly common with Oculink.