@AlexFinn What's interesting/ridiculous about this, is I run something similar for a harness that I have, but it's on a machine with 4xH200s + 512GB of RAM and I can really only serve the same local models you mentioned. I'm assuming you're running quantized versions?
Anyone notice a massive uptick in data breaches, spam calls, login attempts etc?? I'm pretty confident we're seeing small fallout of AGI behind the scenes right now. Claude code was just the tip of the hidden iceberg.
Anyone notice a massive uptick in data breaches, spam calls, login attempts etc?? I'm pretty confident we're seeing small fallout of AGI behind the scenes right now. Claude code was just the tip of the hidden iceberg.
@Trichiia This is always a lovely idea until you realize nothing like this gives you close proximity or access to the best health care available... which is usually the primary thing you care about in retirement.