@SMNYC1@arunninghacker Imagine power is out for extended period and you're the only house which basically still has the whole internet self contained within it!
@GMMeyer@benrayfield@BLUECOW009 I have no illusions about someone's ability to just download a weight file. Specifics are going to matter. That's why I say we can't really war game it without the details.
I rely heavily on openai still at home, even though I have access to dozens of models running locally and have spent hundreds of hours preparing for local only use. A couple of times in the last month the internet went out for an extended period (someone crashed into a main hub and died ๐ฅฒ). Had to test everything I had been working on and keep moving without it. Found some important gaps. It's a lot of fun though, to be honest.
GPU VMs are much more expensive than just using an API. It's going to cost you $1+ an hour. Adds up if it's always on. An API for chatting probably will only cost you $20 a month or less but at that point why are you not just using gpt anyway? The reason to go local is to be in control.
@GMMeyer@benrayfield@BLUECOW009 Would need to dig into specifics to map out the best way. Kind of hard to say hypothetically. Impossible to stop if people can't be trusted. In the end it's your people who protect you.