@0xWhiteMage Openbot is the answer.
It's grokbot, but local (or not, use a cloud model, whatever).
I gave it its own local VM to use and it's what I wanted hermes to be: click button, make silly bot for email management, it works and gets back to me. Done.
Can I stop getting videos in my feed?
I donβt want videos. I donβt want to see dogs getting their ears cut off or open heart surgery while Iβm reading about technology.
@GuideboardLabs No comments on state block size, threshold, what type of decoding you're using, or other generation settings.
Opinion disregarded.
Using this model properly, which is new to people who have always used AR, gives some very impressive results.
@ItsmeAjayKV I was going to add it to my 96GB Mac Studio M5 Ultra. It's not an upgrade outside of raw unified RAM capacity.
Either way, there will be something new eventually that supersedes this. The 512GB version is very, very bright and shiny though.