I'm a staunch Claude loyalist, but I use Claude myself less and less. Grok Bot uses it for me now. Anthropic took so long to ship Duet that by the time it came out, I was so integrated with Grok Bot that switching was too annoying. Same with finances: Claude just got it, and ChatGPT and Grok have had it for ages. What took so long?
@RohanBhanotAI The off button only helps once something has already gone wrong. Giving each agent its own login with only the access its job needs is the part that keeps it from going wrong in the first place.
@kyleichan Filtering the training data is the right layer. Refusal tuning on open weights can be stripped with a tiny edit, but a model that never learned exploit dev has nothing to unlock. Someone can still fine-tune it back in, but they'd have to bring the data themselves.
@kimmonismus If you can edit two neurons in it and it wants to kill you, then what is it gonna look like when you have an open source model that has achieved RSI?