@perrymetzger I feel the exact opposite. I can show you dozens and dozens of chats with me correcting AI and it admitting it is wrong. Happens daily. But it's still very useful. I think both can be true.
@PawelJLisowski@vxunderground I can't think of a worse set of data to have than the unhinged ramblings of a couple billion Facebook users. Can you imagine how braindead an LLM trained on that slop would be?
@UlrichRozier@FoolaFroos I'm running it on a 7800XT (16GB) with a 200k context window. Using unsloth q5. This is the best model for agents I've ever been able to run locally on that card. It's fantastic.
@_sirajuddeen_@notnullptr Let me know how it goes! Curious what kind of context window size you can get on 8GB. My use case is agents with a huge context on 16GB.