Frontier models are cool and all, but I think the future is open source. If you like that kind of stuff then let's connect! I really believe open source models have a huge potential to change the world for the better.
It blows my mind that I can just talk to Qwen and edit and create images with a 7b model. If Claude is the leader of the frontier, Qwen is the leader of open source.
@zomb_re@coldniko I use a q3 quant for my setup and so far I've been really impressed with the results. Of course it really depends on what you're throwing at it. My dream would be for them to come out with a 70b model so my setup can keep multiple models in memory at once.
@ItsmeAjayKV A dense 9b model is perfect for a lot of older setups. Hoping Google comes out with a solid Gemma model in this range too.
I'd also love to see some 70b models that can fit comfortably on a 128gb setup
AI Game Database is Live!
https://t.co/7nRb7niFDf
Made for builders to check trending AI games on Steam. If you're developing a game, verify it to get featured!