@leopardracer Interesting topic. I also have 16GB vram card, question here, how many tokens does Qwen 3.6 27B generate when offloaded to two 16GB cards? And what quantizations were you running?
@jun_song What would be your opinion on NVIDIA RTX PRO 4500 Blackwell. For around 3600$ this seems like a decent choice with nvidia ecosystem and 32GB of vram. It’s słower than 5090 yes, but pricepoint is good. (I’m newbie but my current 16gb of vram is restricting)
𝐀𝐫𝐞 𝐲𝐨𝐮 𝐫𝐞𝐚𝐝𝐲 𝐟𝐨𝐫 𝐭𝐡𝐞 𝐟𝐢𝐫𝐬𝐭 𝐆𝐀𝐓𝐀 𝐑𝐨𝐥𝐥𝐀𝐩𝐩?
GATA is evolving, and we can't wait to show it to you.
Want to take part?
You know what to do!👇
See you next week for the unveiling of our very first RollApp.
#GATAHUB 🤫
12 hours until Season 3: Theia
Lots of date move ups
Retweet and comment your polygon address
We'll be sending out Dromans live today!
888 Dromans are going to 5 tweeters