Max Zanoga

🚀 AI Enthusiast | 🔍 Exploring the frontiers of LLMs & ML | 📚 Lifelong learner & tech optimist

[Max Zanoga @zanoga]

@LottoLabs I bought them much cheaper, so it was worth the effort.
As a result:
160 GB of VRAM (plan to add one more)
128 GB of RAM

[Max Zanoga @zanoga]

@VideoCardz You can always adapt it for consumer PCs.

[Max Zanoga @zanoga]

@0xSero N350 router with pfSense is cheaper and works better for Tailscale, VPNs, and other heavy stuff.

[Max Zanoga @zanoga]

@DanielSmidstrup ASML

[Max Zanoga @zanoga]

@samsja19 It's definitely worth a try. I plan to run more tests and then share all my results

[Max Zanoga @zanoga]

200 Gb InfiniBand NIC with custom cooling for my GPU cluster

[Max Zanoga @zanoga]

@samsja19 It was a success, but an expensive experiment. So, it's $1,200 for the IB switch and $650 for each NIC

[Max Zanoga @zanoga]

@samsja19 Yes, with 3090s , 4 servers connected through an IB switch.

[Max Zanoga @zanoga]

@barckcode I have more than enough compute. How can I get more information?

[Max Zanoga @zanoga]

@isnit0 Looks awesome! I have an almost similar GPU setup (32 GPUs), but for my own inference workloads.

So if your brother-in-law needs some help, feel free to contact me. I’m also from Ukraine, so I’d be happy to share my experience.

[Max Zanoga @zanoga]

Great news for Canada 🇨🇦

Canada helped start the modern AI revolution with AlexNet - now we should aim to lead the world in AI infrastructure and data centres.
Build more clean power. Build more AI data centres. Invest in Canadian talent.
Canada can become the #1 AI infrastructure hub in the world.

[Max Zanoga @zanoga]

@TimJayas self-hosted Qwen3.6 27b

[Max Zanoga @zanoga]

@llmdevguy It makes sense if the price is the same as the RTX Pro 6000.
For 20k, you could buy 2 x RTX Pro 6000.

[Max Zanoga @zanoga]

@AMD Genuine question: will this card be deprecated in two years with no driver/support updates?
Or has AMD changed its strategy and plans to support older GPUs longer?

[Max Zanoga @zanoga]

@NVIDIA_AI_PC 8 TB hard drive just for LLM backups… so yeah, I’ve lost count 😅

[Max Zanoga @zanoga]

@mistralvibe Large + open-source news?

[Max Zanoga @zanoga]

@TheAhmadOsman Next, Dario will announce gravity’s retiring too 🤡

[Max Zanoga @zanoga]

@Noctua_at Thank you! That will help a lot.

[Max Zanoga @zanoga]

@LottoLabs 32 × 3090 GPUs across 4 servers, connected with InfiniBand.

[Max Zanoga @zanoga]

@chat What about APIs to fully replace Telegram?