Finally done it
Wired up my DGX Spark cluster to the Mac Studio M3 Ultra for about 896GB of Vram capacity and about 850 GB usable inference memory with segregated Prefill and Decode using ExoLab's recommended setup. @exolabs@alexocheema . Thank you guys for making this happen.
Shoutout to our friends at SecDSM (our favorite people from Iowa) for sponsoring the KC Cybersecurity Community Expo as a Title Sponsor. Community supporting community.
Tue, Aug 11, 5-9 PM at Knuckleheads KC. Free to attend.
https://t.co/5a9PiwGGL7
There are so many awesome people in our local AI community building in the open, so wth, I guess it's my time to show you guys what I'm spending my tokens on lately and how I managed to keep my only DGX Spark burning in A/B testing 24/7 in the last 2 weeks.
Many more screenshots to come so fallow the thread.
AI is so cool.
Over the course of 3 days, I built a full ATSC3.0 demodulator / decoder using Opus and Fable. I can now watch next-gen over the air HDTV using any SDR with 8MHz of IBW.
My first decoded image is below.
ATSC3.0 is a very complex OFDM waveform. To be able to build a demod/decode for it in 2 and a half days, is just insanity.
Thanks to @ibelings for the nudge to give it a try.