Dino Vitale

LocalAI maxi. Running LLMs on my own hardware. Data sovereignty over cloud convenience. Building agents & consumer rigs. Ex-Cha0tikDino •

[Dino Vitale @Local_famous_AI]

Why I went all-in on Local AI.
Not to save money. Two GPUs and a Blackwell box will never pay themselves back at $20/month.
I did it because I’ve spent 25 years watching people get locked out of systems they don’t own.

[Rushi @rushicrypto]

Building a PC a year before the RAM and SSD shortage feels like being a boomer who bought a house in the ’70s.

[Dino Vitale @Local_famous_AI]

I don’t have the hardware to run GLM 5.2… yet. But you better believe I have several copies of the weights just in case.

[Dino Vitale @Local_famous_AI]

@loktar00 @AutismCapital I think the tension between open source and the big labs is gaining enough momentum that we might actually be able to make a difference this time.

[Dino Vitale @Local_famous_AI]

I love the photos of all of the home data centers, they are all beautiful to me. I love the fact the the true judgement point is "does it work, and what cool shit are you doing with it?" not how sleek and clean it looks. Sometimes progress is messy and enthusiasm beats sleek lines at this point in the game. Keep building!

[Tech2Wild @Tech2Wild]

Ok Guys. 4 x DGX Sparks we going for GLM 5.2 NVFP4 Tonight !

[Tech2Wild @Tech2Wild]

Quick Headups. You DONT NOT Need Breakaway Cables to Run 4 Sparks on a 812 Switch and possible a 804. 400G Ports are Backwards Compatible. We not waiting til tomorrow we going tonight 🙏🏽🔥

[Dino Vitale @Local_famous_AI]

@LottoLabs I think you put your finger right on it

[Dino Vitale @Local_famous_AI]

Same

[Tech2Wild @Tech2Wild]

I've Replace Playing Video Games to Playing with LLMs....

[Dino Vitale @Local_famous_AI]

Using AI to enhance or clarify, your thoughts is the point of the tool. It’s a huge unlock and there’s a difference between what you’re doing and AI generated slop. There are real insights here and I have learned so much for you. Don’t let your detractors slow you down at all. Keep it up.

[Javier ⚛ priv/acc @jvr0x]

So many people bash the @NVIDIAAI DGX Sparks for having low bandwidth.

While that's true, one thing I understood while studying what hardware to buy is that no hardware is perfect, you gotta sacrifice something.

Want raw speed? Get GPUs, but you are restricted on VRAM (which is used to load the models on)

Want to serve large models? Go for unified memory, i.e. a Spark, Mac or these new AMDs, but then you sacrifice bandwidth (which is used for generating tokens, higher is better)

Then you gotta consider energy consumption, cooling, noise, form factor etc..

Pick your poison.

[Dino Vitale @Local_famous_AI]

@karanbhilhatiya hi!

[Dino Vitale @Local_famous_AI]

@superalesha @jxnlco I thoroughly enjoy the refrigerator shelf that you’re using that is epic my friend

[Dino Vitale @Local_famous_AI]

@david_nix A quality UPS will save you a lot of heartache.

[Lotto @LottoLabs]

Crazy to see how far Hermes has come since February lol

[Dino Vitale @Local_famous_AI]

@nimabuyin @LottoLabs I never said that they were 3090s I said that they run 27B they are 5060 TI’s

[Dino Vitale @Local_famous_AI]

@ToniSoto_Vigo @nimabuyin @LottoLabs Those are 5060 TI’s. I have DDR 5 32 gig. MSI MAG Z890 Tomahawk. Under peak load it doesn’t get that hot.

[Dino Vitale @Local_famous_AI]

@loktar00 I stood in line at Best Buy for 10 hours to buy two 3090s in 2020 so I definitely would’ve agreed with that. I also paid 2K for one on eBay.

[Dino Vitale @Local_famous_AI]

@kaaaash____ I have a touchscreen windows machine and it mostly just messes me up. So no, I would not. I like my MacBook just like it is bring back the touch bar if you wanna do something.

[Mustafa @oprydai]

Day 2 of vibecoding

[Karan @KaranD93]

Just moved my Hermes setup to a new rig. I've never dealt with a smoother transfer with literally anything. If I copy 2 lines of code something breaks.
@NousResearch what are you on

At one point I was doubting myself thinking this is too good to be true.

[Dino Vitale @Local_famous_AI]

@loktar00 I try stupid shit all the time just to see if it works because my agent isn’t doing anything right now, so why not