It Still Boots

I make e-waste do things it shouldn't
Tech, Local AI, ESP32 builds, Home Assistant, gadgets, Linux...

[It Still Boots @ItStillBoots]

@VectorCrossProd @i2cjak we need your input on this

[It Still Boots @ItStillBoots]

@DJLougen @0xSero Yeah sadly 💯

[It Still Boots @ItStillBoots]

@LottoLabs …but how higher could it go ?

Amazing performances

[It Still Boots @ItStillBoots]

@Beamsters1 This could run fine on the CMP 170HX without offloading part of the model to the CPU

[It Still Boots @ItStillBoots]

@sudoingX Having the choice is good for the market, competition will push everyone to be better.

The Mac Studio is not perfect but it has it’s advantages, price and performance wise wise I believe it’s on par with 2 DGX Spark, each with their own pros and cons.

[It Still Boots @ItStillBoots]

@Snixtp Especially in clusters thanks to NVLink.
Even if it’s EOL the community will keep it alive for the next few years

[It Still Boots @ItStillBoots]

@viewhero1 I will sacrifice my heatsink this weekend and bend the fins to make it look like that…taking one for the team (CMP 170HX)

[It Still Boots @ItStillBoots]

@viewhero1 Hack number 2 : opening the fins (or replacing the heatsink) and slapping 2 high static pressure fans on top

[It Still Boots @ItStillBoots]

@viewhero1 Hack number 1 : 3d printed ABS shell with a 80mm blower from a 4090, as loud as the 4090 itself I guess

[It Still Boots @ItStillBoots]

@loktar00 The DGX Spark will most likely become very rare because they are pumping the same SOC to the RTX Sparks desktop and laptops…so while they will still technically produce DGX Sparks they will become more expensive indeed and hard to find (my take)

[It Still Boots @ItStillBoots]

@loktar00 What's your theory ?

[It Still Boots @ItStillBoots]

@_ryu15_ ohmagad

[It Still Boots @ItStillBoots]

Yeah but I was looking for a setup that is easy to run, quiet and doesn’t suck 2 KWh.
The Mac is definitely not ideal, but for my use case it’s the better option I believe.

In the meantime I will be watercooling the CMP 170HX and I will sell that one when I get the studio at the end of the year.

[It Still Boots @ItStillBoots]

Calling it now, the Apple M7 Ultra will have an equivalent or higher memory bandwidth than the top of the line GPU Nvidia will be selling in 2027

[It Still Boots @ItStillBoots]

@anemll M7 is going to be their first serious AI hardware

[It Still Boots @ItStillBoots]

@0x0SojalSec And then 1 month later it’s gonna be dog shit

[It Still Boots @ItStillBoots]

@MoonlitMaven Exactly, well you are validating my plan, I just ordered it to replace the CMP 170HX, gonna have to wait 3 months to get it now (only 1 month for the “base” Ultra 256GB)

They will not get cheaper next year anyway, better to get the hardware now

[It Still Boots @ItStillBoots]

@loktar00 It will still rip hard

[It Still Boots @ItStillBoots]

@MoonlitMaven What’s your take on the M5 Ultra Mac Studio ? Looks pretty promising performance wise and it will be small, quiet, not sucking 1-2 KWh…