deepaklypse

AI Infrastructure Wildcat. Views are my own.

[deepaklypse @deepaklypse]

https://t.co/6osBtO2cAK

[deepaklypse @deepaklypse]

Is RAM for AI oversold or is there really no shortage that people are trying to build into? Link below.

[deepaklypse @deepaklypse]

@RobertH67413713 @DustinOgle33 @pmarca Then pay 100x for the power for the nearest Chinese equivalent of a single GB300. That's about 16MW for the best Huaweii equivalent which is about H200.

[deepaklypse @deepaklypse]

@DustinOgle33 @pmarca You have apparently no idea that a mac studio doesnt exist in the same universe as a GB300 for compute.

[deepaklypse @deepaklypse]

@DustinOgle33 @saheljalal @pmarca That does not pay for a GB300, or even a B300 in compute.

[deepaklypse @deepaklypse]

@MsMelChen Love this characterization, Ms Chen!

[deepaklypse @deepaklypse]

@sudoingX @0xSero Is there a way to determine which REAPed model fits say 48G ?

I dont find the descriptions on most of them clearly stated so I'm sure I'm doing it wrong.

Thanks!

[deepaklypse @deepaklypse]

@hicasamadim Square the number of horizontal lines.

[deepaklypse @deepaklypse]

@hicasamadim 9

[deepaklypse @deepaklypse]

@CardilloSamuel @nahiiko So which weights and what kind of tuning (generally) per customer? I am having a hard time seeing which weights would be tuned per customer for most groups of customers.

[deepaklypse @deepaklypse]

Cool idea. No one planned for silicon scarcity, and within a few years that will be addressed. For those who didn't prebuy gear that is considered old today, they have the option of paying inflated prices and hope they trade out before the scarcity premium expires, but somehow buy their replacements without the premium.

Cool story.

[deepaklypse @deepaklypse]

@giffboake @abacaj @InnoboSJ Still cheaper to rent GLM 5.2 than run the infrastructure locally.

[deepaklypse @deepaklypse]

@giffboake @abacaj @InnoboSJ He isn't paying for Fable, this is a silly message.

[deepaklypse @deepaklypse]

@AirCrow @japan_nobunaga Happy workers help the business. That's the only point.

[deepaklypse @deepaklypse]

@AirCrow @japan_nobunaga At one restaurant, the manager told me not to tip at the register--the employees dont get it. I tipped in cash directly to the waiter. YMMV.

[deepaklypse @deepaklypse]

@TheAhmadOsman I dont understand these charts, my problem, because its always... how little inference can you get away with?

I'd love someone to bench mark the current way to run the best models with and without quant at the current time (includes sharding) like Nemotron Ultra3 or GLM 5.2.

[deepaklypse @deepaklypse]

@GhostOfStoneyX2 @newsonstone I would have to have an AI explain this to me, but I'm not in the market. At first blush, it looks beautiful... that is all anyone cares about. For all of the people telling you how you could have done the job, they can share their work.

[deepaklypse @deepaklypse]

@hilldini13 @NoLimitGains lol! Yes, if you buy in now, you totally get a 15% yield!

[deepaklypse @deepaklypse]

@griffieth6585 @elonmusk People scuba dive.