Igor Pener

[Igor Pener @igorpener]

Tried to build a floor that heats spaces with compute power. Here's why the idea was shelved and where things are now:

tl;dr: Interconnecting is hard, 4090s are unbeatable and software is king

🧵👇

[Igor Pener @igorpener]

@__tinygrad__ @clattner_llvm Big fan of both projects but once next gen models output HW instructions natively compilers/frameworks become obsolete. And we’ll need much better inspection/debugging tools (prob also AI enhanced)

[Igor Pener @igorpener]

@yunta_tsai Pretty cool, what device is this?

[Igor Pener @igorpener]

@yunta_tsai Would have to come with an asteroid defense system

[Igor Pener @igorpener]

@elonmusk It needs a defense system

[Igor Pener @igorpener]

@danpacary Need to put the NVIDIA AGX Thor on this chart. Fewer FLOPS than Spark but it supports tcgen05 instructions

[Igor Pener @igorpener]

@__tinygrad__ 💯

[Igor Pener @igorpener]

@yunta_tsai Jetson AGX Thor is the flex. Unlike DGX Spark it supports tcgen05 instructions 👌

[Igor Pener @igorpener]

@yunta_tsai 💯 a monitor with a display controller and one port does the job 😁

[Igor Pener @igorpener]

@aaronburnett won’t make sense to tokenize images/videos for much longer… diffusion ftw

[Igor Pener @igorpener]

@liu_mingyu Congrats

[Igor Pener @igorpener]

@jack 😁

[Igor Pener @igorpener]

@RajaXg Wow

[Igor Pener @igorpener]

@SemiAnalysis_ 😁

[Igor Pener @igorpener]

@__tinygrad__ DDR5 might be obsolete by then

[Igor Pener @igorpener]

@elonmusk Very cool! Would be awesome if you replaced xchat with a simple @telegram protocol integration

[Igor Pener @igorpener]

@elonmusk Final piece will be collecting the Roadster in space and bringing it back to Earth 👌

[Igor Pener @igorpener]

@PalmerLuckey One day 🤞

[Igor Pener @igorpener]

@__tinygrad__ That means tinygrad depends on Mesa’s NAK/NV backend which does not support the latest SASS instruction set, right? tcgen05 missing is a big deal

[Igor Pener @igorpener]

@yunta_tsai 💯 FP4 stores way too little information. Even FP8.

[Igor Pener @igorpener]

@AravSrinivas Yes but the countless legacy OS layers the system runs on slow it down by an order of magnitude