Piyush Singh

AI Chip Architect.

[Piyush Singh @Piyush3dB]

@mattpocockuk If the spec is deleted right after being generated, how does anyone, including yourself, six months from now, verify the code still does what was decided during ‘grilling’?

[Piyush Singh @Piyush3dB]

@mohanp_ai @akshay_pachaar Not quite textbook.. Ring-reduce is implemented in practice, but the implementation will chose an appropriate algorithm to perform the reduction, depending on the network topology, message size, number of ranks. The ring algorithm is very effective up to a certain node count

[Piyush Singh @Piyush3dB]

@ChShersh OCaml is what strong men would’ve made if they’d thought a bit harder 😅

[Piyush Singh @Piyush3dB]

9/9
The future of AI hardware might be Analog, Digital - or a clever mix of both.
We're just getting started. 🚀

[Piyush Singh @Piyush3dB]

1/9
A new class of AI accelerators is gaining traction—based on analog computing.
They offer blazing-fast, ultra-efficient matrix-vector computations. But there’s a twist... 🧵

[Piyush Singh @Piyush3dB]

8/9
It’s not just about raw efficiency. It’s about flexibility, maturity, and reliability.

[Piyush Singh @Piyush3dB]

@BenjDicken Transfer speed is also a function of physical distance of the memory unit from compute logic, clock frequency, bus width, number of outstanding requests in flight, number of pipeline stages within the interconnect logic.
The viz shows one view of a much more complex system.

[Piyush Singh @Piyush3dB]

@ravivadrevu_ And what’s yiur definition of manager mode?

[Piyush Singh @Piyush3dB]

@ravivadrevu_ @dvassallo Whats your definition of founder mode?

[Piyush Singh @Piyush3dB]

@kenshirriff What are the dimensions?

[Piyush Singh @Piyush3dB]

@NoContextHumans Petauke

[Piyush Singh @Piyush3dB]

@marktenenholtz Your profession is bootcampable

[Piyush Singh @Piyush3dB]

@kauravin_ @karpathy What does “transformer-optimal” mean?

[Piyush Singh @Piyush3dB]

@meghaverma_art Try playing Call of Duty in “Veteran” or “Realism” mode