Manoel Gomes Neto

[Manoel Gomes Neto @ManoGomesNeto]

@olabocos Ancelotti viu ele colocando ketchup em pizza

[Manoel Gomes Neto @ManoGomesNeto]

@ZanfaVive @flaviogarag crime ambiental

[Joey Swoll @TheJoeySwoll]

She said it, NOT me!… but she’s right tho. 😉

[MatLab crashes @memecrashes]

gauss🤝🏽gymbros

[Avi Chawla @_avichawla]

CPU vs GPU vs TPU vs NPU vs LPU, explained visually:

5 hardware architectures power AI today.

Each one makes a fundamentally different tradeoff between flexibility, parallelism, and memory access.

> CPU

It is built for general-purpose computing. A few powerful cores handle complex logic, branching, and system-level tasks.

It has deep cache hierarchies and off-chip main memory (DRAM). It's great for operating systems, databases, and decision-heavy code, but not that great for repetitive math like matrix multiplications.

> GPU

Instead of a few powerful cores, GPUs spread work across thousands of smaller cores that all execute the same instruction on different data.

This is why GPUs dominate AI training. The parallelism maps directly to the kind of math neural networks need.

> TPU

They go one step further with specialization.

The core compute unit is a grid of multiply-accumulate (MAC) units where data flows through in a wave pattern.

Weights enter from one side, activations from the other, and partial results propagate without going back to memory each time.

The entire execution is compiler-controlled, not hardware-scheduled. Google designed TPUs specifically for neural network workloads.

> NPU

This is an edge-optimized variant.

The architecture is built around a Neural Compute Engine packed with MAC arrays and on-chip SRAM, but instead of high-bandwidth memory (HBM), NPUs use low-power system memory.

The design goal is to run inference at single-digit watt power budgets, like smartphones, wearables, and IoT devices.

Apple Neural Engine and Intel's NPU follow this pattern.

> LPU (Language Processing Unit)

This is the newest entrant, by Groq.

The architecture removes off-chip memory from the critical path entirely. All weight storage lives in on-chip SRAM.

Execution is fully deterministic and compiler-scheduled, which means zero cache misses and zero runtime scheduling overhead.

The tradeoff is that it provides limited memory per chip, which means you need hundreds of chips linked together to serve a single large model. But the latency advantage is real.

AI compute has evolved from general-purpose flexibility (CPU) to extreme specialization (LPU). Each step trades some level of generality for efficiency.

The visual below maps the internal architecture of all five side by side, and it was inspired by ByteByteGo's post on CPU vs GPU vs TPU. I expanded it to include two more architectures that are becoming central to AI inference today.

👉 Over to you: Which of these 5 have you actually worked with or deployed on?
____
Find me → @_avichawla
Every day, I share tutorials and insights on DS, ML, LLMs, and RAGs.

[Manoel Gomes Neto @ManoGomesNeto]

@Chief117Br Brincar de roleta russa para "farmar" aura

[Steve 🇺🇸 @SteveLovesAmmo]

Sound advice.

[Manoel Gomes Neto @ManoGomesNeto]

@lobotoshasa com café sim

[🎶𝗖𝗹𝗮𝘀𝘀𝗶𝗰𝗮𝗹 𝗠𝗲𝗹𝗼𝗱𝗶𝗲𝘀 ✨ @Old_But_Gold50s]

🎭 Even in the middle of pure chaos, she shows that opera can still soar—hitting every high note flawlessly! 😂🎶

[Manoel Gomes Neto @ManoGomesNeto]

@ZanfaVive Bethoven garçom confirmado

[Manoel Gomes Neto @ManoGomesNeto]

@ZanfaVive Quem cansou de escutar vou o Bethoven

[Manoel Gomes Neto @ManoGomesNeto]

@Chris_Branco Já dei algumas chances. Não mais

[Giga Based Dad @GigaBasedDad]

LOL

[Manoel Gomes Neto @ManoGomesNeto]

@iyoushetwt I bought it at the end of last year. So I'm safe

[Epic Clip Vault @EpicClipVault]

There’s no way… 😮🤯

[Manoel Gomes Neto @ManoGomesNeto]

@helemazevedo no Brasil calvo é rei

[GameVerse @TheGameVerse]

He unexpectedly played Super Mario theme in a concert piano 😍

[Manoel Gomes Neto @ManoGomesNeto]

@ZanfaVive "I want you dust free"

[Manoel Gomes Neto @ManoGomesNeto]

@Bri4nF streamers complaining about drive rush