Mohammed Moiz

[Sean Lie @seanlie]

Ten years ago, we started @cerebras around an approach many believed was impossible.

As a computer architect, it is hard for me to imagine a more exciting time. Model releases are accelerating, and hardware tapeout is compressing from multi-year roadmaps to annual launches.

Hot Chips is my favorite conference, and it’s where I launched Cerebras 7 years ago. This year’s conference was especially exciting, and so much innovation was shared. I am watching the industry recreate itself: SRAM is mainstream, DRAM is moving into the third dimension, networks are being fundamentally redesigned, and AI is helping design and program the chips themselves.

The industry has never moved faster and some of the hardest architectural questions are still wide open.

[Andrew Feldman @andrewdfeldman]

What is semiconductor yield?
How does it work?
Why did it define the semiconductor industry for 70 years?
How did this problem get solved?
And how does this impact developers?

What Is Semiconductor Yield?

When you manufacture chips, not every one comes out working. Some have defects.

“Yield” is the percentage of chips from a manufacturing run that actually work. If you make 100 chips and 90 work, your yield is 90%.

How Does Yield Work?

Chips are made from silicon wafers - thin, circular discs about 12 inches in diameter.

In a perfect world, every square millimeter of a wafer would be flawless.

But that never happens. Every wafer has tiny random defects scattered across it.

Chips are cut from these wafers.
And any chip that lands on a defect is thrown away.

The process of chip manufacturing looks a lot like your mother making cookies.

Imagine your mom rolled out a circle of cookie dough 12 inches in diameter.

Then when she wasn't looking, your brother threw a handful of peanut M&Ms into the air and they landed at random on the dough.

Those M&Ms are flaws.
Nobody can eat a cookie with a peanut M&M in it.

So she has to throw away every cookie that has one.
Now she gets out a small cookie cutter and stamps out cookies.

Because the cookie cutter is small, the probability of hitting an M&M is low. And when a cookie does have one, there isn't much good dough surrounding it.

Not much good dough is thrown away.

The result: a lot of good cookies.
They are small but there are a lot of them.

On the other hand, if she uses a big cookie cutter, the probability of hitting an M&M is much larger.

And when she throws that cookie away, she throws away a lot of good dough with it.

The result: only a few cookies.

They are big, but the 12 inch diameter circle of dough yielded only a few.

This is exactly how chip manufacturing works.

The cookie dough is a silicon wafer.
The cookies are chips.
Peanut M&Ms are flaws (because they are gross)
Bigger chips hit more flaws.
More good silicon gets thrown away.

Smaller chips, like smaller cookies, are less likely to hit flaws.

And when they do, less silicon is discarded.

This is why big chips are disproportionately more expensive.

This is also why people assumed that because there was no way to make a wafer without flaws, there was no way to make a chip the size of a wafer.

Why Did This Define The Industry For 70 Years?

In an ideal world, you'd build really big chips for many data center applications.

Data moves incredibly fast on-chip.

So if you keep the data and compute on-chip, your work takes less time, and uses less power.

In AI, that manifests as super fast inference.

But the moment data has to leave one chip and travel to another - through cables, switches, connectors, circuit boards - it slows down and uses more power.

Lots of off-chip communication slows work, and, in AI, produces slow inference.

Though everyone agreed they were faster, nobody could yield big chips.

So the industry settled on a workaround: don't build one big chip.

Build thousands of small ones and wire them together.

Most AI data centers are built this way today.
Thousands of little GPUs connected by cables, switches, and networks.

It works.
But you pay a price.

Every connection adds latency.
Every cable adds overhead.
Every hop between chips slows things down.
For 70 years, everyone accepted this as the only way.

How Did Cerebras Solve the Yield Problem?

In 2019, we solved the yield problem at @cerebras and brought the first wafer sized processor, wafer scale processor, to market.

How did we do that?

The answer came from studying a different kind of chip entirely. Memory.

Memory is built with a different process.
Memory chips are made up of millions of identical tiles, with redundant tiles woven throughout.

In a memory chip, if a tile has a flaw in it, the chip doesn't get thrown away.

The bad tile is shut down and one of the redundant ones is called into action.

Memory chips weren't designed to avoid flaws, but rather to withstand them.

They use redundancy to withstand flaws.
And their yield is extraordinary.

Our founders realized that if we could develop a compute architecture that looked like memory, that was built of hundreds of thousands of identical tiles, we too could use redundancy to withstand flaws.

We could fail in place, and route around the failed tile, just as they do in memory (and interestingly as they do in data centers where they fail in place, route around, and keep going). This would enable us to yield a wafer scale processor.

And today we are happy to compare our yields to GPUs, that are 1/58th our size.

How Does This Impact Developers?

The impact is simple and easy to see. Cerebras wafer scale processors are up to 15 times faster than @nvidia GPUs.

And when your AI is fast, people use it more often, stay longer, and use it to solve more interesting problems.

[OpenAI @OpenAI]

GPT-5.3-Codex-Spark is now in research preview.

You can just build things—faster.

[Cerebras @cerebras]

OpenAI Codex-Spark powered by Cerebras

You can now just build things faster—at 1,000 tokens/s.

[Andrew Feldman @andrewdfeldman]

The fastest AI processor in the world the @cerebras WSE is having fun in Davos.

[Cerebras @cerebras]

OpenAI🤝Cerebras
https://t.co/KN31O9SNIC

[Sarah Chieng @MilksandMatcha]

After 9 years at NVIDIA, James Wang left and joined @cerebras.

In this Big Chip Club episode, @draecomino exposes the early days of NVIDIA, working with Jensen himself, and taking a bet on the next generation of compute.

[Cerebras @cerebras]

Not sure what events to go to for AI Tech week?

Our intern @KevinTaylor00 used @browser_use to scrape all of the events in record time.

With Cerebras, the agents can now take 30+ steps per minute.

⚡️Go give it a try. It's super fast ⚡️

[Mohammed Moiz @MohammedMoiz7]

@yousef_ki1 .

[TIMES OF GAZA @Timesofgaza]

“Where is mama?”

#Gaza

[Al Jazeera English @AJEnglish]

UN delegates walked out as Israeli PM Netanyahu took the stage at the UN General Assembly.

Other world leaders condemned Israel’s genocide in Gaza, while a further 10 countries recognised Palestinian statehood. Observers say Israel has never been more diplomatically isolated.

[Al Jazeera English @AJEnglish]

Israel’s renewed air attacks on Gaza have killed more than 400 Palestinians, including many children. Here are some of their stories ⤵️

[Sen. Bernie Sanders @SenSanders]

Netanyahu has not allowed any food, water, or fuel into Gaza in two weeks.

Now he has resumed bombing, killing hundreds of people and breaking the ceasefire that had given Gaza a chance to live again.

NO MORE MILITARY AID TO ISRAEL.

[BreakThrough News @BTnewsroom]

BREAKING: Thousands of protestors in NYC march through the streets, condemning Israel's attacks on Gaza and calling for a free Palestine

[Dr.Hamza Alsharif 🇵🇸 @Hamzasharif5750]

If I die, I am not a number, I am a planet in itself, I have dreams and ambitions that I wanted to achieve.

Don't forget me in your prayers and keep talking about me

[• @Alhamdhulillaah]

Ya Allāh invite me to Your House ❤️ 🕋

[Gaza Notifications @gazanotice]

🚨Breaking : Gaza Health Ministry's latest toll confirms at least 200 Palestinians killed and countless injured due to Israel's mass bombardment campaign in Gaza.

[Dr. Omar Suleiman @omarsuleiman]

All of you who feign outrage for the Israeli hostages and mock the deaths of tens of thousands of Palestinian children, may these murders haunt you for eternity

[Elon Musk @elonmusk]

❤️🚀🚀❤️

[Elon Musk @elonmusk]

SpaceX Dragon ship arrives at the Space Station