Strategy and partnerships at Fractile
Also writing on trade, tech and industrial policy
Former UK civil servant and diplomat, 好異史者, he/him
(usual caveats)
"Middle Power" discourse mostly just seems like a variant of managed decline. Taiwan has a population of 23m people and yet arguably the most important trillion dollar company in the world. We should aspire to greatness!
@goodwin_ml joined @HarryStebbings on @twentyminutevc to talk about Fractile's technology, building a frontier AI company in the chip layer, and why he believes the AI buildout will only continue to scale.
https://t.co/Q8HQzIofmj
https://t.co/Jj1sec03IJ
Walter Goodwin believes the world's most capable AI models are held back from delivering on their potential by the chips of today. Yesterday his company, Fractile, announced a $720M Series C to fix that.
Walter, an Oxford PhD, founded Fractile in summer 2022, on a bet that there would be a huge dividend to speed in running AI models. The round is led by Thrive Capital, Founders Fund, Lightspeed and Redpoint, and comes six months after Fractile's $220M Series B.
We sat down in London to discuss the future of semiconductors alongside Sir Robin Saxby, the founding CEO of ARM, who started one of the largest companies ever to come out of the UK with 12 engineers in a pub.
Congratulations to @goodwin_ml and the @fractile_ai team. Enjoy this one!
TIMESTAMPS
0:00 Intro
1:24 Starting Fractile
6:01 Inference Is the Profit Center
9:39 Chips Over My Dead Body: The Founding of ARM
18:45 The Art of the Opinionated Chip
25:09 Breaking the Memory Wall
32:15 How ARM Picked Winners
38:23 Robin Calls a Correction
42:51 The Stickiness of the Transformer
46:49 Is There a Limit to AI Demand?
56:11 How TSMC Became the Standard
57:44 AI-Designed Chips
1:03:52 Brutal Honesty
We have raised a $720M Series C, led by @ThriveCapital, @lightspeedvp, @Redpoint and @foundersfund, to allow us to run faster in shipping the world's fastest chips for AI.
We've seen over the past year that many of the hardest problems that humanity faces - in science, medicine, physics - may be solved in our lifetimes by AI.
One hallmark of AI applied to the toughest problems is that extreme scaling of inference compute becomes vital. In tackling a Millenium Prize problem, for instance, @OpenAI ran 10,000 parallel agents for 80 hours. Costing over $10M, this level of capability is far from democratised today.
When we study agentic scaling, there are two paths: parallel, and sequential. In just the same way that most hard problems solved by humans don't parallelise efficiently, we see the same with agents: fewer agents, thinking for longer, scales better in every way except for the time that you wait for a response.
Building radically faster inference hardware, which doesn't force a trade-off on throughput, model sizes or context lengths, is a key step in bringing down the cost and time we incur in solving our hardest problems.
We're thrilled to be backed to bring this to the world!
We’re delighted to announce that Fractile has raised $720M in a Series C led by @thrivecapital@foundersfund@lightspeedvp and @redpoint, with further participation by brilliant new and existing investors.
Immense that Fractile have raised Europe’s largest-ever semiconductor funding round.
It’s great to see the UK developing frontier AI chip capability. Congratulations to @goodwin_ml and the team!
We are hiring a Head of Private Office and two Private Secretaries at @AISecurityInst to work with me (Chief Strategy Officer) and @HZoete (Director).
If you’re sharp, ambitious, and want to help us run an important and fast-moving organisation, read on!
Today, Baroness Campbell of Surbiton delivered a speech in the @UKHouseofLords using an AI recreation of her voice, built by ElevenLabs. A first for the UK Parliament.
Baroness Campbell has spinal muscular atrophy, which affects her speech. The Baroness has now created an AI voice that replicates the tone, rhythm, and pitch of her original voice.
Our technology has now been used to restore the voices of more than 11,000 people who have lost their voices through injury or illness, and we’ve committed to help one million people living with voice loss around the world.
We want people to have the freedom to move to a better job and help our most promising businesses grow.
Today, the PM announced we will legislate against non-compete clauses, so they no longer hold back workers or stand in the way of startups hiring the talent they need.
We’ll also bring forward options to tackle wider restrictive practices, like excessive notice periods.
We have to empower the people taking risks to build something, giving them the freedom to start and scale.
NON COMPETES BANNED
Today, the PM has announced that his Government will legislate to functionally ban non-compete agreements for startups and scaleups in the UK or as he called it - the Bosman ruling for ruling for the innovation sector' 😂
At the @StartupCltn been working on this for months and we think it’s a huge potential unlock for our tech ecosystem.
Here’s what you need to know…
- Measures to functionally ban non-competes for startups and scaleups in the UK are going to be set out.
- There will also be consultation on a wider set of restrictive practices including gardening leave.
- More detail on these plans at the budget in a few weeks (Wednesday 28th October) including a timetable for consultation with a view to legislation in the coming months.
We think this is a huge move and so do lots of friends including so many of the great founders that signed the letter with Inherent just the other week.
Why? Because talent matters and mobile talent means startups can build. The Valley was built on free-flowing talent. In the UK, we’re now seeing our own versions of this story with companies being built from alumni of both homegrown firms like Revolut and beyond. But we need that to move faster. Hiring and building faster means British startups and scaleups can grow faster. Barriers to that slow our ecosystem down.
We won’t pretend it will be perfect, and people (including some of our friends but also lots of fairly vested interests too) will have a right to disagree. But we think that startups will thrive and win in a faster paced Britain.
So we are delighted with the progress today - as part of a strong speech by the PM outlining his ambition for building the world’s leading innovation nation including more on tax, growing companies outside London and more. But this is the start, not the end of the process. The announcement launches a consultation. It doesn't mean the issue is settled. How far reform goes, and what it looks like on the ground, is still to be decided.
The Prime Minister today has done something that can materially impact the trajectory of the UK tech ecosystem and with it our economy - but only if we make sure it’s delivered. So, the real work starts now.
Really fun @NoPriorsPod with @goodwin_ml founder of @fractile_ai
topics:
- how to win the ai chip market, structurally
- ai for chip design, what’s compressible
- the need to be a frontier lab to serve frontier labs
- solving memory bandwidth
- new hardware scaling laws
The Triple Lock is a poorly designed policy. It has consistently cost more than intended due to its built-in ratchet.
Wage growth tends to lag inflation by about 9 months, which means the same price increase leads to the state pension increasing *twice*.
The state pension has ended up outpacing wages and inflation consistently since the triple lock was introduced. The Prime Minister is absolutely right to rethink it!
Check out the tool and compare options for yourself here: https://t.co/DGlBlvE86B
In the long run, the triple lock is unsustainable. If you increase pensions more than wages & you have an aging population then the sums don't add up. Any politician proposing to keep the triple lock forever is either lying or innumerate. The question is how when & how to stop.
After years of cross-party inaction, Burnham deserves huge credit for scrapping the triple lock just 10 weeks into his premiership.
The fairest and most fiscally responsible choice.
Absolutely we are becoming like Stalin's Russia. Under Andy Burnham everyone with and MBE is sent to the Gulag, while the secret police denounces elderly chaps as "kulaks" as they force them out of their allotments and onto collective farms.
You write as if the entire pension is being abolished. Nonsense. Triple lock was introduced in 2010 to solve a problem ,, but now it’s not necessary.
I’d rather have a decent care system, so would many OAPs.
I was a very fortunate kid. My dad's GP surgery sat between the Dell and Hampshire's County Ground, so at weekends I could go to a game and get a lift home afterwards. It left me with a passion for both sports and a belief that sport opens a window onto who we are.
When I was growing up, the Tebbit test was a matter of intense debate. Which side did you cheer for at the cricket? For all the criticism it received, it was a test anyone could pass. If you supported England because you saw it as home, you were part of the team regardless of the colour of your skin. Born in Southampton, 10 year old me passed it without even knowing about it.
Giving the @MCCOfficial's Cowdrey Lecture on Thursday made me think about cricket's place in our national life and the current arguments about identity.
In Britain we've built the world's most successful multi-faith, multi-ethnic democracy. I was a beneficiary of it. Whatever issues people had with me as PM (and there was no shortage) my race and religion weren't among them. I could read a lesson at the King's coronation or light Diwali diyas on Downing Street with my daughters without controversy. Foreign leaders assumed these must be huge symbolic moments. For most Brits, they just weren't that big a deal.
But Britain's democratic achievement is now under strain. Some of the challenges are ones I've written about before, like Islamism, and the failure of governments, including the one I led, to adequately control immigration. But something else is going on - a risk that we start equating skin colour with nationality.
After I left office, a debate kicked off here on @X about whether I was English at all, because I was a "brown Hindu". During the election campaign I'd been shocked when footage was broadcast of someone calling me a "Paki." It was shocking precisely because it was so unusual. That kind of abuse had simply not been a feature of my political life. But the Englishness argument was stranger still. Call it the reverse Tebbit test. If you're not white, it no longer matters who you support at the cricket, because you can never be English. It's a test no non-white person can ever pass.
I have no truck with people who offend our sense of fairness and come here illegally; I spent half my premiership trying to deport them to Rwanda. I think the bar for legal migration should be high. It is entirely possible to want a radical reduction in immigration and a far more robust approach to integration, and still totally reject the attempt to turn Britishness into a DNA test.
If you're born and brought up in England and view it as home, what are you other than English? Denying people their Englishness or their Britishness because of the colour of their skin is a recipe for alienation and a two-tier society. How are children who hear this meant to feel?
Sport can play a small but significant role here. Cricket is played by nearly every major ethnic group in this country. Ask what my largely white rural constituents in the Dales and the British-Asian kids in Bradford have in common, and the answer is cricket. If cricket can produce England teams in which every kid can see themselves, the impact reaches far beyond the boundary.
As I write in @thetimes today, we must all be on the same side, cheering for the same team.
We cannot allow race to be reintroduced into our politics. We cannot allow Briton to be set against Briton.