A big Chinese lab reached out to me asking for help distilling Fable into their model. I said no.
I told them to use the millions of books that have no copyright instead. Offered to help pick them and to help train the model a different way. They only wanted distillation, which tells you a lot about the mindset there.
I've worked deep in this field and distillation is real. I wasn't convinced at one point. What I saw changed my mind completely.
I'm the biggest supporter of open source. I'm for releasing weights and for the freedom to research and build, because humanity only grows when knowledge gets shared. But let's be logical.
Nobody will convince me that labs shipping a model every month or less, each one a big leap, now can't ship a better one after three months.
Kimi K3.1 Pro isn't a big leap over Kimi K3 and it's been about 100 days.
DeepSeek still can't put out a respectable Pro model.
Zai used to release their strongest model in under two months. It's been three with nothing.
All I hear about Qwen 4 Max is that it's a letdown.
Kimi K3.1 Pro and DeepSeek Flash both show traces of Astra distillation. The leak showed Moonshot used it, and so did DeepSeek.
If this isn't the effect of Anthropic blocking distillation then what is it?
Chinese labs need to get serious about using the talented researchers they have and give their models an identity. Right now their models at their best are a cheaper alternative. I want them out of that box. I want to see what makes them different.
Anthropic has crossed lines too, no argument there. They destroyed millions of books, human knowledge that was in people's hands, and kept it for themselves. I'll never forgive them for that.
But Chinese labs rely on distillation more than they rely on better data.
I didn't work with them. Transparency and honesty matter to me, like you've known since I started here.
@sp_yduck Thank you for building OverlaySubs! I now watch English videos with Traditional Chinese subtitles, all running locally. It is fast and the translation feels natural 🙏
台湾から使わせてもらっています。PR をすぐにマージしていただき、ありがとうございました!
OverlaySubs by @sp_yduck puts live translated subtitles over any audio on your computer: videos, streams, calls.
Everything runs on your own machine. Speech recognition uses whisper.cpp, and translation uses PLaMo 3 Translate by @preferred_jp. You need no API key, and your audio never leaves your computer.
My experience on an M5 Max with Whisper large-v3-turbo and PLaMo 3 Translate 8B:
・English videos turn into Traditional Chinese subtitles almost as people speak. It processes 5 seconds of audio in about half a second.
・The Traditional Chinese reads natural to me as a Taiwanese user, with local terms like 檔案, 伺服器 and 影片.
・The overlay stays on top of every window, and you can drag it anywhere.
It is free and open source for Windows and macOS.
https://t.co/leqM4ao7yQ
Let me tell you a story about how unethical Anthropic is.
In April, the Anthropic team began heavily courting our engineering team to tell them corporate secrets, technical details, and future plans for @cfosilvia.
They pretended their interest was due to our exploding popularity and accelerating compute usage, but it quickly became apparent that Anthropic was fishing for details on how we built our product and why it was so popular.
This included the Anthropic team trying to wine-and-dine our engineers, including a infamous steak dinner where someone told our team "don't worry about it, this is on Dario."
Our team was not born yesterday, so we quickly realized what was happening and refused to share sensitive information and technical details with the Anthropic team.
As we suspected, Anthropic was trying to get information from us, so they could build a competing product. Some people on their team must have a guilty conscious because they messaged us a few days ago to give us "a heads-up" that they were launching a competing product.
Thankfully, the Silvia engineering team has been aggressively working to get off the frontier models for the last ~ 6 months. That effort has been highly successful, because our compute costs are ~ 97% lower when we use our own model & hardware, the latency is lower, and the accuracy of answers materially increases as well.
The sad thing for Anthropic is they have now released an inferior product and they had to sell their soul to do it.
The only thing worse than being a trillion-dollar company that can't beat a 10-person team is being a trillion-dollar company that no one trusts and everyone knows is unethical.
Serious investors continue to choose @cfosilvia over ChatGPT, Claude, and other frontier companies because these products are not optimized to solve the actual user problem.
Today, Anthropic launched a Claude wrapper that is masquerading as a personal finance product. Best of luck to them.
But I will take the Silvia misfits vs the Anthropic losers any day of the week.
if you want to support people trying to do things the right way, and help investors be more informed, then consider signing up for Silvia today: https://t.co/4LyYZFRC4m
Mr. Vice-President,
Please allow me to present a different perspective.
The problem was not the Iran War. It was the cease fire.
If you start a war, you need to win it and finish it – otherwise don’t start it.
This war should have been over six months ago, with the Strait of Hormuz wide open and oil flowing. The second and third tiers of Iranian leadership should have been destroyed, and we should have supported the pro-western forces who could have taken leadership. We stood on the brink of a new, more peaceful Middle East - and then we blinked. We had a chance not only to deny Iran nuclear weapons, but to get rid of the world’s biggest supporter of terrorism.
Instead, we had a cease fire, which was followed by months of will we or won’t we finish the job. Every day was a different message. There still is. Is the war over? Is it about to begin? No one knows. There is confusion and inconsistency.
In June 2025, America was not involved. This was an Israel vs Iran issue.
No one forced the United States to attack Iran then, or in February of 2026. It was a decision made by President Trump. In my opinion, it was the right decision.
Once the decision was made, we should not have stopped until the regime fell. But instead, you negotiated a cease fire that didn’t last, didn’t work and left us in no man’s land, with higher prices and our troops still deployed.
Our troops could have been home, the Navy returned to its bases, a peaceful regime in place , new alliances forged, and gas prices below $3.00 a gallon.
No, Mr. Vice President. It’s not the war. It’s the so-called cease fire.
@AriFleischer This is spot on. Going in wasn't the mistake. Stopping halfway was. Now we've got troops still out there, gas prices up, and nobody knows if it's over or not.
> be AI company
> scrape the entire internet
> ignore licenses and copyright
> download millions of pirated books
> use them to train frontier models
> spend tens of millions buying physical books
> cut off their spines
> scan every page
> destroy the originals
> lecture everyone else about intellectual property
> we are the good guys
Why We Should Protect Taiwan the Way We Protected Mbappé
I used to ask myself: would reunification really be so bad?
People on both sides of the strait share the same blood. Families were torn apart in 1949. Many who fled to Taiwan never saw their hometowns, or the relatives they left behind, ever again. Politics robbed them of that. Part of me thought reunification might heal that wound.
I changed my mind. Not because of any politician, but because of posts like this one:
"If I were China's decision-maker, I'd keep the island, not the people. Give them 5 days to leave by whatever means, and bomb everyone who stays to death. With China's industrial capacity, we can fire a million rockets a day. Come back in a month and see which Ultraman is still alive."
Read it again. 23 million people, five days to abandon their homes, and everyone left behind dies. Written like a joke, with a cartoon reference at the end.
They call it "reunification." But you cannot claim to love a people while planning to bomb them off their own land. That isn't reunification. It's ethnic cleansing, said out loud.
And the casualness is the most frightening part. Mao once spoke of a war in which half of mankind might die as if it were a statistic. Decades later, his admirers talk about human lives exactly the same way.
Now think about Mbappé. A week ago most Chinese netizens barely knew his name. Then he made one joke about a meme. Within days he faced a flood of online abuse, lost his sponsors, had his matches pulled from state TV, and was pressured into apologizing in three languages. Most people watching thought: this is too much. No one should be treated like this.
Mbappé went through it for a few days. Taiwan has lived with it for decades: daily threats, military drills on its doorstep, its people dehumanized online, its friends punished economically. I can't imagine what that feels like.
And the playbook doesn't stop at borders. Bully, threaten, punish economically, demand submission. If we stay silent when it's used on Mbappé and on Taiwan, we have already accepted that it can be used on us.
When someone openly fantasizes about bombing every person who disagrees, that is no longer a political opinion. It's a call for mass murder of civilians.
Standing with Taiwan isn't anti-China. It's refusing to accept that 23 million people can be erased because a government wants their land.
Civilizations don’t get murdered by outsiders. They kill themselves — with their left hand.
I’m not asking you to die for the West. I’m asking you to live for it.”
Having spent a long time watching Elon Musk, and having talked with him, I believe I understand what he understood before almost anyone else. And it's something every one of us needs to understand now.
Western civilization is not one civilization among many. It is the one that gave the world freedom of thought, modern science and the dignity of the individual. And it is under attack. Not by peoples, but by ideologies that want it dead.
If it dies, the world will not become more just. It will become poorer, more brutal and darker. For everyone, including those who hate it.
Why? Because civilizations are not interchangeable. We were told that any culture could be blended with any other, like mixing colors, and that the result would always be harmonious. It isn't true. A society where women are equal to men cannot coexist without friction with a worldview in which a woman's testimony is worth half a man's. A society where you can criticize God, change your religion or have none cannot absorb, without fracturing, a worldview in which apostasy is paid for with your life.
Every people has its own genius and moves at its own pace. But not all values are equal, and you cannot build a nation on laws that contradict each other. Saying so is not racist. Racism is about blood. I am talking about laws, customs and values. And those values belong to no race: a Japanese, a Senegalese or an Iranian can make them his own, and millions have. That is exactly why they are worth defending.
Let's remember where they come from.
It all begins in Greece. In Athens, for the first time, men decide that truth does not descend from a throne but is sought through reason, and that a city governs itself through debate. Socrates chooses death rather than give up thinking freely. At Salamis, a handful of free cities stops the greatest empire in the world.
Then comes Rome. Rome invents law that binds everyone, the citizen who holds rights, the Republic. And one immense idea: you can become Roman without being born Roman. You become Roman by adopting its laws.
Christianity adds the most revolutionary idea in history: every human being, slave and emperor alike, has infinite worth.
Then France. The cathedrals, those ships of stone our ancestors built over centuries for descendants they would never see. Descartes, Pascal, Voltaire. The Declaration of the Rights of Man. And Napoleon, who gives France the Civil Code, the lycées, and one simple principle: careers open to talent. Murat, the son of an innkeeper, ends up a Marshal of the Empire and King of Naples. The Civil Code spreads across much of Europe and still shapes the law of dozens of countries today.
And this civilization goes on to abolish slavery, which had been practiced on every continent since the dawn of time, to push back the plague, smallpox and the night itself, and to set foot on the Moon.
Peoples of the West, be proud of this history. Proud does not mean blind. Every civilization has committed crimes: conquest, slavery, war. Ours is the one that went furthest in examining its own faults, to the point of abolishing what it had once practiced. This capacity to question itself is its greatest strength. And that is exactly the strength now being turned against it.
Because for decades, this magnificent system has been getting hacked. Not by an army. By an alliance of two forces that have nothing in common except one enemy: us.
The first is communism. It lost the economic war, lost the Cold War, lost history's verdict with its tens of millions of dead. But it never lost the universities. It survived by changing costumes: class struggle became the struggle of the oppressed against their oppressors, and the West was declared guilty of everything. It taught our children to be ashamed of their ancestors, their borders and their culture. It is the root cause, because before you can bring down a civilization, you have to take away its will to defend itself.
The second is political Islam. I am not talking about Muslims, many of whom came here precisely to escape this ideology and are its first victims. I am talking about a political project that wants to place religious law above civil law. It has no doubts. It feels no shame. It rushes into the void the first one dug.
One disarms. The other advances.
And let no one on the left believe they will stay in control. History has already staged this play. In 1978, Michel Foucault was enthusing over the Iranian revolution. Iran's communist party, the Tudeh, backed Khomeini and called on Iranians to vote for his Islamic constitution. By 1983, its leaders had been arrested, the party banned, and its chiefs paraded on television to confess their “crimes.” In 1988, thousands of political prisoners were executed, communist activists among them. The second always ends up devouring the first. Useful idiots are only useful for a while.
So here is my call to every Western people. To the French, the Italians, the Poles, the Germans, the Spanish, the Americans, to all of you.
We are at a turning point. What we do in the next ten years will decide what our grandchildren are allowed to say, believe, write and love.
I am not asking you to die for the West. I am asking you for something harder: to live for it.
Learn its history and pass it on. Have children. Speak without fear, even when they call you every name in the book. Vote, get involved, run for office. Build companies, schools, factories, families. Refuse the shame they are trying to inject into you. And stop surrendering anything that makes us who we are: freedom of thought, equality before the law, the dignity of every person.
The historian Arnold Toynbee understood it: civilizations are not murdered, they commit suicide. And those who think they can let the West fall without paying the price should remember the Iranian communists. They helped tear down what they despised, and then they were next.
The Greeks at Salamis were outnumbered. They won because they knew what they were defending. We are the heirs of Athens, Rome, Notre-Dame and the Civil Code. It is no accident that the rockets that will carry humanity to Mars are being built in a free civilization.
It is time to prove ourselves worthy of what we were given.
The West is worth defending. And no one will defend it for us.
In almost any large city on Earth, if the entire power grid collapses at three in the morning and every streetlamp and alarm goes dead, store owners board up their windows to stop looting.
At 3:08 a.m. on September 6, 2018, a magnitude 6.7 earthquake struck Hokkaido, Japan, knocking out one hundred percent of the electricity for all 5.3 million residents.
Every traffic light, ATM, and refrigerator across the island went dark at once.
Instead of locking their doors or raising prices, clerks at Hokkaido's local convenience store chain, Seicomart, opened their emergency kits before dawn.
Years earlier, the company had equipped every store with power inverters designed to plug directly into the twelve-volt car batteries of employees' vehicles parked outside the front doors, alongside propane gas rice cookers that do not rely on electric lines.
By sunrise, over ninety-five percent of their one thousand one hundred stores were open.
With cables running from idling cars into the registers, clerks cooked fresh, steaming hot salted rice balls over propane flames by lantern light and sold them for the exact same one-dollar price as the day before.
Outside in the dark, thousands of hungry neighbors stood quietly in single-file lines, counting out exact coins and bowing to the exhausted staff.
Civilization is revealed when the lights go out.
Recently I was talking with a friend about universal geniuses. And something struck me.
Florence, 1480–1510. Same city, same moment: Leonardo da Vinci, Michelangelo, Machiavelli, Botticelli, Pico della Mirandola. Raphael right behind them. They walked the same streets.
Europe, 1600–1700. Galileo, Kepler, Descartes, Pascal, Huygens, Newton, Leibniz. In two generations, we got calculus, modern mechanics, probability theory, and the scientific method.
Athens, 470–320 BC. Socrates, Plato, Aristotle, Sophocles, Phidias, Thucydides. One century, one city, and the foundations of Western thought were laid.
Europe, 1890–1930. Poincaré, Hilbert, Einstein, Marie Curie, Tesla, Planck, Bohr, then von Neumann.
Always the same pattern. In every great era, the West had 15 to 20 minds of this caliber alive at the same time. People who could touch everything and push the frontier of several fields at once.
Today we have one. Just one. Elon Musk.
And Elon is an anomaly.
Not in the sense that he shouldn't exist. In the sense that the world we built is designed so that someone like him never emerges. Statistically, he shouldn't be here.
Because what forged Elon was an absolutely insane move.
October 2002. eBay buys PayPal. Elon walks away with roughly $180M. Anyone else buys an island and never works another day.
He puts $100M into SpaceX, $70M into Tesla, $10M into SolarCity. Almost everything. On rockets and electric cars, two industries no sane person wanted to touch.
2006–2008. The first three Falcon 1 launches fail. Tesla is burning cash, the financial crisis hits, investors run. He has enough left for one last launch. Just one. He borrows money from friends to pay his rent.
September 28, 2008. The fourth launch reaches orbit.
December 23, 2008. NASA awards SpaceX a $1.6B contract.
December 24, 2008. The Tesla round closes at the last possible hour. A few more days and everything collapses.
That's what a genius is. Not just IQ. The ability to put everything on the table when the entire world tells you it's impossible, and be right.
Now the real question: why do we only have one?
Because a genius needs three things. The freedom to try. The right to get massively rich if it works. The right to fail without being destroyed.
And that's exactly what the collectivist left and the technocrats have torn down across the West for the past 50 years.
They turned success into suspicion. Making a lot of money became a moral failing. Taking risks became irresponsible. Rising above the crowd became an insult to equality.
They stacked up norms, committees, permits, regulations written in Brussels by people who have never built anything in their lives. In Europe, Elon would never have been allowed to blow up three rockets. He'd have been stopped at the first form.
They want to tax capital before it even exists, cap fortunes, redistribute what others created by risking everything.
They replaced excellence with conformity. Our schools produce docile people, not dangerous ones. And a genius, by definition, is someone who disrupts. Their entire system is built to neutralize the people who disrupt.
The result: where we should have 15 to 20 universal geniuses alive at the same time, we have one.
Just one.
And you want to put him in prison.
You summon him before judges, you raid his offices, you insult him morning, noon and night, you dream of breaking up his companies. The man who lands rockets vertically and wants to take humanity to Mars.
You're disgusting.
History won't remember your names. It remembers Galileo, not the inquisitors who tried to silence him.
On a 3090 Ti under Linux: one card, Ubuntu 24.04, driver 580.178.04. Numbers are my own.
1. BF16/FP16 half-rate unlock (Zagitta/gpu-unlock)
GEMM went from 85 to 141 TFLOPS in bf16 and from 84 to 136 in fp16.
It only takes effect after a full power-off. A warm reboot fails. Run journalctl -k -b | grep gpu_unlock and look for "unlocked".
It is an unofficial kernel module, so use it at your own risk.
2. NVENC session limit (keylase/nvidia-patch)
Concurrent encodes went from 8 to 32, and all of them worked.
Total throughput stays the same, though: about 930 fps for 720p H.264 and about 445 fps for 1080p. More streams just split it.
An apt driver update overwrites the patch, so rerun it after every update.
3. Power limit (nvidia-smi -pl 400)
Each image takes 7.6% longer, but power draw drops 16% and energy per image was the lowest of the limits I tried. Peak temp went from 78 to 74°C, and the output is pixel-identical.
At 300 W it is 53% slower and saves no extra energy.
The -pl setting resets on reboot, so apply it from a systemd unit at boot.
4. ComfyUI
--use-sage-attention is about 3% faster, with no quality difference I could see.
--fast fp16_accumulation did nothing on my int8 model. The output was pixel-identical.
5. Not worth the effort
P2P unlock does nothing with a single card.
Ampere has no AV1 hardware encoder (av1_nvenc failed when I tried it).
From reading, not measured: vGPU and MIG are not possible on consumer cards, and for ReBAR, enabling it in the BIOS is enough.