Happily retired & Debt-free 🏖️ Trading the corporate rat race for the calm pursuit of value investing. Here for financial wisdom, witty banter, & good laughs.
Reflecting on the dramas in the past few days and grateful for what I Ching taught us in the very 1st chapter:
“The dragon flies too high and regrets:
Fullness cannot endure forever.
When all lines are nines,
It reveals the Heaven’s way:
True power does not claim to lead.”
Hong Kong Chief Executive Policy Address has laid out clear steps to develop the city as #Gold hub
Besides using its Exchange Fund (USD 570B) to increase gold holding and participate in spot and futures in Hong Kong, it allows the city pension fund MPF (USD 214B) to buy gold ETF
These measures will add liquidity to the city gold trading
https://t.co/kmPDJQdiBf
So basically now we have America accusing China of using slaves to pick cotton, Japanese saying China is populist and militarist, Canadians saying China oppresses indigenous people, and Indians saying China has a caste system.
So basically China is a mirror.
DeepSeek V4.1 Flash Is an Architecture Reset, Not Just a Cheaper Model
Despite having more total and active parameters than its predecessor, V4.1 Flash cuts working KV cache to one quarter and persistent cache storage to one eighth.
Zhihu contributor Exhalation explains how it does this by deleting old modules, sharing KV states, and recomputing local context.
1️⃣ DeepSeek removed its own previous ideas
🔹 MTP: external draft models such as DSpark weakened its speculative-decoding value, while the auxiliary loss no longer justified its memory cost.
🔹 Heavily Compressed Attention: its global-summary role was ambiguous and difficult to combine with FP4 storage.
🔹 Dense warmup: V4.1 trains sparse attention from scratch rather than starting with one trillion dense-attention tokens.
2️⃣ Store less, reuse more
Non-SWA KV cache moves from FP8 to FP4, while the more sensitive SWA portion remains FP8.
DeepSeek no longer persists SWA cache. When a conversation forks from an earlier point, the system rebuilds only a small local window. Post-training simulated this process to limit numerical drift.
A modified YOCO design provides the other major saving. Upper layers reuse the same lower-layer source representation, adding only a layer-specific projection.
The result is roughly half the KV storage and close to 50% less historical prefill computation in the idealized case.
3️⃣ Sparse attention reuses its search
Sparse attention lowers attention cost from O(n²) to O(kn), but finding the top-k tokens can still retain an O(n²) component.
V4.1 Flash either reuses an earlier layer’s top-k result or selects a smaller candidate-block pool before re-indexing.
This prevents token selection from becoming the bottleneck at long context lengths.
4️⃣ Engram and mHC were streamlined
Engram replaces an expensive second-order optimizer state with a Sinkhorn-style update, removes causal convolution, and extends matching from 3-grams to 4-grams.
mHC reorders residual mixing across layers, reducing estimated I/O from (4n+4)d to (3n+2)d.
✅ The larger pattern
DeepSeek is not merely compressing an existing model. It is willing to discard its own previous components when a cheaper system-level design emerges.
V4.1 Flash is less a smaller V4 than a new answer to one question: how much intelligence can be delivered per byte of memory and unit of inference cost?
🔗 Full analysis:
https://t.co/UToM7xMAgH
#DeepSeek #DeepSeekV41 #LLMArchitecture #AIInfra #KVCache #SparseAttention
It's actually pretty insane how much Apple copied Huawei for the new iPhone Duo.
At first I was absolutely convinced the guy in the video below 👇 was holding the new iPhone but no, he's holding the Huawei Pura X Max - released 6 months ago!
🚨Huawei just unveiled the world’s first 3D data center.
Four layers, stacked vertically:
· Cooling at the bottom
· Ascend 950 supernodes on floor two
· Power on floor three
· Batteries on the roof
The modular design cuts the mechanical and electrical delivery cycle from 6 months to 3, with a prefabrication rate above 90%.
#DataCenter #Huawei
Pinglu Canal is now open.
China’s first river-to-sea canal—134.2 km, 5,000-tonne vessel capacity—links SW China to the Beibu Gulf facing SE Asia, creating a new gateway for China-ASEAN cooperation and opening-up.
THE U.S. CAUSED THE COVID PANDEMIC, not China, the U.S. government revealed today.
“It's time the American people learn the real story," spy chief Tulsi Gabbard in a sensation-causing video released on X and a statement on the internet.
And what a story it is.
.
TRUTH AT LAST
The US spent millions to finance a lab in China’s Wuhan to experiment on killer viruses.
The research was on a technique called “gain of function” which some people see as weaponization of the viruses.
That research is “now widely viewed as the source of the unintentional lab leak that sparked the pandemic,” said Gabbard, Director of National Intelligence.
“This dangerous research caused immeasurable harm and countless lost lives,” she added.
.
PREFERRED NARRATIVE
After the pandemic broke out, Washington then worked to tell the world it could not have been a lab leak.
The preferred story circulating at the time was to say that animal-to-human transmission evolved in China due to the circumstances there.
But the evidence tells a different tale, the US spy chief said, releasing a new batch of top secret documents today, her last day in office. "It's time you know the truth," she said.
.
120 BIOLABS
The story begins with the US quietly setting up 120 biological laboratories across more than 30 countries. Some of these laboratories were involved in research on hazardous pathogens, she said.
Dr Anthony Fauci, while serving as head of the National Institute of Allergy and Infectious Diseases, sent millions of dollars of US taxpayer cash to be spent on bat coronaviruses at the Wuhan Institute of Virology, she said.
In 2019, the Covid-19 virus apparently emerged in several locations around the world—but was first formally detected by scientists in Wuhan, China, at the end of 2019.
It was soon found all over the world. The “pandemic caused tremendous hardship and pain for millions,” Gabbard said.
.
PREFERRED NARRATIVE
For the US, the preferred story was that it was NOT a lab leak—because the world would realize that the Pentagon was financing biolabs around the world, and at home.
People raising the alarm about the biolabs were accused of “pushing Russian and Chinese disinformation”.
When the existence of the labs could not be denied, the BBC and other media reported that they were “peaceful labs” which were financed for entirely positive reasons—a line that Pentagon-watchers found hard to swallow.
.
LIED ABOUT INTELLIGENCE CONNECTION
Fauci worked with senior intelligence agents in the early days of the pandemic to shape the narrative but lied about it, Gabbard said.
In his testimony before the House Select Subcommittee on the Coronavirus Pandemic in 2024, he was asked under oath whether he had communicated with intelligence agencies concerning viral research before, during or after the pandemic.
Fauci replied: "Not to my knowledge, about COVID."
In January 2025, many people were puzzled when Former President Joe Biden issued “a pre-emptive pardon” to Fauci. Pardons, by definition, are given to people who have broken the law—but this had not happened at that time.
.
TREMENDOUS HARDSHIP
Gabbard is retiring to spend more time with her husband, who has cancer.
But she wanted to get the truth about this subject out there before she disappeared. She says the evidence indicates US-funded research was the root of the problem.
"The COVID-19 pandemic caused tremendous hardship and pain for millions of our fellow Americans and for countless people around the world,” she said.
Links to her statement and the documents are provided below.
To Japanese who are going through the QTs,
It is extremely disrespectful to honor the lives of your ancestors who brutalized other country’s citizens in that country. She’s not paying respect. She’s distorting history.
At least express regret and shame for what happened.
"Ancestors who lost their lives in Malaysia"?
My grandma, despite having dementia still remembered what she needs to say everytime she met with the Japanese soldiers.
Just early this month, my grandpa told a story about how Japanese soldier line up the heads that they beheaded in one of the roundabout in KL...
The Malaysian WW2 victims are still alive...
Just because Malaysians have good r/ship with Japan, doesn't mean we forgot what has happened.
What an ignorant leader. Japanese army was the one killing people in Malaya during their occupation in WW2. Are they trying to erase the history? Saying something like Japan was the one helping Malaysia's independence? Delulu..
Sumimasen sikit ehh, Tugu Negara was built to honor OUR SOLDIERS AND CIVILIANS who died defending our country during the Japanese occupation in WW2
They were died fighting for freedom because of the cruelty of your ancestors, invading our land. Jgn distort the history ya
I take back what i said earlier. This is pissing me off. Wdym paying respect for soldiers who brutally beheaded, killed, tortured and raped Malaysians in our very land? "lost their lives in Malaysia" Eh hello, our ancestors gave THEIR lives to gain freedom from Japanese terrors
Our Sejarah textbooks severely downplay the dark realities of the Japanese occupation in Malaya
Every young Malaysian should take the time to learn the real history for themselves
First task of Takaichi as the new japanese prime minister:
✅Offend the Malaysians, by venerating Japanese invaders of Malaysia during WW2, in Malaysia.
Next stop is South Korea, is she going to praise her Japanese ancestors for the forced prostitution of Comfort Women?
This tone deaf woman have gotten used to venerating war criminals in Japan, she's doesn't think this is offensive to anyone outside of her own country.
This morning, MAGA is trying to rewrite history—claiming Reagan was anti-immigrant and pro-protectionism.
But the truth is, Reagan stood for almost everything Trump opposes.
It’d be a real shame if this went viral.