Gary King 那篇最值得看的数字,是三位前主编跟 AI 判断的一致率 87%。同样这三位,彼此之间只有 80%。
让专家投票,他们跟机器的共识比跟同行还高。这个比「AI 赢了」本身更难受。
错误率也一起摆着:AI 评审里对稿子的错误陈述占 5.5%,人类 15.9%,大概三分之一。AI 那边没编造引用,这条是逐条核过的。
论���自己承认没测的:作者按意见改完之后,论文有没有真的变好。评审写得漂亮,和稿子变得更好,中间那一步这篇没碰。
By every measure, Opus 4.8 beats human experts as peer reviewers in a study of 124 Harvard social science papers covering a range from statistical analyses to formal models to qualitative work.
As academics, we need to figure out how to adapt the practice of science to AI, fast.
>junior dev at a mid startup
>wednesday morning
>just want to push a minor bugfix to our php app today
>open laptop, check slack
>company group chat is an absolute warzone
>CTO typing in all caps about php2shell
>fucking php
>whatever, server hasn't blown up yet, I just need to get my code in
>open gitlab to merge the PR
>forced emergency logout because of a critical gitlab security patch release
>fucking gitlab
>pipeline fails because of some weird regex compiler bug
>spend 40 minutes fighting CI/CD
>i can just use AI to help debug
>fire up opencode
>api keys nuked because they were breached
>fucking opencode
>i’ll just get fresh LLM api keys from our corp proxy, LiteLLM
>it won’t connect? It’s down?
>look up LiteLLM news: supply chain compromise
>fucking litellm
>cold sweat forming
>slack alert: db connection error
>check our database connection
>we host on TiDB Cloud
>they just announced a security breach, unauthorized access via stolen service account credentials, data copied
>fucking tidb cloud
>full panic attack incoming
>figure fuck it, just ship the container to Railway and go home
>open Railway dashboard
>bright red banner: "Security Disclosure: Rotate all environment variables immediately. All builds paused."
>fucking railway
>try to open the app URL in browser to see if anything is even working
>NET::ERR_CERT_AUTHORITY_INVALID
>eMudhra intermediate certificates compromised
>4
>instantly untrusted by every major browser
>fucking emudhra
>stare blankly at mac screen for 10min
>random pop-up
>restarting in 10min to fix a critical vulnerability
>fucking macos
>close laptop
>leave office
>never come back
When my first AI book was published in 2024, the best AI could do 4 minutes of human work with a 50% chance of success
When I turned in the draft of Co-Existence earlier this year, it was 17 hours
When it was published two days ago, AI could do 17 weeks https://t.co/ON0qKpJ6LD
Researchers proved every LLM is secretly obsessed with Japan.
And they finally figured out why.
They published a paper investigating hidden cultural biases in large language models.
they tested 31,000 questions across 24 different languages on models like gemini, chatgpt, claude, and llama.
they stripped out all geographic hints and just asked the models to pick a place and answer.
the finding was universal.. across a wide range of models and languages, there is a pervasive "obsession" with japanese culture.
even when you prompt them in a language with zero ties to japan, they default to japanese norms, values, and aesthetics at a disproportionately high rate compared to its actual global demographic weight.
the craziest part? they tracked down exactly when the ai develops this obsession.. and it is not from reading the raw internet.
during pre-training, the models actually have a fairly balanced, global view of the world. the obsession gets injected during the safety phase.
when tech companies fine-tune these models to be "helpful, harmless, and polite," the ai starts mapping those corporate safety guidelines directly onto japanese cultural concepts. in the pursuit of creating the perfect, inoffensive, compliant assistant, they warped how the models view the world.
the quantization process (compressing models to run faster locally) actually amplifies this determinism. the smaller and faster your local model is, the more stereotypically it behaves, causing japanese cultural tropes to spike hard.
we spend all this time worrying about existential ai safety, but the real alignment problem is that our most advanced reasoning engines are hyper-fixated on japanese internet culture.
every model upgrade is reinforcing an invisible regional bias that dictates how they generate stories, facts, and code. the cultural commonsense of the internet is not universal..
it’s just localized to whatever the heaviest reddit and anime wiki users were obsessed with.
This is the most serious 48 hours in cybersecurity history.
"Black October" they're calling it
It seems every *hour* there's a new incident, that in a typical year, would be one of the biggest incidents of the *entire year*
SUMMARY OF THE LAST 48 HOURS:
YEAR-LEVEL INCIDENTS (In a typical year, these would be among the biggest incidents of the year):
1. PHP2Shell: a hole in the software behind ~70% of websites. Governments took sites offline.
2. eMudhra: the master keys that prove websites are real were cracked. One was the number 4.
3. California: data on every public school student since 2023 stolen, including disability status
4. Railway: hackers stole customers' secret keys from a hosting platform used by millions of developers
5. Zeabur: 321,810 accounts breached. The company is shutting down.
6. LiteLLM: an AI tool downloaded 3.4 million times a day was poisoned with a password stealer
7. GitLab: a 10-out-of-10 severity hole in every version since 2014
8. Cairn: criminals used an AI hacking tool to break into 100+ companies
9. Ahold Delhaize: hackers knocked the owner of Food Lion and Stop & Shop offline
10. Onamae: malware planted on up to 26,739 customer servers in Japan
MONTH-LEVEL INCIDENTS (In a typical month, these would be among the biggest incidents):
11. Signal: a bug could leave your mic and camera on after you hang up
12. NGINX: 3 critical holes in software running ~1/3 of websites
13. HTTP/3: a single connection can crash 7 of the 10 web server types tested
14. Plex: hackers breaking into home media servers
15. SafePay ransomware: FBI warns it has hit 600+ critical infrastructure organizations
16. Palo Alto: ransomware gangs breaking in through company firewalls
17. Bullhorn: platform used by 10,000+ companies knocked offline
18. Medi-Cal: 970,000 patients' data stolen
19. WordPress: hackers stole a plugin maker's keys and used them to plant backdoors on websites
20. AOMEI: backup software's update server handed out a backdoor
21. Meta Muse: Meta's AI agent exposed users' personal and business secrets
22. Tor: 333 relays hijacked to steal logins
23. TiDB Cloud: database company's cloud breached
Also serious:
24. State Bank of India: India's biggest bank confirms a data breach
25. OVHcloud: hackers slipped a password stealer into a cloud company's official tool
26. Siemens: a software hole being used to spread malware
27. North Korea: state hackers launch a new attack campaign on South Korea
这个推演在资本逻辑上成立,但时间尺度压得太短了。
解量子引力也好、治愈癌症也好,卡住的地方在验证周期。一个新药从候选到三期要十年,一个物理假说要等实验设备排期。模型能把假设生成从几个月压到一天,后面那十年一步都省不掉。所以短期内 API 那点收入还得挣,它养的就是这段长周期。
真正先被砍的,我猜是那些不赚钱的 to C 订阅和免费额度。企业合同和前沿研究共用一套算力,砍客户砍的是最不赚钱的那批,不会砍签了三年合同的。
至于「不用再听用户抱怨」,这话在任何做产品的公司里都不成立。抱怨是需求信号,砍掉它等于关掉传感器,然后你连自己偏了多远都不知道。
I getting a feeling that OpenAI and Anthropic soon will ditch customers completely, just use their models 100% internally and go all in on frontier science and engineering research
Like eg if they actually solve quantum gravity or cure cancer, and own the right to license the solution, can you imagine the ROI behind that? No more listening to users bitching about usage or model nerf or whatever
这条我笑了一下,但底下有个正经的观察。
过去一年里所有「AI 抢饭碗」的论证,模型都在扮演掠夺者:写代码、画图、写文案,一件件��下扒。现在反过来了,一位公众人物康复,评论区第一反应是 AI 该不会要失业了吧。
这个反转说明大家心里的 AI 已经从一个工具变成一个角色了。工具没人替它操心前途,角色才有人设和危机感。模型公司这两年做品牌、做拟人、做语气,本质上就是在把工具往角色推。
问题在于角色化之后,人们对它的容错率反而降了。工具报错就重跑,角色说错话会被追着骂一年。这个账迟早要算。
Linear 的界面设计师离职,把他两年做的动效全晒出来了。
看那种帖子总有点复杂。一边是真心觉得好看,一边会想:这种东西做得越好,外人越难相信它不是 AI 生成的。手感、节奏、那些不解释的细节,本来是人的签名,现在快成了证明自己不是机器的最难一环。
设计师在证明自己会设计,跟我们在证明自己会写字,难度差不多了。
This is my last week at Linear.
It was a privilege to work with such a talented team for the last two years.
Here are a few of my favorite things I helped create during my time here:
‘Wildwood’ director Travis Knight on AI:
“A pencil is a tool. A paintbrush is a tool. A 3D printer is a tool. A digital capture is a tool. AI is not a tool. AI can go fuck itself.”
Fighting game legend SonicFox has pulled out of a gaming convention after organizers used AI-generated art of them to promote the event
"Use the money you offered me in contract to hire artists, and maybe next year I’ll reconsider"
这张图好笑,但底下有个真实的分层。
「boomer AI slop」这个词已经成了一个独立品类:夸张的卡通、饱和的颜色、似曾相识的角色,一看就知道是拿老动画喂出来的。它跟「精致的 AI 图」是两拨人在做,也各有各的观众。
有意思的是审美判断在这里完全不统一。同一张图,一批人觉得是垃圾,另一批人真心觉得好看,而且后者数量不小。这类内容之所以泛滥,正是因为它的受众真实存在。
所以关于 AI 内容会不会毁掉审美的讨论,我越来越觉得问错了。真正的变化是内容供给被切成无数个平行世界,每个世界内部都自洽,彼此看不上。以前大家共享同一套品味标准,现在连「难看」这个词都没法共用了。
Elon Musk on Optimus:
"We've started early production. The growth of Optimus is an S curve, but the initial curve is a shallow slope. We have the vast majority of the 1 million unit/year line installed at Fremont. There's still some things we need to tweak about the design. There's still quite a lot of work to do with the AI in the robot. I would expect that the AI, the electromechanical design, reliability, usage life, expect these issues to be solved by the end of next year. I remain convinced Optimus will be the biggest product on Earth. I do want to temper expectations that we still have a lot to get through, it will take about a year to get through that."
Spectacular Nature piece on why AI is not conscious and probably will never be.
Three arguments:
1) Intelligence is not consciousness.
Intelligence is about solving problems. Consciousness is about having subjective experiences.
AlphaFold can solve super difficult problems. By contrast, our brains performs complex operations entirely outside awareness.
Problem-solving and consciousness are two separate things.
2. Biology is essential.
Our brains are alive, down to every cell. Their activity is inseparable from the living tissue that produces it.
The idea that consciousness can be reproduced simply by running the right computations on silicon components who do not fight for their life is a very far fetching and, I would add, almost religious, assumption.
3) The physical organization may matter more than the computation.
According to integrated information theory, consciousness requires specific causal relationships between a system’s physical components.
The computer architectures running today’s AI lack this organization.
The comparison with AlphaFold is particularly revealing:
Almost nobody things AlphaFold is conscious, despite its inner working is very similar to an LLM
Why?
Because it does not speak.
LLMs do speak like us and therefore we fall into an illusion:
Since they speak like us, they must be like us.
But this inference is wrong.
LLMs are just a series of matrix multiplications.
They are not conscious, and they will never be.
*
Paper in the first reply