https://t.co/UStDmf5MNx chief scientist Jie Tang just revealed the training pipeline behind the upcoming GLM-5.5 (32B, 122B, and 256B) during a lecture at Tsinghua University today.
Instead of relying on public datasets, their pretraining pipeline pulls from six separate internal engines:
- Web: 1 trillion pages crawled at ~10B pages/day with PB-scale template clustering
- Documents: 2 billion scientific PDFs parsed through GLM-OCR (4x faster with speculative decoding)
- Books: 50 million books with layout reordering and garbled-text filtering
- Code: 500 million repositories turned into executable tasks with real tests and issue descriptions
- Video: 10 billion videos for long-sequence world knowledge
- Audio: 300 million hours rewritten via ASR into trillions of tokens
Last night, @higgsfield sent @ComfyUI a cease and desist (attached)
They want the Open Source Higgsfield challenge taken down within 48 hours.
Their argument is that our use of the Higgsfield name and that using their CEO's likeness is an infringement violation (man, the irony). Claiming that it makes the event look like Higgsfield is associated with it.
This couldn't be farther from the truth, which is that Higgsfield made a promise to open source its product and never did.
For the past two weeks, builders have been recreating popular closed apps as open workflows anyone can run.
So we asked our community to deliver where Higgsfield failed: apps in the open, built by the community, for the community. We've made it clear that the challenge is organized by ComfyUI and not affiliated with or endorsed by Higgsfield.
When we started Comfy, we made the community a promise. Our product stays open, free, and yours. We’ve kept it every day since, and one letter isn’t going to change that.
The challenge stays up. Comfy and open source will win!
We tested Kimi K3 and Fable on a real bug from the Cline repo, and found that while both models were able to fix it - Fable wins on speed & Kimi wins on cost.
- Kimi used 1.7x more tokens than Fable (1.2M vs. 730K)
- Fable finished 3.4x faster - 3.5 min and 18 tool calls vs. Kimi’s 12 min and 34 tool calls.
- Kimi cost 2.3x less ($0.92 vs. $2.13) thanks to its 3.3x per-token discount
Both runs used the same Cline harness, and the traces indicate that Kimi is RL trained to spend more tokens thinking and verifying before completing.
This is the first time we've seen an open weight model compete head to head with SOTA. Congratulations to the @Kimi_Moonshot team on this milestone!
Warning: Making video with AI is addictive.
I started with a prompt, just messing around... next thing I knew hours have gone by and my day is gone. But ended up with something I think is pretty great. Maybe I'll start doing some more video posts.
Created with Cherry Video on @MageSpace_.
#AIVideo #AIAnimation #AI動画 #AIArt