Oslo

Maths, Research, and Domains.

[Oslo @oslo]

Superintelligence is about to emerge.

[Kimi.ai @Kimi_Moonshot]

Introducing 𝑨𝒕𝒕𝒆𝒏𝒕𝒊𝒐𝒏 𝑹𝒆𝒔𝒊𝒅𝒖𝒂𝒍𝒔: Rethinking depth-wise aggregation.

Residual connections have long relied on fixed, uniform accumulation. Inspired by the duality of time and depth, we introduce Attention Residuals, replacing standard depth-wise recurrence with learned, input-dependent attention over preceding layers.

🔹 Enables networks to selectively retrieve past representations, naturally mitigating dilution and hidden-state growth.
🔹 Introduces Block AttnRes, partitioning layers into compressed blocks to make cross-layer attention practical at scale.
🔹 Serves as an efficient drop-in replacement, demonstrating a 1.25x compute advantage with negligible (<2%) inference latency overhead.
🔹 Validated on the Kimi Linear architecture (48B total, 3B activated parameters), delivering consistent downstream performance gains.

🔗Full report:
https://t.co/u3EHICG05h

[Stefano Ermon @StefanoErmon]

Mercury 2 is live 🚀🚀

The world’s first reasoning diffusion LLM, delivering 5x faster performance than leading speed-optimized LLMs.

Watching the team turn years of research into a real product never gets old, and I’m incredibly proud of what we’ve built.

We’re just getting started on what diffusion can do for language.

[Oslo @oslo]

@heyitszeth @shiftj I think this should be the ideal path to test your product out and let a few people use it so that you can pivot or upgrade for the better. Doing the same.

[Oslo @oslo]

@3xHarrison but still people will use anthropic or chatgpt. Having a good domain is not related to better research. Meta gave $1 billion to hire individual researchers. Even they don't care about https://t.co/KLRm1q8khR . It is all hype. Hype creates better visibility but not research.

[Oslo @oslo]

@AtomAppraise appraise https://t.co/PUacS7BN92

[Oslo @oslo]

@DCLjasonx "why their not" 😆

[Oslo @oslo]

@PeterDiamandis they design words

[Oslo @oslo]

@arpit_bhayani Ask : "are you sure"

[Oslo @oslo]

@SumnerLN @mikhailshapiro @sandroherbig @alexblania @sama Congrats 👏

[Oslo @oslo]

@Sullys_Blog i find : the better my research, the better the people I happen to interact with.

[Oslo @oslo]

@RickdotX congrats to both.

[Oslo @oslo]

@SOLsesame @tapdotfun sweet

[Oslo @oslo]

@katerleonid moves from "i want this" to "let's see who can beat me" - a classic primal urge.

[Oslo @oslo]

@katerleonid appraised low i suppose. Estibot appraised https://t.co/PUacS7BN92 for $51,000 and i am not sure the exact params it used

[Oslo @oslo]

@Ronald_vanLoon @nvidiaomniverse That is THE FUTURE

[Oslo @oslo]

@DCLjasonx Smart move

[Oslo @oslo]

@brokertom startups usually buy .com after they become successful.

[Oslo @oslo]

@ben_m_somers I am super on this, also building it solo.

[Oslo @oslo]

@willccbb on point.

[Oslo @oslo]

@SOLsesame @tapdotfun from now on "build in public" = #10F420