TNG Technology Consulting GmbH

TNG, aka "The Nerd Group", is a consulting partnership focused on high end information technology, particularly AI. 932 employees, 99.9% academics, ~53% PhDs.

[TNG Technology Consulting GmbH @tngtech]

Today we release DeepSeek-TNG R1T2 Chimera.

This new Chimera is a Tri-Mind Assembly-of-Experts model with three parents, namely R1-0528, R1 and V3-0324.

R1T2 operates at a sweet spot in intelligence vs. output token length. It appears to be...

* about 20% faster than R1, and more than twice as fast as R1-0528

* significantly more intelligent than R1 in benchmarks such as GPQA Diamond and AIME-24/25, albeit not quite on R1-0528 level

* much more intelligent than our first R1T Chimera, and also think-token consistent, which is a major improvement

We perceive it as generally well-behaved and a nice persona to talk to. The weights are on @huggingface under the MIT licence. We are looking forward to your experiments and feedback!

Thanks to @deepseek_ai for giving their models to the world, to @chutes_ai and @openrouter for hosting R1T, to @WolframRvnwlf for benchmarking it, to @xlr8harder for beta-testing the new Chimera, and to @natolambert for constructive discussions at @aiDotEngineer.

[TNG Technology Consulting GmbH @tngtech]

@xeophon @hu_yifei @HPE We ordered a literal ton of the actual machines.

[TNG Technology Consulting GmbH @tngtech]

@Weyaxi @aiand_ @hara_shimpei Congrats, Yağız! They are lucky to have somebody like you!

[TNG Technology Consulting GmbH @tngtech]

@xeophon @hu_yifei We're imagining them since early this year, and ordered them. Unfortunately @HPE does not ship.

[TNG Technology Consulting GmbH @tngtech]

@ar0cket1 @stochasticchasm A guess: It might be possible that with Muon they would not have run through / recovered from the spikes in the pretraining runs. AdamW can recover from a lot of ugly situations.

[TNG Technology Consulting GmbH @tngtech]

@finbarrtimbers Finmeister Barr's onward journey

[TNG Technology Consulting GmbH @tngtech]

@0xSero You could use the HDMI outputs as unidirectional, away-from-the-card data pipes.

[TNG Technology Consulting GmbH @tngtech]

@natolambert @allen_ai Thank you for being such an inspiration, your balanced judgement, your joy of innovation and teaching others!

[TNG Technology Consulting GmbH @tngtech]

@ar0cket1 Good point, thank you!

[TNG Technology Consulting GmbH @tngtech]

Xeophon on the art of benchmarking

[Florian Brand @xeophon]

The talk is now on YouTube!

Link: https://t.co/dY25kEuIUn

[TNG Technology Consulting GmbH @tngtech]

@natolambert If you like, you can spend some months here in Munich and we build something meaningful.

[TNG Technology Consulting GmbH @tngtech]

Thanks for doing interesting and intriguing research! "Wir müssen wissen, wir werden wissen" (David Hilbert)

[TNG Technology Consulting GmbH @tngtech]

Our robots are in the metal hospital right now.

[TNG Technology Consulting GmbH @tngtech]

@Yuchenj_UW Real-time measurement:

[TNG Technology Consulting GmbH @tngtech]

@0xSero What kind of compute? 4x/8x B200? Would 8xRTX6k Pro work?

[TNG Technology Consulting GmbH @tngtech]

@nicolaygerold @xeophon Sent us a DM.

[TNG Technology Consulting GmbH @tngtech]

@xeophon @nicolaygerold Ticket AND Coffee :-)

[TNG Technology Consulting GmbH @tngtech]

https://t.co/7bzOltNaLi

[TNG Technology Consulting GmbH @tngtech]

@allen_ai What a beautiful idea! Congratulations!

[TNG Technology Consulting GmbH @tngtech]

@tugot17 One of the big ones. Whether to believe them is a difficult choice.

[TNG Technology Consulting GmbH @tngtech]

GPU acquisition prioritization, your opinion: