Why stop here? Hear me out. A single BNPL contract for a burrito is incredibly risky. Anyone willing to pay for a burrito in installments can't be trusted to pay their debt. But what if...we pooled the payments together? The risk would go away.
The burst of DeepSeek V3 has attracted attention from the whole AI community to large-scale MoE models. Concurrently, we have been building Qwen2.5-Max, a large MoE LLM pretrained on massive data and post-trained with curated SFT and RLHF recipes. It achieves competitive performance against the top-tier models, and outcompetes DeepSeek V3 in benchmarks like Arena Hard, LiveBench, LiveCodeBench, GPQA-Diamond.
๐ Blog: https://t.co/UnvIk3g0cK
๐ฌ Qwen Chat: https://t.co/BhhXyzLt5B (choose Qwen2.5-Max as the model)
โ๏ธ API: https://t.co/FqHOtIw5Y1 ๏ผcheck the code snippet in the blog๏ผ
๐ป HF Demo: https://t.co/rMSvlNUM18
In the future, we not only continue the scaling in pretraining, but also invest in the scaling in RL. We hope that Qwen is able to explore the unknown in the near future! ๐ฅ
๐ Thank you for your support during the past year. See you next year!