Top Tweets for #forgetrain

4 months ago

#面壁智能开源 #ForgeTrain 由 AI Agent 自主写出的预训练框架，连 CUDA kernel 都是它自己写的。H100 上 MiniCPM4-0.5B 跑到 44% MFU，比 Megatron（NVidia 主推 GPT 实现）基线高约 10%。开启 AI 自我进化迭代 https://t.co/2TzqbLNqfa 随着 Qwen 走向闭源，@OpenBMB 支持开源半边天了

OpenBMB

@OpenBMB

4 months ago

🚀 The era of "AI forgingAI" is officially here! Introducing ForgeTrain — the world’s first fully AI‑generated production‑level pre‑training framework. No human in the loop. This is not an experimental prototype, but a true "AI engine" with zero human code intervention, ready for production. This marks a complete closed loop: Framework written by AI → Validated on diverse hardware → Training leading models. Highlights: ⚡ Speed & Efficiency: Outperforms NVIDIA's mainstream Megatron framework by 10% on H100 GPUs (achieving 44.13% MFU), directly reducing compute costs. 🌐 Cross-Hardware: Full pre-training pipeline successfully validated on Huawei Ascend 910. 🏆 Trained MiniCPM5-1B — ranked #1 among sub-2B models on the @ArtificialAnlys Index. 🔓 100% Open Source: The framework code (tailored for both NVIDIA H100 and Huawei Ascend) and the "Agent Harness" toolchain are fully available for reproduction — coming soon. 💻 GitHub: https://t.co/ChYFOgTXYh