๐ ๐๐ฅ๐๐ฆ๐-๐.๐-๐๐ญ๐จ๐ซ๐ฆ-๐๐ has arrived! A new 8B parameter LLM that outperforms @Meta ๐๐น๐ฎ๐บ๐ฎ-๐ฏ.๐ญ-๐ด๐-๐๐ป๐๐๐ฟ๐๐ฐ๐ and ๐๐ฒ๐ฟ๐บ๐ฒ๐-๐ฏ-๐๐น๐ฎ๐บ๐ฎ-๐ฏ.๐ญ-๐ด๐ across diverse benchmarks! Our new 8B LLM pushes the boundaries of what's possible with smaller language models.
๐ ๐๐๐ฒ ๐๐ญ๐ซ๐๐ง๐ ๐ญ๐ก๐ฌ:
๐ป Perfect for GPU-Poor AI developers. Build Smarter Chatbots, QA Systems, Reasoning Applications, and Agentic Workflows today! Llama-3.1 derivative, so research & commercial-friendly!
๐ For startups building AI-powered products.
๐ง For researchers exploring methods to further push model performance.
- Start building with Llama-3.1-Storm-8B (available in BF16, FP8, and GGUF) today: https://t.co/A6hny9hCiJ
- Built on our winning recipe in NeurIPS LLM Efficiency Challenge. Learn more: https://t.co/ZlgHPQczEk
- Integration guides for @huggingface, @vLLM, and @LightningAI LitGPT: https://t.co/l9hJKS6yEV
๐ Start Llama-3.1-Storm-8B Colab Notebook: https://t.co/3JzS2fbUer
Huge thanks to @rasbt, @marksaroufim , @_lewtun, @maximelabonne and @prateeky2806 for providing valuable feedback! We extend our deepest gratitude to @LambdaAPI for sponsoring compute for this work.
๐๐ฅ๐๐ฆ๐-๐.๐-๐๐ญ๐จ๐ซ๐ฆ-๐๐ is team Upayaโs (@akjindal53244, @pawan_r24, @ankurparikh85, @AkshitaSukh ) most valuable contribution so far towards the open-source community. If you resonate with our work and want to be a part of the journey, we're seeking both computational resources and innovative collaborators to push LLMs further!
#llm #largelanguagemodels #llama3 #huggingface #opensource
RT @akjindal53244: ๐ ๐๐ฅ๐๐ฆ๐-๐.๐-๐๐ญ๐จ๐ซ๐ฆ-๐๐ has arrived! A new 8B parameter LLM that outperforms @Meta ๐๐น๐ฎ๐บ๐ฎ-๐ฏ.๐ญ-๐ด๐-๐๐ป๐๐๐ฟ๐๐ฐ๐ and ๐๐ฒ๐ฟ๐บ๐ฒ๐-๐ฏ-๐๐น๐ฎ๐บ๐ฎโฆ
Releasing ๐๐ฟ๐ถ๐๐ต๐บ๐ผ๐ฎ-๐ ๐ถ๐๐๐ฟ๐ฎ๐น-๐ณ๐ model that achieves improvement of +1.7% on GSM8K, +3.0% on GSM8K PoT, and +1.9% on MATH benchmarks, compared to previously released Arithmo-Mistral-7B model.