Excited to announce that Refuel is officially out of stealth today! We’re building a platform to create, clean, enrich and label datasets at the speed of thought, using LLMs. 🚀
More details below.
Congratulations to our portfolio companies, @togethercompute and @RefuelAI, on uniting their strengths to power the next generation of AI infrastructure!
Together AI’s AI Acceleration Cloud enables developers and enterprises to train and deploy generative AI models with speed, control, and cost-efficiency. By bringing in Refuel’s purpose-built data models and orchestration platform, they’re tackling one of the biggest bottlenecks in AI: cleaning and structuring messy data at scale.
We’re proud of @vipulved, @rish_bhargava, @nihit_desai, and both teams for building the foundation that enables applied AI to thrive.
We have some big news to share today - @RefuelAI is joining @togethercompute to help accelerate the future of open source and enterprise AI! https://t.co/GgPoZ3q5Bx
@auren We'd seen AI models outperforming humans even with earlier, less powerful LLMs - see this report we published in June 2023: https://t.co/yXYkSJLQt8
We didn't measure performance of humans in the first few minutes, but makes sense that humans would quickly get bored here!
Data intelligence too cheap to meter
RefuelLLM-2-mini (75.02%), our latest 1.5B param SLM, outperforms all comparable models including Phi-3.5 (65.3%), Qwen2.5 (67.62%), Gemma2 (64.52%), Llama3-3B (55.8%) and Llama3-1B (39.92%) across our benchmark of data processing tasks such as labeling, enrichment and structure extraction
RefuelLLM-2-mini is a Qwen2-1.5B base model, trained on a corpus of 2750+ datasets spanning tasks such as classification, reading comprehension, structured attribute extraction and entity resolution, using the same recipe as other models in the Refuel-LLM family.
It's fast!
We’re open sourcing the model weights, available on @huggingface - https://t.co/ZfYo7erPMv
If you'd like to access models, along with fine tuning support, DM me or reach out to us: https://t.co/pOBlH80PLp
Grateful to our early customers for their partnership, and the entire @RefuelAI team for their hard work 🚀