Announcing Discovery Loop!
I am very excited to announce that, along with my longtime friends and collaborators @Sanjay_Ghemawat, @OriolVinyalsML and @quocleix, we are founding Discovery Loop (@DiscoLoopAI), a Public Benefit Corporation whose mission is to automate machine learning, science, and engineering to accelerate discoveries and progress. The four of us have worked together for 14 to 30 years, and have helped build some of the world’s most used products, infrastructure and AI models, and we’re excited to turn our attention to this ambitious endeavor.
♾
Learn more at: https://t.co/Rv3LMdLluK
Evaluation shouldn't block the progress of AGI development.
We’re open-sourcing ProEval, a new framework to scale GenAI development without the massive price tag.
💰100x cost reduction
🎯 <1% error margin
🚀 Read the full @GoogleDeepMind tech report here:
Evaluating GenAI is too slow and expensive.
Our new paper introduces ProEval, achieving 8-65x fewer samples needed for 1% accuracy!
It uses Bayesian quadrature to efficiently estimate model performance and catch failure cases early. More in https://t.co/ULCuoFZ8Q8
Check out our open-sourced code and data here! https://t.co/dUp07c8wXx
Joint work with my amzing collaborators Yizheng Huang, Wenjun Zeng and Aditi Kumaresan
We fully refactor the MLE-agent code to provide better user experience.
Here are some of new key features:
• 🤖 Autonomous Baseline Creation: Automatically generates ML/AI baselines to kickstart your projects.
• ☕ Interactive CLI Chat: An intuitive chat interface to enhance your existing projects right from the command line.
• 📂 File System Integration: Keeps your project structure well-organized.
• 🔍 Arxiv and Papers with Code Integration: Easily access the latest research and state-of-the-art methods.
• 🐛 Smart Debugging: Facilitates high-quality code generation with automatic debugger-coder interactions.
• 🧰 Comprehensive Tools Integration: Incorporates various AI/ML functions and MLOps tools for a seamless workflow.
#mle #ai #llm #agent #code