New Tutorial: Building test sets from production traces for LLM eval in @agenta_ai
When your LLM app is in production, your users find edge cases you never thought of.
Here I show how to:
- Convert (batch) traces → test sets
- Create test sets in the playground
Another level of German bureaucracy: Germany’s embassy in Tunis did not give a Tunisian Hip Hop artist a visa to come to Germany to have a live concert in Berlin which the embassy ITSELF publicized on it’s Facebook page last month! 😅
@AuswaertigesAmt@GermanEmbassyTN
Llama 3 now available in @agenta_ai playground!
Yesterday, @AIatMeta announced its latest and most powerful open-source model, #llama3. Today it's in the playground of @agenta_ai
To quickly compare and evaluate Llama3 vs. 70 different models, head to @agenta_ai (links 👇🏼).
📢 Feature announcement: Comparing LLMs and Prompts: Cost, Latency, Tokens
Creating a great #LLM app isn't just about making it good; it's also about finding the cheapest and quickest option. The best teams aim to balance quality and cost.
We've just launched chat capabilities in @agenta_ai. If you are building #chat applications and struggling with errors, #hallucinations, and wrong answers. Read ahead:
With our open-source platform agenta, you can now:
⭐ Develop and test chat applications in the playground
⭐ Compare various prompts and configurations
⭐ Easily add conversations from the playground to the test set
⭐ Evaluate #chatbots using human feedback, featuring an interface for A/B testing, scoring, and annotation
⭐ Implement automatic evaluations to check output quality before production
We support all #LLM providers, and can handle both simple chat applications and more complex ones based on #RAG.
Check it out: https://t.co/hMljKPWAwJ
Repo: https://t.co/EWQDPl7WFg
#llmops #evaluation #llm #openai
We're thrilled to announce the launch of the Cloud-hosted version of Agenta.
A huge thank you to our incredible team for their hard work over the past few weeks, and to our amazing 49 contributors to the project!
Check it out: https://t.co/dtdA86t5rL
🚀 Just published a tutorial on building an AI agent that notifies you on Discord about @HackerNews posts that might interest you! Used @agenta_ai for the #LLM app and @novuhq for the messaging .
#AI#Tutorial#HackerNewsBot
https://t.co/JHhwziNIqD
🎉 Exciting update from #Agenta! We've introduced a new feature to build production-ready #LLM apps in minutes, directly from our UI.🖥
Try the live demo here: https://t.co/1sg5IBYisd
#llmops#opensource
🚀Starting a tutorial series on building production-ready LLM apps! With @agenta_ai, you can build and deploy your @langchain LLM app in less than 2 mins.
Stay tuned for more tutorials on evaluating your app and building RAG-based LLM apps !🛠️💡#LLM#Langchain
🚀 @agenta_ai 's Exciting Update: The #Evaluation Feature is here! 🧪 Building a robust #LLM application requires ample experimentation with #prompts and configurations. Our new feature is here to ease the process.