Humanloop

Humanloop is the LLM evals platform for enterprises. Trusted by Gusto, Vanta and Duolingo to ship reliable AI products.

[Humanloop @humanloop]

We're thrilled to announce that the Humanloop team is joining @AnthropicAI!

Our mission has always been to enable the rapid and safe adoption of AI. Now, as AI progress accelerates, we think Anthropic is the ideal home to continue this work.

[TechCrunch @TechCrunch]

Anthropic nabs Humanloop team as competition for enterprise AI talent heats up | TechCrunch https://t.co/p175SN5xTl

[Humanloop @humanloop]

More at https://t.co/wgl7zqNX1R

[Humanloop @humanloop]

We're thrilled to announce that the Humanloop team is joining @AnthropicAI!

Our mission has always been to enable the rapid and safe adoption of AI. Now, as AI progress accelerates, we think Anthropic is the ideal home to continue this work.

[shai 🌻 @shaiunterslak]

Apparently @humanloop is the best? Has anyone actually tried them?

[AlbionVC @AlbionVC]

AI-native products are evolving fast. At our 𝐔𝐧𝐥𝐨𝐜𝐤 𝐭𝐡𝐞 𝐅𝐮𝐭𝐮𝐫𝐞: 𝐀𝐈 𝐁𝐫𝐞𝐚𝐤𝐟𝐚𝐬𝐭 with @humanloop & @googlecloud, we explored what it takes to build, evaluate, and differentiate LLM apps. Thank you to everyone who joined. #AI #LLMs #Startups

[Humanloop @humanloop]

MCP is rapidly becoming the universal adapter for AI.

Since its release in November, developers and teams have raced to adopt the standard, giving agents the tools they need to interface with the real world, from APIs to internal systems.

Our latest explainer breaks down MCP: what it is, how it works, and how to get started.

🔗 Read here: https://t.co/AGWRreTmDy

[Jordan Burgess @jordnb]

Awesome open source package to strongly type your @humanloop prompts in your code.

Also great explainer of the challenges of collaborating on prompt engineering with subject matter experts.

[Humanloop @humanloop]

Wow. Everything is tokens.

[Humanloop @humanloop]

Register here: https://t.co/WmglpzAcD8

[Humanloop @humanloop]

🗓️ Wednesday March 12th at 10:00 PT

Our CEO @RazRazcle will be speaking at the MLOps Community’s 'AI in Production 2025' about Eval-Driven AI Development.

What to expect:
• Learn how top AI teams use evaluation-driven development to guide model improvements and avoid common pitfalls.

• Discover how to leverage code-based, LLM-as-judge, and human evaluators to optimize LLM performance.

• Gain insights from Brianna Connelly, VP of Data Science at @filevine, on how their AI team uses evals on Humanloop to refine AI applications and RAG systems.

Register to take part virtually (link below)

[Humanloop @humanloop]

@ikavalerov @TweetEdMiller @samstphenson @ikavalerov - have dm'd you!

[Humanloop @humanloop]

📍PMs in AI Meetup, London 🇬🇧

Yesterday we held a Meetup in the UCL Centre for Artificial Intelligence for product managers working on AI agents and applications.

Huges thanks to all who turned up (it was a full house!) and to our speakers:

• @samstphenson (Founder, @meetgranola) - who advised on making your 1 AI feature extremely effective before trying to add any more.

• @Albertorizzoli (Co-founder, @V7labs) - who said to listen to user problems, not their proposed solutions (this is more true than ever with AI).

• @RazRazcle (Co-founder, @humanloop) - advised to bring domain experts into the prompt engineering and evaluation process as early as possible to drive differentiated and effective AI performance.

The London AI community is next level 🚀 What should be the theme of our next meetup? 👀

[Humanloop @humanloop]

@TweetEdMiller @samstphenson @TweetEdMiller on our socials (here / LinkedIn) or newsletter - have DM'd you

[Matt Carey @mattzcarey]

cool event with @RazRazcle from @humanloop, @samstphenson from @meetgranola and Alberto from @V7Labs

Thinking about AI from a PM mindset.

nice to see more events take a different spin on the broad AI industry in London.

[Humanloop @humanloop]

Very excited to share that Humanloop is named as one of Emerging Leaders in the Emerging Market Quadrant for Generative AI Engineering in the 2025 Gartner® Innovation Guide for Generative AI Technologies.

Building reliable AI products doesn't have to be a guessing game - you need an eval-driven workflow and the right collaboration between engineers, product and domain experts. That’s how teams ship AI that works.

Companies like Gusto, Vanta & Duolingo use Humanloop to build great AI products, we love helping companies navigate this new paradigm - reach out to ask questions or book a demo with us https://t.co/1Q54opgBl8

Read more in Gartner 2025 February edition of the Innovation Guide for Generative AI Technologies

[Humanloop @humanloop]

🚀 We’re thrilled to be part of ProductCon on Feb 19, 2025, in London!

ProductCon brings together the brightest minds in tech to share best practices for building world-class products.

📍 Stop by our booth to see how PMs use Humanloop to build differentiated AI products that perform reliably at scale.

🔗 Grab your ticket here: https://t.co/F1wYnRJbLX

[Humanloop @humanloop]

How do you take your AI product from good to great to game-changing?

Next Tuesday (Feb 18th) we’re hosting a Product Managers in AI Meetup in Bloomsbury, London 🇬🇧

Join us for a panel on "How to Build AI Products That Delight Users" with guest speakers:

• @samstphenson, Founder, @meetgranola
• @Albertorizzoli, Co-founder, @V7Labs
• @RazRazcle, Co-founder, @humanloop

Food and drinks will be provided. Limited availability — register here: https://t.co/hMYwEbfBPK

[Humanloop @humanloop]

Read more: https://t.co/sODXFMJ6R7

[Humanloop @humanloop]

Today we’re introducing Templates - a library of Prompts, Evaluators, and Datasets, designed to accelerate time to value when developing and evaluating AI applications.

One of the biggest challenges in testing AI applications and agents is accessing the right datasets and evaluators. So we’ve collaborated with @huggingface to make this easier.

With Templates, the best and most popular golden datasets on Hugging Face are instantly accessible in Humanloop, alongside our fully customizable pre-set evaluators, to help you streamline LLM evaluations.

No more starting from scratch - easily test your prompts and agents for jailbreak vulnerabilities, PII leaks, text-to-SQL accuracy, domain-specific reasoning, and lots more — powered by @huggingface Datasets and @humanloop Evals.

Templates are live now! (Link below to learn more).

[Humanloop @humanloop]

When do you know it's time to try fine-tuning instead of prompt engineering?

Our CEO @RazRazcle is on Data Radicals with @satyx this week to discuss:

🔹 How fine-tuning tends to be an optimization step, which comes once you've pushed the limits of prompt engineering
🔹 Why collaboration with domain experts in the AI product development cycle is key to driving successful outcomes
🔹 How software engineering is changing in the age of AI

And lots more! Watch the full episode here: https://t.co/HuLAeDYt4O