We had a great evening at the London @PyTorch Meetup, hosted by @Revolut and sponsored by HumanSignal.
Great to connect with the builder community and hear talks across foundation models, pretraining, model evaluation, and agentic AI workflows.
Thanks to everyone who joined and helped bring the event together!
SAM2 vs YOLO for Bounding Box Labeling: Which Should You Use?
- YOLO is best for fast bounding box generation when your categories are already defined.
- SAM2 is better when you need flexibility, precision, and detailed object boundaries.
The right choice depends on your dataset, labeling goals, category stability, and quality requirements.
Read more here: https://t.co/zmJd9qMUFx
@RightShip_ replaced spreadsheet-based review workflows for maritime inspection PDFs with Label Studio Enterprise.
Results:
• 3× faster annotation
• Better SME workflows
• More consistent labeling
• Repeatable dataset refreshes
A strong example of operationalizing industrial AI workflows around complex document data.
https://t.co/fmj4Iof6Au
Less admin. More signal.
Recent product updates to Label Studio Enterprise tighten the loop between large-scale annotation, review, and quality measurement:
→ Assign members to projects in bulk
→ Label long PDFs page-by-page with thumbnail navigation
→ See label distribution in Analytics — catch class imbalance early
→ Measure agreement with Consensus or Pairwise methods, built for GenAI evaluation
Read the full changelog → https://t.co/0heF5hHqK1
Generative models don’t have stable “right answers,” so evaluation can’t rely on a single label.
Disagreement is part of the signal.
This breaks down how consensus helps make that measurable:
https://t.co/So9R0Xd6zf
AI programs often have plenty of dashboards, metrics, and experiments.
Even then, it can be difficult to answer what’s working, what needs to change, and what is ready to ship.
This blog outlines a simpler way to measure what actually matters so teams can move faster and run systems with more clarity in production.
https://t.co/XRgNkEZqTU
LangSmith traces + human judgment = better agentic AI
Now you can pull LangSmith traces directly into Label Studio and close the loop on AI quality.
Get the template ⤵️
https://t.co/GhlAFVpDpd
Our new template for @langfuse gives you a powerful interface for evaluating agentic AI. 🪢
- Filter by user, assistant or tool
- Label for issues, verdicts, severity and expected behavior
New step-by-step tutorial in the Label Studio docs:
https://t.co/qm8fA477Ct
@braintrust AI observability meets human-in-the-loop evaluation with Label Studio!
→ Bring traces from Braintrust into Label Studio
→ Label agent output for issues, verdicts, severity and expected behavior
→ Improve the quality of your agentic AI
https://t.co/pmoA7bhYGT
@braintrust AI observability meets human-in-the-loop evaluation with Label Studio!
→ Bring traces from Braintrust into Label Studio
→ Label agent output for issues, verdicts, severity and expected behavior
→ Improve the quality of your agentic AI
https://t.co/pmoA7bhYGT
@braintrust AI observability meets human-in-the-loop evaluation with Label Studio!
→ Bring traces from Braintrust into Label Studio
→ Label agent output for issues, verdicts, severity and expected behavior
→ Improve the quality of your agentic AI
Read more:
https://t.co/5ioiaYReZ9
@braintrust AI observability meets human-in-the-loop evaluation with Label Studio!
→ Bring traces from Braintrust into Label Studio
→ Label agent output for issues, verdicts, severity and expected behavior
→ Improve the quality of your agentic AI
https://t.co/pmoA7biwwr
We spent last week at @PyTorch Conference Europe 2026 talking to teams building AI systems already in production.
Big shift in the conversations:
→ Less focus on models
→ More focus on evaluation, reliability, and real-world performance
We also co-hosted an Open Source AI Soirée with Docling, a room full of people sharing practical lessons from the field (see pictures below!)
The open source AI community is just getting started 🚀
Kicking off #PyTorchCon Europe 2026 tomorrow in Paris!
We’re hosting the Open Source AI Soirée with Docling tomorrow evening. If you’re working on training, evaluation, or production AI systems, it would be great to connect! Register here: https://t.co/s5AB46FNMK
🇫🇷 Heading to the #PyTorch Conference in Paris? We are.
Label Studio is sponsoring PyTorch Conference Europe on April 7–8.
Come find us if you want to talk:
• LLM evaluation
• human feedback workflows
• dataset quality
🚀 Getting back into sharing more about what we’re building at Label Studio.
From LLM evaluation → human-in-the-loop workflows → dataset curation.
For more about AI systems, follow along 👇
https://t.co/m3oRvIzrKw
We’re excited to sponsor @PyTorch Conf EU!
Join the Label Studio and #Docling teams for drinks & bites to talk all things Open Source AI:
Tuesday, April 7th at 18:30 CEST
Register to attend. Venue is walking distance from Station F on the Seine. https://t.co/s5AB46FfXc
@huggingface + Label Studio SDK = 🔥
• Easily import HF datasets into Label Studio for annotation
• Connect HF models with Label Studio for evals, pre-annotations and active learning
• Export labeled data for model training & fine-tuning
Tutorial ↓ https://t.co/X0sPezKHWZ