@marcklingen sat down to demo all langfuse features in a single video.
Agent observability, monitoring, evals, prompt management, and what is special about Langfuse.
Great place to start if you are new, or catch up on latest changes.
https://t.co/3lSorqdNme
I'm a strong believer in the power of laziness, especially for engineers. Laziness as a driver often forces good solutions.
You go into the Langfuse UI to achieve something, eg to find the important traces to look at, setup an evaluator to be alerted when something breaks or optimize a prompt.
Locally, we often did this via Agent + CLI/MCP, but cumbersome.
Therefore, we built Langfuse Halo ππΌ to watch over your traces in-app and proactively help you solve problems
1/x
@spacexai βList this weekβs most expensive Cursor turns and what they have in common.β
Ask Cursor, update your instructions, then compare cost, latency, and task completion.
Read the guide: https://t.co/PoE6FYcsjV
Two Langfuse plugins are now available on the @spacexai Marketplace:
β ππ’π―π¨π§πΆπ΄π¦ ππ£π΄π¦π³π·π’π£πͺππͺπ΅πΊ captures your agentsβ model calls, tool executions, and token usage.
β ππ’π―π¨π§πΆπ΄π¦ gives your agents skills to investigate traces, manage prompts, and run evals.
Analytics powered by @ClickHouseDB
Ask Halo challenge
The brief: find out why eligible customer applications were getting rejected.
In seven minutes, @langfuse's Halo:
- found an ignored β¬6,000 subsidy in traces
- tested a revised prompt and
- made it live, fixing the application workflow
Here's the demo.
Setting up dashboards got a lot more efficient with Halo!
I haven't created a dashboard manually in a while, and we're seeing the same with our users: almost 10% of Halo conversations involve creating dashboards
New article on how we built Halo π
A couple of decisions:
- Halo uses the same MCP server, skill and docs as external agents accessing Langfuse, so every new Halo functionality is immediately available to everyone.
- The agent loop runs separate from its sandbox.
- We use Langfuse to observe and improve Halo.
Read the full article here: https://t.co/mv6mJ6WMRf
experiments now show which metric moved, and why.
chart quality, cost, and latency across runs. compare each score against your baseline. filter to items under a score threshold to find the regressions, then annotate them from the keyboard.
https://t.co/MXBtiQuVQh
Here you see Halo help me get started with evals. It looks at my project, determines that the best first step is capturing user feedback signals, and proposes a list of signals I could capture.
Really helpful when starting out, Halo can be a great sparring partner in getting to a good observability setup
Here you see Halo help me get started with evals. It looks at my project, determines that the best first step is capturing user feedback signals, and proposes a list of signals I could capture.
Really helpful when starting out, Halo can be a great sparring partner in getting to a good observability setup
meet Halo, the assistant that lives inside Langfuse π
ask about your traces, sessions and metrics in plain language, or have it build a dataset or dashboard for you. it asks before changing anything.