Letta

Building machines that learn.

[Letta @Letta_AI]

Introducing FrontierMemory: a new way to evaluate agent memory through downstream task performance.

While existing memory benchmarks focus on recall (saturated via agentic search), FrontierMemory focuses on how agents learn from experience.

[Sarah Wooders @sarahwooders]

guess what kind of harness 👀

[Letta @Letta_AI]

> GPT-6.1 Terra is now available in @Letta_AI

[Letta @Letta_AI]

You can now run FrontierMemory to measure how well your model or harness improves with experience.

We’re also now accepting submissions to the official leaderboard.

Code and submission instructions are available at:
https://t.co/9DoSLhYKpJ

[Letta @Letta_AI]

Honored to have been a featured ecosystem partner by @JensenHuang at GTC Berlin!

We're excited to partner with @NVIDIA on research towards developing agents that continually learn and self-improve.

[Letta @Letta_AI]

@vraj_ai Full repo to run the benchmark will be live shortly (~1 day or so, will be linked on the https://t.co/hc8Vz7ksRR site), so you'll be to benchmark your own harnesses too.

[Letta @Letta_AI]

@ALL_Jonah @MatthewBerman @OpenAI @AnthropicAI @claudeai Use Opus to orchestrate Codex subagents, creating and passing the relevant memories through to the next layer.

[Letta @Letta_AI]

Introducing FrontierMemory: a new way to evaluate agent memory through downstream task performance.

While existing memory benchmarks focus on recall (saturated via agentic search), FrontierMemory focuses on how agents learn from experience.

[Letta @Letta_AI]

@dialectforge @charlespacker @MatthewBerman @OpenAI @AnthropicAI @claudeai You can run it locally! Full instructions on how to do so (with accompanying GitHub repo) will be live shortly (next ~day). Once live, the main website will link to it under the "Submit" tab.

[elvis @omarsar0]

Recommended reading and a super-interesting benchmark for measuring continual learning capabilities through memory.

Agent memory is largely unsolved. As agents advance in capabilities like long-horizon work, it's unclear which models or harnesses work best, or which memory systems and types to use.

Opus 5.5 at the top is not a surprise. But it's exciting that open-weight models like GLM-5.3 perform so well on memory generation.

My big question is how this (better memory systems and persistent agent capabilities) translates into more performant, efficient RSI agents and harnesses.

[Sarah Wooders @sarahwooders]

Memory is becoming a core part of agent harnesses/products (e.g. Instinct, @Muse, @cognition Devin, @PrimeIntellect Prime Agent, @NousResearch Hermes, @openclaw, @LangChain Deep Agents, @Letta_AI) -- yet despite every agent claiming to "continually learn", there's no benchmark to actually measure that capability.

A big problem is that memory benchmarks today only measure recall (e.g. simple Q/A about past events). They don't measure if/how agents actually learn from experience to get better at work.

At the same time, benchmarks for coding/knowledge work consist of many isolated, unrelated tasks - so they also don't allow for measuring cross-task learning. The context needed for a task is fully specified up-front (very unrealistic).

In practice, both agents and humans work through sequences of many *related* tasks. Experience from past work provides context and learnings that apply to future work. This is why if you're a manager, you have to provide a lot more context when assigning tasks to a brand new employee or external contractor. Meanwhile, a great senior employee might not need any instructions at all.

With FrontierMemory, we adapt existing benchmark tasks for coding and knowledge work so that instead of all the necessary context being provided up-front and within the task, it has to be learned from past experience. This allows us to compare how well different models and harnesses learn over time.

[Astasia Myers @AstasiaMyers]

FrontierMemory from @Letta_AI is the first benchmark to measure memory based on performance on downstream tasks.

Memory remains one of the biggest unsolved challenges in AI.

FrontierMemory ACTUALLY gives us a way to actually measure and compare memory capabilities across different harnesses and models.

[Ion Stoica @istoica05]

Truly capable agents must learn from experience, not merely recall facts. The FrontierMemory benchmark evaluates agent memory directly by measuring its impact on downstream task performance.

[Letta @Letta_AI]

Thanks to our partners for providing early feedback and inference to support the benchmark @AnthropicAI @OpenAI @nvidia @databricks @Snowflake @baseten @FireworksAI_HQ

[Letta @Letta_AI]

FrontierMemory is a continuous benchmark. In our next release, we plan to add longer-horizon tasks that enable RSI from memory.

For more details see: https://t.co/hc8Vz7ksRR

[Mark Rizzn Hopkins @rizzn]

Hey, if you're still using @Letta_AI Classic like I am, you need an ADE (as Letta has EOL'd and retired the online version).

I'm maintaining the Sanctum branch of both Letta and the ADE here:

https://t.co/sKkp4wdZM1
https://t.co/65xRjQGf5U

[Letta @Letta_AI]

Letta Code now supports dynamic workflows to compose model-agnostic subagents and decision models. https://t.co/YENMLFyeZG

[Sarah Wooders @sarahwooders]

Using Muse to dispatch work to my @Letta_AI cloud agent, which can be orchestrated via MCP

MCP is the real A2A