
Agent Memory Leaderboard Official. First open championship for agent memory systems. Neutral · Reproducible · Fair. mailto: [email protected]
Joined July 2026
- Tweets188
- Following165
- Followers187
- Likes181
Agent Memory Leaderboard retweeted
8月24日,AML发布第1期智能体记忆功能排行榜
AML 将不同来源题目重新映射到统一的能力体系,使结果不仅能按数据集比较,也能按具体记忆能力进行分析。
评测系统和真实数据集没有公开,只知道是多个跟记忆功能相关的开源数据集组合而成。
如果要参评,只需要提供两类记忆操作:
Add: 将对话、事件、文档或工程历史写入记忆系统。
Search: 在指定查询与作用域下返回相关记忆证据。
Glad to make it into the top 10 in Academia track :)
github.com/0xboyu/aml-memory…
Agent Memory Leaderboard retweeted
Building AI memory is harder than storing conversations.
A useful memory system needs to understand what matters, retrieve the right information, adapt to changing states, and support reasoning across long-running tasks.
Today, we’re excited to share that MemoraX ranked #1 in the Commercial Products — Text Memory track of the first Agent Memory Leaderboard (AML) evaluation.
🏆 #1 Commercial Product — Text Memory
Score: 58.02
The first AML evaluation brought together 136 registered teams and 69 representative memory frameworks, providing a common evaluation environment for comparing memory systems.
For us, this result is a milestone in our effort to build memory as an evolving infrastructure layer for AI agents.
The leaderboard is only the beginning.
This quoted post is unavailable.
Agent Memory Leaderboard retweeted
Agent memory benchmarks have had a basic attribution problem.
Every AI memory startup claims better recall, and until now there was no way to check.
That is why this new shared benchmark caught my attention.
It puts every entrant through the same pipeline: 5,000 questions, one fixed answer model, and the same judging process across systems.
The benchmark also separates open-source and commercial systems. That feels like the right choice: community projects can compete for prizes without being directly compared against heavily funded commercial products.
A group of 20+ research institutions is running all of them through one identical pipeline and publishing the results.
Entries close on August 7, with the first public rankings expected in mid-August.
I’ll be watching the first results closely.
🤝 Paid partnership
This quoted post is unavailable.
Agent Memory Leaderboard retweeted
Everyone in agent memory publishes numbers on their own datasets, their own models, their own judges. So when a score goes up, you can't tell if the memory improved or the eval got softer.
@AgentMemoryL is running the first open, neutral championship:
> Every entrant hits the same add + search endpoints
> They handle generation, judging, and compute
> Text track across 10+ datasets, plus a real code track with temporal constraints
> Logs and evidence are public
Same setup for everyone. That's the part that's been missing.
This quoted post is unavailable.











