x.comthreadelvis (@omarsar0) on X
FrontierMemory is a benchmark that evaluates agent memory through downstream task performance, measuring how agents learn from experience rather than recall, which the post says is saturated via agentic search. In elvis's summary, Claude Opus 5.5 ranks first and open-weight GLM-5.3 does well on memory generation. The authors reply that "memory" here means any adaptation from experience, so harness-level changes can also be scored. The post gives no scores or links.
TL;DR Tweet recommends FrontierMemory, a benchmark scoring agent memory by downstream task gains, with Opus 5.5 on top and GLM-5.3 strong.
Organisations named here
- Letta
- elvis
Technologies named here
- Opus 5.5
- FrontierMemory
- Letta
- GLM-5.3
- Prime Agent
- LLM
- Claude Opus 5.5
Techniques named here
- Memory evaluation through downstream task performance
- Similarity-based retrieval memory
Related in evals
