一项研究显示,直接在原始对话历史上做稠密检索加重排的 Raw-RAG,在 LoCoMo、LongMemEval、MEME 和 MemoryAgentBench 的七项基准与模型设置中有六项排名第一,领先最强智能体记忆系统 0.13 至 5.53 分。
RAG is so back!
This work shows that plain RAG over raw chat history beats complex agentic memory systems on most long-term memory benchmarks.
(bookmark it)
They tested Raw-RAG, which is just dense retrieval plus reranking over the raw conversation, feeding a reader LLM.
Across LoCoMo, LongMemEval, MEME and MemoryAgentBench, it ranks first in six of seven benchmark and model settings, ahead of the strongest agentic memory system by 0.13 to 5.53 points. Ingestion on BEAM-1M takes 0.3 hours, against 3.2 to 27 hours for systems like Mem0, MemOS and Memora.
Why does it hold up? Raw history keeps more of the evidence a question needs, including the relations and dependency paths behind an answer. Rewriting history into memory entries tends to drop those important bits.
Even with complete access to the transformed memory stores, models answer less accurately than with raw evidence.
Before adding a memory layer to your agent, at least run this baseline on your own data.
https://arxiv.org/abs/2610.30755
Chat with Paper: https://academy.dair.ai/papers/is-complex-agentic-memory-always-needed-naive-rag-is-stronger-than-we-thought-2610.30755
来源:elvis · x.com