Weight memory vs. retrieval in agents. Brilliant work from Amazon.
This is a AI post classified by AGK Intelligence as RAG & memory (research), kept by the AI Radar because it carries real work, not commentary.
Weight memory vs. retrieval in agents. Brilliant work from Amazon. This work shows weight memory can outperform text memory on recall of user facts. But the best part is that you can leverage both. Using the same model and user data, this work shows that plain fine-tuning stores user facts in weights at 36.9% accuracy, while on-policy self-distillation reaches 59.9%. That second number also beats retrieval. On eight HaluMem-Long users, the distilled model answers with no retrieved context and beats MemOS-style retrieval (47.8%), extracted context (51.9%), and the raw dialogue (51.3%). The
Posted by elvis (328.1k followers) 2 h ago · 51 likes · 3.6k views · view the original post on X. Kept by the AI Radar as RAG & memory. Tools mentioned: academy.dair.ai.
More AI work like this
- BAIDU JUST DROPPED AN ABSOLUTE GAME-CHANGER FOR DOCUMENT AI — @DataChaz
- If you've built a RAG pipeline, you might end up with a huge bill thanks to all the… — @freeCodeCamp
- @shardul_mane — @shardul_mane
- when you connect Mnemos to your ChatGPT, Claude, Grok, etc. you get your own Notebook.… — @RileyRalmuto
- Your company’s knowledge. AI-powered workflows. A secure, open platform. — @Box
- agents hit @firecrawl over a billion times a month — @ericciarla
- alright...it is time. — @RileyRalmuto
- Connecting models to business knowledge makes AI more useful. — @Box
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.5k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 16:50 UTC. Full method.