AI Post Transformers

EverMemOS for Long-Horizon Agent Memory


Listen Later

This episode explores EverMemOS, a memory system for long-lived AI agents that tries to organize past interactions into structured, higher-level semantic “scenes” instead of relying on flat retrieval alone. It explains why bigger context windows and standard RAG often fail when agents accumulate stale preferences, conflicting facts, and fragmented conversational traces, arguing that the real problem is not just forgetting but poorly organized remembering. The discussion walks through the paper’s core design, including MemCells, MemScenes, semantic consolidation, and reconstructive recollection, framing the system as a state-management layer around transformers rather than a new model architecture. A listener would find it interesting because it connects abstract memory research to practical agent failures and offers a concrete alternative for building assistants that can reason more reliably over long time horizons.
Sources:
1. EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoning — Chuanrui Hu, Xingze Gao, Zuyi Zhou, Dannong Xu, Yi Bai, Xintong Li, Hui Zhang, Tong Li, Chong Zhang, Lidong Bing, Yafeng Deng, 2026
http://arxiv.org/abs/2601.02163
2. MemoryBank: Enhancing Large Language Models with Long-Term Memory — Wanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye, Yanlin Wang, 2023
https://scholar.google.com/scholar?q=MemoryBank%3A+Enhancing+Large+Language+Models+with+Long-Term+Memory
3. MemGPT: Towards LLMs as Operating Systems — Charles Packer, Sarah Wooders, Kevin Lin, Vivian Fang, Shishir G. Patil, Joseph E. Gonzalez, 2023
https://scholar.google.com/scholar?q=MemGPT%3A+Towards+LLMs+as+Operating+Systems
4. A Survey on the Memory Mechanism of Large Language Model based Agents — Zeyu Zhang, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Quanyu Dai, Jieming Zhu, Zhenhua Dong, Ji-Rong Wen, 2024
https://scholar.google.com/scholar?q=A+Survey+on+the+Memory+Mechanism+of+Large+Language+Model+based+Agents
5. MemOS: A Memory OS for AI System — Zhiyu Li, Shichao Song, Chenyang Xi, Hanyu Wang, Chen Tang, Simin Niu, Ding Chen, et al., 2025
https://scholar.google.com/scholar?q=MemOS%3A+A+Memory+OS+for+AI+System
6. Memory OS of AI Agent — Jiazheng Kang, Mingming Ji, Zhe Zhao, Ting Bai, 2025
https://scholar.google.com/scholar?q=Memory+OS+of+AI+Agent
7. Zep: A Temporal Knowledge Graph Architecture for Agent Memory — Preston Rasmussen, Pavlo Paliychuk, Travis Beauvais, Jack Ryan, Daniel Chalef, 2025
https://scholar.google.com/scholar?q=Zep%3A+A+Temporal+Knowledge+Graph+Architecture+for+Agent+Memory
8. Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory — Prateek Chhikara, Dev Khant, Saket Aryan, Taranjeet Singh, Deshraj Yadav, 2025
https://scholar.google.com/scholar?q=Mem0%3A+Building+Production-Ready+AI+Agents+with+Scalable+Long-Term+Memory
9. LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory — Di Wu, Hongwei Wang, Wenhao Yu, Yuwei Zhang, Kai-Wei Chang, Dong Yu, 2024
https://scholar.google.com/scholar?q=LongMemEval%3A+Benchmarking+Chat+Assistants+on+Long-Term+Interactive+Memory
10. Evaluating Very Long-Term Conversational Memory of LLM Agents — Adyasha Maharana, Dong-Ho Lee, Sergey Tulyakov, Mohit Bansal, Francesco Barbieri, Yuwei Fang, 2024
https://scholar.google.com/scholar?q=Evaluating+Very+Long-Term+Conversational+Memory+of+LLM+Agents
11. BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — Yuri/Yurii Kuratov et al., 2024
https://scholar.google.com/scholar?q=BABILong%3A+Testing+the+Limits+of+LLMs+with+Long+Context+Reasoning-in-a-Haystack
12. LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks — Yushi Bai et al., 2024/2025
https://scholar.google.com/scholar?q=LongBench+v2%3A+Towards+Deeper+Understanding+and+Reasoning+on+Realistic+Long-context+Multitasks
13. Memory-Aware and Uncertainty-Guided Retrieval for Multi-Hop Question Answering — Yuelyu Ji, Rui Meng, Zhuochun Li, Daqing He, 2025
https://scholar.google.com/scholar?q=Memory-Aware+and+Uncertainty-Guided+Retrieval+for+Multi-Hop+Question+Answering
14. BRIEF: Bridging Retrieval and Inference for Multi-hop Reasoning via Compression — Yuankai Li, Jia-Chen Gu, Di Wu, Kai-Wei Chang, Nanyun Peng, 2024/2025
https://scholar.google.com/scholar?q=BRIEF%3A+Bridging+Retrieval+and+Inference+for+Multi-hop+Reasoning+via+Compression
15. Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Information — Zeyu Zhang et al., 2025
https://scholar.google.com/scholar?q=Explicit+v.s.+Implicit+Memory%3A+Exploring+Multi-hop+Complex+Reasoning+Over+Personalized+Information
16. Handling Preference Drift in Capturing Dynamic User Preferences for Streaming Session-Based Recommendations — Oussama Alahoum, Boudjemaa Boudaa, Laouni Djafri, 2025/2026
https://scholar.google.com/scholar?q=Handling+Preference+Drift+in+Capturing+Dynamic+User+Preferences+for+Streaming+Session-Based+Recommendations
17. Episodic Memory in AI Agents Poses Risks That Should Be Studied and Mitigated — Chad DeChant, 2025
https://scholar.google.com/scholar?q=Episodic+Memory+in+AI+Agents+Poses+Risks+That+Should+Be+Studied+and+Mitigated
18. AI Post Transformers: Memory Sparse Attention for 100M-Token Scaling — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-04-07-memory-sparse-attention-for-100m-token-s-377cff.mp3
19. AI Post Transformers: Recursive Language Models for Arbitrarily Long Prompts — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-04-04-recursive-language-models-for-arbitraril-fbcd1c.mp3
20. AI Post Transformers: Neural Computers as Learned Latent Runtimes — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-04-11-neural-computers-as-learned-latent-runti-9fa282.mp3
21. AI Post Transformers: How Induction Heads Emerge in Transformers — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-05-03-how-induction-heads-emerge-in-transforme-a7bfcb.mp3
Interactive Visualization: EverMemOS for Long-Horizon Agent Memory
...more
View all episodesView all episodes
Download on the App Store

AI Post TransformersBy mcgrof