From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
Extracted source text · arXiv 2605.06716
\documentclass[11pt]{article}
% Change "review" to "final" to generate the final (sometimes called camera-ready) version.
% Change to "preprint" to generate a non-anonymous version with page numbers.
\usepackage[final]{acl}
% Standard package includes
\usepackage{times}
\usepackage{latexsym}
% For proper rendering and hyphenation of words containing Latin characters (including in bib files)
\usepackage[T1]{fontenc}
\usepackage{fontawesome5}
\usepackage{booktabs}
\usepackage{array}
\usepackage{multirow}
\usepackage{caption}
\newcolumntype{L}[1]{>{\raggedright\arraybackslash}p{#1}}
\newcolumntype{C}[1]{>{\centering\arraybackslash}p{#1}}
%summer
\usepackage[most]{tcolorbox} % 核心：用于绘制色块
\usepackage{enumitem} % 用于控制列表（itemize）的间距
\usepackage{xcolor} % 用于定义颜色
% 定义图片中的颜色
\definecolor{summarybg}{RGB}{230, 240, 248} % 背景色
\definecolor{summarytitle}{RGB}{31, 119, 180} % 标题颜色
\definecolor{Ideas}{RGB}{251, 192, 45}
\definecolor{Summary}{RGB}{44, 160, 44} % 标题颜色
% 创建自定义环境 summarybox
\usepackage{fontawesome5} % 提供书本和灯泡图标
\newtcolorbox{summarybox}[1]{
colback=summarybg,
colframe=summarybg,
arc=0mm,
boxrule=0pt,
left=2mm, right=2mm, top=2mm, bottom=2mm,
fontupper=\scriptsize,
title={\textbf{\scriptsize #1}},
coltitle=summarytitle,
attach title to upper,
after title={\smallskip}
}
% This assumes your files are encoded as UTF8
\usepackage[utf8]{inputenc}
% TikZ for tree diagram
\usepackage{tikz}
\usepackage{xcolor}
\usetikzlibrary{shapes.geometric, arrows.meta, positioning, calc, backgrounds}
%他颜色
% Level 1 主色 (莫兰迪/马卡龙色系：清新且高级)
% Storage -> 绿色系 (Sage Green)
\definecolor{memoryorange}{RGB}{160, 215, 180}
% Reflection -> 蓝色系 (Serenity Blue)
\definecolor{reflectiveyellow}{RGB}{160, 200, 240}
% Experience -> 红色系 (Dusty Rose)
\definecolor{experiencegreen}{RGB}{245, 170, 170}
% Level 2 浅色 (主色的 30% 混合白色)
\definecolor{memoryorangelight}{RGB}{195, 230, 210}
\definecolor{reflectiveyellowlight}{RGB}{195, 220, 245}
\definecolor{experiencegreenlight}{RGB}{250, 205, 205}
% Level 3 更浅色 (主色的 15% 混合白色)
\definecolor{memoryorangelighter}{RGB}{220, 242, 230}
\definecolor{reflectiveyellowlighter}{RGB}{220, 235, 250}
\definecolor{experiencegreenlighter}{RGB}{252, 225, 225}
% Level 4 最浅色 (接近白色的极淡色)
\definecolor{memoryorangelightest}{RGB}{238, 250, 242}
\definecolor{reflectiveyellowlightest}{RGB}{238, 245, 252}
\definecolor{experiencegreenlightest}{RGB}{255, 245, 245}
% 箭头渐变颜色
\definecolor{arrowtop}{RGB}{160, 215, 180}
\definecolor{arrowmiddle}{RGB}{160, 200, 240}
\definecolor{arrowbottom}{RGB}{245, 170, 170}
% 声明垂直三色渐变模式
\pgfdeclareverticalshading{triplestopgradient}{100bp}{
color(10bp)=(arrowbottom);
color(50bp)=(arrowmiddle);
color(90bp)=(arrowtop)
}
% This is not strictly necessary, and may be commented out,
% but it will improve the layout of the manuscript,
% and will typically save some space.
\usepackage{microtype}
% This is also not strictly necessary, and may be commented out.
% However, it will improve the aesthetics of text in
% the typewriter font.
% \usepackage{inconsolata}
% Including images in your LaTeX document requires adding
% additional package(s)
\usepackage{graphicx}
\usepackage{amsmath}
\title{From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms\thanks{Our continuously updated list of papers and resources is available at \url{https://github.com/FeishuLuo/Evolving-LLM-Agent-Memory-Survey}.}}
\author{Jinghao Luo$^2$\thanks{Equal contribution.},
Yuchen Tian$^1$\footnotemark[2]\thanks{Project leader.},
Chuxue Cao$^3$, Ziyang Luo$^1$, Hongzhan Lin$^1$,\\
\textbf{Kaixin Li}$^4$, \textbf{Chuyi Kong}$^1$, \textbf{Ruichao Yang}$^5$, \textbf{Jing Ma}$^1$\thanks{Corresponding author.} \\
$^1$Hong Kong Baptist University \,
$^2$South China Normal University\\
$^3$Hong Kong University of Science and Technology\\
$^4$National University of Singapore \,
$^5$University of Science and Technology Beijing\\
\texttt{FeishuEcho@outlook.com, \{yctian, majing\}@comp.hkbu.edu.hk}}
\begin{document}
\maketitle
\begin{abstract}
%基于大语言模型的智能体正日益依赖存储机制来实现长程推理、自适应行为和动态交互。尽管近期相关的研究呈井喷式发展，但现有文献仍显碎片化，且缺乏统一的演进视角，导致研究摇摆在工程化与认知科学之间。本综述通过提出一个全新的演进框架，系统地回顾了LLM agent记忆机制的发展历程，该框架涵盖三个关键阶段存储(轨迹存储)，反思（轨迹提炼）以及经验（轨迹抽象）。我们在研究中首先形式化定义了LLM agent的三个阶段，随后分析了驱动演进的三大核心动力：长程一致需求，动态环境挑战以及持续学习的最终目标。此外，本项工作还特别分析了前沿的“经验阶段”中主动探索和跨轨迹抽象这两类变革型的机制。最后，我们还讨论了未来几个重要的方向。本次调查旨在为社区提供记忆机制的设计思路，为开发下一代LLM agent提供一份清晰的技术路线图。
% Large Language Model (LLM) based agents have increasingly rely on memory mechanisms to achieve long range reasoning, adaptive behavior, and dynamic interaction.
Large Language Model (LLM)-based agents have fundamentally reshaped artificial intelligence by integrating external tools and planning capabilities.
%
% Despite the recent surge in related studies,
% While memory mechanisms have emerged as the architectural cornerstone to mitigate this deficiency, existing research suffers from paradigmatic fragmentation, remains fragmented and lacks a unified evolutionary perspective oscillating between operating system-inspired engineering and cognitive science simulations—and lacks a unified view of technological synthesis.
While memory mechanisms have emerged as the architectural cornerstone of these systems, current research remains fragmented, oscillating between operating system engineering and cognitive science. This theoretical divide prevents a unified view of technological synthesis and a coherent evolutionary perspective.
% causing research to oscillate between engineering and cognitive science.
To bridge this gap, this survey proposes a novel evolutionary framework for LLM agent memory mechanisms, formalizing the development process into three stages: \textbf{Storage} (trajectory preservation), \textbf{Reflection} (trajectory refinement), and \textbf{Experience} (trajectory abstraction). We first formally define these three stages before analyzing the three core drivers of this evolution: the necessity for long-range consistency, the challenges in dynamic environments, and the ultimate goal of continual learning. Furthermore, we specifically explore two transformative mechanisms in the frontier Experience stage: active exploration and cross-trajectory abstraction. By synthesizing these disparate views, this work offers robust design principles and a clear roadmap for the development of next-generation LLM agents.
\end{abstract}
\section{Introduction}\label{Introduction}
In recent years, the rapid advancement of Large Language Models (LLMs) has fundamentally reshaped the landscape of artificial intelligence~\citep{llama,gpt4o,qwen3}. To augment the capabilities of LLMs, researchers have developed LLM-based agents that integrate LLMs with external tools and modular components, thereby enabling planning, tool use, and environmental interaction~\citep{Yao2022ReActSR,toollm,MCPU}. However, the inherent statelessness of LLMs poses a critical challenge: it hinders agents from maintaining logical consistency across complex, multi-step tasks and precludes learning from prior interactions, often resulting in recurring reasoning errors~\citep{Huang2023LargeLM, Xiong2025HowMM, cao2026diffcot}. Consequently, the development of effective memory mechanisms has emerged as an architectural cornerstone. By mitigating this deficiency, memory mechanisms underpin the robust operation of LLM-based agents and pave the way for self-evolution~\cite{Wang2023ASO, Packer2023MemGPTTL, Wu2025EvolveRSL}.
%Fiugre 1
\begin{figure*}[!h]
\centering
\includegraphics[width=1\linewidth]{Figure_1.pdf}
\vspace{-0.3cm}
\caption{Overview of the LLM agent memory mechanisms.}
\label{fig:overview}
\vspace{-0.3cm}
\end{figure*}
%我们考察了目前LLM agent记忆机制研究发展的主要限制。首先，现有工作大体上呈现两种不同的发展范式:一类方法借鉴操作系统中对存储层级和访问机制的设计思路，将Memory视为一种工程化的数据管理与检索系统；另一类方法则受认知科学与心理学的启发，试图模拟人类记忆形成、巩固与调用过程的认知机理。当前LLM agent记忆机制思路在认知建模与系统工程之间交替前进，整体缺乏一条清晰持续的演进脉络。其次，记忆机制发展的核心能力归纳不够明确，现有方法在写入、管理和读取等环节提出了大量的具体实现，但是缺乏对后续研究需要参照的重要变革性技术的概述。此外，在最近的一些调查中，XXXXXX也讨论了与LLM agent记忆机制相关的主题。然而。XXX忽略了发展过程中重要的变革性技术，而XXX则更侧重于记忆形式的静态分类回顾，缺乏动态的认知演进过程。这些限制阻碍了社区对LLM agent下一代记忆机制研究和设计。
%We investigate the primary limitations hindering the advancement of research on memory mechanisms for LLM-based agents. First, existing literature generally follows two distinct paradigms: one approach draws upon design principles regarding storage hierarchies and access mechanisms found in operating systems, treating memory as an engineered system for data management and retrieval~\citep{Packer2023MemGPTTL, Hu2024HiAgentHW, Kang2025MemoryOO}; conversely, the other approach draws inspiration from cognitive science and psychology, attempting to simulate cognitive mechanisms governing the formation, consolidation, and retrieval of human memory~\citep{Zhong2023MemoryBankEL, Hou2024MyAU, Xu2025AMEMAM}. Consequently, current methodologies for memory mechanisms in LLM-based agents oscillate between cognitive modeling and systems engineering, resulting in the absence of a coherent and continuous evolutionary trajectory. Second, the characterization of core capabilities driving the development of memory mechanisms remains ambiguous. Although existing methods propose numerous specific implementations for the writing, management, and retrieval of information, the field lacks a synthesis of the transformative technologies that should serve as references for subsequent research.Furthermore, recent surveys by~\citet{Zhang2024ASO, Hu2025MemoryIT} have discussed topics related to memory mechanisms in LLM-based agents. However,~\citet{Zhang2024ASO} overlooks key transformative technologies within the developmental process, whereas~\citet{Hu2025MemoryIT} prioritizes a static review of classifications of memory forms, thereby failing to capture the dynamic nature of cognitive evolution. These limitations impede the ability of the research community to design and investigate the next generation of memory mechanisms for LLM-based agents.
%我们发现了阻碍LLM agent记忆机制研究进展的两个主要限制。首先，现有的方法在两种联系薄弱的范式之间摇摆：一类以工程为中心，借鉴操作系统的设计思路来管理记忆数据。另一类受认知科学和心理学启发，模拟人类记忆形成、巩固和调用的机理。这种缺乏交替前进的情形导致记忆机制的工作支离破碎，缺乏一条清晰持续的演进脉络。其次，尽管现有方法在写入、管理和读取等环节提出了大量具体实现，但是该领域仍然缺乏后续演进可以参照的重要变革型技术的概述。
% We identify two primary obstacles to advancing memory mechanisms for LLM agents. First, existing methodologies oscillate between two weakly integrated paradigms: one focuses on engineering and adopts design principles from operating systems for the management of memory data~\citep{Packer2023MemGPTTL, Hu2024HiAgentHW, Kang2025MemoryOO}; the other draws inspiration from cognitive science and psychology to simulate mechanisms for the formation, consolidation, and retrieval of memory in humans~\citep{Zhong2023MemoryBankEL, Hou2024MyAU, Xu2025AMEMAM}. The lack of synergistic progress results in a fragmented body of research without a coherent and continuous trajectory of evolution. Second, while current methods provide numerous implementations for stages such as the writing, management, and retrieval of data, the field lacks a synthesis of the transformative technologies that could serve as a unified reference for future evolution.
We identify two primary obstacles to advancing memory mechanisms for LLM agents: (i) \textit{Paradigmatic Fragmentation}: Existing methodologies oscillate between two weakly integrated paradigms. One focuses on engineering, adopting design principles from operating systems for the management of memory data~\citep{Packer2023MemGPTTL, Hu2024HiAgentHW, Kang2025MemoryOO}, while the other draws inspiration from cognitive science and psychology to simulate mechanisms for the formation, consolidation, and retrieval of human memory~\citep{Zhong2023MemoryBankEL, Hou2024MyAU, Xu2025AMEMAM}. This lack of synergistic progress results in a fragmented body of research, preventing the formation of a coherent and continuous trajectory of evolution. (ii) \textit{The Absence of Technological Synthesis}: Although numerous methods address isolated stages of memory processing, the field lacks a cohesive summary of the critical technologies that have historically propelled memory mechanism advancement~\citep{Xu2025AMEMAM, Yang2025CoarsetoFineGM, Zhang2025MemEngineAU}. Existing surveys have not sufficiently isolated these key technical drivers from general methodologies~\cite{Wu2025FromHM, Du2025RethinkingMI, doi:10.36227/techrxiv.176539617.79044553/v1, Cao2025RememberMR}. Consequently, the core technologies remain obscure, leaving future researchers without a clear roadmap of which innovations are robust enough to build upon.
%近期虽然有一些综述探讨了LLM agent的记忆机制，但普遍缺乏统一的演进视角，这掩盖了记忆发展的内在动力，阻碍了对下一代LLM agent记忆机制的深入探索。具体而言，XXX侧重于现有工程模块分类，缺乏对演进路径中关键技术变革的系统阐述；而XXX虽然涵盖记忆的动态过程，但其视角仍然局限于功能性的静态分类，未能揭示动态演进规律。
While recent surveys have examined memory mechanisms for LLM agent systems, they lack a unified evolutionary perspective. This limitation obscures the internal drivers of memory development and impedes the in-depth exploration of architectures for next-generation agents. Specifically, \citet{Zhang2024ASO} focuses on the classification of engineering modules, but fails to systematically expound on the logic behind critical technological transformations throughout their development. Furthermore, while \citet{Hu2025MemoryIT} addresses the dynamic processes of memory, its perspective remains confined to static functional categorizations, failing to reveal the underlying principles of dynamic evolution inherent to memory mechanisms.
%为了解决上述局限性，我们提出了一个动态演进的 LLM agent 记忆机制框架。将记忆演进过程形式化为三个阶段 1）Storage，构建不同的存储模式，侧重于忠实记录历史交互轨迹，2）Reflction，引入动态评估循环，通过主动管理与修正交互轨迹，3）Experience，实现前瞻性的指导，从交互轨迹簇中抽象出高阶行为模式和策略。
To address these limitations, we propose a framework for memory mechanisms in LLM-based agents centered on dynamic evolution. We formalize this evolutionary process into three distinct stages: (i) \textbf{Storage}, which constructs diverse storage modes focused on the faithful recording of historical interaction trajectories; (ii) \textbf{Reflection}, which introduces a loop for dynamic evaluation to actively manage and refine these records; and (iii) \textbf{Experience}, which implements prospective guidance by abstracting high-level behavior patterns and strategies from clustered interactions (\S\ref{Background}).
%在我们提出记忆机制的三个阶段的基础上。我们遵循“Why-How-what”的思维逻辑，围绕三个紧密相连的研究问题展开调查：RQ1：Why do memory mechanisms evolve? 我们揭示长程一致性、动态环境交互及持续学习的需求如何作为核心诱因推动机制演进；RQ2：How do memory mechanisms evolve? 我们勾勒出从存储到反思再到经验的演进路径，分析了其结构性的改变;RQ3: What changes does Experience bring? 我们深入剖析了主动探索与跨轨迹抽象等经验阶段的新范式如何破解智能体的适应性与自主性瓶颈。
Building upon the proposed three stages of memory mechanisms, this survey follows a "Why-How-What" logic to address three interconnected research questions:~\textbf{RQ1: Why do memory mechanisms evolve?} reveals how the requirements for long-range consistency, dynamic environment interaction, and continual learning serve as core catalysts driving mechanistic evolution (\S\ref{Evolutionary Drivers});~\textbf{RQ2: How do memory mechanisms evolve?} delineates the evolutionary path from Storage to Reflection and then to Experience, analyzing the fundamental structural shifts involved (\S\ref{Evolutionary Path}); and~\textbf{RQ3: What changes does Experience bring?} provides an in-depth analysis of how frontier paradigms in the Experience stage, such as proactive exploration and cross-trajectory abstraction, address the bottlenecks in agent adaptability and autonomy (\S\ref{Transformative Experience}).
%最后，我们展望了LLM agent记忆机制的未来方向。首先，我们强调记忆机制应该根据任务类型采取更动态的触发方式；其次，我们强调工作区间记忆的构建是记忆机制的重要核心之际；接下来，我们还主张为记忆机制构建更加全面的数据集，特别是经验阶段。最后，我们将分布式共享记忆的协作以及多模态记忆的融合确立为未来研究的关键突破口。
Finally, we outline future directions for LLM agent memory mechanisms. First, we emphasize that memory mechanisms should adopt more dynamic triggering modes based on task types (\S\ref{Future Direction}). Second, we highlight that the construction of working memory is a vital core of memory mechanisms. Next, we advocate for the development of more comprehensive datasets for memory mechanisms, especially for the Experience stage. Finally, we establish the coordination of distributed shared memory and the fusion of multimodal memory as critical breakthroughs for future research.
%本调查和数据集的概述分别记载于附录A,B和C
The overview of this survey and related datasets is documented in Appendix~\S\ref{Overview} and~\S\ref{Datasets}, respectively.
\section{Background}\label{Background}
\subsection{The LLM Agent Framework}
We formalize an LLM-based agent as a decision-making entity parameterized by $\theta$, interacting with a dynamic environment $\mathcal{E}$. The agent's operation is governed by a policy $\pi_\theta$, which maps the current context to a probability distribution over the action space $\mathcal{A}$.
At time step $t$, the agent receives an observation $o_t \in \mathcal{O}$ and retrieves relevant information $m_t$ from its memory module $\mathcal{M}$. The generated action $a_t$ is sampled as follows:
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{equation}
a_t \sim \pi_\theta(a_t \mid \mathcal{I}, o_t, m_t),
\end{equation}}
where $\mathcal{I}$ denotes the static system instruction, and $m_t = \text{Retrieve}(\mathcal{M}, o_t)$ represents the context-specific memory. Crucially, we distinguish between the global memory repository $\mathcal{M}$ and its retrieved instantiation $m_t$ at time $t$. In this survey, we define ``LLM agent memory'' $\mathcal{M}$ as an externalized repository that bridges the frozen parametric knowledge in $\theta$ and the evolving environmental dynamics.
\subsection{Taxonomy}
We classify the evolution of memory mechanisms into three tiers based on the level of information abstraction and cognitive processing.
\noindent\textbf{Storage.}
Storage serves as the foundational layer. Unlike higher-level mechanisms, storage preserves trajectories with minimal transformation, maintaining a one-to-one correspondence between memory entries and execution traces. We define a trajectory $\tau$ as a chronological sequence of observation-action pairs within a task session:
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{equation}
\tau = \langle (o_1, a_1), \dots, (o_T, a_T) \rangle.
\end{equation}}
The raw storage $\mathcal{M}_{raw}$ is formally defined as a cumulative set of historical trajectories:
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{equation}
\mathcal{M}_{raw} = \{ \tau_i \}_{i=1}^N, \quad \tau_i \in \mathcal{T},
\end{equation}}
where $\mathcal{T}$ represents the space of all possible interaction trajectories.
\noindent\textbf{Reflection.}
Reflection is modeled as a semantic transformation mapping $\mathcal{F}_{ref}: \mathcal{T} \to \mathcal{S}$, where $\mathcal{S}$ denotes the space of evaluated or corrected reasoning paths. Similar to the storage phase, Reflection functions as a mechanism to populate the global repository $\mathcal{M}$, but with a focus on quality density rather than raw fidelity.
It operates by analyzing a completed trajectory $\tau_i$ to generate a refined memory unit $m'_i$, which encapsulates critiques or corrective insights:
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{equation}
m'_i = \mathcal{F}_{ref}(\tau_i \mid \phi),
\end{equation}}
where $\phi$ represents the evaluation criteria. The key distinction lies in the storage protocol: while standard Storage preserves raw interaction logs, Reflection acts as a semantic filter, injecting processed insights back into the repository ($\mathcal{M} \leftarrow \mathcal{M} \cup \{ m'_i \}$). Once stored, $m'_i$ becomes an independent memory entry, decoupling the valuable logic from the specific noise of the original trajectory $\tau_i$ and serving as a refined reference for future retrieval.
\noindent\textbf{Experience.}
Experience represents the highest cognitive layer, characterized by cross-trajectory abstraction. This stage aims to satisfy the Minimum Description Length (MDL) principle by compressing redundant trajectories into generalized schemas.
Let $\mathcal{T}_{batch} \subset \mathcal{M}_{raw}$ be a subset of topologically similar trajectories. We define the Experience function $\mathcal{F}_{exp}$ as an inductive operator that extracts a set of universally applicable rules $\mathcal{K}$:
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{equation}
\mathcal{T}_{batch} = \{ \tau_i \mid \text{Sim}(\tau_i, \tau_j) > \epsilon \},
\end{equation}}
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{equation}
\mathcal{K} = \mathcal{F}_{exp}(\mathcal{T}_{batch}) \quad \text{s.t.} \quad |\mathcal{K}| \ll \sum_{\tau \in \mathcal{T}_{batch}} |\tau|.
\end{equation}}
Formally, $\mathcal{K}$ serves as a policy prior that elevates $\pi_\theta$ beyond
rule consistent actions, enabling decision-making at a higher level of abstraction.
%summer2
%定义记忆机制的阶段
%我们形式化的定义了LLM agent行动流程，并将其中的记忆机制定义为演进的三个阶段，Storage-Reflection-Experience
%我们基于记忆的利用程度来定义记忆机制，并没有引入记忆机制中其他相关的技术定义
%我们定义的三个演进阶段并非完全替代，而是属于进化视角，记忆机制仍然具体上一阶段的部分特征，但其本质已经进入了下一个阶段
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{summarybox}{Summary \& Ideas - Defining the Stages of memory mechanisms}
\begin{itemize}[leftmargin=1.8em, nosep] % [leftmargin=*] 让点点靠左，nosep 压缩行间距
\item[{\makebox[1em][c]{\textcolor{Summary}{\faBook}}}] Defining the Stages of memory mechanisms We provide a formal definition for the workflow of actions in LLM agents and characterize the memory mechanisms within this process as three stages of evolution: Storage, Reflection, and Experience. (\textit{cf}. Figure~\ref{fig:overview})
\item[{\makebox[1em]{\textcolor{Ideas}{\faLightbulb}}}] We define these mechanisms based on the degree of utilization of memory, without introducing other related technical definitions.
\item[{\makebox[1em]{\textcolor{Ideas}{\faLightbulb}}}] The three stages of evolution do not represent complete substitution but are framed within an evolutionary perspective; a mechanism for memory may still retain certain characteristics of the preceding stage, even as its essence has transitioned into the subsequent stage.
\end{itemize}
\end{summarybox}}
\section{Evolutionary Drivers}\label{Evolutionary Drivers}
%为了更好的理解LLM agent记忆机制的演化，我们首先需要明确基本问题RQ1：Why do memory mechanisms evolve?虽然预训练给予了LLM强大的推理能力，但这种能力主要体现在静态的参数化知识上面，在长期的真实世界交互场景中仍存在明显局限。在本节中，我们从LLM agent的三个核心需求出发，探讨它们是如何通过推动记忆机制的演进，从而弥合预训练模型与真实世界之间的差异。
%To facilitate a more profound understanding of the evolution of memory mechanisms in LLM agents, we first address the fundamental question RQ1: Why do memory mechanisms evolve? Although pre-training endows large language models with significant capacity for reasoning, this capacity is primarily localized within static parametric knowledge and exhibits clear limitations in scenarios of interaction within the real world over extended durations. In this section, we investigate three core requirements for LLM agents to explore how they catalyze the evolution of memory mechanisms, thereby bridging the gap between models that are pre-trained and the complexities of the real world.
%为了更好的理解LLM agent记忆机制的演化，我们首先需要明确基本问题RQ1：Why do memory mechanisms evolve?在本节中，我们从LLM agent的三个核心需求出发，探讨它们是如何通过推动记忆机制的演进，从而弥合预训练模型与真实世界之间的差异。
To facilitate a comprehensive understanding regarding the evolution of memory mechanisms for LLM agents, we first address the fundamental question \textbf{RQ1: Why do memory mechanisms evolve?} In this section, we examine three core requirements for LLM agents to investigate how they drive the progression of memory mechanisms, thereby bridging the gap between models from pretraining and the real world.
%(1) 长程一致
%长程一致性是LLM agent迈向真实世界的先决条件，也是早期驱动记忆机制产生的源动力。虽然LLM在上下文窗口内部表现出较强的局部连贯性，但是真实世界的任务执行往往要求LLM agent跨越多个时间步进行决策和交互。冗余探索、错误积累与推理断裂会频繁出现在交互轨迹中，使得LLM agent难以维持整体的一致性。我们以两个互补的维度分析LLM agent对一致性的内在需求：其一是状态连贯；其二则是目标一致。
\subsection{Long-Term Consistency}
%Consistency over the long term constitutes a prerequisite for the advancement of LLM agents into the real world and functioned as the original catalyst for studies on memory mechanisms. Although large language models demonstrate high levels of local coherence within the window of the context, the fulfillment of tasks in the real world frequently necessitates that LLM agents perform decision making and interaction across numerous time steps. Redundant exploration, the accumulation of errors, and fractures in reasoning often appear within the trajectories of interaction, which prevents LLM agents from maintaining consistency in a global sense. We examine the inherent need for consistency in LLM agents via two complementary dimensions:coherence of state and consistency of goals.
%长程一致性是LLM agent迈向真实世界的先决条件，也是早期驱动记忆机制演进的源动力。尽管LLM在上下文窗口内具有较强的局部连贯性，但是在多步骤交互中常常会遭受冗余探索、错误累计和推理断裂的困扰。我们通过状态一致性和目标一致性两个维度来分析长程一致的必要性。
Consistency across long horizons constitutes a prerequisite for the deployment of LLM agents within the real world and serves as the primary impetus for the early evolution of memory mechanisms. Although large language models exhibit robust local coherence within the context window, they frequently encounter issues such as redundant exploration, accumulation of errors, and discontinuities in reasoning during interactions involving multiple steps. We analyze the necessity of consistency over long durations through two dimensions: consistency of state and consistency of goals.
%状态连贯
%由于LLM本质上的无状态性，导致其缺乏将自身锚定在现实的内在机制，这直接催生了记忆模块的产生。首先，他维护了内部的推理状态，确保智能体在多步任务中维持一致的思维轨迹。其次，它实现了与外部世界的同步，防止LLM agent基于错误的世界认知产生错误的行为决策。最后，它还能将交互经历内化为连贯的人格特征，通过身份的持续性来约束行为的连贯性。
%The inherent statelessness of LLMs results in a deficiency of internal mechanisms for anchoring the models in reality, which directly necessitated the development of modules for memory~\citep{Huang2023AdvancingTA, Sumers2023CognitiveAF,Packer2023MemGPTTL}. First, memory maintains internal states of reasoning to ensure that agents preserve consistent trajectories of thought during tasks with multiple steps~\citep{Yao2023TreeOT, Sun2025ScalingLL}. Second, it facilitates synchronization with the external world, which prevents LLM agents from making erroneous decisions for behavior based on inaccurate states of the world~\citep{Majumder2023CLINAC, Yang2025CoarsetoFineGM}. Finally, memory allows for the internalization of experiences from interaction into coherent traits of persona, thereby ensuring the coherence of behavior through the persistence of identity~\citep{Park2023GenerativeAI, Westhuer2025EnablingPL}.
%LLM agent固有的无状态性导致缺乏将自身锚定在显示的内在机制，这催动了记忆模块的产生。首先，它维持内部的推理状态以保持思维的连贯；其次，它将代理认知与外部世界同步，防止错误内部认知导致的错误决策，最后，它将交互内化为持久的角色特征，以确保行为统一。
\noindent\textbf{Consistency of State.}
The inherent statelessness of LLM agents results in a deficiency of internal mechanisms for explicit anchoring, which has catalyzed the emergence of modules for memory~\citep{Huang2023AdvancingTA, Sumers2023CognitiveAF,Packer2023MemGPTTL}. First, these modules maintain internal states for reasoning to ensure the coherence of thought~\citep{Yao2023TreeOT, Sun2025ScalingLL}; second, they synchronize the cognition of the agent with the external world to prevent erroneous decisions arising from inaccurate internal perceptions~\citep{Majumder2023CLINAC, Yang2025CoarsetoFineGM}; finally, they internalize interactions into persistent traits of the persona to ensure uniformity in behavior~\citep{Park2023GenerativeAI, Westhuer2025EnablingPL, Liang2025AIMB}.
%目标一致
%由于LLM的自回归本质，LLM agent倾向于针对局部一致的动作进行优化，这通常会导致逐渐偏离原始的任务目标。该问题在多步规划和多智能体的现实场景中尤其突出。记忆机制通过持久且明确地表示高级目标来缓解短期推理或环境观察的影响。此外，在多智能体系统中，通过对目标相关记忆的对齐与共享，个体孤立的局部行为可以被拓展为群体对目标的共同理解和协调执行。
%Owing to the autoregressive nature of large language models, LLM agents tend to optimize for actions that achieve consistency at a local level, which frequently results in a gradual divergence from the original goals of the task~\citep{Huang2024UnderstandingTP, Everitt2025EvaluatingTG}. This issue is particularly pronounced in practical scenarios that require planning across multiple steps or involve the interaction of multiple agents. memory mechanisms mitigate the influence of reasoning in the short term or observations from the environment by providing a representation of goals at a high level that is both persistent and explicit~\citep{Hu2024HiAgentHW, Li2025HiPlanHP}. Furthermore, within systems of multiple agents, the alignment and sharing of memories related to the goal allow behaviors that are isolated at the individual level to be transformed into a collective understanding and coordinated execution of the objective by the group~\citep{Gao2024AgentScopeAF, Liu2025RCRRouterER}.
%由于自规划的本质，LLM agent经常针对局部一致的动作进行优化，从而导致全局目标的背离。记忆机制通过提供持久、明确的高级目标来减轻这种漂移。此外在多智能体系统中，共享的目标相关记忆可以将孤立的行为转变为协调的集体执行，维护最终目标统一。
\noindent\textbf{Consistency of Goals.}
Due to the inherent nature of planning by the agent, LLM agents frequently optimize for actions with local consistency, which results in a departure from objectives at the global level~\citep{Huang2024UnderstandingTP, Everitt2025EvaluatingTG}. Memory mechanisms mitigate this drift by providing persistent and explicit goals at a high level~\citep{Hu2024HiAgentHW, Li2025HiPlanHP}. Furthermore, in systems with multiple agents, shared memory regarding goals can transform isolated behaviors into coordinated execution by the collective, thereby maintaining the unity of the final objective~\citep{Gao2024AgentScopeAF, Liu2025RCRRouterER}.
%(2) 动态环境
%LLM agent与动态环境的交互构成了记忆机制演进更持久的驱动力。与静态基准或单轮问题解决设置不同，现实环境的本质上是非静态的，知识的时效性和环境的因果性相互交融，这使得固定的推理模式和静态的记忆迅速变的脆弱。
%The interaction between LLM agents and dynamic environments provides a persistent impetus for the evolution of memory mechanisms. In contrast to static benchmarks or settings for problem solving in a single turn, the nature of realistic environments is inherently nonstationary. The interplay between the temporal validity of knowledge and the causal structure of the environment causes fixed patterns for reasoning and static memory to become rapidly fragile.
%环境的动态特性构成了记忆机制演进的更持久动力。与静态基准不同，真实环境中时间有效性和环境因果关系之间相互作用使得固定的推理模式和静态的存储迅速变得脆弱。
\subsection{Dynamic Environments}
%The dynamic characteristics of the environment constitute a more enduring impetus for the evolution of memory mechanisms. In contrast to benchmarks of a static nature, the interplay between temporal validity and causality within the environment in settings from the real world renders fixed patterns for reasoning and static forms of storage rapidly fragile.
The dynamic characteristics of the environment constitute a more enduring impetus for the evolution of memory mechanisms. In contrast to static benchmarks, the interplay between temporal validity and causality in real-world settings renders fixed patterns for reasoning and static forms of storage rapidly fragile.
\begin{figure}[!h]
\centering
\includegraphics[width=1\linewidth]{Figure_2.pdf}
\caption{The Drivers in Dynamic Environments.}
\label{fig:2}
\end{figure}
%知识的时效性
%在动态环境中，LLM agent所拥有的知识不再普遍有效，而是受当前条件的限制。随着环境动态的发展，曾经正确的事实，启发和行动策略可能会逐渐失去有效性。至关重要的是，过时的知识往往会悄无声息的失败，尽管事实上已经不正确，但它仍然具有高度的语义相关性。这使得记忆机制需要从静态的记忆存储转向主动的记忆管理，结合时间感知，记忆衰减和更加灵活的记忆检索等机制。
%Within dynamic environments, the knowledge possessed by LLM agents is no longer universally valid but is instead contingent upon current conditions~\citep{Lazaridou2021MindTG, Jang2022TemporalWikiAL, Ko2024GrowOVERHC}. As the dynamics of the environment evolve, facts, heuristics, and strategies for action that were previously accurate may gradually lose their efficacy. Crucially, obsolete knowledge frequently leads to silent failure; despite being factually incorrect, it often retains a high degree of semantic relevance~\citep{ luu2022timewaitsoneanalysis, Kalai2023CalibratedLM, kasai2024realtimeqawhatsanswer}. This phenomenon necessitates a transition in memory mechanisms from the static storage of information toward active management of memory, incorporating elements such as awareness of time, the decay of memory, and more flexible methods for the retrieval of memory~\citep{Zhong2023MemoryBankEL, Siyue2024MRAGAM, Li2025MemOSAM, Salama2025MemInsightAM}.
%动态环境中的知识通常仅在一定条件下成立，并非永恒成立。随着环境的发展，以前正确的行动策略可能会逐渐失去有效性。至关重要的是，过时的知识往往会悄无声息的失败，尽管事实上已经不正确，但仍然具有高度语义相关性。这推动记忆机制从静态的存储转向主动的管理，结合时间感知、衰减策略和更灵活的检索。
\noindent\textbf{The Temporal Validity of Knowledge.}
Knowledge within environments of a dynamic nature is typically conditional rather than eternally valid~\citep{Lazaridou2021MindTG, Jang2022TemporalWikiAL, Ko2024GrowOVERHC}. As the environment progresses, strategies for action that were once correct may experience a gradual loss of utility. Crucially, knowledge that is outdated often fails without overt indication~\citep{luu2022timewaitsoneanalysis, Kalai2023CalibratedLM, kasai2024realtimeqawhatsanswer}; although factually incorrect, such information may still exhibit significant relevance in its semantic representation. This necessity propels the evolution of memory mechanisms from the paradigm of static storage toward that of active management, integrating awareness of temporal factors, policies for decay, and methods for retrieval with enhanced flexibility~\citep{Zhong2023MemoryBankEL, Siyue2024MRAGAM, Salama2025MemInsightAM, Du2025MemR3MR, Houichime2025MemoryAR}.
%环境的因果性
%动态环境的因果性对记忆机制也提出了前所未有的要求。现实世界的环境表现出了复杂的因果性，某些行为甚至会引发级联效应，而决策导致的结果通常需要一段时间后才能显现。这要求LLM agent不仅需要存储历史交互，还需要依靠记忆机制构建跨时间步的因果依赖。凭借构建因果一致的世界模型实现在动态环境下稳健的行为规划。
%The causality inherent in dynamic environments also imposes unprecedented requirements on memory mechanisms. Environments in the real world exhibit complex causality, wherein certain actions may trigger effects in a cascade, and the outcomes resulting from decisions typically manifest only after a duration of time~\citep{Joshi2024COLDCR, Cui2025UncertaintyIC, Liu2025LargeLM}. This necessitates that LLM agents not only store interactions from the past but also rely on memory mechanisms to construct dependencies of causality across steps of time~\citep{Majumder2023CLINAC, Raman2025REMIAN}. By establishing a model of the world with consistency in causality, agents can achieve robust planning of behavior within environments that are dynamic~\citep{Tang2024WorldCoderAM, Kim2025CoExC}.
%复杂的现实世界因果关系涉及延迟结果和级联效应。这要求记忆机制必须超越记录交互本身，构建跨越时间步的复杂因果依赖关系。通过因果一致的内在世界来实现稳健的规划。
\noindent\textbf{The Causal Structure of the Environment.}
Causal relationships within the complex real world involve delayed outcomes and cascading effects~\citep{Joshi2024COLDCR, Cui2025UncertaintyIC, Liu2025LargeLM}. This necessitates that memory mechanisms transcend the mere documentation of interactions to construct dependencies for causality of a complex nature across steps in time~\citep{Majumder2023CLINAC, Du2025MemoryT1RL, Raman2025REMIAN}. Consequently, planning with robustness is achieved through the realization of internal worlds characterized by consistency in causality~\citep{Tang2024WorldCoderAM, Kim2025CoExC, Bohnet2025EnhancingLP}.
%(3) 持续学习
%持续学习是LLM agent长期发展的终极要求。当部署在开放环境中时，智能体不可避免地会遇到训练分布之外的模式。如果没有能力将这些记忆内化为可复用的知识，智能体将局限于重复的试错循环。因此，持续学习对记忆机制提出了更高层次的要求：记忆不仅需要提供复用过往经历的手段，还需要应对两个不同维度的挑战：其一，密集记忆的扩展性瓶颈；其二，记忆到经验的跃迁需求。
%Continual learning constitutes the ultimate requirement for the development of LLM agents over the long term. When deployed within open environments, agents inevitably encounter patterns that fall outside the distribution of training. In the absence of a capacity to internalize these memories into knowledge for reuse, agents remain confined to repetitive cycles of trial and error. Consequently, continual learning imposes higher-level constraints on memory mechanisms: memory must not only support the reuse of past experiences but also address two critical challenges—first, Constraints on The Storage of Memory; and second, the requirement for experience.
\subsection{Continual Learning}
%持续学习是对LLM agent的终极要求。开放世界的部署不可避免地会面对训练外的模式。如果没有将这些记忆内化为可重用的知识，LLM agent将陷入重复的试错循环。因此，记忆机制不仅需要做到的过往重现，还需要解决密集记忆的扩展瓶颈和抽象需求。
Continual learning represents the ultimate requirement for LLM agents. Deployment within an open world inevitably involves encountering patterns that reside outside of the distribution of training. Without the effective internalization of these memories into actionable knowledge for reuse, the LLM agent will remain confined to repetitive cycles of trial and error. Therefore, memory mechanisms must not only enable the reproduction of historical trajectories but also address the bottlenecks of scaling and the requirements for abstraction inherent in dense memory.
%存储记忆的限制
%随着LLM agent与真实世界长时间交互积累记忆，存储的记忆量通常会线性拓展，早期的记忆机制通过向量化等机制来拓展记忆的存储量。但是最近的研究表明，无限制的记忆拓展反而对LLM agent性能有害，错误将会在记忆系统中传播来污染学习的效果。因此，记忆机制的研究需要探索更具战略性的添加和删除策略。
%As LLM agents accumulate memory through interactions within the real world over long durations, the volume of memory in storage typically expands linearly~\citep{Hu2023ChatDBAL, Packer2023MemGPTTL}. Early memory mechanisms utilized techniques such as vectorization to increase the capacity for the storage of memory. However, recent research indicates that the unrestricted expansion of memory is detrimental to the performance of LLM agents, as errors propagate within the system of memory and contaminate the effectiveness of learning~\cite{Xiong2025HowMM}. Therefore, investigations into memory mechanisms must explore more strategic policies for the addition and removal of information~\cite{Du2025RethinkingMI}.
%长时间与现实世界交互会导致存储的记忆线性拓展，早期的记忆机制利用向量化等方法来拓展存储。但是最近的研究表明，无限制的记忆拓展反而对LLM agent性能有害，错误会在记忆系统中传播并污染学习的效果。这需要记忆机制探索更战略性的添加和删除策略。
\noindent\textbf{Constraints on The Storage of Memory.}
Interaction with the real world over extended durations results in the linear expansion of memory in storage~\citep{Hu2023ChatDBAL, Packer2023MemGPTTL}. Early memory mechanisms utilized techniques such as vectorization to scale storage capacity. However, recent research indicates that the unrestricted expansion of memory is detrimental to the performance of LLM agents, as errors propagate within the system for memory and contaminate the efficacy of learning~\citep{Xiong2025HowMM, srivastava2025memorygraftpersistentcompromisellm}. This necessitates the exploration of more strategic policies for the addition and deletion of information within memory mechanisms~\cite{Du2025RethinkingMI, Liu2025ContextAA}.
%经验的需求
%LLM agent记忆大多是情景性的，与特点的背景、任务或环境深度捆绑。这迫使记忆机制将记忆转变为经验的要求，经验跨越了多个轨迹，将记忆内化为指导未来行为的知识。这使得记忆机制开始探寻更多的方式抽象经验，例如，通过迭代反思和蒸馏将多轮探索的轨迹提炼为语义化的经验，或是直接通过微调将轨迹抽象为参数经验。
%The majority of memory in LLM agents is episodic and remains deeply coupled with specific backgrounds, tasks, or environments~\citep{Shinn2023ReflexionLA, Wang2023ASO}. This necessitates the transformation of memory into experience, which spans multiple trajectories and internalizes memory into knowledge for the guidance of future behavior. Consequently, research on memory mechanisms has begun to investigate diverse approaches for the abstraction of experience, such as the refinement of trajectories from multiple rounds of exploration into semantic experience through iterative reflection and distillation~\citep{Tang2025AgentKL, Cai2025FLEXCA}, or the direct abstraction of trajectories into parameters by means of fine-tuning~\citep{Xia2025Agent0US, Alakuijala2025MementoNM}.
%大多数LLM agent的记忆都是情景性的，局限于特定的任务。这迫使原始的记忆群需要转化为经验，以指导未来跨情景的行为。这使得部分记忆机制的工作开始探寻多种方式抽象出经验。
\noindent\textbf{The Requirement for Experience.}
The memory of most LLM agents is of an episodic nature and remains restricted to specific tasks~\citep{Shinn2023ReflexionLA, Wang2023ASO}. This limitation necessitates the transformation of raw clusters of memory into experience to provide guidance for behavior across future scenarios. Consequently, research on memory mechanisms has begun to explore various methodologies for the abstraction of experience~\citep{Tang2025AgentKL, Cai2025FLEXCA, Xia2025Agent0US, Alakuijala2025MementoNM, Guo2025GenEnvDC}.
%记忆演进的驱动因素
%长程一致，动态环境和持续学习作为最主要的三个动力共同促使LLM agent从静态的模型演变为能够在真实世界中长期存在并进化的自主实体。
%记忆机制演进的驱动力本身也代表了研究者们不断增加的要求，从保证复杂推理任务的长程一致性再到适应不断变化的动态世界，最终期望在LLM agent在任务场景下不断完善自我。
%
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{summarybox}{Summary \& Ideas - Evolutionary Drivers}
\begin{itemize}[leftmargin=1.8em, nosep]
\item[{\makebox[1em][c]{\textcolor{Summary}{\faBook}}}] Consistency over long durations, dynamic environments, and the capacity for continual learning drive the evolution of LLM agents from static models into autonomous systems capable of operation within the real world over extended horizons.
\item[{\makebox[1em]{\textcolor{Ideas}{\faLightbulb}}}] The driving force for the evolution of memory mechanisms stems from a leap in research vision: from maintaining logical consistency in complex reasoning, to dynamic adaptation in environmental perception, and finally to the autonomous evolution of LLM agents.
\end{itemize}
\end{summarybox}}
\section{Evolutionary Path}\label{Evolutionary Path}
%基于这些进化驱动因素，我们深入探究了RQ2: How do memory mechanisms evolve?将演进路径归纳为：Storage、Reflection and Experience
Building upon these evolutionary drivers, we conduct an investigation in-depth into \textbf{RQ2: How do memory mechanisms evolve?} We categorize the trajectory of evolution into three primary stages: storage, reflection, and experience.
\subsection{Storage}
%存储阶段是记忆机制的起点，其核心目标是解决 LLM 有限上下文窗口与不断增长的交互历史之间的矛盾，此阶段的记忆机制致力于尽可能的忠实地保存交互轨迹$\tau_i$以维持智能体的行动一致性。
The stage of storage serves as the starting point for memory mechanisms, where the primary objective is to resolve the contradiction between the limited window of context within Large Language Models and the continuously expanding history of interaction. Memory mechanisms during this phase are dedicated to the faithful preservation of interaction trajectories $\tau_i$ to the greatest extent possible to maintain consistency in the actions of the agent.
\noindent\textbf{Linear.}
%线性存储是最直接的记录方式，它将交互轨迹视为按时间排序的Token流，通常采用FIFO的策略进行管理。研究的重点在于通过修改注意力机制或位置编码来拓展上下文窗口，或通过机械降噪的方式来实现信息稀疏化。
Linear storage represents the most direct method of recording, in which interaction trajectories are treated as a stream of tokens ordered by time and managed typically through a strategy of First-In, First-Out (FIFO). Research focuses on the extension of the window of context via modifications to the mechanism of attention or the encoding of position~\citep{Ratner2022ParallelCW, Xiao2023EfficientSL,Jin2024LLMML}, as well as the achievement of information sparsification through the mechanical reduction of noise~\citep{Zhang2023H2OHO, Jiang2023LLMLinguaCP,Xiao2024InfLLMTL}.
\noindent\textbf{Vector.}
%向量存储将交互轨迹编码到高维空间，大大拓展的记忆的存储容量。此类方法将研究的重心从存储设计转向检索优化，包括基于语义邻近度的检索和引入时间衰减、重要性评分的加权检索。
Vector storage encodes interaction trajectories into a high-dimensional space, which greatly expands the capacity for the storage of memory. Such methods shift the focus of research from the design of storage toward the optimization of retrieval, including retrieval based on semantic proximity~\citep{Melz2023EnhancingLI, Liu2024MemLongMR, Das2024LarimarLL} as well as weighted retrieval that incorporates temporal decay and scores for importance~\citep{Zhong2023MemoryBankEL, Park2023GenerativeAI}.
\noindent\textbf{Structured.}
%结构化存储采用显式的数据架构以超越线性存储的容量限制和向量检索的歧义性。例如，利用关系数据库的表格形式存储记忆，把记忆划分为不同层次解决存储容量和检索速度的权衡问题，直接将交互历史建模为实体和关系的拓扑网络。
Structured storage employs explicit data architectures to transcend the limitations on capacity inherent in linear storage and the ambiguity associated with vector retrieval. For instance, these methods utilize the tabular formats of relational databases for the storage of memory~\citep{Hu2023ChatDBAL, Xue2023DBGPTED, Lee2025TrainingAT}, partition memory into distinct hierarchies to address the trade-off between storage capacity and speed of retrieval~\citep{Packer2023MemGPTTL, Lu2023MemoChatTL}, and directly model the history of interaction as a topological network of entities and relations~\citep{Modarressi2024MemLLMFL, Li2024GraphReaderBG}.
%反思
\subsection{Reflection}
%存储机制无法解决记忆的质量问题，原始轨迹中不可避免地混杂着幻觉、逻辑错误及无效尝试，这使得记忆机制逐渐转向反思阶段。反思阶段将记忆从被动的记录着转变为主动的批判者，利用各种反馈信号对过往轨迹进行修正与去噪，以提升记忆库的质量。
Mechanisms for storage fail to address the quality of memory, as raw trajectories are inevitably contaminated by hallucinations, errors in logic, and ineffective attempts. This limitation necessitates a transition of memory mechanisms toward reflection. In this phase, memory is transformed from a passive recorder into an active critic, utilizing various signals of feedback to perform correction and denoising of past trajectories to enhance the quality of the repository of memory.
\noindent\textbf{Introspection.}
%内省式
%内省式反思将LLM agent视为自主批评家，利用模型内部的知识来完善记忆，无需外部的反馈，研究的重点是通过纠正轨迹中的错误，维护记忆的生命周期和对长轨迹进行压缩提炼。
Introspective reflection conceptualizes the LLM agent as an autonomous critic that leverages the internal knowledge of the model to refine memory without the requirement for external feedback. Research in this area focuses on the correction of errors within trajectories~\citep{Liu2023ThinkinMemoryRA, Zhang2025ConstructingCS, Bohnet2025EnhancingLP, cao2026pushing}, the maintenance of the lifecycle of memory~\citep{Li2025CAMAC, Kang2025MemoryOO, Chhikara2025Mem0BP}, and the compression and distillation of long trajectories~\cite{Huang2025MemOrbAP, Han2025LEGOMemMP, Yang2025CoarsetoFineGM, Ye2025AgentFoldLW}.
\noindent\textbf{Environment.}
%环境式
%环境式反思将外部环境信号作为记忆反思的主要锚点，以减轻“幻觉”问题，该方法侧重利用现实世界的结果来主动优化行为策略和校准内部的世界模型。
Environmental reflection treats signals from the external environment as the primary anchors for the reflection of memory to mitigate the issue of hallucinations. This approach focuses on the utilization of outcomes from the real world to proactively optimize policies for behavior~\citep{Sun2024EnhancingAL, Yan2025MemoryDrivenSF, Yan2025MemoryR1EL} and calibrate internal models of the world~\citep{Sun2024EnhancingAL, Xiao2025ToolMemEM, Sun2025PreferenceAwareMU}.
\noindent\textbf{Coordination.}
%协作式
%协作式的反思将这一过程拓展到的群体，利用角色分工和共识来克服个体认知的瓶颈。通过构建异构的智能体社会来实现对记忆的反思。
Collaborative reflection extends this process to the collective, leveraging the division of roles and consensus to overcome bottlenecks in the cognition of individuals. This mechanism facilitates the reflection of memory through the construction of societies of heterogeneous agents~\cite{Bo2024ReflectiveMC, Balestri2025NarrativeMI, Wang2025GraphCogentML, Ozer2025MARMultiAgentRI}.
\subsection{Experience}
%尽管通过反思能有效的降低噪声和幻觉，但由于反思记忆往往是碎片化且高度依赖于上下文。这会导致记忆机制面对新任务时需要承担较高的检索成本与推理负担。此外，最新的研究也表明LLM agent对成功的轨迹常常表现出显著的“跟随”特性，不加抽象的修正轨迹仍可能因为微小的上下文偏移诱发错误。因此，经验阶段的记忆通过从相似轨迹中剥离具体语境，提炼出具有普适性的启发式智慧，这在压缩原本庞大的记忆库的同时以类似人类的“直觉”形式实现对未知环境的泛化能力。
Although reflection effectively mitigates noise and hallucinations, reflected memories are frequently fragmented and exhibit a high degree of dependence on context. This results in significant costs for retrieval and a heavy burden of inference for memory mechanisms when addressing new tasks. Moreover, recent research indicates that LLM agents often demonstrate a pronounced tendency to follow successful trajectories; corrected trajectories devoid of abstraction may still induce errors resulting from minor shifts in context. Consequently, memory in the stage of experience extracts universal heuristic wisdom by isolating similar trajectories from their specific contexts. This approach compresses the originally vast repository of memory and enables generalization to unknown environments through a form of intuition similar to that of humans. A detailed comparison between reflection and experience is summarized in Table~\ref{tab:reflection_vs_experience}.
%Although reflection effectively mitigates noise and hallucinations, reflected memories are frequently fragmented and exhibit a high degree of dependence on context. This results in significant costs for retrieval and a heavy burden of inference for memory mechanisms when addressing new tasks. Moreover, recent research indicates that LLM agents often demonstrate a pronounced tendency to follow successful trajectories; corrected trajectories devoid of abstraction may still induce errors resulting from minor shifts in context. The fundamental distinction is therefore one of operational scope: \textbf{reflection operates on individual trajectories}, producing refined entries tied to their original context that are retrieved to assist similar tasks, whereas \textbf{experience operates across trajectory clusters}, abstracting universal wisdom detached from any specific scenario to guide decisions in unseen situations and drive self evolution. Consequently, memory in the stage of experience extracts universal heuristic wisdom by isolating similar trajectories from their specific contexts, compressing the vast repository of memory and enabling generalization to unknown environments through a form of intuition similar to that of humans.A detailed comparison between reflection and experience is summarized in Table~\ref{tab:reflection_vs_experience}.
%显式经验
%显示经验代表了符号集成，从交互轨迹群中提取人类可读和可编辑的高泛化性经验。允许LLM agent通过将经验具体化为自然语言策略，或是直接抽象化为可执行的实体，从而实现了高解释性的自进化过程。
\noindent\textbf{Explicit.}
Explicit experience represents the integration of symbols, extracting human-readable and editable experiences with a high level of generalizability from clusters of interaction trajectories. This allows the LLM agent to achieve a highly interpretable process of self-evolution by either concretizing experiences into natural language policies~\citep{Cai2025FLEXCA, Zhang2025GMemoryTH, Hassell2025LearningFS, Wan2025LoongFlowDE} or directly abstracting them into executable entities~\citep{Wang2025InducingPS, Zhang2025AccelOptAS, Shi2025YoutuAgentSA}.A further line distills accumulated trajectories into an evolvable skill library, coupling procedural abstractions with a lifecycle of induction, reuse, and refinement~\citep{Zhang2026MemSkillLA, Ni2026Trace2SkillDT}.
\noindent\textbf{Implicit.}
%隐式经验
%隐式经验将交互历史内化为模型参数，旨在解决显性记忆带来的推理开销和上下文限制。隐式经验可以通过微调的方式直接转化为模型自身的能力实现，同时，社区也在探索将经验转化为模型的隐藏层的潜变量，在推理过程中动态调用。
Implicit experience internalizes interaction histories into model parameters, aiming to resolve the inference overhead and context limitations inherent in explicit memory. Implicit experience can be realized by directly converting experiences into the model's intrinsic capabilities through fine-tuning~\citep{Alakuijala2025MementoNM, Zhai2025AgentEvolverTE, Zhang2025AgentLV, Tandon2025EndtoEndTT, Yu2025GuidedSL}. Furthermore, the research community is exploring the transformation of experience into latent variables within the model's hidden layers, which are then dynamically invoked during the inference process~\citep{Zhang2025LatentEvolveST, Zhang2025MemGenWG}.
\noindent\textbf{Hybrid.}
%混合经验
%混合经验建立了一个积累-内化的动态循环过程。通过“经验迁移”的机制，将显示经验视为一个高容量的缓存，以周期性的参数更新方式经其压缩内化为模型的隐式权重。
Hybrid experience establishes a dynamic cycle of accumulation and internalization. Through a mechanism for experience transfer, explicit experience is treated as a high-capacity cache, which is subsequently compressed and internalized into the implicit weights of the model through periodic updates of parameters~\citep{Wu2025EvolveRSL, liu2026exploratorymemoryaugmentedllmagent, Ouyang2025ReasoningBankSA, Xia2026SkillRLEA}.
%summer3
%记忆演进的路径
%本章介绍了LLM agent记忆机制从追求忠实记录的“存储阶段”，经由纠偏去噪的“反思阶段”，最终演进为高阶抽象“经验阶段”的演进路径。
%尽管部分工作以经验相称，但他们可能并不属于本次调查的经验范畴
%由于长度限制，我们在演进路径中并没有详细介绍工作，部分有代表性的工作我们将放在附录中介绍
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{summarybox}{Summary \& Ideas - Evolutionary Path}
\begin{itemize}[leftmargin=1.8em, nosep] % [leftmargin=*] 让点点靠左，nosep 压缩行间距
\item[{\makebox[1em][c]{\textcolor{Summary}{\faBook}}}] This chapter traces how LLM agent memory mechanisms evolve from faithful recording in Storage, to error correction in Reflection, and finally to high-order abstraction in Experience.
\item[{\makebox[1em]{\textcolor{Ideas}{\faLightbulb}}}] Although a portion of the literature adopts the terminology of experience, these works may not fall within the conceptual scope of experience established for this survey.
\item[{\makebox[1em]{\textcolor{Ideas}{\faLightbulb}}}] Due to space constraints, we do not provide detailed descriptions of these works within the evolutionary path; instead, some representative studies are presented in the Appendix~\S\ref{Detail within the Evolutionary Path}.
\end{itemize}
\end{summarybox}}
\begin{table*}[t]
\centering
\small
\renewcommand{\arraystretch}{1.3}
\begin{tabular}{p{2.8cm}p{6.5cm}p{6cm}}
\toprule
\textbf{Dimension} & \textbf{Reflection} & \textbf{Experience} \\
\midrule
Functional signature &
Intra-trajectory transformation: $\mathcal{F}_{\text{ref}}(\tau_i \mid \phi) = m'_i$ &
Inter-trajectory induction: $\mathcal{F}_{\text{exp}}(\mathcal{T}_{\text{batch}}) = \mathcal{K}$ \\
Output form &
Refined memory unit $m'_i$ tied to the original task context &
Universal rules or skills $\mathcal{K}$ detached from any specific scenario \\
Retrieval dependency &
Retrieved to assist semantically similar past tasks at inference time &
Applicable to unseen scenarios as a policy prior, without trajectory-level matching \\
Representative works &
Reflexion~\citep{Shinn2023ReflexionLA}, CLIN~\citep{Majumder2023CLINAC}, AgentFold~\citep{Ye2025AgentFoldLW}&
FLEX~\citep{Cai2025FLEXCA}, MemSkill~\citep{Zhang2026MemSkillLA}, SkillRL~\citep{Xia2026SkillRLEA} \\
\bottomrule
\end{tabular}
\caption{Structural comparison between Reflection and Experience. While Reflection injects refined units $m'_i$ back into $\mathcal{M}$ to assist similar future tasks, Experience extracts a separate rule set $\mathcal{K}$ that serves as a policy prior for unseen scenarios, marking a fundamental shift from trajectory-local refinement to cross-trajectory abstraction.}
\label{tab:reflection_vs_experience}
\end{table*}
\section{Transformative Experience}\label{Transformative Experience}
%在阐述完记忆机制的演进路径以后，我们讨论了RQ3：What changes does Experience bring?，在本章节中我们会将会阐明经验作为记忆机制的新阶段有哪些鲜明的技术特征。
Following the exposition of the evolutionary trajectory for memory mechanisms, we address \textbf{RQ3: What changes does Experience bring?} In this section, we elucidate the distinct technical characteristics of experience as a novel stage in the development of memory mechanisms.
%主动探索
\subsection{Active Exploration}
%得益于经验阶段高度压缩轨迹的特性，主动探索利用记忆机制将LLM agent从被动的信息记录者转化为目标驱动的经验收集者。在Experience阶段，记忆机制的核心能力不再局限于存储历史，而是通过主动探索环境来收集高价值的经验。在这里，探索被定义为一个以记忆为中心的过程，先前的经验指导其方向，其结果被抽象回记忆中。
Active exploration leverages memory mechanisms to transform LLM agents from passive recorders of information into collectors of experience driven by goals. In the stage of Experience, the core capability of memory mechanisms is no longer confined to the storage of history, but extends to the acquisition of valuable experience through the active exploration of the environment. Here, exploration is framed as a memory-centric process, where prior experience guides its direction and its outcomes are abstracted back into memory.
%探索的机制
\noindent\textbf{Exploration Mechanisms.}
%主动探索的驱动机制已经从传统的随机探索策略转向更具深度的内在动机和反馈驱动。奖励信号的驱动通过设计和优化即时奖励函数引导LLM agent探索更有价值的状态空间；课程驱动通过动态生成和调整任务序列实现从简单到困难的探索任务；复用驱动通过抽象和复用历史轨迹来进行高效的探索。
The driving mechanisms for active exploration have transitioned from traditional strategies of random exploration toward more profound drivers of intrinsic motivation and feedback. Drivers based on signals of reward guide LLM agents to explore state spaces of greater value through the design and optimization of immediate reward functions~\citep{Zheng2024OnlineIR, Pan2025WonderWW, Sun2025CuriosityDrivenRL}; drivers based on curricula facilitate exploration tasks of increasing difficulty through the dynamic generation and adjustment of sequences for tasks~\citep{Wei2025WebAgentR1TW, Ahn2022DoAI}; and drivers based on reuse enable exploration of high efficiency through the abstraction and reuse of trajectories from history~\citep{Wang2025RAGENUS, Cai2025FLEXCA}.
%探索的维度
\noindent\textbf{Exploration Dimensions.}
%主动探索的核心在于利用记忆机制实现LLM agent的能力边界的拓展。其可以被总结为三个关键维度：广度探索旨在缓解LLM agent在陌生环境下的认知确实，通过好奇心机制将记忆转化为结构化的经验；深度探索侧重于在垂直任务中挖掘高阶技能，驱动记忆从初级的指令遵循到复杂的经验策略；策略探索则聚焦于决策路径的动态优化，利用经验积累提升LLM agent在长程规划中的决策精准度。
The core of active exploration resides in the utilization of memory mechanisms to facilitate the expansion of the boundaries of capability for LLM agents. This process can be categorized into three critical dimensions: exploration of breadth aims to alleviate cognitive deficiencies of LLM agents in unfamiliar environments, transforming memory into experience that is structured through mechanisms of curiosity~\citep{qi2025webrltrainingllmweb, Zhai2025AgentEvolverTE, Cheng2025WebATLASAL}; exploration of depth focuses on the extraction of skills of a high order within vertical tasks, driving the evolution of memory from the basic following of instructions to complex experiential strategies~\citep{Xia2025Agent0US, Liu2025Agent0VLES}; and exploration of strategy centers on the dynamic optimization of paths for decision making, leveraging the accumulation of experience to enhance the precision of decisions for LLM agents during planning over long horizons~\cite{Shi2025MonteCP, BIDOCHKO2026102740}.
%跨轨迹抽象
\subsection{Cross-Trajectory Abstraction}
%跨轨迹抽象通过把孤立的轨迹压缩为普适性的模式，将分散的偶发性经验转化为稳定的策略先验。这使得LLM agent能够超越具体的动作序列，在更高的抽象维度上进行决策，为应对未知任务提供前瞻性的引导，实现对规律的理解。
Cross-trajectory abstraction compresses isolated trajectories into universal patterns, transforming scattered and episodic experiences into stable priors for policy. This enables LLM agents to transcend specific sequences of actions and engage in decision making at higher dimensions of abstraction, which provides prospective guidance for tasks that are unknown and facilitates an understanding of underlying regularities.
\begin{figure}[t!]
\centering
\includegraphics[width=1\linewidth]{Figure_3.pdf}
% \vspace{-0.1cm}
\caption{Overview of Cross-Trajectory Abstraction.}
\label{fig:3}
\vspace{-0.3cm}
\end{figure}
%抽象机制
\noindent\textbf{Abstraction Mechanisms.}
%抽象机制是将原始的交互轨迹群转化为普适性经验的核心算子。与侧重于单条修正的反思机制不同，经验阶段的抽象旨在通过跨轨迹的归纳实现知识的抽象。现有的方法按照抽象载体可分为：通过蒸馏和对比成功与失败轨迹，利用归纳能力提取策略和模式；从轨迹集合中过滤任务特定上下文，将行为序列抽象为层次化的工作流；利用代码的组合性，将重复出现的行为模式封装为可重用的程序函数；通过微调将轨迹群直接内化为模型权重。
%The mechanism for abstraction serves as the core operator for the transformation of groups of raw interaction trajectories into experience that is universal. Distinct from mechanisms for reflection that focus on the correction of single trajectories, abstraction within the stage of experience aims to achieve the abstraction of knowledge through induction across trajectories. Existing methods can be categorized according to the medium of abstraction: the extraction of strategies and patterns by leveraging capabilities for induction through the distillation and comparison of trajectories of success and failure; the abstraction of sequences of behavior into hierarchical workflows by filtering contexts specific to tasks from sets of trajectories; the encapsulation of recurring patterns of behavior into functions for programs that are reusable by utilizing the compositionality of code~\citep{Yang2025AutomatedSD, Zhang2025MemEvolveMO, Wang2025InducingPS}; and the direct internalization of groups of trajectories into the weights of the model through fine-tuning.
%抽象机制是从将原始的交互轨迹群转化为普适性经验的核心算子。与侧重于单条轨迹纠错的反思机制不同，经验阶段的抽象侧重于执行跨轨迹的归纳运算。根据其操作逻辑，包括利用成功与失败轨迹的对立来精确勾勒策略边界的对比归纳；通过对行为序列的分块和多粒度聚合，将细粒度的动作蒸馏为高阶的思维模式；利用代码的组合，将重复出现的行为模式封装为可重用的程序函数；通过微调技术将轨迹群内化为模型参数。
The mechanism for abstraction serves as the core operator for the transformation of groups of raw interaction trajectories into experience that is universal. In contrast to mechanisms for reflection that focus on the correction of errors within single trajectories, abstraction during the stage of experience emphasizes the execution of inductive operations across trajectories. According to its operational logic, this process includes contrastive induction, which utilizes the opposition between successful and failed trajectories to delineate the boundaries of policy with precision~\citep{Forouzandeh2025LearningHP, He2024IDEAET}; the distillation of actions of fine granularity into patterns of thought of a high order through the chunking and aggregation of behavioral sequences across multiple levels of granularity~\citep{Fang2025MempEA, Latimer2025HindsightI2}; the encapsulation of recurring patterns of behavior into program functions that are reusable by leveraging the compositionality of code~\citep{Yang2025AutomatedSD, Zhang2025MemEvolveMO, Wang2025InducingPS}; and the internalization of groups of trajectories into the parameters of the model through techniques for fine-tuning~\citep{Ding2025RethinkingET, Chen2025InternalizingWM}.
%抽象粒度
\noindent\textbf{Abstraction Granularity.}
%记忆机制的抽象层次决定了记忆的可迁移性和可解释性。根据其与原始执行轨迹的距离，抽象层次可以被分为保留语义逻辑，最接近原始任务的浅层抽象；剥离所有自然语言冗余，只含有模块化骨架的结构的中层抽象；以及直接将轨迹压缩进模型内部，具备直觉特征的深层抽象。
The hierarchy of abstraction for memory mechanisms determines the boundaries for generalization and the degree of interpretability for experience. Based on the degree to which the results of abstraction deviate from original trajectories, these can be categorized into three progressive levels: abstraction at the shallow level retains a portion of semantic logic, utilizing “rules” described in natural language as experience~\citep{Cao2025RememberMR, Chen2025SWEExpES, Wei2025EvoMemoryBL, Hayashi2025SelfAbstractionFG}; abstraction at the intermediate level completely removes redundancies of natural language, extracting only modular skeletons for execution as experience~\citep{Wang2024AgentWM, Liu2025ContextualER, Yu2025PolySkillLG}; and abstraction at the deep level compresses the distribution of trajectories into the weights of the model, enabling the complete transformation of experience into intuition for decision making~\citep{Cheng2025AgentR1TP, Luo2025AgentLT, Wang2025ReinforcementLF}.
%summer4
%记忆演进的路径
%在经验这一记忆机制的新阶段，主动探索和跨轨迹抽象成为了这个阶段最主要的两个特征
%经验阶段由于其Cross-Trajectory Abstraction的特点，使得LLM agent能够主动探索去获取更多轨迹，这两者相辅相成共同促进LLM agent自我进化
%经验阶段高度抽象的记忆也能让他们避免一些传统记忆机制容易遇到的问题
{\setlength{\abovedisplayskip}{0.1cm}
\setlength{\belowdisplayskip}{0.1cm}
\begin{summarybox}{Summary \& Ideas - Transformative Experience}
\begin{itemize}[leftmargin=1.8em, nosep] % [leftmargin=*] 让点点靠左，nosep 压缩行间距
\item[{\makebox[1em][c]{\textcolor{Summary}{\faBook}}}] Within the novel stage of memory mechanisms characterized by Experience, active exploration and abstraction across trajectories represent the two primary features of this phase.
\item[{\makebox[1em]{\textcolor{Ideas}{\faLightbulb}}}] The feedback loop between exploration and abstraction serves as the central engine that drives the autonomous and continuous evolution of LLM agents during the phase of experience.
\item[{\makebox[1em]{\textcolor{Ideas}{\faLightbulb}}}] Memories characterized by a high degree of abstraction during the phase of experience also enable agents to circumvent challenges frequently associated with conventional memory mechanisms~\citep{Xiong2025HowMM,Gharat2025FromPT, srivastava2025memorygraftpersistentcompromisellm}.
\end{itemize}
\end{summarybox}}
\section{Future Directions}\label{Future Direction}
%在这一部分中，我们讲讨论LLM agent记忆机制新出现的前景以及有价值的方向
In this section, we discuss emerging prospects and promising directions for memory mechanisms for LLM agents.
\noindent\textbf{Active Memory Perception.}
%目前，某些记忆机制仍然采用被动触发模式，这需要LLM agents对记忆库的很大一部分进行不加区别的检索。更重要的是，稳定地检索不相关或过时的记忆可能会破坏推理的连贯性。最近的工作已经开始通过自主检索控制器来解决这一挑战，未来的研究要求内存机制自主评估任务是否需要引入额外的内存并确定要集成的特定类型的内存，确保内存机制充当按需调用的资源。
Currently, certain memory mechanisms still utilize modes of passive triggering, which necessitates that LLM agents perform indiscriminate retrieval of a significant portion of the memory repository~\citep{Wang2025OMemOM, Rasmussen2025ZepAT}. More importantly, the persistent retrieval of irrelevant or obsolete memories can disrupt the coherence in reasoning of the LLM agent~\cite{Xu2025AMEMAM,Tan2025InPA}. Recent work has begun to address this challenge through autonomous retrieval controllers~\citep{Du2025MemR3MR}. Future research demands that memory mechanisms autonomously evaluate whether a task requires the introduction of additional memory and determine the specific type of memory to be integrated, ensuring that memory mechanisms function as resources that are invoked on demand.
\noindent\textbf{Organization of Working Memory.}
%随着LLM agent面临的任务复杂度和Horizon不断拓展，任务内工作记忆的构建已成为核心瓶颈。LLM agent必须将过往轨迹重构为动态可塑的记忆区间，以实现注意力的有效分配。未来的研究可以聚焦于区间记忆的隔离，重要决策节点的回顾性整合以及工作记忆的自适应剪枝。
As the complexity of tasks and the horizons encountered by LLM agents continue to expand, the construction of working memory within tasks has emerged as a primary bottleneck. LLM agents must reconstruct trajectories from the past into memory intervals that are dynamic and plastic to facilitate the effective allocation of attention~\citep{Hu2024HiAgentHW, Luo2025BeyondCL}. Future research may focus on the isolation of interval memory, the retrospective integration of critical nodes for decision making, and the adaptive pruning of working memory~\citep{Sun2025ScalingLL, zhang2025memoryactionautonomouscontext, Nan2025NemoriSA}.
\noindent\textbf{Benchmark for Experience.}
%现有的数据集主要评估记忆在存储与反思阶段的检索和去噪能力，对于经验阶段的抽象和泛化能力的评估则严重不足(附录 C)。经验生命周期的评估与LLM agent元学习能力息息相关，关系着主动泛化的自演进系统的实现。因此，我们提出的演进路径为指导这些基准的开发提供了有价值的基础。
Existing datasets primarily evaluate the capacity for retrieval and denoising of memory within the stages of storage and reflection, whereas the evaluation of the capacity for abstraction and generalization during the stage of experience remains significantly insufficient (Appendix~\S\ref{Datasets}). The assessment of the lifecycle of experience is closely linked to the capacity for meta-learning in LLM agents, which is essential for the realization of systems for self evolution based on active generalization~\citep{Behrouz2024TitansLT, Wei2025EvoMemoryBL}. Consequently, the path of evolution we propose provides a valuable foundation for guiding the development of these benchmarks.
\noindent\textbf{Distributed Shared Memory.}
%多智能体协作是通过“Organizations”的必经之路。这确立分布式共享记忆在研究中的核心地位。目前共享记忆机制主要依赖显示对话通信，不仅受带宽瓶颈限制，而且容易在沟通中引入噪声。未来的方向是构建一套独属于多智能体的共识记忆系统，保障个体一致性的同时维护群体的共识，构建社会化的经验进化。
Collaboration among multiple agents represents the essential pathway toward the realization of “Organizations.” This establishes distributed shared memory as central to current research~\cite{doi:10.36227/techrxiv.176539617.79044553/v1}. At present, mechanisms for shared memory rely primarily on communication through explicit dialogue, which is not only constrained by bottlenecks in bandwidth but is also prone to the introduction of noise during the process of exchange~\citep{Tran2025MultiAgentCM, Liao2025AgentMasterAM, Zou2025LatentCI}. To overcome current communication constraints, future efforts should prioritize the development of consensus memory systems. These systems aim to achieve efficient synchronization between individual perspectives and collective knowledge, thereby fostering a more agile process of socialized experience evolution~\citep{Yuen2025IntrinsicMA, Rezazadeh2025CollaborativeMM}.
\noindent\textbf{Multimodal Memory.}
%多模态记忆是LLM agent记忆机制未来的重要发展方向。该方向需要将视觉感知状态，语言推理过程以及其他相关感知模态整合为具有统一时序和语义的记忆单元。特别是对于具身智能而言，内部世界模型的完整性直接影响任务规划与执行。围绕这一目标，现有研究正从探索多模态抽象，跨模态时间对齐以及高效记忆巩固等方面探索新的记忆机制。
Multimodal memory represents a significant direction for the future development of memory mechanisms for LLM agents. This direction requires the integration of states of visual perception, processes of linguistic reasoning, and other perceptual modalities into memory units characterized by unified temporality and semantics~\citep{Liu2025MemVerseMM, Zhou2025M2PAAM, He2025RSAgentLT}. For embodied intelligence in particular, the integrity of internal models of the world directly influences the planning and execution of tasks~\citep{Feng2025EmbodiedAF, Long2025ASL}. To achieve this objective, existing research explores novel memory mechanisms by investigating multimodal abstraction, temporal alignment across modalities, and the efficient consolidation of memory. A detailed exposition of current approaches and open challenges is provided in
Appendix~\S\ref{Extended Discussion on Multimodal Memory Mechanisms}.
\section{Conclusion}
%本综述对 LLM agent 的记忆机制进行了系统性回顾，构建了包含存储、反思与经验三个渐进阶段的演进框架 。我们的分析揭示，记忆机制的演进逻辑已超越单纯的容量扩展，其本质是信息密度的深化以及跨认知抽象维度的转变。通过引入主动探索与跨轨迹抽象等前沿机制，经验阶段使智能体能够突破单一情景的局限，凝练出可迁移的行为策略。我们希望本项研究能为社区提供设计先进记忆架构的理论指引，推动 LLM agent 迈向具备持续学习能力的通用人工智能。
This survey provides a systematic review of memory mechanisms for LLM agents, establishing an evolutionary framework that encompasses three progressive stages: storage, reflection, and experience. Our analysis demonstrates that memory evolution is not merely the expansion of storage capacity but fundamentally involves the enhancement of information density and a transformation across cognitive abstraction dimensions. By introducing mechanisms such as active exploration and cross-trajectory abstraction, memory mechanisms within the experience stage enable agents to transcend situational constraints and acquire transferable behavioral experience. We hope this survey assists the community in designing more advanced memory mechanisms, guiding LLM agents toward the realization of true general artificial intelligence.
\section*{Limitations}
This survey provides a comprehensive qualitative analysis of memory mechanisms for LLM agents; however, we acknowledge several limitations that warrant discussion.
%缺乏记忆机制的直接性能比较
\noindent\textbf{Lack of Direct Quantitative Comparison.}
%本综述采用定性分析的框架，缺乏对记忆机制的全面性能比较。这是因为存储，反思和经验三个阶段的设计目标存在差异，且目前尚无全面统一的基准可供跨阶段综合评估。此外，原始研究在基础模型，环境配置和提示词等方面的差异使得直接的数值比较可能产生误导。
This survey adopts a qualitative analytical framework and lacks a comprehensive performance comparison of memory mechanisms. This is because the design objectives differ across the three stages of storage, reflection, and experience, and no unified benchmark currently exists for comprehensive evaluation across all stages. Moreover, variations in foundation models, environments, and prompts across original studies render direct numerical comparison potentially misleading.
%与现有学习范式之间的联系
\noindent\textbf{Relation to Established Learning Paradigms.}
%在经验阶段，尤其是隐式经验，在技术层面与微调、强化学习及元学习存在交叉。本分类体系并未将经验定位为一种全新的学习范式，而是强调这些成熟技术如何在以记忆为种新的LLM agent智能体架构中得到部署，并作为交互轨迹与参数更新的关键中介。
The experience stage, particularly implicit experience, intersects with fine-tuning, reinforcement learning, and meta-learning at a technical level. This taxonomy does not position experience as an entirely novel learning paradigm; rather, it emphasizes how these established techniques are deployed within memory-centric LLM agent architectures, serving as a critical intermediary between interaction trajectories and parameter updates.
%新近度偏差
\noindent\textbf{Temporal Coverage and Recency Bias.}
%LLM agents智能体记忆机制的研究在2024年至2025年间经历了快速增长，其中经验阶段作为一个连贯的研究方向直到2025年下半年才开始成形。这一时间分布特征体现在本综述的文献覆盖中，并带来两方面的方法论影响：（i）早期具有影响力的工作相对于其历史贡献可能未获得足够的关注（ii）本综述收录的部分近期预印本尚未正式通航评审，为了平衡学术严谨性和时效性，本综述优先纳入提出新颖架构或展示可复现结果的工作。
Research on memory mechanisms for LLM agents has experienced rapid growth from 2024 to 2025, with the experience stage emerging as a coherent research direction only in the latter half of 2025. This temporal distribution is reflected in the coverage of this survey and brings two methodological implications: (i) early influential works may not have received attention commensurate with their historical contributions, and (ii) some recent preprints included in this survey have not yet undergone formal peer review. To balance academic rigor with timeliness, this survey prioritizes works that propose novel architectures or demonstrate reproducible results.
%\bibliographystyle{acl_natbib}
\section*{Acknowledgment}
This work is partially supported by National Natural Science Foundation of China Young Scientists Fund (No. 62206233) and RMGS (2025 First Processing Cycle).
\bibliography{anthology}
\appendix
\renewcommand{\theequation}{\thesection.\arabic{equation}}
\setcounter{equation}{0}
\section{Overview}\label{Overview}
%我们首先形式化定义了LLM agent的工作框架以及记忆机制的演进范式。同时将演进的主要动力概括为三个，强调驱动力是支撑记忆机制乃至LLM agent本身能力变化的主要因素。基于对过往轨迹的利用深度，本调查提出了一套三阶段的演进框架。
%1.Storage：作为演进的基础层，主要对长程历史交互中轨迹进行忠实保存，解决LLM agent记忆容量的问题。
%2.Reflecion：引入动态评估回路，让记忆机制从记录者变为评价者，缓解LLM agent在记忆中存在的幻觉及逻辑错误问题。
%3.Experience：代表了最高的认知阶层，通过跨轨迹抽象从轨迹群中提取高阶行为模式，将冗余的记忆压缩为可迁移、可复用的启发式策略。
%进一步地，我们深入的讨论记忆机制迈向经验阶段的两大关键技术变革：主动探索和跨轨迹抽象。这使得LLM agent能从被动的信息接收者转变为目标驱动的经验收集者，提升自身在位置任务中的前瞻性泛化能力。最后，本次调查还讨论了记忆机制未来有价值的几个方向。
We first provide a formal definition for the operational framework of LLM agents and the evolutionary paradigms of memory mechanisms. Furthermore, we categorize the primary drivers for this evolution into three dimensions, emphasizing that these driving forces constitute the fundamental factors supporting transformations in memory mechanisms and the inherent capabilities of LLM agents. Based on the depth to which historical trajectories are utilized, this survey proposes an evolutionary framework consisting of three distinct stages:
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Storage:} As the foundational layer of evolution, this stage focuses on the faithful preservation of trajectories from interactions over a long duration to address constraints regarding the memory capacity of LLM agents.
\item \textbf{Reflection:} Through the introduction of loops for dynamic evaluation, the memory mechanism transitions from a recorder of information to an evaluator, thereby mitigating issues related to hallucinations and logical errors within the memory of LLM agents.
\item \textbf{Experience:} Representing the highest level of cognition, this stage employs abstraction across multiple trajectories to extract behavioral patterns of a higher order. This process compresses redundant memory into heuristic strategies that are transferable and reusable.
\end{itemize}
Furthermore, we provide an in-depth discussion on two pivotal technological shifts required for memory mechanisms to advance toward the stage of experience: active exploration and abstraction across trajectories. These advancements enable LLM agents to transition from passive recipients of information to collectors of experience driven by specific goals, thereby enhancing the capacity for proactive generalization in tasks that are unknown. Finally, this survey discusses several valuable directions for the future of memory mechanisms.
\noindent\textbf{Summary of Contribution.}
%作为一篇调查论文，我们主要的目标是综合和分析现有研究，同时为想要理解和设计记忆机制的研究者提供新的见解和思路。我们认为我们的工作在以下几个方面提供了重大新颖性：
As a survey, our primary objective is the synthesis and analysis of existing research, while providing novel insights and perspectives for researchers who aim to understand and design memory mechanisms. We believe that our work offers significant novelty in the following aspects:
%这项调查针对当前记忆机制研究缺乏演进视角且高度碎片化的问题，提供了一个全面且前瞻的概述。包括被忽略的研究，最新的进展以及更广阔的理论视角。
%这项调查构建了一种三阶段的演进框架来组织文章。在此基础上系统的勾勒出了记忆机制发展的动力与路径以及前沿的特性。这一视角为该领域研究工作提供了新的见解。
%这项调查提供了对现有文献的原创解释和深度剖析。例如，我们以对过往交互轨迹的利用程度为基准，提出了演进视角的分类法。此外，我们还总结了经验阶段记忆机制的两大关键特征和几个未得到充分开发或解决的问题。
%在LLM agent元年，本文作为首篇从演进视角系统调查其记忆机制的综述，捕捉了截至2025年最前沿的研究，回应了Agent首次面对现实世界的适应与学习的紧迫需求。通过整合现有文献，我们为这一关键领域的进一步探索和创新提供了新的起点。
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Scope \& Coverage:} To address the absence of a perspective on evolution and the significant fragmentation in contemporary research on memory mechanisms, this survey provides a comprehensive overview that is forward-looking. This work encompasses research that has been overlooked, the most recent advancements, and theoretical perspectives of a broader nature.
\item \textbf{Organization \& Structure:} This survey constructs an evolutionary framework in three stages to organize the manuscript. On this basis, we systematically delineate the drivers and pathways for the development of memory mechanisms, as well as characteristics at the frontier. This perspective provides novel insights for research within this domain.
\item \textbf{Insights \& Critical Analysis:} This survey provides original interpretations and an in-depth analysis of the existing literature. For instance, we propose a taxonomy from an evolutionary perspective, using the degree of utilization for trajectories of past interaction as a benchmark. Furthermore, we summarize two pivotal characteristics of memory mechanisms in the stage of experience and identify several issues that remain underexplored or unresolved.
\item \textbf{Timeliness \& Relevance:} In the inaugural year of LLM agents, this work represents the first survey to systematically examine memory mechanisms from a perspective of evolution, capturing research at the frontier through 2025. It addresses the urgent necessity for adaptation and learning as agents encounter the real world for the first time. Through the synthesis of existing literature, we provide a new foundation for further exploration and innovation in this critical field.
\end{itemize}
%总而言之，我们的工作通过全面的覆盖、创新的分类和原创的见解贡献了新颖性。我们相信这些贡献额能够极大地促进对LLM agent记忆机制的理解，并为研究界提供了宝贵的资源。
Overall, this survey offers a novel perspective by providing comprehensive coverage and an innovative classification of memory evolution. We anticipate that these contributions will bridge the knowledge gap regarding LLM agent memory mechanisms and offer a foundational resource for future research.
%绘图
\begin{figure*}[!h]
\centering
\resizebox{1.0\textwidth}{!}{%
\begin{tikzpicture}[
% ========== 节点样式 ==========
% Level 1: Storage, Reflection, Experience
level1/.style={draw, line width=0.6pt, rounded corners=2pt, minimum width=1.2cm, minimum height=0.45cm, fill=memoryorange, font=\fontsize{6}{7}\selectfont\bfseries, align=center, inner sep=1.5pt},
% Level 2: Linear, Vector...
level2/.style={draw, line width=0.5pt, rounded corners=2pt, minimum width=1.2cm, minimum height=0.32cm, fill=memoryorangelight, font=\fontsize{5}{6}\selectfont\bfseries, align=center, inner sep=1pt},
% Level 3: Methods
level3/.style={draw, line width=0.4pt, rounded corners=1pt, minimum width=2.6cm, minimum height=0.28cm, fill=memoryorangelighter, font=\fontsize{4.5}{5.5}\selectfont, align=center, inner sep=1pt},
% Level 4: Examples
level4/.style={draw, line width=0.4pt, rounded corners=1pt, minimum width=6.5cm, minimum height=0.28cm, fill=memoryorangelightest, font=\fontsize{4}{5.5}\selectfont, align=center, inner sep=1.5pt},
% 连接线
line/.style={line width=0.4pt, draw=black!70},
]
% ========== 坐标系统 ==========
\def\vstep{0.35}
% 定义列的 X 坐标
\def\colTitle{-1.6}
\def\colOne{-0.1}
\def\colTwo{1.4}
\def\colThree{3.6}
\def\colFour{8.4}
% 连接线拐角缓冲
\def\gapL{0.12}
\def\gapM{0.15}
% 箭头位置
\def\arrowX{12}
% ========== PHASE 1: STORAGE (7 Rows) ==========
% Row 1: Y = 2.80
\node[level3] (cwa) at (\colThree, 2.80) {Context Window Adaptation};
\node[level4] (cwa-ex) at (\colFour, 2.80) {e.g. PCW~\cite{Ratner2022ParallelCW}, StreamingLLM~\cite{Xiao2023EfficientSL}, SelfExtend~\cite{Jin2024LLMML}};
% Row 2: Y = 2.45
\node[level3] (ics) at (\colThree, 2.45) {Information Sparsification};
\node[level4] (ics-ex) at (\colFour, 2.45) {e.g. H2O~\cite{Zhang2023H2OHO}, Quest~\cite{Tang2024QuestQS}, LLMLingua~\cite{Jiang2023LLMLinguaCP}};
% Parent: Linear
\node[level2] (linear) at (\colTwo, 2.625) {Linear};
% Row 3: Y = 2.10
\node[level3] (sr) at (\colThree, 2.10) {Semantic Retrieval};
\node[level4] (sr-ex) at (\colFour, 2.10) {e.g. ARMRAG~\cite{Melz2023EnhancingLI}, MemLong~\cite{Liu2024MemLongMR}, Larimar~\cite{Das2024LarimarLL}};
% Row 4: Y = 1.75
\node[level3] (wr) at (\colThree, 1.75) {Weighted Retrieval};
\node[level4] (wr-ex) at (\colFour, 1.75) {e.g. MemoryBank~\cite{Zhong2023MemoryBankEL}, Stanford Town~\cite{Park2023GenerativeAI}};
% Parent: Vector
\node[level2] (vector) at (\colTwo, 1.925) {Vector};
% Row 5: Y = 1.40
\node[level3] (tdb) at (\colThree, 1.40) {Tabular Database};
\node[level4] (tdb-ex) at (\colFour, 1.40) {e.g. ChatDB~\cite{Hu2023ChatDBAL}, DB-GPT~\cite{Xue2023DBGPTED}, MAC-SQL~\cite{Lee2025TrainingAT}};
% Row 6: Y = 1.05
\node[level3] (ta) at (\colThree, 1.05) {Tiered Architectures};
\node[level4] (ta-ex) at (\colFour, 1.05) {e.g. MemGPT~\cite{Packer2023MemGPTTL}, MemoChat~\cite{Lu2023MemoChatTL}, MemOS~\cite{Li2025MemOSAM}};
% Row 7: Y = 0.70
\node[level3] (sg) at (\colThree, 0.70) {Semantic Graphs};
\node[level4] (sg-ex) at (\colFour, 0.70) {e.g. MemLLM~\cite{Modarressi2024MemLLMFL}, AriGraph~\cite{Anokhin2024AriGraphLK}, GraphReader~\cite{Li2024GraphReaderBG}};
% Parent: Structured
\node[level2] (structured) at (\colTwo, 1.05) {Structured};
% Main Node: Storage
\node[level1] (memory) at (\colOne, 1.86) {Storage \\ (\S\ref{Storage})};
% ========== PHASE 2: REFLECTION (6 Rows) ==========
% Row 8: Y = 0.20
\node[level3, fill=reflectiveyellowlighter] (er) at (\colThree, 0.20) {Error Rectification};
\node[level4, fill=reflectiveyellowlightest] (er-ex) at (\colFour, 0.20) {e.g. Reflexion~\cite{Shinn2023ReflexionLA}, TiM~\cite{Liu2023ThinkinMemoryRA}, LLM-MapRepair~\cite{Zhang2025ConstructingCS}};
% Row 9: Y = -0.15
\node[level3, fill=reflectiveyellowlighter] (dm) at (\colThree, -0.15) {Dynamic Maintenance};
\node[level4, fill=reflectiveyellowlightest] (dm-ex) at (\colFour, -0.15) {e.g. Zep~\cite{Rasmussen2025ZepAT}, Mem0~\cite{Chhikara2025Mem0BP}, CAMA~\cite{Li2025CAMAC}};
% Row 10: Y = -0.50
\node[level3, fill=reflectiveyellowlighter] (kc) at (\colThree, -0.50) {Knowledge Compression};
\node[level4, fill=reflectiveyellowlightest] (kc-ex) at (\colFour, -0.50) {e.g. MemOrb~\cite{Huang2025MemOrbAP}, LEGOMem~\cite{Han2025LEGOMemMP}, AgentFold~\cite{Ye2025AgentFoldLW}};
% Parent: Introspection
\node[level2, fill=reflectiveyellowlight] (introspective) at (\colTwo, -0.15) {Introspection};
% Row 11: Y = -0.85
\node[level3, fill=reflectiveyellowlighter] (em) at (\colThree, -0.85) {Environment Modeling};
\node[level4, fill=reflectiveyellowlightest] (em-ex) at (\colFour, -0.85) {e.g. DEAL~\cite{Sun2024EnhancingAL}, ToolMem~\cite{Xiao2025ToolMemEM}, CLIN~\cite{Majumder2023CLINAC}};
% Row 12: Y = -1.20
\node[level3, fill=reflectiveyellowlighter] (do) at (\colThree, -1.20) {Decision Optimization};
\node[level4, fill=reflectiveyellowlightest] (do-ex) at (\colFour, -1.20) {e.g. Memory-R1~\cite{Yan2025MemoryR1EL}, MDSF~\cite{Yan2025MemoryDrivenSF}, Self-Goal~\cite{Yang2024SelfGoalYL}};
% Parent: Environment
\node[level2, fill=reflectiveyellowlight] (environmental) at (\colTwo, -1.025) {Environment};
% Row 13: Y = -1.55
\node[level3, fill=reflectiveyellowlighter] (mdc) at (\colThree, -1.55) {Multi-dimensional Calibration};
\node[level4, fill=reflectiveyellowlightest] (mdc-ex) at (\colFour, -1.55) {e.g. MIRIX~\cite{Wang2025MIRIXMM}, CoGent~\cite{Wang2025GraphCogentML}, CSR~\cite{Bo2024ReflectiveMC}};
% Parent: Social
\node[level2, fill=reflectiveyellowlight] (Coordination) at (\colTwo, -1.55) {Coordination};
% Main Node: Reflection
\node[level1, fill=reflectiveyellow] (reflective) at (\colOne, -0.67) {Reflection \\ (\S\ref{Reflection})};
% ========== PHASE 3: EXPERIENCE (5 Rows) ==========
% Row 14: Y = -2.05
\node[level3, fill=experiencegreenlighter] (hg) at (\colThree, -2.05) {Heuristic Guidelines};
\node[level4, fill=experiencegreenlightest] (hg-ex) at (\colFour, -2.05) {e.g. FLEX~\cite{Cai2025FLEXCA}, ArcMem~\cite{Ho2025ArcMemoAR}, LightMem~\cite{Fang2025LightMemLA}};
% Row 15: Y = -2.40
\node[level3, fill=experiencegreenlighter] (pp) at (\colThree, -2.40) {Procedural Primitives};
\node[level4, fill=experiencegreenlightest] (pp-ex) at (\colFour, -2.40) {e.g. CASCADE~\cite{Huang2025CASCADECA}, IPS~\cite{Wang2025InducingPS}, AccelOpt~\cite{Zhang2025AccelOptAS}};
% Parent: Explicit
\node[level2, fill=experiencegreenlight] (explicit) at (\colTwo, -2.225) {Explicit};
% Row 16: Y = -2.75
\node[level3, fill=experiencegreenlighter] (ew) at (\colThree, -2.75) {Latent Modulation};
\node[level4, fill=experiencegreenlightest] (ew-ex) at (\colFour, -2.75) {e.g. MemGen~\cite{Zhang2025MemGenWG}, LatentEvolve~\cite{Zhang2025LatentEvolveST}};
% Row 17: Y = -3.10
\node[level3, fill=experiencegreenlighter] (pi) at (\colThree, -3.10) {Parameter Internalization};
\node[level4, fill=experiencegreenlightest] (pi-ex) at (\colFour, -3.10) {e.g. AgentEvolver~\cite{Zhai2025AgentEvolverTE}, Agent-LV~\cite{Zhang2025AgentLV}, Verl~\cite{Jiang2025VerlToolTH}};
% Parent: Implicit
\node[level2, fill=experiencegreenlight] (implicit) at (\colTwo, -2.925) {Implicit};
% Row 18: Y = -3.45
\node[level3, fill=experiencegreenlighter] (et) at (\colThree, -3.45) {Experience Transfer};
\node[level4, fill=experiencegreenlightest] (et-ex) at (\colFour, -3.45) {e.g. ReasoningBank~\cite{Ouyang2025ReasoningBankSA},EvolveR~\cite{Wu2025EvolveRSL}, Hybrid-Replay~\cite{liu2026exploratorymemoryaugmentedllmagent}};
% Parent: Hybrid
\node[level2, fill=experiencegreenlight] (hybrid) at (\colTwo, -3.45) {Hybrid};
% Main Node: Experience
\node[level1, fill=experiencegreen] (experience) at (\colOne, -2.75) {Experience \\ (\S\ref{Experience})};
% ========== 左侧大标题 ==========
\node[draw, line width=0.6pt, black, rounded corners=2pt, inner sep=3pt, font=\fontsize{8}{10}\selectfont\bfseries\itshape, rotate=90, anchor=center] (titlenode) at (\colTitle, -0.45) {A Survey from Storage to Experience};
% ========== 连线逻辑 ==========
% 标题 -> 主节点
\draw[line] (titlenode.south) -- ++(0.4,0) |- (memory.west);
\draw[line] (titlenode.south) -- ++(0.4,0) |- (reflective.west);
\draw[line] (titlenode.south) -- ++(0.4,0) |- (experience.west);
% Storage Groups: Level 1 -> Level 2
\draw[line] (memory.east) -- ++(\gapM,0) |- (linear.west);
\draw[line] (memory.east) -- ++(\gapM,0) |- (vector.west);
\draw[line] (memory.east) -- ++(\gapM,0) |- (structured.west);
% Storage Groups: Level 2 -> Level 3
\foreach \child in {cwa, ics} \draw[line] (linear.east) -- ++(\gapL,0) |- (\child.west);
\foreach \child in {sr, wr} \draw[line] (vector.east) -- ++(\gapL,0) |- (\child.west);
\foreach \child in {tdb, ta, sg} \draw[line] (structured.east) -- ++(\gapL,0) |- (\child.west);
% Reflection Groups: Level 1 -> Level 2
\draw[line] (reflective.east) -- ++(\gapM,0) |- (introspective.west);
\draw[line] (reflective.east) -- ++(\gapM,0) |- (environmental.west);
\draw[line] (reflective.east) -- ++(\gapM,0) |- (Coordination.west);
% Reflection Groups: Level 2 -> Level 3
\foreach \child in {er, dm, kc} \draw[line] (introspective.east) -- ++(\gapL,0) |- (\child.west);
\foreach \child in {em, do} \draw[line] (environmental.east) -- ++(\gapL,0) |- (\child.west);
\draw[line] (Coordination.east) -- ++(\gapL,0) -- (mdc.west);
% Experience Groups: Level 1 -> Level 2
\draw[line] (experience.east) -- ++(\gapM,0) |- (explicit.west);
\draw[line] (experience.east) -- ++(\gapM,0) |- (implicit.west);
\draw[line] (experience.east) -- ++(\gapM,0) |- (hybrid.west);
% Experience Groups: Level 2 -> Level 3
\foreach \child in {hg, pp} \draw[line] (explicit.east) -- ++(\gapL,0) |- (\child.west);
\foreach \child in {ew, pi} \draw[line] (implicit.east) -- ++(\gapL,0) |- (\child.west);
\draw[line] (hybrid.east) -- ++(\gapL,0) -- (et.west);
% Level 3 -> Level 4 直线连接
\foreach \start/\end in {cwa/cwa-ex, ics/ics-ex, sr/sr-ex, wr/wr-ex, tdb/tdb-ex, ta/ta-ex, sg/sg-ex,
er/er-ex, dm/dm-ex, kc/kc-ex, em/em-ex, do/do-ex, mdc/mdc-ex,
hg/hg-ex, pp/pp-ex, ew/ew-ex, pi/pi-ex, et/et-ex} {
\draw[line] (\start.east) -- (\end.west);
}
% ========== Evolution Path Arrow ==========
\begin{scope}[on background layer]
% 上半段渐变：绿色 -> 蓝色
\shade[top color=arrowtop, bottom color=arrowmiddle]
(\arrowX, 3.0) rectangle ++(0.4, -3.05);
% 下半段渐变：蓝色 -> 粉色
\shade[top color=arrowmiddle, bottom color=arrowbottom]
(\arrowX, -0.05) rectangle ++(0.4, -3.05);
% 箭头尖端（三角形）
\fill[arrowbottom]
(\arrowX-0.3, -3.1) -- (\arrowX+0.2, -3.65) -- (\arrowX+0.7, -3.1) -- cycle;
\end{scope}
% 文字放在箭头中央
\node[rotate=-90, font=\fontsize{8}{9}\selectfont\bfseries, anchor=center, text=black]
at (\arrowX+0.2, -0.4) {Evolution path};
\end{tikzpicture}
}%
\caption{Taxonomy of the LLM agent memory mechanisms.}
\label{fig:taxonomy}
\end{figure*}
\section{Detail within the Evolutionary Path}\label{Detail within the Evolutionary Path}
%由于正文篇幅限制，我们将在本节中对记忆机制演进的各个阶段的代表性工作进行详细阐述。对于没想工作，我们描述了其核心贡献，技术机制以及在进化路径中的位置。
Due to space constraints in the main text, we provide detailed exposition of representative works within each stage of the memory mechanism evolution in this section. For each work, we describe its core contribution, technical mechanism, and position within the evolutionary trajectory.
\subsection{Storage}\label{Storage}
%存储阶段的核心目标主要是为了最大限度的精确保留轨迹，从而使LLM agent能同时保持对内部和外部状态的精确感知，存储阶段的记忆机制虽然为LLM agent的连续性和推理提供了必要的上下文，但是它本质易受到LLM本身随机性和幻觉污染。早期的研究通过构建线性、向量和结构化三种技术类型的记忆来满足对不同环境下记忆的写入,管理和读取要求。
The primary objective of the storage phase is the precise preservation of trajectories to the maximum extent possible, which enables LLM agents to maintain an accurate perception of both internal and external states~\cite{Xi2023TheRA}. Although the memory mechanisms of the storage phase provide the context necessary for continuity and reasoning, they remain inherently susceptible to contamination from the stochasticity and hallucinations of the underlying model. Prior research has addressed the requirements for the writing, management, and retrieval of memory within various environments by constructing memory architectures across three technical categories: linear, vector, and structured.
\noindent\textbf{Linear.}\label{Linear}
%线性存储代表记忆机制最原始和直观的形式。它将LLM agent的交互记录当作按时间顺序排列的连续tokens流，严格遵循先进先出(FIFO)策略在上下文窗口内管理记忆。这一阶段的工作可以被归纳为两个部分：1.调整上下文窗口，2.信息稀疏化。
Linear storage represents the most primitive and intuitive form of memory mechanisms. It treats the records of interaction for LLM agents as a continuous stream of tokens arranged in chronological order, managing memory within the context window through strict adherence to a strategy of First-In, First-Out (FIFO). The work in this phase can be categorized into two components: adjustment of the context window and sparsification of information.
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Context Window Adaptation:} Context window adaptation techniques seek to extend the usable input length of LLMs by modifying attention mechanisms, positional encoding schemes, or input structures. Representative approaches include optimizing intrinsic attention computation ~\cite{Xiao2023EfficientSL}, remapping positional encodings to enable longer sequences ~\cite{Jin2024LLMML}, and restructuring inputs to mitigate length constraints ~\cite{Ratner2022ParallelCW}. These methods expand raw storage capacity but do not alter the semantics of stored trajectories.
\item \textbf{Information Sparsification:} Information sparsification treats memory compression as a mechanical denoising process independent of agent reflection. Methods typically rely on statistical or attention-based heuristics to remove low-utility tokens. For example,~\citet{Zhang2023H2OHO} evicts tokens based on cumulative attention scores, while~\citet{Tang2024QuestQS} and~\citet{Xiao2024InfLLMTL} retrieve salient memory blocks via query–key similarity.~\citet{Jiang2023LLMLinguaCP} further identifies redundant segments through perplexity estimation. While effective for efficiency, these methods operate without semantic abstraction.
\end{itemize}
\noindent\textbf{Vector.}\label{Vector}
%矢量存储通过将交互轨迹编码到高维空间来缓解记忆存储容量的问题。但他同样引入了新的挑战：即如何从海量的存储库中有效的检索与任务相关的记忆。因此，研究的重点转入检索优化。我们将方法分为两类：1.语义检索和2.加权检索
Vector storage mitigates the constraints of capacity for memory storage by encoding interaction trajectories into spaces of high dimensionality. However, it also introduces a novel challenge: the efficient retrieval of memories relevant to the task from massive repositories. Consequently, the focus of research has transitioned toward the optimization of retrieval. We categorize these methodologies into two classes: semantic retrieval and weighted retrieval.
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Semantic Retrieval:} Semantic retrieval constitutes the foundational approach to vector memory, where relevance is determined by geometric proximity in embedding space. ~\citet{Melz2023EnhancingLI} retrieves historical reasoning chains via semantic alignment, while~\citet{Liu2024MemLongMR} integrates fine-grained retrieval-attention during decoding to sustain long-context reasoning.~\citet{Das2024LarimarLL} further internalizes episodic memory into a latent matrix, enabling one-shot read–write operations. Despite improved recall, these methods treat retrieved content as flat historical evidence.
\item \textbf{Weighted Retrieval:} Weighted retrieval extends semantic similarity by assigning differentiated importance to memories using multi-dimensional scoring signals.~\citet{Zhong2023MemoryBankEL} models temporal decay via the Ebbinghaus Forgetting Curve, while ~\citet{Park2023GenerativeAI} retrieves memories based on a weighted combination of relevance, recency, and importance. Such mechanisms improve prioritization but remain retrieval-centric rather than abstraction-driven.
\end{itemize}
\noindent\textbf{Structured.}\label{Structured}
%结构化存储通过预先定义的关系结构来存储记忆。该范式强调记忆知识的完整性和强制执行，从而能够实现精准的操作、复杂的逻辑推理和高效的多跳检索。根据结构化的方式方式我们将其分为三类：表格数据库，分层结构和图
Structured storage preserves memory through predefined structures of relationships. This paradigm emphasizes the integrity and enforcement of knowledge within memory, which facilitates precise operations, complex reasoning based on logic, and efficient retrieval across multiple hops. Based on the method of organization, we categorize these systems into three classes: tabular databases, tiered architectures and semantic graphs.
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Tabular Database:} Database-backed memory systems leverage mature relational databases to store agent knowledge in structured tabular form. Early work frames databases as symbolic memory ~\cite{Hu2023ChatDBAL}, while subsequent approaches translate natural language queries into SQL via specialized controllers for secure and efficient access ~\cite{Xue2023DBGPTED}. Multi-agent extensions further distribute database construction and maintenance across specialized roles ~\cite{Lee2025TrainingAT}.
\item \textbf{Tiered Architectures:} Tiered memory architectures draw inspiration from computer storage hierarchies and human cognition to balance capacity and access latency. MemGPT ~\cite{Packer2023MemGPTTL} introduces a dual-layer design separating main and external context, enabling virtual context expansion. Cognitive-inspired systems such as SWIFT–SAGE ~\cite{Lin2023SwiftSageAG} dynamically adjust retrieval intensity, while streaming-update architectures maintain long-term stability without exhaustive retrieval ~\cite{Zhou2023RecurrentGPTIG,Lu2023MemoChatTL}.
\item \textbf{Semantic Graphs:} Graph memory represents interaction histories as networks of entities and relations, enabling structured reasoning beyond flat storage. Triplet-based extraction supports precise updates and retrieval ~\cite{Modarressi2024MemLLMFL}, while neuro-symbolic approaches integrate logical constraints into graph representations ~\cite{Wang2024SymbolicWM}. Graph-based world models further support environment-centric reasoning ~\cite{Anokhin2024AriGraphLK}, and coarse-to-fine traversal over text graphs enables efficient long-context retrieval ~\cite{Zhou2023RecurrentGPTIG,Lu2023MemoChatTL}.
\end{itemize}
\subsection{Reflection}\label{Reflection}
%尽管存储阶段探索了多种存储记忆的方法来保证LLM agent的长程一致性，但他们并没有从根本上解决记忆质量的问题。原始的交互轨迹不可避免地将成功的轨迹与幻觉、逻辑错误和无效的尝试混合在一起。如果不加以评估，被动存储所有轨迹会导致错误累计和重复失败。反思阶段通过引入内省、环境和协作为反馈信号，对历史轨迹进行矫正和去噪，得到更优质的记忆。
Although the storage stage explores diverse methods for the preservation of memory to ensure the consistency of LLM agents over the long term, these approaches do not fundamentally address the quality of memory. Raw trajectories of interaction inevitably conflate successful sequences with hallucinations, errors in logic, and attempts that are invalid~\cite{Zhang2023HowLM, Ghasemabadi2025CanLP, Zhang2025ReplayFA}. Without the application of evaluation, the passive storage of all trajectories leads to an accumulation of errors and the repetition of failures. The reflection stage incorporates introspection, the environment, and coordination as signals for feedback to rectify and denoise historical trajectories, thereby producing memory of higher quality.
\noindent\textbf{Introspection.}\label{Introspection}
%内省反思代表了一种内部的认知过程，即利用LLM agent自身的知识来评估、完善和重组记忆而不需要外部的反馈，目前研究可以通过三种不同的功能途径来实现自省：1.错误纠正 2.动态维护和3 知识压缩
Introspective reflection represents an internal cognitive process that utilizes the LLM agent’s own knowledge to evaluate, refine, and restructure memory without the need for external feedback. Current research achieves introspection through three distinct functional pathways: error rectification, dynamic maintenance, and knowledge compression.
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Error Rectification:} targets hallucinations and multi-step reasoning errors by verifying and repairing stored trajectories through self-critique. \citet{Shinn2023ReflexionLA} introduces Reflexion, which prompts agents to reflect on failed trajectories and distill corrective feedback into textual memory. This mechanism enables systematic error correction and sustained performance improvement across episodes, establishing introspective reflection as a central mechanism rather than a peripheral heuristic.Building on this paradigm,~\citet{Liu2023ThinkinMemoryRA} introduces a post-reasoning verification stage to retain only validated memories, while~\citet{Zhang2025ConstructingCS} detects contradictory or erroneous segments through introspective consistency checks, thereby limiting error accumulation and propagation.
\item \textbf{Dynamic Maintenance:} Dynamic maintenance focuses on lifecycle management of memory content.~\citet{Li2025CAMAC} incrementally updates internal knowledge schemas via clustering, while~\citet{Rasmussen2025ZepAT} and ~\citet{Chhikara2025Mem0BP} maintain continuity by parsing and updating structured entity relations. At the system level, rule-based controllers inspired by operating systems strategically update and persist core memories ~\cite{Packer2023MemGPTTL,Zhou2025MEM1LT,Kang2025MemoryOO}.
\item \textbf{Knowledge Compression:} Knowledge compression distills high-dimensional trajectories into compact and reusable representations.~\citet{Huang2025MemOrbAP} generates structured reflections to extract coherent character profiles, while~\citet{Han2025LEGOMemMP} decomposes interaction sequences into modular procedural memories. Multi-granularity abstraction further aligns distilled memories with task demands ~\cite{Tan2025InPA,Yang2025CoarsetoFineGM}, and context-folding techniques preserve working-context efficiency during reasoning ~\cite{Sun2025ScalingLL,Ye2025AgentFoldLW,Li2025DeepAgentAG}.
\end{itemize}
\noindent\textbf{Environment.}\label{Environment}
%虽然内省反思利用模型内部的知识完善记忆，但是它本质上仍然存在与事实不相符的风险。为了减轻这种风险，环境反思利用真实世界的结果来主动优化行为并校准模型内部的知识。当前的研究主要沿着两条路径进行1.世界建模和2.决策优化
While introspective reflection leverages knowledge within the model to refine memory, it inherently carries a risk of inconsistency with factual reality. To mitigate this risk, reflection from the environment utilizes outcomes in the real world to actively optimize behavior and calibrate the internal knowledge of the model. Current research primarily proceeds along two trajectories: environment modeling and decision optimization.
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Environment Modeling:} Environmental modeling aligns internal memory with dynamic external conditions such as environments, tools, and user preferences.~\citet{Sun2024EnhancingAL} enables agents to infer and validate world rules from demonstrations, while~\citet{Xiao2025ToolMemEM} summarizes tool behavior from execution outcomes. Preference-aware updates integrate short-term variation with long-term trends~\cite{Sun2025PreferenceAwareMU}, and EM-based formulations ensure memory consistency under distribution shifts~\cite{Yin2024ExplicitML}.
\item \textbf{Decision Optimization:} Decision optimization treats memory management as a learnable policy guided by environmental rewards or execution feedback.~\citet{Yan2025MemoryR1EL} learns discrete actions from outcome-based rewards, while~\citet{Yan2025MemoryDrivenSF} refines memory quality using value-annotated decision trajectories. For complex planning, interaction feedback is used to validate and prune goal hierarchies~\cite{Yang2024SelfGoalYL}.
\end{itemize}
\noindent\textbf{Coordination.}\label{Coordination}
%协作反思利用多智能体系统中角色专业化和共识机制，将反思过程从个体层面延伸至集体层面。通过跨多个代理的审议，这种范式减轻了单模型架构在处理复杂记忆轨迹时常见的认知瓶颈和幻觉。
Collaborative reflection leverages the specialization of roles and mechanisms for consensus within systems of multiple agents to extend the process of reflection from the level of the individual to that of the collective. Through deliberation across multiple agents, this paradigm alleviates cognitive bottlenecks and hallucinations that are common in architectures with a single model during the processing of trajectories of complex memory.
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Multi-dimensional Calibration:} Multi-dimensional calibration realizes distributed memory management through heterogeneous agent societies.~\citet{Wang2025MIRIXMM} coordinates core, episodic, and semantic memory modules to process multimodal long contexts.~\citet{Wang2025GraphCogentML} decomposes graph reasoning into perception, caching, and execution roles to reduce context loss. Narrative-level coherence is achieved by integrating episodic and semantic memories across agents ~\cite{Balestri2025NarrativeMI}. Moreover, ~\citet{Ozer2025MARMultiAgentRI} and~\citet{Bo2024ReflectiveMC} further enhance reasoning consistency and collaboration efficiency in agent societies by implementing collaborative reflection across diverse roles and personalized feedback mechanisms.
\end{itemize}
\subsection{Experience}\label{Experience}
%虽然反思机制通过评估减轻了幻觉和噪音，但它们的纠正功效仍然是轨迹级的，尚未产生可以转移的策略级知识。此外，针对于轨迹的反思还有可能导致记忆库的线性膨胀，产生推理负担，甚至有可能导致轨迹跟随的特性。因此记忆机制必须跳出反思过去的局限，迈向指导未来的经验阶段。这一阶段的记忆机制通过在轨迹群中抽象出脱离具体语境的普适性智慧，通过这一过程LLM agent真正摆脱了了冗长复杂的记忆库，以直觉般的技能或规则实现对未知幻觉的零样本迁移。经验阶段的研究通过抽象出显示，隐式和混合形式的经验来实现前瞻性智慧。
Although reflection mechanisms mitigate hallucinations~\citep{Tian_Yan_Yang_Zhao_Chen_Wang_Luo_Ma_Song_2025} and noise through evaluation, their corrective efficacy remains at the level of trajectories and has not yet yielded knowledge at the level of strategy that is transferable~\citep{Shinn2023ReflexionLA, Renze2024SelfReflectionIL}. In addition, reflection focused on trajectories may lead to a linear expansion of the memory bank, which imposes a burden for inference and may potentially result in a characteristic of following trajectories~\citep{Hong2025EnhancingMR, Zhu2025WhereLA,Fu2025AgentRefineEA}. Consequently, memory mechanisms must transcend the limitations of reflecting on the past and move toward a stage of experience for the guidance of the future. At this stage, memory mechanisms abstract universal wisdom that is independent of context from clusters of trajectories; through this process, LLM agents~\citep{luo2026agentmathempoweringmathematicalreasoning,tian2025evolproveradvancingautomatedtheorem} truly liberate themselves from memory banks that are verbose and complex, achieving zero-shot transfer to scenarios that are unknown by means of skills or rules that are intuitive. Research on the stage of experience achieves prospective wisdom through the abstraction of experience in forms that are explicit, implicit, and hybrid.
\noindent\textbf{Explicit.}\label{Explicit}
%显示经验通过从轨迹集群中提取人类可读，可编辑和可概括的知识模式，将经验记忆作为可以直接检索和重用的智慧见解，类似于查阅参考手册或函数库。这种方式不仅缓解了推理压力，同时为LLM agent提供了可解释性和自我进化的能力。显示经验的研究总体可以被概括为：Heuristic Guidelines和Procedural Primitives。
Explicit experience abstracts patterns of knowledge that are readable by humans, editable, and generalizable from clusters of trajectories, framing experiential memory as insights of wisdom that allow for direct retrieval and reuse, analogous to the consultation of a reference manual or a library of functions. This methodology not only alleviates the pressure of inference but also provides LLM agents with capabilities for interpretability and self-evolution. Research on explicit experience can generally be categorized into Heuristic Guidelines and Procedural Primitives.
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Heuristic Guidelines:} Heuristic guidelines serve to crystallize implicit intuition into explicit natural language strategies. In this domain, researchers focus on distilling experience into textual rules:~\citet{Ouyang2025ReasoningBankSA} abstracts key decision principles through contrastive analysis of successful and failed trajectories, while~\citet{Suzgun2025DynamicCT} proposes dynamically generated "prompt lists" for real-time heuristic guidance.~\citet{Xu2025SEDMSS} and~\citet{Hassell2025LearningFS} investigate rule induction from supervisory signals, achieving textual experience transfer via "cross-domain knowledge diffusion" and "semantic task guidance," respectively. To transcend linear text limitations in modeling complex dependencies, recent work shifts toward structured schemas.~\citet{Ho2025ArcMemoAR} and~\citet{Zhang2025GMemoryTH} abstract multi-turn reasoning traces into experience graphs, leveraging topological structures to capture logical dependencies and enable effective storage and reuse of collaboration patterns and high-level cognitive principles.
Moreover,~\citet{Cai2025FLEXCA} organizes heuristic knowledge into modular and compositional units, enabling systematic reuse across tasks.
\item \textbf{Procedural Primitives:} Procedural primitives represent the abstraction of complex reasoning chains into executable entities, designed to significantly reduce planning overhead.~\citet{Wang2025InducingPS} proposes a skill induction mechanism that encapsulates high-frequency action sequences into functions, enabling agents to invoke complex skills as atomic actions.~\citet{Zhang2025AccelOptAS} extends this executable paradigm to hardware optimization, enabling agents to accumulate kernel optimization skills that iteratively enhance accelerator performance. In this line of work,~\citet{Huang2025CASCADECA} enables the composition and cascading execution of such procedural primitives, allowing agents to construct complex behaviors through structured skill invocation.
\end{itemize}
\noindent\textbf{Implicit.}\label{Implicit}
%隐式经验摈弃了检索离散文本的方式，将交互历史抽象为隐式先验，解决了推理开销和上下文约束。经验记忆被转化为高维空间中的潜在变量或者神经网络的参数。基于转化实现形式，隐式经验被分为两条途径：Latent Modulation和Parameter Internalization
Implicit experience eschews the retrieval of discrete text and abstracts the history of interactions into implicit priors, thereby addressing the overhead of inference and the constraints of context. Experiential memory is transformed into latent variables within spaces of high dimensionality or into parameters of the neural network. Based on the form of implementation for the transformation, implicit experience is categorized into two trajectories: Latent Modulation and Parameter Internalization.
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Latent Modulation:} Latent modulation operates on the cognitive stream within continuous high-dimensional latent space. By encoding experience into latent variables or activation states, this paradigm "weaves" historical insights into current reasoning in a parameter-free manner, circumventing expensive parameter updates.~\citet{Zhang2025MemGenWG} introduces the MemGen framework, employing a "Memory Weaver" to dynamically generate and inject latent token sequences conditioned on current reasoning state.~\citet{Zhang2025LatentEvolveST} achieves smooth transfer from historical experience to current decision-making without altering static parameters, using alternating Fast Retrieval and Slow Integration within latent space.
\item \textbf{Parameter Internalization:} Parameter Internalization transforms explicit trajectories into intrinsic capabilities within model weights. Through gradient updates, this mechanism instills adaptive priors into LLM agents, enabling effective navigation of complex environments. For context distillation,~\citet{Alakuijala2025MementoNM} proposes iterative distillation to internalize corrective hints into model weights.~\citet{Liu2025AnalyzingAI} converts business rules into model priors, alleviating retrieval overload in RAG systems, while~\citet{Zhai2025AgentEvolverTE} introduces "Experience Stripping," eliminating retrieval segments during training to force internalization of explicit experience into autonomous reasoning capabilities independent of external auxiliaries. For Reinforcement Learning (RL),~\citet{Zhang2025AgentLV} proposes a pioneering early experience paradigm, leveraging implicit world models and sub-reflective prediction to internalize trial-and-error experience into policy priors without extrinsic rewards.~\citet{Lyu2025FromCT} achieves strategic transformation from Reflection to Experience by applying RL to student-generated reflections.~\citet{Feng2025GroupinGroupPO} proposes group-based policy optimization for fine-grained experience internalization across multi-turn interactions.~\citet{Jiang2025VerlToolTH} establishes standardized alignment between RL and tool invocation, enhancing agents' capacity to transmute tool-use experience into intrinsic strategies.
\end{itemize}
\noindent\textbf{Hybrid.}\label{Hybrid}
%混合经验旨在解决显示经验库随着长期交互面临的存储膨胀和检索效率问题。混合经验建立了一个积累-内化的动态循环系统。将显示经验视为一个高容量的缓存，通过周期性的参数更新机制将高价值的显示经验压缩并内化为模型的隐式权重。
Hybrid experience aims to transcend the dichotomy between explicit and implicit paradigms by establishing a dynamic "Accumulate-Internalize" cycle. This paradigm directly addresses the challenges of "Storage Explosion" and "Retrieval Latency" encountered by explicit experience repositories during long-term interactions, while simultaneously mitigating the tension caused by parameter updates lagging behind environmental dynamics.
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Experience Transfer:} Experience Transfer facilitates capability internalization by progressively decoupling agents from external retrieval reliance. ~\citet{Wu2025EvolveRSL} employs offline distillation to abstract complex trajectories into structured experience for inference guidance, then uses these experiences to generate high-quality trajectories for policy optimization. By transferring knowledge from explicit experience pools into model parameters via gradient updates, this approach eliminates dependence on external retrieval systems.~\citet{liu2026exploratorymemoryaugmentedllmagent, Ouyang2025ReasoningBankSA} maintain an explicit experience replay buffer preserving high-value exploration trajectories. Through a hybrid On-Policy and Off-Policy update strategy, this framework leverages explicit memory for immediate exploration while encoding successful experiences into network parameters via offline updates, ensuring agents sustain optimal performance through internalized "intuition" without external support.
\end{itemize}
\section{Extended Discussion on Multimodal Memory Mechanisms}\label{Extended Discussion on Multimodal Memory Mechanisms}
%多模态记忆拓展了传统的以文本为中心的记忆范式，涵盖异构的感知模式，主要包括视觉和听觉信号。多模态记忆的输入包括于文本，音频和图像，其中视频属于听觉和视觉的复合输入。随着LLM Agent开始在需要联合语言推理和多维感知的混合环境中工作（例如具身导航，交互式网页等）记忆机制需要帮助其捕捉现实世界互动中丰富的跨模态依赖关系。我们将总结多模态记忆的主要工作，并阐述其区别于文本记忆所面对的独特挑战。
Multimodal memory extends the conventional paradigm of memory centered on text to encompass heterogeneous modalities of perception, principally involving signals of a visual and auditory nature~\citep{Long2025SeeingLR}. The inputs for multimodal memory comprise text, audio, and images, with video constituting a composite input that integrates both auditory and visual components~\citep{Yin2025VideoARMAR}. As LLM agents begin to operate within hybrid environments that necessitate the joint execution of linguistic reasoning and perception across multiple dimensions, such as embodied navigation and interactive web browsing, mechanisms for memory are required to facilitate the capture of the rich dependencies across modalities that arise within interactions situated in the real world~\citep{Wang2026ExploreWL, Chen2026TowardsML, Yan2026M2DA}. In what follows, we summarize the principal body of work on multimodal memory and delineate the distinctive challenges that differentiate it from memory of a purely textual nature.
\subsection{Current Approaches.}\label{Current Approaches.}
%目前关于LLM Agent多模态记忆机制的研究主要停留在存储阶段，反思和经验阶段的工作较少。我们沿两个重要维度讨论现有方法：多模态表示，多模态检索。
Research on mechanisms for multimodal memory within LLM agents remains predominantly confined to the stage of Storage, with comparatively limited work addressing the stages of Reflection and Experience. We discuss existing methodologies along two salient dimensions: Multimodal Representation and Multimodal Retrieval.
\noindent\textbf{Multimodal Representation.}\label{Multimodal Representation.}
%以文本为中心的统一语义表示是目前LLM Agent多模态记忆的最主流范式，其核心思想是利用预训练的MLLM将所有模态“文本化”，但同时也会损失原始模态中的文本难以表示的信息。MemVerse/M3-Agent%为了缓解文本化带来的视觉信息损失，近期工作也开始对原始模态进行稠密表示，与文本摘要结合进行并置存储，通过多路索引和自适应检索补偿信息损失。WorldMM/M2A/Omn%同时，嵌入共享空间常被作为工具之一被多模态记忆机制调用。MA-LMM
%总体而言，现有工作在语义操作和模态保真之间权衡，逐步从纯文本化范式走向多模态并置的混合表示。
Unified semantic representation centered on text currently constitutes the predominant paradigm within mechanisms of multimodal memory for LLM agents~\citep{Liu2025MemVerseMM, Chen2025TeleMemBL}. The central premise of this approach resides in the utilization of pretrained Multimodal Large Language Models (MLLMs) for the textualization of all modalities; nevertheless, such a process incurs the loss of information inherent to the original modalities that resists adequate articulation within text. To mitigate the loss of visual information introduced through textualization, recent work has begun to construct dense representations of the original modalities, which are subsequently stored in juxtaposition with their corresponding summaries in text~\citep{Wen2026EventMemAgentHE, Bo2025AgenticLW}. Through indexing across multiple pathways and retrieval of an adaptive nature, these approaches seek to compensate for the attendant loss of information. Furthermore, embedding within a shared space is frequently invoked as one of the instruments leveraged by mechanisms of multimodal memory~\citep{He2024MALMMML}. Taken as a whole, existing research negotiates a trade-off between operations at the semantic level and fidelity to the original modalities, progressively transitioning from paradigms of pure textualization toward hybrid representations characterized by the juxtaposition of multiple modalities.
\noindent\textbf{Multimodal Retrieval.}\label{Multimodal Retrieval.}
%多模态并置的混合表示使得查询和目标常跨越不同模态，不同查询对语义抽象和感知保真的需求存在显著差异。M2A,Omn采用多路融合检索，即并行运行语义、词法、视觉等通道，再通过排序融合互补信号提升召回鲁棒性。HippoMM、MemVerse采用层次化检索，即在不同抽象层级间级联召回，先在语义摘要层粗筛，再升级到原模态细节层进行精确重建。WorldMM、M3-Agent则将检索过程交由Agent动态决策，再多轮交互中按意图选择对应模态的特异查询，直至信息充分。
Hybrid representations juxtapose multiple modalities, so queries and targets frequently cross modality boundaries, and different queries vary substantially in how much they demand semantic abstraction versus perceptual fidelity. To address this, three retrieval strategies have emerged. Parallel fusion retrieves along semantic, lexical, and visual channels simultaneously, then integrates the complementary signals through rank fusion to improve recall robustness~\citep{Feng2026M2AMM, Liu2026OmniSimpleMemAD}. Hierarchical retrieval cascades recall across levels of abstraction, first filtering coarsely over semantic summaries and then escalating to the original modalities for precise reconstruction~\citep{Lin2025HippoMMHM}. Agent-driven retrieval, by contrast, delegates the process to the agent itself, which selects modality-specific queries across multiple turns according to its current intent, until the acquired information is deemed sufficient~\citep{Yeo2025WorldMMDM}.
\subsection{Unique Challenges.}\label{Unique Challenges.}
%与以文本为中心的记忆机制相比，多模态记忆面临一系列源于模态异构带来的特殊挑战。我们主要从三方面展开：多模态对齐、时间一致性和巩固与遗忘。
In contrast to mechanisms of memory centered on text, multimodal memory confronts a series of distinctive challenges that arise from the heterogeneity across modalities. We elaborate this discussion principally along three dimensions, addressing Multimodal Alignment, Temporal Consistency, and subsequently Consolidation and Forgetting.
\noindent\textbf{Multimodal Alignment.}\label{Multimodal Alignment.}
%多模态记忆需要将视觉、听觉与文本信号绑定在同一语义单元上，这一过程远比单模态对齐困难，不同模态的信号粒度不对称、语义密度差距悬殊、且统一实体在不同模态中的表征可能完全不同。错误的对齐不仅无法召回完整的记忆，还可能引入无关信号妨碍推理。
Multimodal memory necessitates the binding of signals of a visual, auditory, and textual nature onto a unified semantic unit, a process considerably more arduous than alignment confined to a single modality. The granularity of signals across distinct modalities exhibits a pronounced asymmetry, the density of semantic content differs by a substantial margin, and the representations of a unified entity across disparate modalities may diverge entirely~\citep{Cai2025OnTV, Wang2025DeepMELAM, Yu2026ModalityGS}. Erroneous alignment not only precludes the recall of memory in its complete form, but may further introduce signals of an irrelevant character that impede the process of reasoning~\citep{Lu2026MMAMM}.
\noindent\textbf{Temporal Consistency.}\label{Temporal Consistency.}
%多模态记忆是在连续时间轴上展开的，而不是像文本那样以离散的token为单位，这使得记忆单元的长度与粒度组织成为了重要问题。此外，事件边界往往不与物理时间对齐，单个行动可能跨越多帧的视觉变化与多段语音，这要求记忆机制具备自适应分段、多尺度索引与层级巩固等设计。
Multimodal memory unfolds along a continuous axis of time rather than in terms of discrete tokens as with text, which renders the organization of length and granularity for units of memory a consideration of significant importance~\citep{Yang2025MemorySL, Lian2026FromVT}. Furthermore, the boundaries of events frequently fail to align with physical time: a single action may traverse visual variations spanning multiple frames as well as segments of speech of extended duration~\citep{Wang2024VideoAgentLV}. This state of affairs imposes upon mechanisms of memory the requirement for designs that incorporate adaptive segmentation, indexing across multiple scales, and consolidation of a hierarchical nature.
\noindent\textbf{Consolidation and Forgetting.}\label{Consolidation and Forgetting.}
%与文本记忆可在统一语义空间内完成遗忘和巩固不同，多模态记忆则面临更多独特困难。首先，不同模态的相似性无法用统一度量衡量，其次，不同模态的时效性差异悬殊，偏好文本可能长期有效而场景状态可能在环境改变后立刻失效，衰减函数难以适配，最后，巩固过程可能会丢失非文本信号中的感知细节。
In contrast to memory of a purely textual nature, wherein the processes of forgetting and consolidation may be executed within a unified semantic space, multimodal memory confronts a series of difficulties that are considerably more distinctive. First, the similarity across disparate modalities cannot be assessed through a unified metric~\citep{Wen2025QuantifyingCM, Wei2025MitigatingIA}. Second, the temporal validity associated with distinct modalities diverges by a pronounced margin: textual preferences may retain efficacy over extended durations, whereas the state of a scene may forfeit validity immediately following a transformation of the environment, rendering the adaptation of functions for decay a matter of considerable difficulty~\citep{Alqithami2025ForgetfulBF}. Finally, the process of consolidation may incur the loss of perceptual details inherent to signals of a non-textual nature~\citep{Lian2026FromVT}.
%综合来看，现有多模态记忆研究主要集中在存储阶段，反思阶段和经验阶段的工作仍极为稀缺。这一分布表明了多模态记忆尚处于早期阶段，未来研究将可能在Reflection层面解决跨模态错误、幻觉等问题，以及在Experience阶段探索从多模态轨迹簇中抽取与模态无关的策略先验。
Taken as a whole, existing research on multimodal memory is concentrated predominantly within the stage of Storage, whereas work pertaining to the stages of Reflection and Experience remains exceedingly scarce. This distribution indicates that multimodal memory resides at an early phase of its development. Future research will likely address, at the level of Reflection, issues such as errors and hallucinations that manifest across modalities, and will further explore, within the stage of Experience, the extraction of policy priors that are invariant to modality from clusters of trajectories of a multimodal nature~\citep{Wang2025MitigatingMH, Allard2026ExperientialRL, Lei2025RoboMemoryAB}.
\section{Datasets and Benchmarks}\label{Datasets}
%近期社区设计了各种数据集来评估LLM agent在动态环境中的长期一致性和自我进化能力。但是现有的基准依然主要评估静态存储和检索，缺乏对动态交互场景中记忆其他重要能力的评估。遵循我们的进化路径，我们根据这些基准主要的关注点依然将他们分为存储、反思和经验阶段。基准的详细信息可在表X中看到。
Recently, the research community has developed various datasets to evaluate the consistency over the long term and the capacity for self evolution of LLM agents within dynamic environments. However, existing benchmarks still primarily assess the storage and retrieval of static data, which results in a lack of evaluation for other critical capabilities of memory within scenarios of dynamic interaction. Following our proposed path of evolution (\S\ref{Evolutionary Path}), we categorize these benchmarks into stages of storage, reflection, and experience according to their primary areas of focus. Detailed information for these benchmarks is provided in Table~\ref{Table.1}.
%Stroage阶段是记忆机制的基石，主要评估LLM agent在不同场景、任务和模态下对信息的准确存储和长距离检索能力。我们根据评估的重点确定了三类重要基准。
\noindent\textbf{Storage Stage.} The storage stage serves as the cornerstone for mechanisms of memory, primarily evaluating the capacity of LLM agents for the accurate storage and retrieval of information over long distances across various scenarios, tasks, and modalities.
%Extreme Context类型的基准侧重于探测LLM agent记忆的物理极限，即在海量的干扰信息中提取并处理微笑事实的能力。例如通过多针检索定义模型的实际有效窗口，或者将推理任务嵌入百万字的背景中测试智能体能力或将挑战扩展至视觉领域，该领域的核心是评估模型真实的记忆能力。
%Interactive Consistency类型的基研究基于跨会话的交互，要求LLM agent能在跨会话的交互中能够有一致性的记忆。例如提供千万词级的连贯对话框架，或是直接评持续交互中知识的更新以及拒绝能力，还有则是检测在长期历史中如何保持角色一致与准确。这一阶段的核心是评估模型的长距离一致性的记忆能力
%Relational Fact类型的基准主要是检测LLM agent语义关联与多跳推理的能力，包括测试模型跨文档的整合事实的能力，在个人琐事中的多步推理能力。此外也有结合情感，环境因素以及安全性检测模型的记忆唤起能力。
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Extreme Context:} Extreme context types focus on probing the physical limits of memory in LLM agents, specifically the capacity for extracting and processing minute facts within massive volumes of distracting information. For instance, these benchmarks define the actual effective window of the model through the retrieval of multiple needles~\cite{Hsieh2024RULERWT}, assess the capabilities of agents by embedding reasoning tasks within backgrounds of a million words~\cite{Kuratov2024BABILongTT} and assessing the reliability of memory within a long context~\cite{Yen2024HELMETHT}, or extend these challenges to the domain of vision~\cite{Wang2024MultimodalNI}. The core of this area is the evaluation of the authentic capacity for memory in the model.
\item \textbf{Interactive Consistency:} Research regarding the category of Interactive Consistency is based on interaction across sessions, which requires LLM agents to maintain memory with consistency throughout such interactions. Examples include the provision of frameworks for coherent dialogue at the scale of ten million words~\cite{Tavakoli2025BeyondAM}, the direct evaluation of the update of knowledge and the capacity for rejection during continuous interaction~\cite{Maharana2024EvaluatingVL}, and the detection of how consistency and accuracy for personas are maintained over histories of long duration~\citep{jia-etal-2025-evaluating, Zhong2023MemoryBankEL}. The core of this stage is the assessment of the capacity for memory with consistency over long distances.
\item \textbf{Relational Fact:} Benchmarks of the relational fact category primarily evaluate the capacity of LLM agents for semantic association and reasoning across multiple hops. This involves testing the ability of the model for the integration of facts across documents and reasoning in multiple steps within the context of personal trivia~\citep{Zhang2025ExplicitVI, Yang2018HotpotQAAD}, while adjacent fact-checking evaluation frameworks have also involved knowledge recall and evidence integration during multi-step factual reasoning~\citep{lin2025fact, lin2026towards}. Furthermore, certain frameworks focus on emotional support and interactive scenarios to evaluate the model's capacity for memory recall across proactive and passive paradigms~\cite{He2024MADialBenchTR}.
\end{itemize}
\noindent\textbf{Reflection Stage.} The core of the Reflection stage is the evaluation of how agents transform raw trajectories into memory of high quality, with an emphasis on the denoising and fidelity of memory, the deep alignment with characteristics of users, and the support for perception within complex environments.
%Recltion阶段的核心是评估智能体如何将原始轨迹转化为高质量记忆，重点在于记忆的去噪保真，用户特征的深度对齐，以及复杂环境下的感知支撑。我们将其分为以下三类。
%Error Correction主要评估在记忆系统的生命周期中是否会产生错误或幻觉。例如，测试记忆的搜索、编辑、匹配操作，检查记忆提取或更新阶段的幻觉情况，或是在长上下文下评估记忆的可靠性。
%Personalization聚焦于从智能体的历史中提取深度个性化的能力，包括用户通过反思挖掘潜藏的信息，以获取隐性偏好，用户特质，关键信息和共享部分。
%Dynamic Reasoning关注记忆在多部推理和复杂环境感知中的关键作用，涉及到记忆的选择性遗忘，决策回溯，真实场景和总结与衔接。
\begin{itemize}[leftmargin=*, leftmargin=1.5em, rightmargin=1em]
\item \textbf{Error Correction:} Error correction primarily evaluates whether errors or hallucinations emerge during the lifecycle of the memory system. For instance, it involves testing operations for the search, editing, and matching of memory~\cite{Xia2025MinervaAP}, examining the presence of hallucinations during the stages of extraction or update~\cite{Chen2025HaluMemEH}.
\item \textbf{Personalization:} Personalization focuses on the capacity for the extraction of deep personalization from the history of the agent, which includes the mining of latent information through reflection to identify implicit preferences~\citep{Jiang2025PersonaMemv2TP, Huang2025MemPALTM}, traits of users~\citep{Du2024PerLTQAAP, Zhao2025DoLR}, key information~\citep{Yuan2023PersonalizedLL, Li2025TowardMP}, and shared components~\citep{Tsaknakis2025DoLR, Kim2024SHARESM}.
\item \textbf{Dynamic Reasoning:} Dynamic reasoning emphasizes the critical role of memory in reasoning across multiple steps and the perception of environments with high complexity. This involves the selective forgetting of memory~\cite{Hu2025EvaluatingMI}, backtracking on decisions~\cite{Wan2025StoryBenchAD}, scenarios in the real world~\citep{Deng2024OnTM, Miyai2025WebChoreArenaEW}, and the mechanisms for summarization and transition~\cite{Maharana2024EvaluatingVL}.
\end{itemize}
%经验阶段是记忆演进路径的最高阶段，此时的重点转变为LLM agent在动态环境下如何从零散轨迹中提取通用轨迹，在实战中持续进化。这个阶段的测试集较少，但都具有相当强的经验色彩：XXX和XXX模拟真实部署环境，测试LLM agent在输入和反馈的循环中提取经验的能力；XXX和XX则更加关注经验的迁移能力，通过测试经验在习得后迁移到其他任务来衡量抽象和泛化能力。
%经验阶段是记忆演进路径的最高阶段，此时的重点转变为 LLM agent 在动态环境下如何从零散轨迹中抽象通用经验，在实战中持续进化。这个阶段的测试集较少，但都具有相当强的经验色彩：XXX 和 XXX 模拟真实部署环境，测试 LLM agent 在输入和反馈的循环中提取并内化经验的能力；XXX和 XXX 则更加关注经验的迁移能力，通过测试经验在习得后迁移到其他多样化任务中，来衡量其抽象与泛化水平。
\noindent\textbf{Experience Stage.} The Experience Stage represents the pinnacle of the evolutionary path of memory mechanisms; at this phase, the focus shifts toward how LLM agents abstract general experience from fragmented trajectories within dynamic environments to facilitate continuous evolution through practical application. While benchmarks for this stage are relatively scarce, they possess a strong empirical character:~\citet{Wu2024StreamBenchTB} and~\citet{Ai2025MemoryBenchAB} simulate environments for authentic deployment to evaluate the capacity of LLM agents for the extraction and internalization of experience within cycles of input and feedback; conversely,~\citet{Wei2025EvoMemoryBL} and~\citet{Zheng2025LifelongAgentBenchEL} emphasize the capacity for the transfer of experience, measuring levels of abstraction and generalization by assessing the transfer of acquired experience to a diverse range of other tasks.
\begin{table*}[!htbp]
\centering
\scriptsize
\setlength{\tabcolsep}{2pt}
\renewcommand{\arraystretch}{0.93}
\resizebox{\textwidth}{!}{ \begin{tabular}{L{1.8cm} >{\hspace{0.3cm}}L{2.2cm} L{2.5cm} C{0.85cm} L{9.2cm}}
\toprule
\textbf{Stage} & \textbf{Dataset} & \textbf{Reference} & \textbf{Size} & \textbf{Description} \\
\midrule
% ========== Storage Stage Benchmark ==========
\multirow{14}{1.8cm}[-6.5em]{Storage Stage Benchmark}
& LongBench & ~\citet{Bai2023LongBenchAB} & 4.7k & Evaluate faithful memory preservation and retrieval by performing information extraction and reasoning across multiple tasks with sequences up to 32k tokens. \\
\cmidrule(l){2-5}
& LongBenchv2 & ~\citet{Bai2024LongBenchVT} & 503 & Answer complex multiple-choice questions through the processing of extremely long sequences with lengths between 8k and 2M words for the purpose of evaluating the capacity of memory and the precision of reasoning. \\
\cmidrule(l){2-5}
& RULER & ~\citet{Hsieh2024RULERWT} & Scalable & Evaluate the effectiveness of retrieval and synthesis within long contexts through tasks such as multi-needle extraction or multi-hop reasoning to identify true memory capacity. \\
\cmidrule(l){2-5}
& MMNeedle & ~\citet{Wang2024MultimodalNI} & 280k & Identify a target sub image within a massive collection of images through the analysis of textual descriptions and visual contents for the purpose of measuring the limits of multimodal retrieval. \\
\cmidrule(l){2-5}
& HotpotQA & ~\citet{Yang2018HotpotQAAD} & 113k & Answer questions by performing reasoning across multiple hops over information scattered in diverse documents based on Wikipedia to provide accurate results and supporting facts. \\
\cmidrule(l){2-5}
& MemoryBank & ~\citet{Zhong2023MemoryBankEL} & 194 & Answer questions by recalling pertinent information and summarizing user traits across a history of interactions spanning ten days to evaluate the precision of retrieval and the maintenance of user portraits for long-term dialogues. \\
\cmidrule(l){2-5}
& BABILong & ~\citet{Kuratov2024BABILongTT} & Scalable & Answer questions by performing reasoning on facts scattered across extremely long documents of natural language to test the limits of memory and retrieval for contexts with length up to one million tokens. \\
\cmidrule(l){2-5}
& DialSim & ~\citet{Kim2024DialSimAR} & 1.3k & Evaluate the precision of retrieval for memory by answering spontaneous questions across sessions of dialogue involving multiple parties with long durations. \\
\cmidrule(l){2-5}
& LongMemEval & ~\citet{Maharana2024EvaluatingVL} & 500 & Answer questions through the extraction of information from histories of interactive chat with multiple sessions for the purpose of evaluating the performance of retrieval and reasoning across dependencies of long range. \\
\cmidrule(l){2-5}
& BEAM & ~\citet{Tavakoli2025BeyondAM} & 100 & Evaluate the capacity of memory and the precision of retrieval by answering questions based on coherent and topically diverse conversations with length up to ten million tokens. \\
\cmidrule(l){2-5}
& MPR & ~\citet{Zhang2025ExplicitVI} & 108k & Answer complex questions by conducting reasoning across multiple hops of factual information specific to a user within a framework of explicit or implicit memory for the purpose of evaluating the precision of retrieval. \\
\cmidrule(l){2-5}
& LOCCO & ~\citet{jia-etal-2025-evaluating} & 1.6k & Evaluate the persistence of memory and the retrieval of historical facts by analyzing chronological conversations across extended periods of time for the purpose of measuring information decay. \\
\cmidrule(l){2-5}
& MADial-Bench & ~\citet{He2024MADialBenchTR} & 160 & Evaluate the effectiveness of retrieval and recognition for historical events across multiple turns of interaction by simulating paradigms of passive and proactive recall for the purpose of providing emotional support. \\
\cmidrule(l){2-5}
& HELMET & ~\citet{Yen2024HELMETHT} & Scalable & Evaluate the effectiveness of models for long-context by performing information extraction and reasoning across seven diverse categories for sequences with lengths up to 128k tokens to provide a thorough assessment of memory capacity. \\
\bottomrule
\end{tabular}}
\caption{Representative datasets for benchmarking LLM agent memory mechanisms.}
\label{Table.1}
\end{table*}
% ============================================================
% 第二部分 - Reflection + Experience 合并
% ============================================================
\begin{table*}[!htbp]
\ContinuedFloat
\centering
\scriptsize
\setlength{\tabcolsep}{2pt}
\renewcommand{\arraystretch}{0.93}
\resizebox{\textwidth}{!}{ \begin{tabular}{L{1.8cm} >{\hspace{0.3cm}}L{2.2cm} L{2.5cm} C{0.85cm} L{9.2cm}}
\toprule
\textbf{Stage} & \textbf{Dataset} & \textbf{Reference} & \textbf{Size} & \textbf{Description} \\
\midrule
% ========== Reflection Stage Benchmark ==========
\multirow{15}{1.8cm}[-9em]{Reflection Stage Benchmark}
& Minerva & ~\citet{Xia2025MinervaAP} & Scalable & Analyze the proficiency of LLMs in utilizing and manipulating context memory through a programmable framework of atomic and composite tasks for the purpose of pinpointing specific functional deficiencies and providing actionable insights. \\
\cmidrule(l){2-5}
& HaluMem & ~\citet{Chen2025HaluMemEH} & 3.5k & Evaluate the fidelity of memory by quantifying the occurrence of fabrication and omission during the stages of storage and retrieval across dialogues of multiple turns. \\
\cmidrule(l){2-5}
& MABench & ~\citet{Hu2025EvaluatingMI} & 2.1k & Evaluate the competencies of accurate retrieval and learning at test time across sequences of incremental interactions with multiple turns. \\
\cmidrule(l){2-5}
& PRM & ~\citet{Yuan2023PersonalizedLL} & 700 & Evaluate the capability of personalized assistants to maintain a dynamic memory bank by preserving evolving user knowledge and experiences across long term dialogues for the purpose of generating tailored responses. \\
\cmidrule(l){2-5}
& PersonMemv2 & ~\citet{Jiang2025PersonaMemv2TP} & 1k & Generate personalized responses through the extraction of implicit personas from interactions with long context and thousands of preferences of users to evaluate the adaptation of agents. \\
\cmidrule(l){2-5}
& LoCoMo & ~\citet{Maharana2024EvaluatingVL} & 50 & Evaluate the reliability of memory by executing question answering and event summarization across sequences of conversation with lengths of up to nine thousand tokens spanning thirty-five sessions. \\
\cmidrule(l){2-5}
& WebChoreArena & ~\citet{Miyai2025WebChoreArenaEW} & 451 & Analyze the performance of memory for information retrieval and complex aggregation by performing multiple steps of navigation and reasoning across hundreds of web pages. \\
\cmidrule(l){2-5}
& MT-Mind2Web & ~\citet{Deng2024OnTM} & 720 & Evaluate the performance of conversational web navigation via multiturn instruction following across sequential interactions with both users and environment for the purpose of managing context dependency and limited memory space. \\
\cmidrule(l){2-5}
& StoryBench & ~\citet{Wan2025StoryBenchAD} & 80 & Evaluate the capacity for reflection and sequential reasoning by navigating hierarchical decision trees within interactive fiction games to trace back and revise earlier choices independently across multiple turns. \\
\cmidrule(l){2-5}
& PerLTQA & ~\citet{Du2024PerLTQAAP} & 8.6k & Answer personalized questions by retrieving and synthesizing semantic and episodic information from a memory bank of thirty characters to evaluate the accuracy of retrieval for memory. \\
\cmidrule(l){2-5}
& ImplexConv & ~\citet{Li2025TowardMP} & 2.5k & Evaluate implicit reasoning in personalized dialogues by retrieving and synthesizing subtle or semantically distant information from history encompassing 100 sessions to test the efficiency of hierarchical memory structures. \\
\cmidrule(l){2-5}
& Share & ~\citet{Kim2024SHARESM} & 3.2k & Improve the quality of interactions across long durations by extracting persona data and memories of shared history from scripts of movies to sustain a consistent relationship between two individuals. \\
\cmidrule(l){2-5}
& Mem-PAL & ~\citet{Huang2025MemPALTM} & 100 & Evaluate the capability of personalization for assistants oriented toward service by identifying subjective traits and preferences of users from histories of dialogue and behavioral logs across multiple sessions for the purpose of generating tailored responses. \\
\cmidrule(l){2-5}
& PrefEval & ~\citet{Zhao2025DoLR} & 3k & Quantify the robustness of proactive preference following by evaluating the ability of models to infer and satisfy explicit or implicit user traits amidst long context distractions for sequences with length up to 100k tokens. \\
\cmidrule(l){2-5}
& LIDB & ~\citet{Tsaknakis2025DoLR} & 210 & Discover the latent preferences of users and generate personalized responses through interactions across multiple turns within a framework of three agents for the purpose of evaluating the efficiency of elicitation and adaptation. \\
\midrule
% ========== Experience Stage Benchmark ==========
\multirow{4}{1.8cm}[-1.5em]{Experience Stage Benchmark}
& StreamBench & ~\citet{Wu2024StreamBenchTB} & 9.7k & Evaluate the capacity for continuous improvement and online learning via iterative feedback processing across diverse task streams to measure the adaptation of agents after deployment. \\
\cmidrule(l){2-5}
& MemoryBench & ~\citet{Ai2025MemoryBenchAB} & 20k & Evaluate the capacity for continual learning of Large Language Model systems by simulating the accumulation of feedback from users across multiple domains to measure the effectiveness of procedural memory. \\
\cmidrule(l){2-5}
& Evo-Memory & ~\citet{Wei2025EvoMemoryBL} & 3.7k & Evaluate the capacity for learning at test time and the evolution of memory by processing continuous streams of tasks for the purpose of reuse of experience across diverse scenarios. \\
\cmidrule(l){2-5}
& LABench & ~\citet{Zheng2025LifelongAgentBenchEL} & 1.4k & Evaluate the lifelong learning ability and transfer of knowledge across sequences of interdependent tasks in dynamic environments for the purpose of measuring the acquisition and retention of skills. \\
\bottomrule
\end{tabular}}
\caption[]{Representative datasets for benchmarking LLM agent memory mechanisms (continued).}
\end{table*}
\end{document}
\begin{thebibliography}{248}
\providecommand{\natexlab}[1]{#1}
\bibitem[{Ahn et~al.(2022)Ahn, Brohan, Brown, Chebotar, Cortes, David, Finn, Gopalakrishnan, Hausman, Herzog, Ho, Hsu, Ibarz, Ichter, Irpan, Jang, Ruano, Jeffrey, Jesmonth, Joshi, Julian, Kalashnikov, Kuang, Lee, Levine, Lu, Luu, Parada, Pastor, Quiambao, Rao, Rettinghouse, Reyes, Sermanet, Sievers, Tan, Toshev, Vanhoucke, Xia, Xiao, Xu, Xu, and Yan}]{Ahn2022DoAI}
Michael Ahn, Anthony Brohan, Noah Brown, Yevgen Chebotar, Omar Cortes, Byron David, Chelsea Finn, Keerthana Gopalakrishnan, Karol Hausman, Alexander Herzog, Daniel Ho, Jasmine Hsu, Julian Ibarz, Brian Ichter, Alex Irpan, Eric Jang, Rosario M~Jauregui Ruano, Kyle Jeffrey, Sally Jesmonth, and 24 others. 2022.
\newblock \href {https://api.semanticscholar.org/CorpusID:247939706} {Do as i can, not as i say: Grounding language in robotic affordances}.
\newblock In \emph{Conference on Robot Learning}.
\bibitem[{Ai et~al.(2025)Ai, Tang, Wang, Long, Su, and Liu}]{Ai2025MemoryBenchAB}
Qingyao Ai, Yichen Tang, Changyue Wang, Jianming Long, Weihang Su, and Yiqun Liu. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:282210434} {Memorybench: A benchmark for memory and continual learning in llm systems}.
\newblock \emph{ArXiv}, abs/2510.17281.
\bibitem[{Alakuijala et~al.(2025)Alakuijala, Gao, Ananov, Kaski, Marttinen, Ilin, and Valpola}]{Alakuijala2025MementoNM}
Minttu Alakuijala, Ya~Gao, Georgy Ananov, Samuel Kaski, Pekka Marttinen, Alexander Ilin, and Harri Valpola. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:276107931} {Memento no more: Coaching ai agents to master multiple tasks via hints internalization}.
\newblock \emph{ArXiv}, abs/2502.01562.
\bibitem[{Allard et~al.(2026)Allard, Teinturier, Xing, and Viaud}]{Allard2026ExperientialRL}
Marc-Antoine Allard, Arnaud Teinturier, Victor Xing, and Gautier Viaud. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:286789991} {Experiential reflective learning for self-improving llm agents}.
\bibitem[{Alqithami(2025)}]{Alqithami2025ForgetfulBF}
Saad Alqithami. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:283897267} {Forgetful but faithful: A cognitive memory architecture and benchmark for privacy-aware generative agents}.
\newblock \emph{ArXiv}, abs/2512.12856.
\bibitem[{Anokhin et~al.(2024)Anokhin, Semenov, Sorokin, Evseev, Burtsev, and Burnaev}]{Anokhin2024AriGraphLK}
Petr Anokhin, Nikita Semenov, Artyom~Y. Sorokin, Dmitry Evseev, Mikhail Burtsev, and Evgeny Burnaev. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:271039035} {Arigraph: Learning knowledge graph world models with episodic memory for llm agents}.
\newblock In \emph{International Joint Conference on Artificial Intelligence}.
\bibitem[{Bai et~al.(2023)Bai, Lv, Zhang, Lyu, Tang, Huang, Du, Liu, Zeng, Hou, Dong, Tang, and Li}]{Bai2023LongBenchAB}
Yushi Bai, Xin Lv, Jiajie Zhang, Hong Lyu, Jiankai Tang, Zhidian Huang, Zhengxiao Du, Xiao Liu, Aohan Zeng, Lei Hou, Yuxiao Dong, Jie Tang, and Juanzi Li. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:261245264} {Longbench: A bilingual, multitask benchmark for long context understanding}.
\newblock \emph{ArXiv}, abs/2308.14508.
\bibitem[{Bai et~al.(2024)Bai, Tu, Zhang, Peng, Wang, Lv, Cao, Xu, Hou, Dong, Tang, and Li}]{Bai2024LongBenchVT}
Yushi Bai, Shangqing Tu, Jiajie Zhang, Hao Peng, Xiaozhi Wang, Xin Lv, Shulin Cao, Jiazheng Xu, Lei Hou, Yuxiao Dong, Jie Tang, and Juanzi Li. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:274859535} {Longbench v2: Towards deeper understanding and reasoning on realistic long-context multitasks}.
\newblock \emph{ArXiv}, abs/2412.15204.
\bibitem[{Balestri and Pescatore(2025)}]{Balestri2025NarrativeMI}
Roberto Balestri and Guglielmo Pescatore. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280565831} {Narrative memory in machines: Multi-agent arc extraction in serialized tv}.
\newblock \emph{ArXiv}, abs/2508.07010.
\bibitem[{Behrouz et~al.(2024)Behrouz, Zhong, and Mirrokni}]{Behrouz2024TitansLT}
Ali Behrouz, Peilin Zhong, and Vahab~S. Mirrokni. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:275212078} {Titans: Learning to memorize at test time}.
\newblock \emph{ArXiv}, abs/2501.00663.
\bibitem[{Bidochko and Vyklyuk(2026)}]{BIDOCHKO2026102740}
Andrii Bidochko and Yaroslav Vyklyuk. 2026.
\newblock \href {https://doi.org/10.1016/j.jocs.2025.102740} {Thought management system for long-horizon, goal-driven llm agents}.
\newblock \emph{Journal of Computational Science}, 93:102740.
\bibitem[{Bo et~al.(2025)Bo, Zhang, Sun, Wu, Xie, Tan, Chen, He, Li, Zhao, Wang, and Li}]{Bo2025AgenticLW}
Weihao Bo, Shan Zhang, Yanpeng Sun, Jingjing Wu, Qunyi Xie, Xiao Tan, Kunbin Chen, Wei He, Xiaofan Li, Na~Zhao, Jingdong Wang, and Zechao Li. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:283261501} {Agentic learner with grow-and-refine multimodal semantic memory}.
\newblock \emph{ArXiv}, abs/2511.21678.
\bibitem[{Bo et~al.(2024)Bo, Zhang, Dai, Feng, Wang, Li, Chen, and Wen}]{Bo2024ReflectiveMC}
Xiaohe Bo, Zeyu Zhang, Quanyu Dai, Xueyang Feng, Lei Wang, Rui Li, Xu~Chen, and Ji-Rong Wen. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:276318441} {Reflective multi-agent collaboration based on large language models}.
\newblock \emph{Advances in Neural Information Processing Systems 37}.
\bibitem[{Bohnet et~al.(2025)Bohnet, Kamienny, Sedghi, Gorur, Awasthi, Parisi, Swersky, Liu, Nova, and Fiedel}]{Bohnet2025EnhancingLP}
Bernd Bohnet, P.~Kamienny, Hanie Sedghi, Dilan Gorur, Pranjal Awasthi, Aaron~T Parisi, Kevin Swersky, Rosanne Liu, Azade Nova, and Noah Fiedel. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284350956} {Enhancing llm planning capabilities through intrinsic self-critique}.
\bibitem[{Cai et~al.(2025{\natexlab{a}})Cai, Liu, Gao, Jiang, Zhang, van~den Hengel, and Shi}]{Cai2025OnTV}
Yichao Cai, Yuhang Liu, Erdun Gao, Tianjiao Jiang, Zhen Zhang, Anton van~den Hengel, and Javen~Qinfeng Shi. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:277781009} {On the value of cross-modal misalignment in multimodal representation learning}.
\bibitem[{Cai et~al.(2025{\natexlab{b}})Cai, Guo, Pei, Feng, Chen, Zhang, Ma, Wang, and Zhou}]{Cai2025FLEXCA}
Zhicheng Cai, Xinyuan Guo, Yu~Pei, Jiangtao Feng, Jiangjie Chen, Ya-Qin Zhang, Wei-Ying Ma, Mingxuan Wang, and Hao Zhou. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282912514} {Flex: Continuous agent evolution via forward learning from experience}.
\bibitem[{Cao et~al.(2026{\natexlab{a}})Cao, Yang, Li, Pan, Zhao, Chen, Tian, Wu, He, Han et~al.}]{cao2026pushing}
Chuxue Cao, Jinluan Yang, Haoran Li, Kunhao Pan, Zijian Zhao, Zhengyu Chen, Yuchen Tian, Lijun Wu, Conghui He, Sirui Han, and 1 others. 2026{\natexlab{a}}.
\newblock Pushing the boundaries of natural reasoning: Interleaved bonus from formal-logic verification.
\newblock \emph{arXiv preprint arXiv:2601.22642}.
\bibitem[{Cao et~al.(2026{\natexlab{b}})Cao, Lin, Gu, Luo, and Ma}]{cao2026diffcot}
Shidong Cao, Hongzhan Lin, Yuxuan Gu, Ziyang Luo, and Jing Ma. 2026{\natexlab{b}}.
\newblock Diffcot: Diffusion-styled chain-of-thought reasoning in llms.
\newblock \emph{arXiv preprint arXiv:2601.03559}.
\bibitem[{Cao et~al.(2025)Cao, Deng, Yu, Zhou, Liu, Ding, and Zhao}]{Cao2025RememberMR}
Zouying Cao, Jiaji Deng, Li~Yu, Weikang Zhou, Zhaoyang Liu, Bolin Ding, and Hai Zhao. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:283737683} {Remember me, refine me: A dynamic procedural memory framework for experience-driven agent evolution}.
\bibitem[{Chen et~al.(2025{\natexlab{a}})Chen, Guan, Lin, Li, Lin, Wang, Chen, Luo, Sun, Zhang, and Li}]{Chen2025TeleMemBL}
Chunliang Chen, Ming Guan, Xiao Lin, Jiaxu Li, Luxi Lin, Qiying Wang, Xiangyu Chen, Jixiang Luo, Changzhi Sun, Dell Zhang, and Xuelong Li. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:284647493} {Telemem: Building long-term and multimodal memory for agentic ai}.
\newblock \emph{ArXiv}, abs/2601.06037.
\bibitem[{Chen et~al.(2025{\natexlab{b}})Chen, Niu, Li, Liu, Zheng, Tang, Li, Xiong, and Li}]{Chen2025HaluMemEH}
Ding Chen, Simin Niu, Kehang Li, Peng Liu, Xiangping Zheng, Bo~Tang, Xinchi Li, Feiyu Xiong, and Zhiyu Li. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282758378} {Halumem: Evaluating hallucinations in memory systems of agents}.
\newblock \emph{ArXiv}, abs/2511.03506.
\bibitem[{Chen et~al.(2026)Chen, Lu, Liu, Dong, Zou, Lv, Li, Mao, Pei, Wang, Li, Sapra, Liu, Zheng, Huang, Wang, Yu, Tao, Liu, and Lu}]{Chen2026TowardsML}
Guo Chen, Lidong Lu, Yicheng Liu, Li~Dong, Lidong Zou, Jixin Lv, Zhenquan Li, Xinyi Mao, Baoqi Pei, Shihao Wang, Zhiqi Li, Karan Sapra, Fuxiao Liu, Yin-Dong Zheng, Yifei Huang, Limin Wang, Zhiding Yu, Andrew Tao, Guilin Liu, and Tong Lu. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:286256385} {Towards multimodal lifelong understanding: A dataset and agentic baseline}.
\bibitem[{Chen et~al.(2025{\natexlab{c}})Chen, Zhu, Wang, Zhang, Wang, Gao, Xiao, Teh, He, and Li}]{Chen2025InternalizingWM}
Shiqi Chen, Tongyao Zhu, Zian Wang, Jinghan Zhang, Kangrui Wang, Siyang Gao, Teng Xiao, Yee~Whye Teh, Junxian He, and Manling Li. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282203038} {Internalizing world models via self-play finetuning for agentic rl}.
\newblock \emph{ArXiv}, abs/2510.15047.
\bibitem[{Chen et~al.(2025{\natexlab{d}})Chen, Lin, Gu, Shi, Lian, Yun, Chen, Sun, Cao, and Wang}]{Chen2025SWEExpES}
Silin Chen, Shaoxin Lin, Xiaodong Gu, Yuling Shi, Heng Lian, Longfei Yun, Dong Chen, Weiguo Sun, Lin Cao, and Qianxiang Wang. 2025{\natexlab{d}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280401697} {Swe-exp: Experience-driven software issue resolution}.
\newblock \emph{ArXiv}, abs/2507.23361.
\bibitem[{Cheng et~al.(2025{\natexlab{a}})Cheng, Kumar, Lal, Rajasekaran, Ramezani, Khan, Rokhlenko, Chiu-Webster, Hua, and Amiri}]{Cheng2025WebATLASAL}
Jiali Cheng, Anjishnu Kumar, Roshan Lal, Rishi Rajasekaran, Hani Ramezani, Omar~Zia Khan, Oleg Rokhlenko, Sunny Chiu-Webster, Gang Hua, and Hadi Amiri. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282389238} {Webatlas: An llm agent with experience-driven memory and action simulation}.
\bibitem[{Cheng et~al.(2025{\natexlab{b}})Cheng, Jie, Yu, Yan, Luo, Liu, Wang, Liu, and Chen}]{Cheng2025AgentR1TP}
Mingyue Cheng, Ouyang Jie, Shuo Yu, Ruiran Yan, Yucong Luo, Zirui Liu, Daoyu Wang, Qi~Liu, and Enhong Chen. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283081049} {Agent-r1: Training powerful llm agents with end-to-end reinforcement learning}.
\bibitem[{Chhikara et~al.(2025)Chhikara, Khant, Aryan, Singh, and Yadav}]{Chhikara2025Mem0BP}
Prateek Chhikara, Dev Khant, Saket Aryan, Taranjeet Singh, and Deshraj Yadav. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:278165315} {Mem0: Building production-ready ai agents with scalable long-term memory}.
\newblock \emph{ArXiv}, abs/2504.19413.
\bibitem[{Cui et~al.(2025)Cui, Mouchel, and Faltings}]{Cui2025UncertaintyIC}
Shaobo Cui, Luca Mouchel, and Boi Faltings. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280035098} {Uncertainty in causality: A new frontier}.
\newblock In \emph{Annual Meeting of the Association for Computational Linguistics}.
\bibitem[{Das et~al.(2024)Das, Chaudhury, Nelson, Melnyk, Swaminathan, Dai, Lozano, Kollias, Chenthamarakshan, Navr{\'a}til, Dan, and Chen}]{Das2024LarimarLL}
Payel Das, Subhajit Chaudhury, Elliot Nelson, Igor Melnyk, Sarath Swaminathan, Sihui Dai, Aur{\'e}lie~C. Lozano, Georgios Kollias, Vijil Chenthamarakshan, Jir{\'i} Navr{\'a}til, Soham Dan, and Pin-Yu Chen. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:268532114} {Larimar: Large language models with episodic memory control}.
\newblock \emph{ArXiv}, abs/2403.11901.
\bibitem[{Deng et~al.(2024)Deng, Zhang, Zhang, Yuan, Ng, and Chua}]{Deng2024OnTM}
Yang Deng, Xuan Zhang, Wenxuan Zhang, Yifei Yuan, See-Kiong Ng, and Tat-Seng Chua. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:267897510} {On the multi-turn instruction following for conversational web agents}.
\newblock In \emph{Annual Meeting of the Association for Computational Linguistics}.
\bibitem[{Ding et~al.(2025)Ding, Chen, Lv, Yuan, Zhu, Tian, Zhu, Wang, Deng, Mi, Shang, and Lin}]{Ding2025RethinkingET}
Bowen Ding, Yuhan Chen, Jiayang Lv, Jiyao Yuan, Qi~Zhu, Shuangshuang Tian, Dantong Zhu, Futing Wang, Heyuan Deng, Fei Mi, Lifeng Shang, and Tao Lin. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:283883758} {Rethinking expert trajectory utilization in llm post-training}.
\bibitem[{Du et~al.(2025{\natexlab{a}})Du, Li, Zhang, and Song}]{Du2025MemR3MR}
Xingbo Du, Loka Li, Duzhen Zhang, and Le~Song. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:284133206} {Memr3: Memory retrieval via reflective reasoning for llm agents}.
\newblock \emph{ArXiv}, abs/2512.20237.
\bibitem[{Du et~al.(2025{\natexlab{b}})Du, Huang, Zheng, Wang, Montella, Lapata, Wong, and Pan}]{Du2025RethinkingMI}
Yiming Du, Wenyu Huang, Danna Zheng, Zhaowei Wang, S{\'e}bastien Montella, Mirella Lapata, Kam-Fai Wong, and Jeff~Z. Pan. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:278237720} {Rethinking memory in ai: Taxonomy, operations, topics, and future directions}.
\newblock \emph{ArXiv}, abs/2505.00675.
\bibitem[{Du et~al.(2025{\natexlab{c}})Du, Wang, Xiang, Wang, Huang, Xue, Liang, Zeng, Mi, Bai, Shang, Pan, Jiang, and Wong}]{Du2025MemoryT1RL}
Yiming Du, Baojun Wang, Yifan Xiang, Zhaowei Wang, Wenyu Huang, Boyang Xue, Bin Liang, Xingshan Zeng, Fei Mi, Haoli Bai, Lifeng Shang, Jeff~Z. Pan, Yuxin Jiang, and Kam-Fai Wong. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:284132930} {Memory-t1: Reinforcement learning for temporal reasoning in multi-session agents}.
\bibitem[{Du et~al.(2024)Du, Wang, Zhao, Liang, Wang, Zhong, Wang, and Wong}]{Du2024PerLTQAAP}
Yiming Du, Hongru Wang, Zhengyi Zhao, Bin Liang, Baojun Wang, Wanjun Zhong, Zezhong Wang, and Kam-Fai Wong. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:267938190} {Perltqa: A personal long-term memory dataset for memory classification, retrieval, and synthesis in question answering}.
\newblock \emph{ArXiv}, abs/2402.16288.
\bibitem[{Everitt et~al.(2025)Everitt, Garbacea, Bellot, Richens, Papadatos, Campos, and Shah}]{Everitt2025EvaluatingTG}
Tom Everitt, Cristina Garbacea, Alexis Bellot, Jonathan Richens, Henry Papadatos, Sim{\'e}on Campos, and Rohin Shah. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:277824195} {Evaluating the goal-directedness of large language models}.
\newblock \emph{ArXiv}, abs/2504.11844.
\bibitem[{Fang et~al.(2025{\natexlab{a}})Fang, Deng, Xu, Jiang, Tang, Xu, Deng, Yao, Wang, Qiao, Chen, and Zhang}]{Fang2025LightMemLA}
Jizhan Fang, Xinle Deng, Haoming Xu, Ziyan Jiang, Yuqi Tang, Ziwen Xu, Shumin Deng, Yunzhi Yao, Mengru Wang, Shuofei Qiao, Huajun Chen, and Ningyu Zhang. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282245881} {Lightmem: Lightweight and efficient memory-augmented generation}.
\newblock \emph{ArXiv}, abs/2510.18866.
\bibitem[{Fang et~al.(2025{\natexlab{b}})Fang, Liang, Wang, Wu, Qiao, Xie, Huang, Chen, and Zhang}]{Fang2025MempEA}
Runnan Fang, Yuan Liang, Xiaobin Wang, Jialong Wu, Shuofei Qiao, Pengjun Xie, Fei Huang, Huajun Chen, and Ningyu Zhang. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280561810} {Memp: Exploring agent procedural memory}.
\newblock \emph{ArXiv}, abs/2508.06433.
\bibitem[{Feng et~al.(2026)Feng, Xu, Chen, Dai, Wu, Li, Zeng, Xie, Liang, Lu, and Zhang}]{Feng2026M2AMM}
Junyu Feng, Binxiao Xu, Jiayi Chen, Meng~Yi Dai, Cenyang Wu, Haodong Li, Bohan Zeng, Yu~Xie, Hao Liang, Ming Lu, and Wentao Zhang. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:285452337} {M2a: Multimodal memory agent with dual-layer hybrid memory for long-term personalized interactions}.
\newblock \emph{ArXiv}, abs/2602.07624.
\bibitem[{Feng et~al.(2025{\natexlab{a}})Feng, Xue, Liu, and An}]{Feng2025GroupinGroupPO}
Lang Feng, Zhenghai Xue, Tingcong Liu, and Bo~An. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:278715074} {Group-in-group policy optimization for llm agent training}.
\newblock \emph{ArXiv}, abs/2505.10978.
\bibitem[{Feng et~al.(2025{\natexlab{b}})Feng, Wang, Jiang, and Zhu}]{Feng2025EmbodiedAF}
Tongtong Feng, Xin Wang, Yu-Gang Jiang, and Wenwu Zhu. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281505303} {Embodied ai: From llms to world models}.
\newblock \emph{ArXiv}, abs/2509.20021.
\bibitem[{Forouzandeh et~al.(2025)Forouzandeh, Peng, Moradi, Yu, and Jalili}]{Forouzandeh2025LearningHP}
Saman Forouzandeh, Wei Peng, Parham Moradi, Xinghuo Yu, and Mahdi Jalili. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284077809} {Learning hierarchical procedural memory for llm agents through bayesian selection and contrastive refinement}.
\bibitem[{Fu et~al.(2025)Fu, He, Wang, Hong, Gongque, Zeng, Wang, Wang, Cai, and Xu}]{Fu2025AgentRefineEA}
Dayuan Fu, Keqing He, Yejie Wang, Wentao Hong, Zhuoma Gongque, Weihao Zeng, Wei Wang, Jingang Wang, Xunliang Cai, and Weiran Xu. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:275323978} {Agentrefine: Enhancing agent generalization through refinement tuning}.
\newblock \emph{ArXiv}, abs/2501.01702.
\bibitem[{Gao et~al.(2024)Gao, Li, Kuang, Pan, Chen, Ma, Qian, Yao, Zhu, Cheng, Shi, Li, Ding, and Zhou}]{Gao2024AgentScopeAF}
Dawei Gao, Zitao Li, Weirui Kuang, Xuchen Pan, Daoyuan Chen, Zhijian Ma, Bingchen Qian, Liuyi Yao, Lin Zhu, Chen Cheng, Hongzhu Shi, Yaliang Li, Bolin Ding, and Jingren Zhou. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:267782737} {Agentscope: A flexible yet robust multi-agent platform}.
\newblock \emph{ArXiv}, abs/2402.14034.
\bibitem[{Gharat et~al.(2025)Gharat, Agrawal, and Patro}]{Gharat2025FromPT}
Himanshu Gharat, Himanshi Agrawal, and Gourab~K. Patro. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:283933650} {From personalization to prejudice: Bias and discrimination in memory-enhanced ai agents for recruitment}.
\bibitem[{Ghasemabadi and Niu(2025)}]{Ghasemabadi2025CanLP}
Amirhosein Ghasemabadi and Di~Niu. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284133177} {Can llms predict their own failures? self-awareness via internal circuits}.
\bibitem[{Guo et~al.(2025)Guo, Yang, Chen, Xiao, Wang, Juan, Qiu, Shen, and Wang}]{Guo2025GenEnvDC}
Jiacheng Guo, Ling Yang, Peter Chen, Qixin Xiao, Yinjie Wang, Xinzhe Juan, Jiahao Qiu, Ke~Shen, and Mengdi Wang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284077413} {Genenv: Difficulty-aligned co-evolution between llm agents and environment simulators}.
\bibitem[{Han et~al.(2025)Han, Couturier, Diaz, Zhang, R{\"u}hle, and Rajmohan}]{Han2025LEGOMemMP}
Dongge Han, Camille Couturier, Daniel~Madrigal Diaz, Xuchao Zhang, Victor R{\"u}hle, and Saravan Rajmohan. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:281843936} {Legomem: Modular procedural memory for multi-agent llm systems for workflow automation}.
\newblock \emph{ArXiv}, abs/2510.04851.
\bibitem[{Hassell et~al.(2025)Hassell, Zhang, Kim, Mitchell, and Hruschka}]{Hassell2025LearningFS}
Jackson Hassell, Dan Zhang, Han~Jun Kim, Tom Mitchell, and Estevam Hruschka. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:282304825} {Learning from supervision with semantic and episodic memory: A reflective approach to agent adaptation}.
\newblock \emph{ArXiv}, abs/2510.19897.
\bibitem[{Hayashi et~al.(2025)Hayashi, Pang, Zhao, Liu, Gokul, Bansal, Xiong, Yavuz, and Zhou}]{Hayashi2025SelfAbstractionFG}
Hiroaki Hayashi, Bo~Pang, Wenting Zhao, Ye~Liu, Akash Gokul, Srijan Bansal, Caiming Xiong, Semih Yavuz, and Yingbo Zhou. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:282911910} {Self-abstraction from grounded experience for plan-guided policy refinement}.
\bibitem[{He et~al.(2024{\natexlab{a}})He, Li, Jang, Jia, Cao, Shah, Shrivastava, and Lim}]{He2024MALMMML}
Bo~He, Hengduo Li, Young~Kyun Jang, Menglin Jia, Xuefei Cao, Ashish Shah, Abhinav Shrivastava, and Ser-Nam Lim. 2024{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:269005185} {Ma-lmm: Memory-augmented large multimodal model for long-term video understanding}.
\newblock \emph{2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, pages 13504--13514.
\bibitem[{He et~al.(2024{\natexlab{b}})He, Zhu, Wang, Wang, Haffari, and Zhang}]{He2024MADialBenchTR}
Junqing He, Liang Zhu, Rui Wang, Xi~Wang, Gholamreza Haffari, and Jiaxing Zhang. 2024{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:272827841} {Madial-bench: Towards real-world evaluation of memory-augmented dialogue generation}.
\newblock In \emph{North American Chapter of the Association for Computational Linguistics}.
\bibitem[{He et~al.(2024{\natexlab{c}})He, Zhang, Yan, Wu, and Chen}]{He2024IDEAET}
Kaiyu He, Mian Zhang, Shuo Yan, Peilin Wu, and Zhiyu Chen. 2024{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:273025550} {Idea: Enhancing the rule learning ability of large language model agent through induction, deduction, and abduction}.
\newblock In \emph{Annual Meeting of the Association for Computational Linguistics}.
\bibitem[{He et~al.(2025)He, Zhang, Gao, Li, Hong, Chen, Jiang, Fu, and Zhang}]{He2025RSAgentLT}
Xingqi He, Yujie Zhang, Shuyong Gao, Wenjie Li, Lingyi Hong, Mingxi Chen, Kaixun Jiang, Jiyuan Fu, and Wenqiang Zhang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284350430} {Rsagent: Learning to reason and act for text-guided segmentation via multi-turn tool invocations}.
\bibitem[{Ho et~al.(2025)Ho, Si, Feng, Yu, Yang, Liu, Hu, and Qin}]{Ho2025ArcMemoAR}
Matthew Ho, Chen Si, Zhaoxiang Feng, Fangxu Yu, Yichi Yang, Zhijian Liu, Zhiting Hu, and Lianhui Qin. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:281103677} {Arcmemo: Abstract reasoning composition with lifelong llm memory}.
\newblock \emph{ArXiv}, abs/2509.04439.
\bibitem[{Hong and He(2025)}]{Hong2025EnhancingMR}
Chuanyang Hong and Qingyun He. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:278420582} {Enhancing memory retrieval in generative agents through llm-trained cross attention networks}.
\newblock \emph{Frontiers in Psychology}, 16.
\bibitem[{Hou et~al.(2024)Hou, Tamoto, and Miyashita}]{Hou2024MyAU}
Yuki Hou, Haruki Tamoto, and Homei Miyashita. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:268819055} {"my agent understands me better": Integrating dynamic human-like memory recall and consolidation in llm-based agents}.
\newblock \emph{Extended Abstracts of the CHI Conference on Human Factors in Computing Systems}.
\bibitem[{Houichime et~al.(2025)Houichime, Souhar, and Amrani}]{Houichime2025MemoryAR}
Tarik Houichime, Abdelghani Souhar, and Youn{\`e}s~El Amrani. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284132830} {Memory as resonance: A biomimetic architecture for infinite context memory on ergodic phonetic manifolds}.
\bibitem[{Hsieh et~al.(2024)Hsieh, Sun, Kriman, Acharya, Rekesh, Jia, and Ginsburg}]{Hsieh2024RULERWT}
Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, Shantanu Acharya, Dima Rekesh, Fei Jia, and Boris Ginsburg. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:269032933} {Ruler: What's the real context size of your long-context language models?}
\newblock \emph{ArXiv}, abs/2404.06654.
\bibitem[{Hu et~al.(2023)Hu, Fu, Du, Luo, Zhao, and Zhao}]{Hu2023ChatDBAL}
Chenxu Hu, Jie Fu, Chenzhuang Du, Simian Luo, Junbo~Jake Zhao, and Hang Zhao. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:259088875} {Chatdb: Augmenting llms with databases as their symbolic memory}.
\newblock \emph{ArXiv}, abs/2306.03901.
\bibitem[{Hu et~al.(2024)Hu, Chen, Chen, Mu, Shao, and Luo}]{Hu2024HiAgentHW}
Mengkang Hu, Tianxing Chen, Qiguang Chen, Yao Mu, Wenqi Shao, and Ping Luo. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:271903203} {Hiagent: Hierarchical working memory management for solving long-horizon agent tasks with large language model}.
\newblock \emph{ArXiv}, abs/2408.09559.
\bibitem[{Hu et~al.(2025{\natexlab{a}})Hu, Wang, and McAuley}]{Hu2025EvaluatingMI}
Yuanzhe Hu, Yu~Wang, and Julian McAuley. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280136659} {Evaluating memory in llm agents via incremental multi-turn interactions}.
\newblock \emph{ArXiv}, abs/2507.05257.
\bibitem[{Hu et~al.(2025{\natexlab{b}})Hu, Liu, Yue, Zhang, Liu, Zhu, Lin, Guo, Dou, Xi, Jin, Tan, Yin, Liu, Zhang, Sun, Zhu, Sun, Peng, Cheng, Fan, Guo, Yu, Zhou, Hu, Huo, Wang, Niu, Wang, Yin, Hu, Liao, Li, Wang, Zhou, Liu, Cheng, Zhang, Gui, Pan, Zhang, Torr, Dou, Wen, Huang, Jiang, and Yan}]{Hu2025MemoryIT}
Yuyang Hu, Shichun Liu, Yanwei Yue, Guibin Zhang, Boyang Liu, Fangyi Zhu, Jiahang Lin, Honglin Guo, Shihan Dou, Zhiheng Xi, Senjie Jin, Jiejun Tan, Yanbin Yin, Jiongnan Liu, Zeyu Zhang, Zhongxiang Sun, Yutao Zhu, Hao Sun, Boci Peng, and 28 others. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283897233} {Memory in the age of ai agents}.
\bibitem[{Huang et~al.(2023{\natexlab{a}})Huang, Chen, Mishra, Zheng, Yu, Song, and Zhou}]{Huang2023LargeLM}
Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu~Steven Zheng, Adams~Wei Yu, Xinying Song, and Denny Zhou. 2023{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:263609132} {Large language models cannot self-correct reasoning yet}.
\newblock \emph{ArXiv}, abs/2310.01798.
\bibitem[{Huang et~al.(2025{\natexlab{a}})Huang, Chen, Fei, Li, Schwaller, and Ceder}]{Huang2025CASCADECA}
Xu~Huang, Junwu Chen, Yuxing Fei, Zhuohan Li, Philippe Schwaller, and Gerbrand Ceder. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:284350716} {Cascade: Cumulative agentic skill creation through autonomous development and evolution}.
\bibitem[{Huang et~al.(2024)Huang, Liu, Chen, Wang, Wang, Lian, Wang, Tang, and Chen}]{Huang2024UnderstandingTP}
Xu~Huang, Weiwen Liu, Xiaolong Chen, Xingmei Wang, Hao Wang, Defu Lian, Yasheng Wang, Ruiming Tang, and Enhong Chen. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:267411892} {Understanding the planning of llm agents: A survey}.
\newblock \emph{ArXiv}, abs/2402.02716.
\bibitem[{Huang et~al.(2025{\natexlab{b}})Huang, Liu, Zhao, Zhong, Yue, and Jiang}]{Huang2025MemOrbAP}
Yizhe Huang, Yang Liu, Ruiyu Zhao, Xiaolong Zhong, Xingming Yue, and Ling Jiang. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281496282} {Memorb: A plug-and-play verbal-reinforcement memory layer for e-commerce customer service}.
\newblock \emph{ArXiv}, abs/2509.18713.
\bibitem[{Huang et~al.(2023{\natexlab{b}})Huang, Xu, Jiang, Lai, Li, Yao, Chen, Yang, Xin, and Ma}]{Huang2023AdvancingTA}
Yunpeng Huang, Jingwei Xu, Zixu Jiang, Junyu Lai, Zenan Li, Yuan Yao, Taolue Chen, Lijuan Yang, Zhou Xin, and Xiaoxing Ma. 2023{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:265308945} {Advancing transformer architecture in long-context large language models: A comprehensive survey}.
\newblock \emph{ArXiv}, abs/2311.12351.
\bibitem[{Huang et~al.(2025{\natexlab{c}})Huang, Dai, Wu, Wu, Chen, Yu, Li, Ge, Wang, and Jin}]{Huang2025MemPALTM}
Zhaopei Huang, Qifeng Dai, Guozheng Wu, Xiaopeng Wu, Kehan Chen, Chuan Yu, Xubin Li, Tiezheng Ge, Wenxuan Wang, and Qin Jin. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283073534} {Mem-pal: Towards memory-based personalized dialogue assistants for long-term user-agent interaction}.
\bibitem[{Hurst et~al.(2024)Hurst, Lerer, Goucher, Perelman, Ramesh, Clark, Ostrow, Welihinda, Hayes, Radford, Madry, Baker{-}Whitcomb, Beutel, Borzunov, Carney, Chow, Kirillov, Nichol, Paino, Renzin, Passos, Kirillov, Christakis, Conneau, Kamali, Jabri, Moyer, Tam, Crookes, Tootoonchian, Kumar, Vallone, Karpathy, Braunstein, Cann, Codispoti, Galu, Kondrich, Tulloch, Mishchenko, Baek, Jiang, Pelisse, Woodford, Gosalia, Dhar, Pantuliano, Nayak, Oliver, Zoph, Ghorbani, Leimberger, Rossen, Sokolowsky, Wang, Zweig, Hoover, Samic, McGrew, Spero, Giertler, Cheng, Lightcap, Walkin, Quinn, Guarraci, Hsu, Kellogg, Eastman, Lugaresi, Wainwright, Bassin, Hudson, Chu, Nelson, Li, Shern, Conger, Barette, Voss, Ding, Lu, Zhang, Beaumont, Hallacy, Koch, Gibson, Kim, Choi, McLeavey, Hesse, Fischer, Winter, Czarnecki, Jarvis, Wei, Koumouzelis, and Sherburn}]{gpt4o}
Aaron Hurst, Adam Lerer, Adam~P. Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ~Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, Aleksander Madry, Alex Baker{-}Whitcomb, Alex Beutel, Alex Borzunov, Alex Carney, Alex Chow, Alex Kirillov, Alex Nichol, Alex Paino, and 79 others. 2024.
\newblock \href {https://doi.org/10.48550/ARXIV.2410.21276} {Gpt-4o system card}.
\newblock \emph{CoRR}, abs/2410.21276.
\bibitem[{Jang et~al.(2022)Jang, Ye, Lee, Yang, Shin, Han, Kim, and Seo}]{Jang2022TemporalWikiAL}
Joel Jang, Seonghyeon Ye, Changho Lee, Sohee Yang, Joongbo Shin, Janghoon Han, Gyeonghun Kim, and Minjoon Seo. 2022.
\newblock \href {https://api.semanticscholar.org/CorpusID:248476156} {Temporalwiki: A lifelong benchmark for training and evaluating ever-evolving language models}.
\newblock In \emph{Conference on Empirical Methods in Natural Language Processing}.
\bibitem[{Jia et~al.(2025)Jia, Liu, Li, Chen, and Liu}]{jia-etal-2025-evaluating}
Zixi Jia, Qinghua Liu, Hexiao Li, Yuyan Chen, and Jiqiang Liu. 2025.
\newblock \href {https://doi.org/10.18653/v1/2025.findings-acl.1014} {Evaluating the long-term memory of large language models}.
\newblock In \emph{Findings of the Association for Computational Linguistics: ACL 2025}, pages 19759--19777, Vienna, Austria. Association for Computational Linguistics.
\bibitem[{Jiang et~al.(2025{\natexlab{a}})Jiang, Yuan, Shen, Hao, Xu, Chen, Liu, Vijjini, He, Yu, Poovendran, Wornell, Ungar, Roth, Chen, and Taylor}]{Jiang2025PersonaMemv2TP}
Bowen Jiang, Yuan Yuan, Maohao Shen, Zhuoqun Hao, Zhangchen Xu, Zichen Chen, Ziyi Liu, Anvesh~Rao Vijjini, Jiashu He, Hanchao Yu, Radha Poovendran, Greg Wornell, Lyle Ungar, Dan Roth, Sihao Chen, and Camillo~Jose Taylor. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283693901} {Personamem-v2: Towards personalized intelligence via learning implicit user personas and agentic memory}.
\bibitem[{Jiang et~al.(2025{\natexlab{b}})Jiang, Lu, Li, Lyu, Nie, Wang, Su, Chen, Zou, Du, Pang, and Chen}]{Jiang2025VerlToolTH}
Dongfu Jiang, Yi~Lu, Zhuofeng Li, Zhiheng Lyu, Ping Nie, Haozhe Wang, Alex Su, Hui Chen, Kai Zou, Chao Du, Tianyu Pang, and Wenhu Chen. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281080546} {Verltool: Towards holistic agentic reinforcement learning with tool use}.
\newblock \emph{ArXiv}, abs/2509.01055.
\bibitem[{Jiang et~al.(2023)Jiang, Wu, Lin, Yang, and Qiu}]{Jiang2023LLMLinguaCP}
Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, and Lili Qiu. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:263830701} {Llmlingua: Compressing prompts for accelerated inference of large language models}.
\newblock In \emph{Conference on Empirical Methods in Natural Language Processing}.
\bibitem[{Jin et~al.(2024)Jin, Han, Yang, Jiang, Liu, yuan Chang, Chen, and Hu}]{Jin2024LLMML}
Hongye Jin, Xiaotian Han, Jingfeng Yang, Zhimeng Jiang, Zirui Liu, Chia yuan Chang, Huiyuan Chen, and Xia Hu. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:266725385} {Llm maybe longlm: Self-extend llm context window without tuning}.
\newblock \emph{ArXiv}, abs/2401.01325.
\bibitem[{Joshi et~al.(2024)Joshi, Ahmad, and Modi}]{Joshi2024COLDCR}
Abhinav Joshi, Areeb Ahmad, and Ashutosh Modi. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:274422558} {Cold: Causal reasoning in closed daily activities}.
\newblock \emph{ArXiv}, abs/2411.19500.
\bibitem[{Kalai and Vempala(2023)}]{Kalai2023CalibratedLM}
Adam~Tauman Kalai and Santosh~S. Vempala. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:265445593} {Calibrated language models must hallucinate}.
\newblock \emph{Proceedings of the 56th Annual ACM Symposium on Theory of Computing}.
\bibitem[{Kang et~al.(2025)Kang, Ji, Zhao, and Bai}]{Kang2025MemoryOO}
Jiazheng Kang, Mingming Ji, Zhe Zhao, and Ting Bai. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:279250574} {Memory os of ai agent}.
\newblock \emph{ArXiv}, abs/2506.06326.
\bibitem[{Kasai et~al.(2024)Kasai, Sakaguchi, Takahashi, Bras, Asai, Yu, Radev, Smith, Choi, and Inui}]{kasai2024realtimeqawhatsanswer}
Jungo Kasai, Keisuke Sakaguchi, Yoichi Takahashi, Ronan~Le Bras, Akari Asai, Xinyan Yu, Dragomir Radev, Noah~A. Smith, Yejin Choi, and Kentaro Inui. 2024.
\newblock \href {https://arxiv.org/abs/2207.13332} {Realtime qa: What's the answer right now?}
\newblock \emph{Preprint}, arXiv:2207.13332.
\bibitem[{Kim et~al.(2024{\natexlab{a}})Kim, Park, and Chang}]{Kim2024SHARESM}
Eunwon Kim, Chanho Park, and Buru Chang. 2024{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:273654255} {Share: Shared memory-aware open-domain long-term dialogue dataset constructed from movie script}.
\newblock \emph{ArXiv}, abs/2410.20682.
\bibitem[{Kim et~al.(2024{\natexlab{b}})Kim, Chay, Hwang, Kyung, Chung, Cho, Jo, and Choi}]{Kim2024DialSimAR}
Jiho Kim, Woosog Chay, Hyeonji Hwang, Daeun Kyung, Hyunseung Chung, Eunbyeol Cho, Yohan Jo, and Edward Choi. 2024{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:273234634} {Dialsim: A real-time simulator for evaluating long-term dialogue understanding of conversational agents}.
\newblock \emph{ArXiv}, abs/2406.13144.
\bibitem[{Kim and won Hwang(2025)}]{Kim2025CoExC}
Minsoo Kim and Seung won Hwang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280391153} {Coex - co-evolving world-model and exploration}.
\newblock \emph{ArXiv}, abs/2507.22281.
\bibitem[{Ko et~al.(2024)Ko, Kim, Choi, and Kim}]{Ko2024GrowOVERHC}
Dayoon Ko, Jinyoung Kim, Hahyeon Choi, and Gunhee Kim. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:270371589} {Growover: How can llms adapt to growing real-world knowledge?}
\newblock In \emph{Annual Meeting of the Association for Computational Linguistics}.
\bibitem[{Kuratov et~al.(2024)Kuratov, Bulatov, Anokhin, Rodkin, Sorokin, Sorokin, and Burtsev}]{Kuratov2024BABILongTT}
Yuri Kuratov, Aydar Bulatov, Petr Anokhin, Ivan Rodkin, Dmitry Sorokin, Artyom~Y. Sorokin, and Mikhail Burtsev. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:270521583} {Babilong: Testing the limits of llms with long context reasoning-in-a-haystack}.
\newblock \emph{ArXiv}, abs/2406.10149.
\bibitem[{Latimer et~al.(2025)Latimer, Boschi, Neeser, Bartholomew, Srivastava, Wang, and Ramakrishnan}]{Latimer2025HindsightI2}
Chris Latimer, Nicol'o Boschi, Andrew Neeser, Chris Bartholomew, Gaurav Srivastava, Xuan Wang, and Naren Ramakrishnan. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:283897719} {Hindsight is 20/20: Building agent memory that retains, recalls, and reflects}.
\bibitem[{Lazaridou et~al.(2021)Lazaridou, Kuncoro, Gribovskaya, Agrawal, Liska, Terzi, Gim{\'e}nez, de~Masson~d'Autume, Kocisk{\'y}, Ruder, Yogatama, Cao, Young, and Blunsom}]{Lazaridou2021MindTG}
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gim{\'e}nez, Cyprien de~Masson~d'Autume, Tom{\'a}s Kocisk{\'y}, Sebastian Ruder, Dani Yogatama, Kris Cao, Susannah Young, and Phil Blunsom. 2021.
\newblock \href {https://api.semanticscholar.org/CorpusID:239886013} {Mind the gap: Assessing temporal generalization in neural language models}.
\newblock In \emph{Neural Information Processing Systems}.
\bibitem[{Lee and Ko(2025)}]{Lee2025TrainingAT}
Seokhan Lee and Hanseok Ko. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:282448398} {Training a team of language models as options to build an sql-based memory}.
\newblock \emph{Applied Sciences}.
\bibitem[{Lei et~al.(2025)Lei, Cai, Que, Cui, Tan, Hong, Hu, Zhu, Wu, Jiang, Wang, Li, Cui, Zhao, and Han}]{Lei2025RoboMemoryAB}
Mingcong Lei, Honghao Cai, Binbin Que, Zezhou Cui, Liangchen Tan, Junkun Hong, Gehan Hu, Shuangyu Zhu, Yimou Wu, Shaohan Jiang, Ge~Wang, Zhen Li, Shuguang Cui, Yiming Zhao, and Yatong Han. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280421800} {Robomemory: A brain-inspired multi-memory agentic framework for lifelong learning in physical embodied systems}.
\newblock \emph{ArXiv}, abs/2508.01415.
\bibitem[{Li et~al.(2025{\natexlab{a}})Li, Zhang, Bo, Tian, Chen, Dai, Dong, and Tang}]{Li2025CAMAC}
Rui Li, Zeyu Zhang, Xiaohe Bo, Zihang Tian, Xu~Chen, Quanyu Dai, Zhenhua Dong, and Ruiming Tang. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281886660} {Cam: A constructivist view of agentic memory for llm-based reading comprehension}.
\newblock \emph{ArXiv}, abs/2510.05520.
\bibitem[{Li et~al.(2024)Li, He, Guo, Bu, Bai, Liu, Liu, Qu, Li, Ouyang, Su, and Zheng}]{Li2024GraphReaderBG}
Shilong Li, Yancheng He, Hangyu Guo, Xingyuan Bu, Ge~Bai, Jie Liu, Jiaheng Liu, Xingwei Qu, Yangguang Li, Wanli Ouyang, Wenbo Su, and Bo~Zheng. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:270620354} {Graphreader: Building graph-based agent to enhance long-context abilities of large language models}.
\newblock In \emph{Conference on Empirical Methods in Natural Language Processing}.
\bibitem[{Li et~al.(2025{\natexlab{b}})Li, Jiao, Jin, Dong, Jin, Wang, Wang, Zhu, Wen, Lu, and Dou}]{Li2025DeepAgentAG}
Xiaoxi Li, Wenxiang Jiao, Jiarui Jin, Guanting Dong, Jiajie Jin, Yinuo Wang, Hao Wang, Yutao Zhu, Ji-Rong Wen, Yuan Lu, and Zhicheng Dou. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282384893} {Deepagent: A general reasoning agent with scalable toolsets}.
\newblock \emph{ArXiv}, abs/2510.21618.
\bibitem[{Li et~al.(2025{\natexlab{c}})Li, Bantupalli, Dharmani, Zhang, and Shang}]{Li2025TowardMP}
Xintong Li, Jalend Bantupalli, Ria Dharmani, Yuwei Zhang, and Jingbo Shang. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:276903780} {Toward multi-session personalized conversation: A large-scale dataset and hierarchical tree framework for implicit reasoning}.
\newblock \emph{ArXiv}, abs/2503.07018.
\bibitem[{Li et~al.(2025{\natexlab{d}})Li, Song, Xi, Wang, Tang, Niu, Chen, Yang, Li, Yu, Zhao, Wang, Liu, Lin, Wang, Huo, Chen, Chen, Li, Tao, Ren, Lai, Wu, Tang, Wang, Fan, Zhang, Zhang, Yan, Yang, Xu, Xu, Chen, Wang, Yang, Zhang, Xu, Chen, and Xiong}]{Li2025MemOSAM}
Zhiyu Li, Shichao Song, Chenyang Xi, Hanyu Wang, Chen Tang, Simin Niu, Ding Chen, Jiawei Yang, Chunyu Li, Qingchen Yu, Jihao Zhao, Yezhaohui Wang, Peng Liu, Zehao Lin, Pengyuan Wang, Jiahao Huo, Tianyi Chen, Kai Chen, Ke-Rong Li, and 20 others. 2025{\natexlab{d}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280093879} {Memos: A memory os for ai system}.
\newblock \emph{ArXiv}, abs/2507.03724.
\bibitem[{Li et~al.(2025{\natexlab{e}})Li, Chang, Yu, and Le}]{Li2025HiPlanHP}
Ziyue Li, Yuan Chang, Gaihong Yu, and Xiaoqiu Le. 2025{\natexlab{e}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280870607} {Hiplan: Hierarchical planning for llm-based agents with adaptive global-local guidance}.
\newblock \emph{ArXiv}, abs/2508.19076.
\bibitem[{Lian et~al.(2026)Lian, Wang, Yao, Wang, Chen, Wang, Zhang, and Xia}]{Lian2026FromVT}
Niu Lian, Yuting Wang, Hanshu Yao, Jinpeng Wang, Bin Chen, Yaowei Wang, Min Zhang, and Shu-Tao Xia. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:286222503} {From verbatim to gist: Distilling pyramidal multimodal memory via semantic information bottleneck for long-horizon video agents}.
\newblock \emph{ArXiv}, abs/2603.01455.
\bibitem[{Liang et~al.(2025)Liang, Li, Li, Zhou, Jiang, Wang, Ji, Zhu, Liu, Ren, Fu, Ng, Liang, Liu, and Qin}]{Liang2025AIMB}
Jiafeng Liang, Hao Li, Chang Li, Jiaqi Zhou, Shixin Jiang, Zekun Wang, Changkai Ji, Zhihao Zhu, Runxuan Liu, Taolin Ren, Jinlan Fu, See-Kiong Ng, Xia Liang, Ming Liu, and Bing Qin. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284311192} {Ai meets brain: Memory systems from cognitive neuroscience to autonomous agents}.
\bibitem[{Liao et~al.(2025)Liao, Liao, and Gadiraju}]{Liao2025AgentMasterAM}
Callie~C. Liao, Duoduo Liao, and Sai~Surya Gadiraju. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280337378} {Agentmaster: A multi-agent conversational framework using a2a and mcp protocols for multimodal information retrieval and analysis}.
\newblock \emph{ArXiv}, abs/2507.21105.
\bibitem[{Lin et~al.(2023)Lin, Fu, Yang, Ammanabrolu, Brahman, Huang, Bhagavatula, Choi, and Ren}]{Lin2023SwiftSageAG}
Bill~Yuchen Lin, Yicheng Fu, Karina Yang, Prithviraj Ammanabrolu, Faeze Brahman, Shiyu Huang, Chandra Bhagavatula, Yejin Choi, and Xiang Ren. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:258960143} {Swiftsage: A generative agent with fast and slow thinking for complex interactive tasks}.
\newblock \emph{ArXiv}, abs/2305.17390.
\bibitem[{Lin et~al.(2026)Lin, Chen, Shen, Luo, Ye, Ma, Chua, and Xu}]{lin2026towards}
Hongzhan Lin, Zixin Chen, Zhiqi Shen, Ziyang Luo, Zhen Ye, Jing Ma, Tat-Seng Chua, and Guandong Xu. 2026.
\newblock Towards comprehensive stage-wise benchmarking of large language models in fact-checking.
\newblock \emph{arXiv preprint arXiv:2601.02669}.
\bibitem[{Lin et~al.(2025{\natexlab{a}})Lin, Deng, Gu, Zhang, Ma, Ng, and Chua}]{lin2025fact}
Hongzhan Lin, Yang Deng, Yuxuan Gu, Wenxuan Zhang, Jing Ma, See~Kiong Ng, and Tat-Seng Chua. 2025{\natexlab{a}}.
\newblock Fact-audit: An adaptive multi-agent framework for dynamic fact-checking evaluation of large language models.
\newblock In \emph{Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, pages 360--381.
\bibitem[{Lin et~al.(2025{\natexlab{b}})Lin, Wang, Ye, Fu, Li, and Chen}]{Lin2025HippoMMHM}
Yueqian Lin, Qinsi Wang, Hancheng Ye, Yuzhe Fu, Hai Li, and Yiran Chen. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:277787074} {Hippomm: Hippocampal-inspired multimodal memory for long audiovisual event understanding}.
\newblock \emph{ArXiv}, abs/2504.10739.
\bibitem[{Liu et~al.(2026{\natexlab{a}})Liu, Ling, Qiu, Liu, Han, Xia, Tu, Zheng, Xie, Fleming, Ding, and Yao}]{Liu2026OmniSimpleMemAD}
Jiaqi Liu, Zipeng Ling, Shi Qiu, Yanqing Liu, Siwei Han, Peng Xia, Haoqin Tu, Zeyu Zheng, Cihang Xie, Charles Fleming, Mingyu Ding, and Huaxiu Yao. 2026{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:287023679} {Omni-simplemem: Autoresearch-guided discovery of lifelong multimodal agent memory}.
\bibitem[{Liu et~al.(2025{\natexlab{a}})Liu, Xiong, Xia, Zhou, Ji, Feng, Han, Ding, and Yao}]{Liu2025Agent0VLES}
Jiaqi Liu, Kaiwen Xiong, Peng Xia, Yiyang Zhou, Haonian Ji, Lu~Feng, Siwei Han, Mingyu Ding, and Huaxiu Yao. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283250484} {Agent0-vl: Exploring self-evolving agent for tool-integrated vision-language reasoning}.
\bibitem[{Liu et~al.(2025{\natexlab{b}})Liu, Wang, Huang, Li, Fan, Li, Guo, Sarikaya, and Ji}]{Liu2025AnalyzingAI}
Jiateng Liu, Zhenhailong Wang, Xiaojiang Huang, Yingjie Li, Xing Fan, Xiang Li, Chenlei Guo, Ruhi Sarikaya, and Heng Ji. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282057538} {Analyzing and internalizing complex policy documents for llm agents}.
\newblock \emph{ArXiv}, abs/2510.11588.
\bibitem[{Liu et~al.(2025{\natexlab{c}})Liu, Kong, Yang, Yang, Li, Dong, Nanjekye, Tang, Yuan, Niu, Zhang, Zhao, Lin, Huang, and Wang}]{Liu2025RCRRouterER}
Jun Liu, Zhenglun Kong, Changdi Yang, Fan Yang, Tianqi Li, Peiyan Dong, Joannah Nanjekye, Hao Tang, Geng Yuan, Wei Niu, Wenbin Zhang, Pu~Zhao, Xue Lin, Dong-Xu Huang, and Yanzhi Wang. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280546606} {Rcr-router: Efficient role-aware context routing for multi-agent llm systems with structured memory}.
\newblock \emph{ArXiv}, abs/2508.04903.
\bibitem[{Liu et~al.(2025{\natexlab{d}})Liu, Sun, Cheng, Lei, Chen, Wen, Yang, Fu, Cai, Deng, Yu, Hu, Shi, and Wang}]{Liu2025MemVerseMM}
Junming Liu, Yifei Sun, Weihua Cheng, Haodong Lei, Yirong Chen, Licheng Wen, Xuemeng Yang, Daocheng Fu, Pinlong Cai, Nianchen Deng, Yi~Yu, Shuyue Hu, Botian Shi, and Ding Wang. 2025{\natexlab{d}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283466545} {Memverse: Multimodal memory for lifelong learning agents}.
\bibitem[{Liu et~al.(2023)Liu, Yang, Shen, Hu, Zhang, Gu, and Zhang}]{Liu2023ThinkinMemoryRA}
Lei Liu, Xiaoyan Yang, Yue Shen, Binbin Hu, Zhiqiang Zhang, Jinjie Gu, and Guannan Zhang. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:265212826} {Think-in-memory: Recalling and post-thinking enable llms with long-term memory}.
\newblock \emph{ArXiv}, abs/2311.08719.
\bibitem[{Liu et~al.(2025{\natexlab{e}})Liu, Yang, Jiang, Li, Guo, Liu, and Dai}]{Liu2025ContextAA}
Shukai Liu, Jian Yang, Bo~Jiang, Yizhi Li, Jinyang Guo, Xianglong Liu, and Bryan Dai. 2025{\natexlab{e}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:284275525} {Context as a tool: Context management for long-horizon swe-agents}.
\bibitem[{Liu et~al.(2024)Liu, Tang, Li, Chen, and Zhang}]{Liu2024MemLongMR}
Weijie Liu, Zecheng Tang, Juntao Li, Kehai Chen, and Min Zhang. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:272310589} {Memlong: Memory-augmented retrieval for long text modeling}.
\newblock \emph{ArXiv}, abs/2408.16967.
\bibitem[{Liu et~al.(2025{\natexlab{f}})Liu, Xu, Wu, Yuan, Yang, Zhou, Liu, Guan, Wang, Yu, McAuley, Ai, and Huang}]{Liu2025LargeLM}
Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, Yuhang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian~J. McAuley, Wei Ai, and Furong Huang. 2025{\natexlab{f}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:277245089} {Large language models and causal inference in collaboration: A comprehensive survey}.
\newblock \emph{ArXiv}, abs/2403.09606.
\bibitem[{Liu et~al.(2025{\natexlab{g}})Liu, Si, Narasimhan, and Yao}]{Liu2025ContextualER}
Yitao Liu, Chenglei Si, Karthik~R. Narasimhan, and Shunyu Yao. 2025{\natexlab{g}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:279250810} {Contextual experience replay for self-improvement of language agents}.
\newblock In \emph{Annual Meeting of the Association for Computational Linguistics}.
\bibitem[{Liu et~al.(2026{\natexlab{b}})Liu, Kim, Luo, Li, and Yang}]{liu2026exploratorymemoryaugmentedllmagent}
Zeyuan Liu, Jeonghye Kim, Xufang Luo, Dongsheng Li, and Yuqing Yang. 2026{\natexlab{b}}.
\newblock \href {https://arxiv.org/abs/2602.23008} {Exploratory memory-augmented llm agent via hybrid on- and off-policy optimization}.
\newblock \emph{Preprint}, arXiv:2602.23008.
\bibitem[{Long et~al.(2025{\natexlab{a}})Long, He, song Ye, Pan, Lin, Li, Zhao, and Li}]{Long2025SeeingLR}
Lin Long, Yichen He, Wen song Ye, Yiyuan Pan, Yuan Lin, Hang Li, Junbo Zhao, and Wei Li. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280642200} {Seeing, listening, remembering, and reasoning: A multimodal agent with long-term memory}.
\newblock \emph{ArXiv}, abs/2508.09736.
\bibitem[{Long et~al.(2025{\natexlab{b}})Long, Zhao, Zhang, Zhang, Wang, Liu, Shu, Lu, Wang, Wei, Li, Yin, Yao, Pan, Shen, Yang, Cao, and Dai}]{Long2025ASL}
Xiaoxiao Long, Qingrui Zhao, Kaiwen Zhang, Zihao Zhang, Dingrui Wang, Yumeng Liu, Zhengjie Shu, Yi~Lu, Shouzheng Wang, Xinzhe Wei, Wei Li, Wei Yin, Yao Yao, Jiangtian Pan, Qiu Shen, Ruigang Yang, Xun Cao, and Qionghai Dai. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280137292} {A survey: Learning embodied intelligence from physical simulators and world models}.
\newblock \emph{ArXiv}, abs/2507.00917.
\bibitem[{Lu et~al.(2023)Lu, An, Lin, Pergola, He, Yin, Sun, and Wu}]{Lu2023MemoChatTL}
Junru Lu, Siyu An, Mingbao Lin, Gabriele Pergola, Yulan He, Di~Yin, Xing Sun, and Yunsheng Wu. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:260926502} {Memochat: Tuning llms to use memos for consistent long-range open-domain conversation}.
\newblock \emph{ArXiv}, abs/2308.08239.
\bibitem[{Lu et~al.(2026)Lu, Cheng, Zhang, and Tang}]{Lu2026MMAMM}
Yihao Lu, W.~Cheng, Zeyu Zhang, and Hao Tang. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:285725661} {Mma: Multimodal memory agent}.
\newblock \emph{ArXiv}, abs/2602.16493.
\bibitem[{Luo et~al.(2026)Luo, Feng, Sun, Xu, Zheng, Wang, Yang, Hu, and Tang}]{luo2026agentmathempoweringmathematicalreasoning}
Haipeng Luo, Huawen Feng, Qingfeng Sun, Can Xu, Kai Zheng, Yufei Wang, Tao Yang, Han Hu, and Yansong Tang. 2026.
\newblock \href {https://arxiv.org/abs/2512.20745} {Agentmath: Empowering mathematical reasoning for large language models via tool-augmented agent}.
\newblock \emph{Preprint}, arXiv:2512.20745.
\bibitem[{Luo et~al.(2025{\natexlab{a}})Luo, Morgan, Li, Zhao, Ngo, Schroeder, Yang, Ben-Kish, O'Brien, and Glass}]{Luo2025BeyondCL}
Hongyin Luo, Nathaniel Morgan, Tina Li, Derek Zhao, Ai~Vy Ngo, Philip Schroeder, Lijie Yang, Assaf Ben-Kish, Jack O'Brien, and James~R. Glass. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280675636} {Beyond context limits: Subconscious threads for long-horizon reasoning}.
\newblock \emph{ArXiv}, abs/2507.16784.
\bibitem[{Luo et~al.(2025{\natexlab{b}})Luo, Zhang, He, Wang, Zhao, Li, Qiu, and Yang}]{Luo2025AgentLT}
Xufang Luo, Yuge Zhang, Zhiyuan He, Zilong Wang, Siyun Zhao, Dongsheng Li, Luna~K. Qiu, and Yuqing Yang. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280526917} {Agent lightning: Train any ai agents with reinforcement learning}.
\newblock \emph{ArXiv}, abs/2508.03680.
\bibitem[{Luo et~al.(2025{\natexlab{c}})Luo, Shen, Yang, Zhao, Jwalapuram, Saha, Sahoo, Savarese, Xiong, and Li}]{MCPU}
Ziyang Luo, Zhiqi Shen, Wenzhuo Yang, Zirui Zhao, Prathyusha Jwalapuram, Amrita Saha, Doyen Sahoo, Silvio Savarese, Caiming Xiong, and Junnan Li. 2025{\natexlab{c}}.
\newblock \href {https://doi.org/10.48550/ARXIV.2508.14704} {Mcp-universe: Benchmarking large language models with real-world model context protocol servers}.
\newblock \emph{CoRR}, abs/2508.14704.
\bibitem[{Luu et~al.(2022)Luu, Khashabi, Gururangan, Mandyam, and Smith}]{luu2022timewaitsoneanalysis}
Kelvin Luu, Daniel Khashabi, Suchin Gururangan, Karishma Mandyam, and Noah~A. Smith. 2022.
\newblock \href {https://arxiv.org/abs/2111.07408} {Time waits for no one! analysis and challenges of temporal misalignment}.
\newblock \emph{Preprint}, arXiv:2111.07408.
\bibitem[{Lyu et~al.(2025)Lyu, Wang, Huang, and Xu}]{Lyu2025FromCT}
Yuanjie Lyu, Chengyu Wang, Jun Huang, and Tong Xu. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:281393943} {From correction to mastery: Reinforced distillation of large language model agents}.
\newblock \emph{ArXiv}, abs/2509.14257.
\bibitem[{Maharana et~al.(2024)Maharana, Lee, Tulyakov, Bansal, Barbieri, and Fang}]{Maharana2024EvaluatingVL}
Adyasha Maharana, Dong-Ho Lee, S.~Tulyakov, Mohit Bansal, Francesco Barbieri, and Yuwei Fang. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:268041615} {Evaluating very long-term conversational memory of llm agents}.
\newblock \emph{ArXiv}, abs/2402.17753.
\bibitem[{Majumder et~al.(2023)Majumder, Dalvi, Jansen, Tafjord, Tandon, Zhang, Callison-Burch, and Clark}]{Majumder2023CLINAC}
Bodhisattwa~Prasad Majumder, Bhavana Dalvi, Peter~Alexander Jansen, Oyvind Tafjord, Niket Tandon, Li~Zhang, Chris Callison-Burch, and Peter Clark. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:264146262} {Clin: A continually learning language agent for rapid task adaptation and generalization}.
\newblock \emph{ArXiv}, abs/2310.10134.
\bibitem[{Melz(2023)}]{Melz2023EnhancingLI}
Eric Melz. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:265043634} {Enhancing llm intelligence with arm-rag: Auxiliary rationale memory for retrieval augmented generation}.
\newblock \emph{ArXiv}, abs/2311.04177.
\bibitem[{Miyai et~al.(2025)Miyai, Zhao, Egashira, Sato, Sunada, Onohara, Yamanishi, Toyooka, Nishina, Maeda, Aizawa, and Yamasaki}]{Miyai2025WebChoreArenaEW}
Atsuyuki Miyai, Zaiying Zhao, Kazuki Egashira, Atsuki Sato, Tatsumi Sunada, Shota Onohara, Hiromasa Yamanishi, Mashiro Toyooka, Kunato Nishina, Ryoma Maeda, Kiyoharu Aizawa, and T.~Yamasaki. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:279119756} {Webchorearena: Evaluating web browsing agents on realistic tedious web tasks}.
\newblock \emph{ArXiv}, abs/2506.01952.
\bibitem[{Modarressi et~al.(2024)Modarressi, K{\"o}ksal, Imani, Fayyaz, and Schutze}]{Modarressi2024MemLLMFL}
Ali Modarressi, Abdullatif K{\"o}ksal, Ayyoob Imani, Mohsen Fayyaz, and Hinrich Schutze. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:269214524} {Memllm: Finetuning llms to use an explicit read-write memory}.
\newblock \emph{ArXiv}, abs/2404.11672.
\bibitem[{Nan et~al.(2025)Nan, Ma, Wu, and Chen}]{Nan2025NemoriSA}
Jiayan Nan, Wenquan Ma, Wenlong Wu, and Yize Chen. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280526452} {Nemori: Self-organizing agent memory inspired by cognitive science}.
\newblock \emph{ArXiv}, abs/2508.03341.
\bibitem[{Ni et~al.(2026)Ni, Liu, Liu, Sun, Zhou, Cheng, Wang, Jiang, and Jiang}]{Ni2026Trace2SkillDT}
Jingwei Ni, Yihao Liu, Xinpeng Liu, Yutao Sun, Mengyu Zhou, Pengyu Cheng, Dexin Wang, Xiaoxi Jiang, and Guanjun Jiang. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:286789995} {Trace2skill: Distill trajectory-local lessons into transferable agent skills}.
\bibitem[{Ouyang et~al.(2025)Ouyang, Yan, Hsu, Chen, Jiang, Wang, Han, Le, Daruki, Tang, Tirumalashetty, Lee, Rofouei, Lin, Han, Lee, and Pfister}]{Ouyang2025ReasoningBankSA}
Siru Ouyang, Jun Yan, I-Hung Hsu, Yanfei Chen, Ke~Jiang, Zifeng Wang, Rujun Han, Long~T. Le, Samira Daruki, Xiangru Tang, Vishy Tirumalashetty, George Lee, Mahsan Rofouei, Hangfei Lin, Jiawei Han, Chen-Yu Lee, and Tomas Pfister. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:281674540} {Reasoningbank: Scaling agent self-evolving with reasoning memory}.
\newblock \emph{ArXiv}, abs/2509.25140.
\bibitem[{Ozer et~al.(2025)Ozer, Wu, Wang, Dosti, Zhang, and Rue}]{Ozer2025MARMultiAgentRI}
Onat Ozer, Grace Wu, Yuchen Wang, Daniel Dosti, Honghao Zhang, and Vivi De~La Rue. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284154082} {Mar:multi-agent reflexion improves reasoning abilities in llms}.
\bibitem[{Packer et~al.(2023)Packer, Fang, Patil, Lin, Wooders, and Gonzalez}]{Packer2023MemGPTTL}
Charles Packer, Vivian Fang, Shishir~G. Patil, Kevin Lin, Sarah Wooders, and Joseph Gonzalez. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:263909014} {Memgpt: Towards llms as operating systems}.
\newblock \emph{ArXiv}, abs/2310.08560.
\bibitem[{Pan et~al.(2025)Pan, Liu, and Wang}]{Pan2025WonderWW}
Yiyuan Pan, Zhe Liu, and Hesheng Wang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:281525435} {Wonder wins ways: Curiosity-driven exploration through multi-agent contextual calibration}.
\newblock \emph{ArXiv}, abs/2509.20648.
\bibitem[{Park et~al.(2023)Park, O’Brien, Cai, Morris, Liang, and Bernstein}]{Park2023GenerativeAI}
Joon~Sung Park, Joseph~C. O’Brien, Carrie~J. Cai, Meredith~Ringel Morris, Percy Liang, and Michael~S. Bernstein. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:258040990} {Generative agents: Interactive simulacra of human behavior}.
\newblock \emph{Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology}.
\bibitem[{Qi et~al.(2025)Qi, Liu, Iong, Lai, Sun, Zhao, Yang, Yang, Sun, Yao, Zhang, Xu, Tang, and Dong}]{qi2025webrltrainingllmweb}
Zehan Qi, Xiao Liu, Iat~Long Iong, Hanyu Lai, Xueqiao Sun, Wenyi Zhao, Yu~Yang, Xinyue Yang, Jiadai Sun, Shuntian Yao, Tianjie Zhang, Wei Xu, Jie Tang, and Yuxiao Dong. 2025.
\newblock \href {https://arxiv.org/abs/2411.02337} {Webrl: Training llm web agents via self-evolving online curriculum reinforcement learning}.
\newblock \emph{Preprint}, arXiv:2411.02337.
\bibitem[{Qin et~al.(2024)Qin, Liang, Ye, Zhu, Yan, Lu, Lin, Cong, Tang, Qian, Zhao, Hong, Tian, Xie, Zhou, Gerstein, Li, Liu, and Sun}]{toollm}
Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, Sihan Zhao, Lauren Hong, Runchu Tian, Ruobing Xie, Jie Zhou, Mark Gerstein, Dahai Li, Zhiyuan Liu, and Maosong Sun. 2024.
\newblock \href {https://openreview.net/forum?id=dHng2O0Jjr} {Toolllm: Facilitating large language models to master 16000+ real-world apis}.
\newblock In \emph{The Twelfth International Conference on Learning Representations, {ICLR} 2024, Vienna, Austria, May 7-11, 2024}. OpenReview.net.
\bibitem[{Raman et~al.(2025)Raman, VijaiAravindh, and Ragav}]{Raman2025REMIAN}
Vishal Raman, R~VijaiAravindh, and Abhijith Ragav. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280922051} {Remi: A novel causal schema memory architecture for personalized lifestyle recommendation agents}.
\newblock \emph{ArXiv}, abs/2509.06269.
\bibitem[{Rasmussen et~al.(2025)Rasmussen, Paliychuk, Beauvais, Ryan, and Chalef}]{Rasmussen2025ZepAT}
Preston Rasmussen, Pavlo Paliychuk, Travis Beauvais, Jack Ryan, and Daniel Chalef. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:275907122} {Zep: A temporal knowledge graph architecture for agent memory}.
\newblock \emph{ArXiv}, abs/2501.13956.
\bibitem[{Ratner et~al.(2022)Ratner, Levine, Belinkov, Ram, Magar, Abend, Karpas, Shashua, Leyton-Brown, and Shoham}]{Ratner2022ParallelCW}
Nir Ratner, Yoav Levine, Yonatan Belinkov, Ori Ram, Inbal Magar, Omri Abend, Ehud Karpas, Amnon Shashua, Kevin Leyton-Brown, and Yoav Shoham. 2022.
\newblock \href {https://api.semanticscholar.org/CorpusID:258686160} {Parallel context windows for large language models}.
\newblock In \emph{Annual Meeting of the Association for Computational Linguistics}.
\bibitem[{Renze and Guven(2024)}]{Renze2024SelfReflectionIL}
Matthew Renze and Erhan Guven. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:275956778} {Self-reflection in large language model agents: Effects on problem-solving performance}.
\newblock \emph{2024 2nd International Conference on Foundation and Large Language Models (FLLM)}, pages 516--525.
\bibitem[{Rezazadeh et~al.(2025)Rezazadeh, Li, Lou, Zhao, Wei, and Bao}]{Rezazadeh2025CollaborativeMM}
Alireza Rezazadeh, Zichao Li, Ange Lou, Yuying Zhao, Wei Wei, and Yujia Bao. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:278904585} {Collaborative memory: Multi-user memory sharing in llm agents with dynamic access control}.
\newblock \emph{ArXiv}, abs/2505.18279.
\bibitem[{Salama et~al.(2025)Salama, Cai, Yuan, Currey, Sunkara, Zhang, and Benajiba}]{Salama2025MemInsightAM}
Rana Salama, Jason Cai, Michelle Yuan, Anna Currey, Monica Sunkara, Yi~Zhang, and Yassine Benajiba. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:277349587} {Meminsight: Autonomous memory augmentation for llm agents}.
\newblock \emph{ArXiv}, abs/2503.21760.
\bibitem[{Shi et~al.(2025{\natexlab{a}})Shi, Cai, Cai, Xu, Chen, Qin, Zhou, Fei, Qiu, Tan, Li, Li, Lin, Cai, Mao, Wu, Li, and Sun}]{Shi2025YoutuAgentSA}
Yuchen Shi, Yuzheng Cai, Siqi Cai, Zihan Xu, Lichao Chen, Yulei Qin, Zhijian Zhou, Xiang Fei, Chaofan Qiu, Xiaoyu Tan, Gang Li, Zongyi Li, Haojia Lin, Guocan Cai, Yong Mao, Yunsheng Wu, Ke~Li, and Xing Sun. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:284350437} {Youtu-agent: Scaling agent productivity with automated generation and hybrid policy optimization}.
\bibitem[{Shi et~al.(2025{\natexlab{b}})Shi, Fang, and Chen}]{Shi2025MonteCP}
Zijing Shi, Meng Fang, and Ling Chen. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:277999605} {Monte carlo planning with large language model for text-based game agents}.
\newblock \emph{ArXiv}, abs/2504.16855.
\bibitem[{Shinn et~al.(2023)Shinn, Cassano, Labash, Gopinath, Narasimhan, and Yao}]{Shinn2023ReflexionLA}
Noah Shinn, Federico Cassano, Beck Labash, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:258833055} {Reflexion: language agents with verbal reinforcement learning}.
\newblock In \emph{Neural Information Processing Systems}.
\bibitem[{Siyue et~al.(2024)Siyue, Xue, Zhang, Wu, Luu, and Chen}]{Siyue2024MRAGAM}
Zhang Siyue, Yuxiang Xue, Yiming Zhang, Xiaobao Wu, Anh~Tuan Luu, and Zhao Chen. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:274965713} {Mrag: A modular retrieval framework for time-sensitive question answering}.
\newblock \emph{ArXiv}, abs/2412.15540.
\bibitem[{Srivastava and He(2025)}]{srivastava2025memorygraftpersistentcompromisellm}
Saksham~Sahai Srivastava and Haoyu He. 2025.
\newblock \href {https://arxiv.org/abs/2512.16962} {Memorygraft: Persistent compromise of llm agents via poisoned experience retrieval}.
\newblock \emph{Preprint}, arXiv:2512.16962.
\bibitem[{Sumers et~al.(2023)Sumers, Yao, Narasimhan, and Griffiths}]{Sumers2023CognitiveAF}
Theodore~R. Sumers, Shunyu Yao, Karthik Narasimhan, and Thomas~L. Griffiths. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:261556862} {Cognitive architectures for language agents}.
\newblock \emph{Trans. Mach. Learn. Res.}, 2024.
\bibitem[{Sun et~al.(2025{\natexlab{a}})Sun, Chai, Wang, Sun, Wu, and Wang}]{Sun2025CuriosityDrivenRL}
Haoran Sun, Yekun Chai, Shuohuan Wang, Yu~Sun, Hua Wu, and Haifeng Wang. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:275758441} {Curiosity-driven reinforcement learning from human feedback}.
\newblock In \emph{Annual Meeting of the Association for Computational Linguistics}.
\bibitem[{Sun et~al.(2025{\natexlab{b}})Sun, Zhang, and Zeng}]{Sun2025PreferenceAwareMU}
Haoran Sun, Zekun Zhang, and Shaoning Zeng. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282058600} {Preference-aware memory update for long-term llm agents}.
\newblock \emph{ArXiv}, abs/2510.09720.
\bibitem[{Sun et~al.(2025{\natexlab{c}})Sun, Lu, Ling, Liu, Yao, Yang, and Chen}]{Sun2025ScalingLL}
Weiwei Sun, Miao Lu, Zhan Ling, Kang Liu, Xuesong Yao, Yiming Yang, and Jiecao Chen. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282064490} {Scaling long-horizon llm agent via context-folding}.
\newblock \emph{ArXiv}, abs/2510.11967.
\bibitem[{Sun et~al.(2024)Sun, Shi, C{\^o}t{\'e}, Berseth, Yuan, and Liu}]{Sun2024EnhancingAL}
Zhiyuan Sun, Haochen Shi, Marc-Alexandre C{\^o}t{\'e}, Glen Berseth, Xingdi Yuan, and Bang Liu. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:271431868} {Enhancing agent learning through world dynamics modeling}.
\newblock \emph{ArXiv}, abs/2407.17695.
\bibitem[{Suzgun et~al.(2025)Suzgun, Y{\"u}ksekg{\"o}n{\"u}l, Bianchi, Jurafsky, and Zou}]{Suzgun2025DynamicCT}
Mirac Suzgun, Mert Y{\"u}ksekg{\"o}n{\"u}l, Federico Bianchi, Daniel Jurafsky, and James Zou. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:277667675} {Dynamic cheatsheet: Test-time learning with adaptive memory}.
\newblock \emph{ArXiv}, abs/2504.07952.
\bibitem[{Tan et~al.(2025)Tan, Yan, Hsu, Han, Wang, Le, Song, Chen, Palangi, Lee, Iyer, Chen, Liu, Lee, and Pfister}]{Tan2025InPA}
Zhen Tan, Jun Yan, I-Hung Hsu, Rujun Han, Zifeng Wang, Long~T. Le, Yiwen Song, Yanfei Chen, Hamid Palangi, George Lee, Anand Iyer, Tianlong Chen, Huan Liu, Chen-Yu Lee, and Tomas Pfister. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:276928772} {In prospect and retrospect: Reflective memory management for long-term personalized dialogue agents}.
\newblock \emph{ArXiv}, abs/2503.08026.
\bibitem[{Tandon et~al.(2025)Tandon, Dalal, Li, Koceja, Rod, Buchanan, Wang, Leskovec, Koyejo, Hashimoto, Guestrin, McCaleb, Choi, and Sun}]{Tandon2025EndtoEndTT}
Arnuv Tandon, Karan Dalal, Xinhao Li, Daniel Koceja, Marcel Rod, Sam Buchanan, Xiaolong Wang, Jure Leskovec, Sanmi Koyejo, Tatsunori Hashimoto, Carlos Guestrin, Jed McCaleb, Yejin Choi, and Yu~Sun. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284313495} {End-to-end test-time training for long context}.
\bibitem[{Tang et~al.(2024{\natexlab{a}})Tang, Key, and Ellis}]{Tang2024WorldCoderAM}
Hao Tang, Darren Key, and Kevin Ellis. 2024{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:267751283} {Worldcoder, a model-based llm agent: Building world models by writing code and interacting with the environment}.
\newblock \emph{ArXiv}, abs/2402.12275.
\bibitem[{Tang et~al.(2024{\natexlab{b}})Tang, Zhao, Zhu, Xiao, Kasikci, and Han}]{Tang2024QuestQS}
Jiaming Tang, Yilong Zhao, Kan Zhu, Guangxuan Xiao, Baris Kasikci, and Song Han. 2024{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:270559146} {Quest: Query-aware sparsity for efficient long-context llm inference}.
\newblock \emph{ArXiv}, abs/2406.10774.
\bibitem[{Tang et~al.(2025)Tang, Qin, Peng, Zhou, Shao, Du, Wei, Xia, Wu, Zhu, Zhang, Liu, Wang, Hong, Wu, Cheng, Wang, and Zhou}]{Tang2025AgentKL}
Xiangru Tang, Tianrui Qin, Tianhao Peng, Ziyang Zhou, Yanjun Shao, Tingting Du, Xinming Wei, Peng Xia, Fang Wu, He~Zhu, Ge~Zhang, Jiaheng Liu, Xingyao Wang, Sirui Hong, Chenglin Wu, Hao Cheng, Chi Wang, and Wangchunshu Zhou. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280047833} {Agent kb: Leveraging cross-domain experience for agentic problem solving}.
\newblock \emph{ArXiv}, abs/2507.06229.
\bibitem[{Tavakoli et~al.(2025)Tavakoli, Salemi, Ye, Abdalla, Zamani, and Mitchell}]{Tavakoli2025BeyondAM}
Mohammad Tavakoli, Alireza Salemi, Carrie Ye, Mohamed Abdalla, Hamed Zamani, and J.~Ross Mitchell. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:282719168} {Beyond a million tokens: Benchmarking and enhancing long-term memory in llms}.
\newblock \emph{ArXiv}, abs/2510.27246.
\bibitem[{Tian et~al.(2025{\natexlab{a}})Tian, Huang, Wang, Ma, Huang, Luo, Lin, Zheng, and Du}]{tian2025evolproveradvancingautomatedtheorem}
Yuchen Tian, Ruiyuan Huang, Xuanwu Wang, Jing Ma, Zengfeng Huang, Ziyang Luo, Hongzhan Lin, Da~Zheng, and Lun Du. 2025{\natexlab{a}}.
\newblock \href {https://arxiv.org/abs/2510.00732} {Evolprover: Advancing automated theorem proving by evolving formalized problems via symmetry and difficulty}.
\newblock \emph{Preprint}, arXiv:2510.00732.
\bibitem[{Tian et~al.(2025{\natexlab{b}})Tian, Yan, Yang, Zhao, Chen, Wang, Luo, Ma, and Song}]{Tian_Yan_Yang_Zhao_Chen_Wang_Luo_Ma_Song_2025}
Yuchen Tian, Weixiang Yan, Qian Yang, Xuandong Zhao, Qian Chen, Wen Wang, Ziyang Luo, Lei Ma, and Dawn Song. 2025{\natexlab{b}}.
\newblock \href {https://doi.org/10.1609/aaai.v39i24.34717} {Codehalu: Investigating code hallucinations in llms via execution-based verification}.
\newblock \emph{Proceedings of the AAAI Conference on Artificial Intelligence}, 39(24):25300--25308.
\bibitem[{Touvron et~al.(2023)Touvron, Lavril, Izacard, Martinet, Lachaux, Lacroix, Rozi{\`{e}}re, Goyal, Hambro, Azhar, Rodriguez, Joulin, Grave, and Lample}]{llama}
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie{-}Anne Lachaux, Timoth{\'{e}}e Lacroix, Baptiste Rozi{\`{e}}re, Naman Goyal, Eric Hambro, Faisal Azhar, Aur{\'{e}}lien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. 2023.
\newblock \href {https://doi.org/10.48550/ARXIV.2302.13971} {Llama: Open and efficient foundation language models}.
\newblock \emph{CoRR}, abs/2302.13971.
\bibitem[{Tran et~al.(2025)Tran, Dao, Nguyen, Pham, O’Sullivan, and Nguyen}]{Tran2025MultiAgentCM}
Khanh-Tung Tran, Dung Dao, Minh-Duong Nguyen, Quoc-Viet Pham, Barry O’Sullivan, and Hoang~D. Nguyen. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:275471465} {Multi-agent collaboration mechanisms: A survey of llms}.
\newblock \emph{ArXiv}, abs/2501.06322.
\bibitem[{Tsaknakis et~al.(2025)Tsaknakis, Song, Gan, Kang, Garc{\'i}a, Liu, Fleming, and Hong}]{Tsaknakis2025DoLR}
Ioannis~C. Tsaknakis, Bingqing Song, Shuyu Gan, Dongyeop Kang, Alfredo Garc{\'i}a, Gaowen Liu, Charles Fleming, and Mingyi Hong. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:282209649} {Do llms recognize your latent preferences? a benchmark for latent information discovery in personalized interaction}.
\newblock \emph{ArXiv}, abs/2510.17132.
\bibitem[{Wan et~al.(2025)Wan, Dai, Wang, Li, Wang, Mao, Lan, and Xiao}]{Wan2025LoongFlowDE}
Chunhui Wan, Xunan Dai, Zhuo Wang, Minglei Li, Yanpeng Wang, Yinan Mao, Yu~Lan, and Zhiwen Xiao. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:284351394} {Loongflow: Directed evolutionary search via a cognitive plan-execute-summarize paradigm}.
\bibitem[{Wan and Ma(2025)}]{Wan2025StoryBenchAD}
Luanbo Wan and Weizhi Ma. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:279402292} {Storybench: A dynamic benchmark for evaluating long-term memory with multi turns}.
\newblock \emph{ArXiv}, abs/2506.13356.
\bibitem[{Wang et~al.(2025{\natexlab{a}})Wang, Yan, Yang, Hu, Zhang, Luo, and Bai}]{Wang2025DeepMELAM}
Fang Wang, Tianwei Yan, Zonghao Yang, Minghao Hu, Jun Zhang, Zhunchen Luo, and Xiaoying Bai. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280708653} {Deepmel: A multi-agent collaboration framework for multimodal entity linking}.
\newblock \emph{ArXiv}, abs/2508.15876.
\bibitem[{Wang et~al.(2024{\natexlab{a}})Wang, Shi, Tan, Qin, Wang, Zhang, Nambi, Ganu, and Wang}]{Wang2024MultimodalNI}
Hengyi Wang, Haizhou Shi, Shiwei Tan, Weiyi Qin, Wenyuan Wang, Tunyu Zhang, Akshay~Uttama Nambi, Tanuja Ganu, and Hao Wang. 2024{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:270559255} {Multimodal needle in a haystack: Benchmarking long-context capability of multimodal large language models}.
\newblock In \emph{North American Chapter of the Association for Computational Linguistics}.
\bibitem[{Wang et~al.(2025{\natexlab{b}})Wang, Yan, Wang, Tian, Mishra, Xu, Gandhi, Xu, and Cheong}]{Wang2025ReinforcementLF}
Jiongxiao Wang, Qiaojing Yan, Yawei Wang, Yijun Tian, Soumya~Smruti Mishra, Zhichao Xu, Megha Gandhi, Panpan Xu, and Lin~Lee Cheong. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:284058483} {Reinforcement learning for self-improving agent with skill library}.
\bibitem[{Wang et~al.(2023)Wang, Ma, Feng, Zhang, ran Yang, Zhang, Chen, Tang, Chen, Lin, Zhao, Wei, and rong Wen}]{Wang2023ASO}
Lei Wang, Chengbang Ma, Xueyang Feng, Zeyu Zhang, Hao ran Yang, Jingsen Zhang, Zhi-Yang Chen, Jiakai Tang, Xu~Chen, Yankai Lin, Wayne~Xin Zhao, Zhewei Wei, and Ji~rong Wen. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:261064713} {A survey on large language model based autonomous agents}.
\newblock \emph{Frontiers of Computer Science}, 18.
\bibitem[{Wang et~al.(2025{\natexlab{c}})Wang, Tian, Li, Liang, Wang, Chen, Wang, Lu, Ma, Jiang, and Zhou}]{Wang2025OMemOM}
Piaohong Wang, Motong Tian, Jiaxian Li, Yuan Liang, Yuqing Wang, Qianben Chen, Tiannan Wang, Zhicong Lu, Jiawei Ma, Yuchen~Eleanor Jiang, and Wangchunshu Zhou. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283073241} {O-mem: Omni memory system for personalized, long horizon, self-evolving agents}.
\bibitem[{Wang et~al.(2025{\natexlab{d}})Wang, Liang, Chen, Huang, Li, Ma, Zhang, Qin, and Leung}]{Wang2025GraphCogentML}
Rongzheng Wang, Shuang Liang, Qizhi Chen, Yihong Huang, Muquan Li, Yizhuo Ma, Dongyang Zhang, Ke~Qin, and Man-Fai Leung. 2025{\natexlab{d}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281682226} {Graphcogent: Mitigating llms'working memory constraints via multi-agent collaboration in complex graph understanding}.
\bibitem[{Wang et~al.(2026)Wang, Liu, Gao, Ma, Wang, Xie, and Tan}]{Wang2026ExploreWL}
Sen Wang, Bangwei Liu, Zhenkun Gao, Lizhuang Ma, Xuhong Wang, Yuan Xie, and Xin Tan. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:284860982} {Explore with long-term memory: A benchmark and multimodal llm-based reinforcement learning framework for embodied exploration}.
\newblock \emph{ArXiv}, abs/2601.10744.
\bibitem[{Wang et~al.(2025{\natexlab{e}})Wang, Shen, Chang, Nguyen, Li, and {\'A}lvarez}]{Wang2025MitigatingMH}
Shan Wang, Maying Shen, Nadine Chang, Chuong Nguyen, Hongdong Li, and Jos{\'e}~M. {\'A}lvarez. 2025{\natexlab{e}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281092200} {Mitigating multimodal hallucinations via gradient-based self-reflection}.
\newblock \emph{ArXiv}, abs/2509.03113.
\bibitem[{Wang et~al.(2024{\natexlab{b}})Wang, Wei, Choi, and Ren}]{Wang2024SymbolicWM}
Siyuan Wang, Zhongyu Wei, Yejin Choi, and Xiang Ren. 2024{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:271957585} {Symbolic working memory enhances language models for complex rule application}.
\newblock \emph{ArXiv}, abs/2408.13654.
\bibitem[{Wang et~al.(2024{\natexlab{c}})Wang, Zhang, Zohar, and Yeung-Levy}]{Wang2024VideoAgentLV}
Xiaohan Wang, Yuhui Zhang, Orr Zohar, and Serena Yeung-Levy. 2024{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:268510077} {Videoagent: Long-form video understanding with large language model as agent}.
\newblock In \emph{European Conference on Computer Vision}.
\bibitem[{Wang and Chen(2025)}]{Wang2025MIRIXMM}
Yu~Wang and Xi~Chen. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280277519} {Mirix: Multi-agent memory system for llm-based agents}.
\newblock \emph{ArXiv}, abs/2507.07957.
\bibitem[{Wang et~al.(2025{\natexlab{f}})Wang, Wang, Wang, Zhang, Li, Yang, Yu, Nguyen, Liu, Gottlieb, Lam, Lu, Cho, Wu, Li, Wang, Choi, and Li}]{Wang2025RAGENUS}
Zihan Wang, Kangrui Wang, Qineng Wang, Pingyue Zhang, Linjie Li, Zhengyuan Yang, Kefan Yu, Minh~Nhat Nguyen, Licheng Liu, Eli Gottlieb, Monica Lam, Yiping Lu, Kyunghyun Cho, Jiajun Wu, Fei-Fei Li, Lijuan Wang, Yejin Choi, and Manling Li. 2025{\natexlab{f}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:278170861} {Ragen: Understanding self-evolution in llm agents via multi-turn reinforcement learning}.
\newblock \emph{ArXiv}, abs/2504.20073.
\bibitem[{Wang et~al.(2025{\natexlab{g}})Wang, Gandhi, Neubig, and Fried}]{Wang2025InducingPS}
Zora~Zhiruo Wang, Apurva Gandhi, Graham Neubig, and Daniel Fried. 2025{\natexlab{g}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:277634286} {Inducing programmatic skills for agentic tasks}.
\newblock \emph{ArXiv}, abs/2504.06821.
\bibitem[{Wang et~al.(2024{\natexlab{d}})Wang, Mao, Fried, and Neubig}]{Wang2024AgentWM}
Zora~Zhiruo Wang, Jiayuan Mao, Daniel Fried, and Graham Neubig. 2024{\natexlab{d}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:272592995} {Agent workflow memory}.
\newblock \emph{ArXiv}, abs/2409.07429.
\bibitem[{Wei et~al.(2025{\natexlab{a}})Wei, Sachdeva, Coleman, He, Bei, Ning, Ai, Li, He, hsin Chi, Wang, Chen, Pereira, Kang, and Cheng}]{Wei2025EvoMemoryBL}
Tianxin Wei, Noveen Sachdeva, Benjamin Coleman, Zhankui He, Yuanchen Bei, Xuying Ning, Mengting Ai, Yunzhe Li, Jingrui He, Ed~Huai hsin Chi, Chi Wang, Shuo Chen, Fernando Pereira, Wang-Cheng Kang, and Derek~Zhiyuan Cheng. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283261706} {Evo-memory: Benchmarking llm agent test-time learning with self-evolving memory}.
\bibitem[{Wei et~al.(2025{\natexlab{b}})Wei, Munir, and Marculescu}]{Wei2025MitigatingIA}
Xiwen Wei, Mustafa Munir, and Radu Marculescu. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283466885} {Mitigating intra- and inter-modal forgetting in continual learning of unified multimodal models}.
\newblock \emph{ArXiv}, abs/2512.03125.
\bibitem[{Wei et~al.(2025{\natexlab{c}})Wei, Yao, Liu, Zhang, Lu, Qiu, Yu, Xu, Zhang, Yin, Yun, and Li}]{Wei2025WebAgentR1TW}
Zhepei Wei, Wenlin Yao, Yao Liu, Weizhi Zhang, Qin Lu, Liang Qiu, Changlong Yu, Puyang Xu, Chao Zhang, Bing Yin, Hyokun Yun, and Lihong Li. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:278788476} {Webagent-r1: Training web agents via end-to-end multi-turn reinforcement learning}.
\newblock \emph{ArXiv}, abs/2505.16421.
\bibitem[{Wen et~al.(2026)Wen, Wang, Zhang, Huang, and Wu}]{Wen2026EventMemAgentHE}
Siwei Wen, Zhangcheng Wang, Xingjian Zhang, Lei Huang, and Wenjun Wu. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:285659749} {Eventmemagent: Hierarchical event-centric memory for online video understanding with adaptive tool use}.
\newblock \emph{ArXiv}, abs/2602.15329.
\bibitem[{Wen et~al.(2025)Wen, Huang, Goldstein, Kumar, Ghazi, and Zhang}]{Wen2025QuantifyingCM}
Yuxin Wen, Yangsibo Huang, Tom Goldstein, Ravi Kumar, Badih Ghazi, and Chiyuan Zhang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:279243317} {Quantifying cross-modality memorization in vision-language models}.
\newblock \emph{ArXiv}, abs/2506.05198.
\bibitem[{Westh{\"a}u{\ss}er et~al.(2025)Westh{\"a}u{\ss}er, Minker, and Zepf}]{Westhuer2025EnablingPL}
Rebecca Westh{\"a}u{\ss}er, Wolfgang Minker, and Sebastian Zepf. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:281951598} {Enabling personalized long-term interactions in llm-based agents through persistent memory and user profiles}.
\newblock \emph{ArXiv}, abs/2510.07925.
\bibitem[{Wu et~al.(2024)Wu, Tam, Lin, Chen, and yi~Lee}]{Wu2024StreamBenchTB}
Cheng-Kuang Wu, Zhi~Rui Tam, Chieh-Yen Lin, Yun-Nung Chen, and Hung yi~Lee. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:270440494} {Streambench: Towards benchmarking continuous improvement of language agents}.
\newblock \emph{ArXiv}, abs/2406.08747.
\bibitem[{Wu et~al.(2025{\natexlab{a}})Wu, Wang, Mei, Cai, Fu, Yang, Wen, Yang, Shen, Wang, and Shi}]{Wu2025EvolveRSL}
Rong Wu, Xiaoman Wang, Jianbiao Mei, Pinlong Cai, Daocheng Fu, Cheng Yang, Licheng Wen, Xuemeng Yang, Yufan Shen, Yuxin Wang, and Botian Shi. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282210254} {Evolver: Self-evolving llm agents through an experience-driven lifecycle}.
\newblock \emph{ArXiv}, abs/2510.16079.
\bibitem[{Wu and Shu(2025)}]{doi:10.36227/techrxiv.176539617.79044553/v1}
Shanglin Wu and Kai Shu. 2025.
\newblock \href {https://doi.org/10.36227/techrxiv.176539617.79044553/v1} {Memory in llm-based multi-agent systems: Mechanisms, challenges, and collective intelligence}.
\newblock \emph{TechRxiv}, 2025(1210).
\bibitem[{Wu et~al.(2025{\natexlab{b}})Wu, Liang, Zhang, Wang, Zhang, Guo, Tang, and Liu}]{Wu2025FromHM}
Yaxiong Wu, Sheng Liang, Chen Zhang, Yichao Wang, Yongyue Zhang, Huifeng Guo, Ruiming Tang, and Yong Liu. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:277993681} {From human memory to ai memory: A survey on memory mechanisms in the era of llms}.
\newblock \emph{ArXiv}, abs/2504.15965.
\bibitem[{Xi et~al.(2023)Xi, Chen, Guo, He, Ding, Hong, Zhang, Wang, Jin, Zhou, Zheng, Fan, Wang, Xiong, Liu, Zhou, Wang, Jiang, Zou, Liu, Yin, Dou, Weng, Cheng, Zhang, Qin, Zheng, Qiu, Huan, and Gui}]{Xi2023TheRA}
Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, Rui Zheng, Xiaoran Fan, Xiao Wang, Limao Xiong, Qin Liu, Yuhao Zhou, Weiran Wang, Changhao Jiang, Yicheng Zou, and 11 others. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:261817592} {The rise and potential of large language model based agents: A survey}.
\newblock \emph{ArXiv}, abs/2309.07864.
\bibitem[{Xia et~al.(2025{\natexlab{a}})Xia, Ruehle, Rajmohan, and Shokri}]{Xia2025MinervaAP}
Menglin Xia, Victor Ruehle, Saravan Rajmohan, and Reza Shokri. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:276116638} {Minerva: A programmable memory test benchmark for language models}.
\newblock \emph{ArXiv}, abs/2502.03358.
\bibitem[{Xia et~al.(2026)Xia, Chen, Wang, Liu, Zeng, Wang, Han, Zhou, Zhao, Chen, Zheng, Xie, and Yao}]{Xia2026SkillRLEA}
Peng Xia, Jianwen Chen, Han Wang, Jiaqi Liu, Kaide Zeng, Yu~Wang, Siwei Han, Yiyang Zhou, Xujiang Zhao, Haifeng Chen, Zeyu Zheng, Cihang Xie, and Huaxiu Yao. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:285452037} {Skillrl: Evolving agents via recursive skill-augmented reinforcement learning}.
\newblock \emph{ArXiv}, abs/2602.08234.
\bibitem[{Xia et~al.(2025{\natexlab{b}})Xia, Xia, Zeng, Liu, Qin, Wu, Zhou, Xiong, and Yao}]{Xia2025Agent0US}
Peng Xia, Peng Xia, Kaide Zeng, Jiaqi Liu, Can Qin, Fang Wu, Yiyang Zhou, Caiming Xiong, and Huaxiu Yao. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283110047} {Agent0: Unleashing self-evolving agents from zero data via tool-integrated reasoning}.
\bibitem[{Xiao et~al.(2024)Xiao, Zhang, Han, Xiao, Lin, Zhang, Liu, Han, and Sun}]{Xiao2024InfLLMTL}
Chaojun Xiao, Pengle Zhang, Xu~Han, Guangxuan Xiao, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Song Han, and Maosong Sun. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:267523068} {Infllm: Training-free long-context extrapolation for llms with an efficient context memory}.
\newblock \emph{Advances in Neural Information Processing Systems 37}.
\bibitem[{Xiao et~al.(2023)Xiao, Tian, Chen, Han, and Lewis}]{Xiao2023EfficientSL}
Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, and Mike Lewis. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:263310483} {Efficient streaming language models with attention sinks}.
\newblock \emph{ArXiv}, abs/2309.17453.
\bibitem[{Xiao et~al.(2025)Xiao, Li, Wang, Tang, and Wang}]{Xiao2025ToolMemEM}
Yunzhong Xiao, Yangmin Li, Hewei Wang, Yunlong Tang, and Zora~Zhiruo Wang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:281891854} {Toolmem: Enhancing multimodal agents with learnable tool capability memory}.
\newblock \emph{ArXiv}, abs/2510.06664.
\bibitem[{Xiong et~al.(2025)Xiong, Lin, Xie, He, Tang, Lakkaraju, and Xiang}]{Xiong2025HowMM}
Zidi Xiong, Yuping Lin, Wenya Xie, Pengfei He, Jiliang Tang, Himabindu Lakkaraju, and Zhen Xiang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:278788765} {How memory management impacts llm agents: An empirical study of experience-following behavior}.
\newblock \emph{ArXiv}, abs/2505.16067.
\bibitem[{Xu et~al.(2025{\natexlab{a}})Xu, Hu, Zhang, Yu, Tang, Song, Duan, Ai, and Shi}]{Xu2025SEDMSS}
Haoran Xu, Jiacong Hu, Ke~Zhang, Lei Yu, Yuxin Tang, Xinyuan Song, Yiqun Duan, Lynn Ai, and Bill Shi. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281252587} {Sedm: Scalable self-evolving distributed memory for agents}.
\newblock \emph{ArXiv}, abs/2509.09498.
\bibitem[{Xu et~al.(2025{\natexlab{b}})Xu, Liang, Mei, Gao, Tan, and Zhang}]{Xu2025AMEMAM}
Wujiang Xu, Zujie Liang, Kai Mei, Hang Gao, Juntao Tan, and Yongfeng Zhang. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:276421617} {A-mem: Agentic memory for llm agents}.
\newblock \emph{ArXiv}, abs/2502.12110.
\bibitem[{Xue et~al.(2023)Xue, Jiang, Shi, Cheng, Chen, Yang, Zhang, He, Zhang, Wei, Zhao, Zhou, Qi, Yi, Liu, and Chen}]{Xue2023DBGPTED}
Siqiao Xue, Caigao Jiang, Wenhui Shi, Fangyin Cheng, Keting Chen, Hongjun Yang, Zhiping Zhang, Jianshan He, Hongyang Zhang, Ganglin Wei, Wang Zhao, Fan Zhou, Danrui Qi, Hong Yi, Shaodong Liu, and Faqiang Chen. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:266690744} {Db-gpt: Empowering database interactions with private large language models}.
\newblock \emph{ArXiv}, abs/2312.17449.
\bibitem[{Yan et~al.(2026)Yan, Zhang, Huzhang, Li, Wang, Chen, Xu, Luo, Li, Dong, and Shen}]{Yan2026M2DA}
Dawei Yan, Haokui Zhang, Guangda Huzhang, Yang Li, Yibo Wang, Qin Chen, Zhao Xu, Wei Luo, Ying Li, Wei Dong, and Chunhua Shen. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:286222375} {M2: Dual-memory augmentation for long-horizon web agents via trajectory summarization and insight retrieval}.
\newblock \emph{ArXiv}, abs/2603.00503.
\bibitem[{Yan et~al.(2025{\natexlab{a}})Yan, Yang, Huang, Nie, Ding, Li, Ma, Schutze, Tresp, and Ma}]{Yan2025MemoryR1EL}
Sikuan Yan, Xiufeng Yang, Zuchao Huang, Ercong Nie, Zifeng Ding, Zonggen Li, Xiaowen Ma, Hinrich Schutze, Volker Tresp, and Yunpu Ma. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280918480} {Memory-r1: Enhancing large language model agents to manage and utilize memories via reinforcement learning}.
\newblock \emph{ArXiv}, abs/2508.19828.
\bibitem[{Yan et~al.(2025{\natexlab{b}})Yan, Ou, Yang, Song, Zhang, Li, and Wang}]{Yan2025MemoryDrivenSF}
Xue Yan, Zijing Ou, Mengyue Yang, Yan Song, Haifeng Zhang, Yingzhen Li, and Jun Wang. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281682979} {Memory-driven self-improvement for decision making with large language models}.
\newblock \emph{ArXiv}, abs/2509.26340.
\bibitem[{Yang et~al.(2025{\natexlab{a}})Yang, Li, Yang, Zhang, Hui, Zheng, Yu, Gao, Huang, Lv, Zheng, Liu, Zhou, Huang, Hu, Ge, Wei, Lin, Tang, Yang, Tu, Zhang, Yang, Yang, Zhou, Lin, Dang, Bao, Yang, Yu, Deng, Li, Xue, Li, Zhang, Wang, Zhu, Men, Gao, Liu, Luo, Li, Tang, Yin, Ren, Wang, Zhang, Ren, Fan, Su, Zhang, Zhang, Wan, Liu, Wang, Cui, Zhang, Zhou, and Qiu}]{qwen3}
An~Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo~Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, Chujie Zheng, Dayiheng Liu, Fan Zhou, Fei Huang, Feng Hu, Hao Ge, Haoran Wei, Huan Lin, Jialong Tang, and 40 others. 2025{\natexlab{a}}.
\newblock \href {https://doi.org/10.48550/ARXIV.2505.09388} {Qwen3 technical report}.
\newblock \emph{CoRR}, abs/2505.09388.
\bibitem[{Yang et~al.(2024)Yang, Chen, Zhang, Yuan, Chen, Richardson, Xiao, and Yang}]{Yang2024SelfGoalYL}
Ruihan Yang, Jiangjie Chen, Yikai Zhang, Siyu Yuan, Aili Chen, Kyle Richardson, Yanghua Xiao, and Deqing Yang. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:270357425} {Selfgoal: Your language agents already know how to achieve high-level goals}.
\newblock \emph{ArXiv}, abs/2406.04784.
\bibitem[{Yang et~al.(2025{\natexlab{b}})Yang, Xiao, Zhang, Zhang, Wang, and Xu}]{Yang2025CoarsetoFineGM}
Wei Yang, Jinwei Xiao, Hongming Zhang, Qingyang Zhang, Yanna Wang, and Bo~Xu. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280699719} {Coarse-to-fine grounded memory for llm agent planning}.
\newblock \emph{ArXiv}, abs/2508.15305.
\bibitem[{Yang and Ren(2025)}]{Yang2025MemorySL}
Yanlai Yang and Mengye Ren. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:275789040} {Memory storyboard: Leveraging temporal segmentation for streaming self-supervised learning from egocentric videos}.
\newblock \emph{ArXiv}, abs/2501.12254.
\bibitem[{Yang et~al.(2025{\natexlab{c}})Yang, Kang, Lee, Lee, young Yun, and Lee}]{Yang2025AutomatedSD}
Yongjin Yang, Sinjae Kang, Juyong Lee, Dongjun Lee, Se~young Yun, and Kimin Lee. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:279243862} {Automated skill discovery for language agents through exploration and iterative feedback}.
\newblock \emph{ArXiv}, abs/2506.04287.
\bibitem[{Yang et~al.(2018)Yang, Qi, Zhang, Bengio, Cohen, Salakhutdinov, and Manning}]{Yang2018HotpotQAAD}
Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William~W. Cohen, Ruslan Salakhutdinov, and Christopher~D. Manning. 2018.
\newblock \href {https://api.semanticscholar.org/CorpusID:52822214} {Hotpotqa: A dataset for diverse, explainable multi-hop question answering}.
\newblock In \emph{Conference on Empirical Methods in Natural Language Processing}.
\bibitem[{Yao et~al.(2023)Yao, Yu, Zhao, Shafran, Griffiths, Cao, and Narasimhan}]{Yao2023TreeOT}
Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas~L. Griffiths, Yuan Cao, and Karthik Narasimhan. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:258762525} {Tree of thoughts: Deliberate problem solving with large language models}.
\newblock \emph{ArXiv}, abs/2305.10601.
\bibitem[{Yao et~al.(2022)Yao, Zhao, Yu, Du, Shafran, Narasimhan, and Cao}]{Yao2022ReActSR}
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2022.
\newblock \href {https://api.semanticscholar.org/CorpusID:252762395} {React: Synergizing reasoning and acting in language models}.
\newblock \emph{ArXiv}, abs/2210.03629.
\bibitem[{Ye et~al.(2025)Ye, Zhang, Li, Yin, Tao, Zhao, Su, Zhang, Qiao, Wang, Xie, Huang, Chen, Zhou, and Jiang}]{Ye2025AgentFoldLW}
Rui Ye, Zhongwang Zhang, Kuan Li, Huifeng Yin, Zhengwei Tao, Yida Zhao, Liangcai Su, Liwen Zhang, Zile Qiao, Xinyu Wang, Pengjun Xie, Fei Huang, Siheng Chen, Jingren Zhou, and Yong Jiang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:282400798} {Agentfold: Long-horizon web agents with proactive context management}.
\newblock \emph{ArXiv}, abs/2510.24699.
\bibitem[{Yen et~al.(2024)Yen, Gao, Hou, Ding, Fleischer, Izsak, Wasserblat, and Chen}]{Yen2024HELMETHT}
Howard Yen, Tianyu Gao, Minmin Hou, Ke~Ding, Daniel Fleischer, Peter Izsak, Moshe Wasserblat, and Danqi Chen. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:273098808} {Helmet: How to evaluate long-context language models effectively and thoroughly}.
\newblock \emph{ArXiv}, abs/2410.02694.
\bibitem[{Yeo et~al.(2025)Yeo, Kim, Yoon, and Hwang}]{Yeo2025WorldMMDM}
Woongyeong Yeo, Kangsan Kim, Jaehong Yoon, and Sung~Ju Hwang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:283458398} {Worldmm: Dynamic multimodal memory agent for long video reasoning}.
\newblock \emph{ArXiv}, abs/2512.02425.
\bibitem[{Yin et~al.(2025)Yin, Meng, Chen, Ding, Shao, and Yu}]{Yin2025VideoARMAR}
Yufei Yin, Qianke Meng, Minghao Chen, Jiajun Ding, Zhenwei Shao, and Zhou Yu. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:283896486} {Videoarm: Agentic reasoning over hierarchical memory for long-form video understanding}.
\newblock \emph{ArXiv}, abs/2512.12360.
\bibitem[{Yin et~al.(2024)Yin, Sun, Guo, Zeng, Cheng, Qiu, and Huang}]{Yin2024ExplicitML}
Zhangyue Yin, Qiushi Sun, Qipeng Guo, Zhiyuan Zeng, Qinyuan Cheng, Xipeng Qiu, and Xuanjing Huang. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:273901309} {Explicit memory learning with expectation maximization}.
\newblock In \emph{Conference on Empirical Methods in Natural Language Processing}.
\bibitem[{Yu et~al.(2025{\natexlab{a}})Yu, Li, Shi, and Qi}]{Yu2025PolySkillLG}
Simon Yu, Gang Li, Weiyan Shi, and Pengyuan Qi. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:282203716} {Polyskill: Learning generalizable skills through polymorphic abstraction}.
\newblock \emph{ArXiv}, abs/2510.15863.
\bibitem[{Yu et~al.(2025{\natexlab{b}})Yu, Liang, Huang, Panaganti, Fang, Mi, and Yu}]{Yu2025GuidedSL}
Wenhao Yu, Zhenwen Liang, Chengsong Huang, Kishan Panaganti, Tianqing Fang, Haitao Mi, and Dong Yu. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283458198} {Guided self-evolving llms with minimal human supervision}.
\bibitem[{Yu et~al.(2026)Yu, Xin, Zhang, Liu, Zhao, Hu, Yu, Qiao, Tang, Yang, Hu, Qin, Xiong, Qiao, and Yan}]{Yu2026ModalityGS}
Xiaomin Yu, Yi~Xin, Wenjie Zhang, Chonghan Liu, Hanzhen Zhao, Xiaoxing Hu, Xinlei Yu, Ziyue Qiao, Hao Tang, Xue Yang, Xiaobin Hu, Chengwei Qin, Hui Xiong, Yu~Qiao, and Shuicheng Yan. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:285453455} {Modality gap-driven subspace alignment training paradigm for multimodal large language models}.
\newblock \emph{ArXiv}, abs/2602.07026.
\bibitem[{Yuan et~al.(2023)Yuan, Sun, Wang, Cao, and Li}]{Yuan2023PersonalizedLL}
Ruifeng Yuan, Shichao Sun, Zili Wang, Ziqiang Cao, and Wenjie Li. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:266690798} {Personalized large language model assistant with evolving conditional memory}.
\newblock In \emph{International Conference on Computational Linguistics}.
\bibitem[{Yuen et~al.(2025)Yuen, Medina, Su, Du, and Sobey}]{Yuen2025IntrinsicMA}
Sizhe Yuen, Francisco~Gomez Medina, Ting Su, Yali Du, and Adam~J. Sobey. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:280635601} {Intrinsic memory agents: Heterogeneous multi-agent llm systems through structured contextual memory}.
\newblock \emph{ArXiv}, abs/2508.08997.
\bibitem[{Zhai et~al.(2025)Zhai, Tao, Chen, Zou, Chen, Fu, Mai, Yu, Deng, Cao, Liu, Ding, and Zhou}]{Zhai2025AgentEvolverTE}
Yunpeng Zhai, Shuchang Tao, Cheng Chen, Anni Zou, Ziqian Chen, Qingxu Fu, Shinji Mai, Li~Yu, Jiaji Deng, Zouying Cao, Zhaoyang Liu, Bolin Ding, and Jingren Zhou. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:282992095} {Agentevolver: Towards efficient self-evolving agent system}.
\bibitem[{Zhang et~al.(2025{\natexlab{a}})Zhang, Zhu, Wei, Song, Nie, Jia, Vijaykumar, Wang, and Olukotun}]{Zhang2025AccelOptAS}
Genghan Zhang, Shaowei Zhu, Anjiang Wei, Zhenyu Song, Allen Nie, Zhen Jia, Nandita Vijaykumar, Yida Wang, and Kunle Olukotun. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:283109792} {Accelopt: A self-improving llm agentic system for ai accelerator kernel optimization}.
\bibitem[{Zhang et~al.(2025{\natexlab{b}})Zhang, Fu, Wan, Yu, Wang, and Yan}]{Zhang2025GMemoryTH}
Gui-Min Zhang, Muxin Fu, Guancheng Wan, Miao Yu, Kun Wang, and Shuicheng Yan. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:279250852} {G-memory: Tracing hierarchical memory for multi-agent systems}.
\newblock \emph{ArXiv}, abs/2506.07398.
\bibitem[{Zhang et~al.(2025{\natexlab{c}})Zhang, Fu, and Yan}]{Zhang2025MemGenWG}
Gui-Min Zhang, Muxin Fu, and Shuicheng Yan. 2025{\natexlab{c}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281676243} {Memgen: Weaving generative latent memory for self-evolving agents}.
\newblock \emph{ArXiv}, abs/2509.24704.
\bibitem[{Zhang et~al.(2025{\natexlab{d}})Zhang, Meng, Wan, Li, Wang, Yin, Bai, and Yan}]{Zhang2025LatentEvolveST}
Gui-Min Zhang, Fanci Meng, Guancheng Wan, Zherui Li, Kun Wang, Zhenfei Yin, Lei Bai, and Shuicheng Yan. 2025{\natexlab{d}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281675514} {Latentevolve: Self-evolving test-time scaling in latent space}.
\newblock \emph{ArXiv}, abs/2509.24771.
\bibitem[{Zhang et~al.(2025{\natexlab{e}})Zhang, Ren, Zhan, Zhou, Wang, Zhu, Zhou, and Yan}]{Zhang2025MemEvolveMO}
Guibin Zhang, Haotian Ren, Chong Zhan, Zhenhong Zhou, Junhao Wang, He~Zhu, Wangchunshu Zhou, and Shuicheng Yan. 2025{\natexlab{e}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:284078455} {Memevolve: Meta-evolution of agent memory systems}.
\bibitem[{Zhang et~al.(2026)Zhang, Long, Bao, Feng, Zhang, Yue, and Wang}]{Zhang2026MemSkillLA}
Haozhen Zhang, Quanyu Long, Jianzhu Bao, Tao Feng, Weizhi Zhang, Haodong Yue, and Wenya Wang. 2026.
\newblock \href {https://api.semanticscholar.org/CorpusID:285269715} {Memskill: Learning and evolving memory skills for self-evolving agents}.
\newblock \emph{ArXiv}, abs/2602.02474.
\bibitem[{Zhang et~al.(2025{\natexlab{f}})Zhang, Chen, Liu, Xue, Liao, Liu, Wang, Ning, Chen, Fu, Xie, Sun, Gou, Qi, Meng, Yang, Zhang, Li, Shah, Huynh, Li, Yang, Cao, Jang, Zhou, Zhu, Sun, Weston, Su, and Wu}]{Zhang2025AgentLV}
Kai Zhang, Xiangchao Chen, Bo~Liu, Tianci Xue, Zeyi Liao, Zhihan Liu, Xiyao Wang, Yuting Ning, Zhaorun Chen, Xiaohan Fu, Jian Xie, Yuxuan Sun, Boyu Gou, Qi~Qi, Zihang Meng, Jianwei Yang, Ning Zhang, Xian Li, Ashish Shah, and 11 others. 2025{\natexlab{f}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281951121} {Agent learning via early experience}.
\newblock \emph{ArXiv}, abs/2510.08558.
\bibitem[{Zhang et~al.(2025{\natexlab{g}})Zhang, Yao, Liu, Zhang, Cen, Zhou, Fang, Zhao, Lai, and Song}]{Zhang2025ReplayFA}
Kongcheng Zhang, Qi~Yao, Shunyu Liu, Wenjian Zhang, Mingcan Cen, Yang Zhou, Wenkai Fang, Yiru Zhao, Baisheng Lai, and Mingli Song. 2025{\natexlab{g}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:284311803} {Replay failures as successes: Sample-efficient reinforcement learning for instruction following}.
\bibitem[{Zhang et~al.(2023{\natexlab{a}})Zhang, Press, Merrill, Liu, and Smith}]{Zhang2023HowLM}
Muru Zhang, Ofir Press, William Merrill, Alisa Liu, and Noah~A. Smith. 2023{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:258841857} {How language model hallucinations can snowball}.
\newblock \emph{ArXiv}, abs/2305.13534.
\bibitem[{Zhang et~al.(2025{\natexlab{h}})Zhang, Chen, Feng, Jiang, and Meng}]{Zhang2025ConstructingCS}
Puzhen Zhang, Xuyang Chen, Yu~Feng, Yuhan Jiang, and Liqiu Meng. 2025{\natexlab{h}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:281843644} {Constructing coherent spatial memory in llm agents through graph rectification}.
\newblock \emph{ArXiv}, abs/2510.04195.
\bibitem[{Zhang et~al.(2025{\natexlab{i}})Zhang, Shu, Ma, Lin, Wu, and Sang}]{zhang2025memoryactionautonomouscontext}
Yuxiang Zhang, Jiangming Shu, Ye~Ma, Xueyuan Lin, Shangxi Wu, and Jitao Sang. 2025{\natexlab{i}}.
\newblock \href {https://arxiv.org/abs/2510.12635} {Memory as action: Autonomous context curation for long-horizon agentic tasks}.
\newblock \emph{Preprint}, arXiv:2510.12635.
\bibitem[{Zhang et~al.(2024)Zhang, Dai, Bo, Ma, Li, Chen, Zhu, Dong, and Wen}]{Zhang2024ASO}
Zeyu Zhang, Quanyu Dai, Xiaohe Bo, Chen Ma, Rui Li, Xu~Chen, Jieming Zhu, Zhenhua Dong, and Ji-Rong Wen. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:269293320} {A survey on the memory mechanism of large language model-based agents}.
\newblock \emph{ACM Transactions on Information Systems}, 43:1 -- 47.
\bibitem[{Zhang et~al.(2025{\natexlab{j}})Zhang, Dai, Chen, Li, Li, and Dong}]{Zhang2025MemEngineAU}
Zeyu Zhang, Quanyu Dai, Xu~Chen, Rui Li, Zhongyang Li, and Zhenhua Dong. 2025{\natexlab{j}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:278327095} {Memengine: A unified and modular library for developing advanced memory of llm-based agents}.
\newblock \emph{Companion Proceedings of the ACM on Web Conference 2025}.
\bibitem[{Zhang et~al.(2025{\natexlab{k}})Zhang, Zhang, Tan, Li, and Chen}]{Zhang2025ExplicitVI}
Zeyu Zhang, Yang Zhang, Haoran Tan, Rui Li, and Xu~Chen. 2025{\natexlab{k}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280686168} {Explicit v.s. implicit memory: Exploring multi-hop complex reasoning over personalized information}.
\newblock \emph{ArXiv}, abs/2508.13250.
\bibitem[{Zhang et~al.(2023{\natexlab{b}})Zhang, Sheng, Zhou, Chen, Zheng, Cai, Song, Tian, R{\'e}, Barrett, Wang, and Chen}]{Zhang2023H2OHO}
Zhenyu~(Allen) Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher R{\'e}, Clark~W. Barrett, Zhangyang Wang, and Beidi Chen. 2023{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:259263947} {H2o: Heavy-hitter oracle for efficient generative inference of large language models}.
\newblock \emph{ArXiv}, abs/2306.14048.
\bibitem[{Zhao et~al.(2025)Zhao, Hong, Liu, Hazarika, and Lin}]{Zhao2025DoLR}
Siyan Zhao, Mingyi Hong, Yang Liu, Devamanyu Hazarika, and Kaixiang Lin. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:276317480} {Do llms recognize your preferences? evaluating personalized preference following in llms}.
\newblock \emph{ArXiv}, abs/2502.09597.
\bibitem[{Zheng et~al.(2025)Zheng, Cai, Li, Zhang, Li, Zhang, Song, and Ma}]{Zheng2025LifelongAgentBenchEL}
Junhao Zheng, Xidi Cai, Qiuke Li, Duzhen Zhang, Zhongzhi Li, Yingying Zhang, Le~Song, and Qianli Ma. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:278739762} {Lifelongagentbench: Evaluating llm agents as lifelong learners}.
\newblock \emph{ArXiv}, abs/2505.11942.
\bibitem[{Zheng et~al.(2024)Zheng, Henaff, Zhang, Grover, and Amos}]{Zheng2024OnlineIR}
Qinqing Zheng, Mikael Henaff, Amy Zhang, Aditya Grover, and Brandon Amos. 2024.
\newblock \href {https://api.semanticscholar.org/CorpusID:273695775} {Online intrinsic rewards for decision making agents from large language model feedback}.
\newblock \emph{ArXiv}, abs/2410.23022.
\bibitem[{Zhong et~al.(2023)Zhong, Guo, Gao, Ye, and Wang}]{Zhong2023MemoryBankEL}
Wanjun Zhong, Lianghong Guo, Qi-Fei Gao, He~Ye, and Yanlin Wang. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:258741194} {Memorybank: Enhancing large language models with long-term memory}.
\newblock \emph{ArXiv}, abs/2305.10250.
\bibitem[{Zhou et~al.(2023)Zhou, Jiang, Cui, Wang, Xiao, Hou, Cotterell, and Sachan}]{Zhou2023RecurrentGPTIG}
Wangchunshu Zhou, Yuchen~Eleanor Jiang, Peng Cui, Tiannan Wang, Zhenxin Xiao, Yifan Hou, Ryan Cotterell, and Mrinmaya Sachan. 2023.
\newblock \href {https://api.semanticscholar.org/CorpusID:258832617} {Recurrentgpt: Interactive generation of (arbitrarily) long text}.
\newblock \emph{ArXiv}, abs/2305.13304.
\bibitem[{Zhou et~al.(2025{\natexlab{a}})Zhou, Li, Liu, Zhao, Wang, Li, Tian, and Xu}]{Zhou2025M2PAAM}
Yanfang Zhou, Xiaodong Li, Yuntao Liu, Yongqiang Zhao, Xintong Wang, Zhenyu Li, Jinlong Tian, and Xinhai Xu. 2025{\natexlab{a}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:280322030} {M2pa: A multi-memory planning agent for open worlds inspired by cognitive theory}.
\newblock In \emph{Annual Meeting of the Association for Computational Linguistics}.
\bibitem[{Zhou et~al.(2025{\natexlab{b}})Zhou, Qu, Wu, Kim, Kim, Prakash, Rus, Zhao, Low, and Liang}]{Zhou2025MEM1LT}
Zijian Zhou, Ao~Qu, Zhaoxuan Wu, Sunghwan Kim, Sunghwan Kim, Alok Prakash, Daniela Rus, Jinhua Zhao, Bryan Kian~Hsiang Low, and Paul Liang. 2025{\natexlab{b}}.
\newblock \href {https://api.semanticscholar.org/CorpusID:279465470} {Mem1: Learning to synergize memory and reasoning for efficient long-horizon agents}.
\newblock \emph{ArXiv}, abs/2506.15841.
\bibitem[{Zhu et~al.(2025)Zhu, Liu, Li, Tian, Yang, Zhang, Han, Xie, Cui, Zhang, Ma, Yu, Ramesh, Wu, Liu, Lu, Zou, and You}]{Zhu2025WhereLA}
Kunlun Zhu, Zijia Liu, Bingxuan Li, Muxin Tian, Yingxuan Yang, Jiaxun Zhang, Pengrui Han, Qipeng Xie, Fuyang Cui, Weijia Zhang, Xiaoteng Ma, Xiaodong Yu, Gowtham Ramesh, Jialian Wu, Zicheng Liu, Pan Lu, James Zou, and Jiaxuan You. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:281681143} {Where llm agents fail and how they can learn from failures}.
\newblock \emph{ArXiv}, abs/2509.25370.
\bibitem[{Zou et~al.(2025)Zou, Yang, Qiu, Li, Tieu, Lu, Shen, Tong, Choi, He, Zou, Wang, and Yang}]{Zou2025LatentCI}
Jiaru Zou, Xiyuan Yang, Ruizhong Qiu, Gaotang Li, Katherine Tieu, Pan Lu, Ke~Shen, Hanghang Tong, Yejin Choi, Jingrui He, James Zou, Mengdi Wang, and Ling Yang. 2025.
\newblock \href {https://api.semanticscholar.org/CorpusID:283251109} {Latent collaboration in multi-agent systems}.
\end{thebibliography}