The Immutable Past: Formalizing State Mutability and Conflict Resolution in Mutable RAG
Abstract
Retrieval-Augmented Generation (RAG) serves as the primary memory architecture for long-horizon autonomous agents. However, treating shared memory as an append-only stream introduces Semantic Shadowing, a critical failure mode where conflicting historical observations accumulate and statistically dominate valid recent updates. In dynamic environments, this results in severe state divergence as agents retrieve and act upon obsolete facts. This paper formalizes the mechanics of State Mutability to prove that standard dense retrieval suffers from Asymptotic Recall Decay. Furthermore, we formally demonstrate a Majority Vote Trap, revealing that increasing the retrieval context window paradoxically degrades generation accuracy by diluting the attention mechanism under conditions of semantic equivalence. To resolve this, we introduce GC-Mem (Garbage Collection for Memory), a strict inference-time consistency protocol. Unlike heuristic time-decay mechanisms—which indiscriminately destroy valid long-term memory—GC-Mem relies purely on a temporal dominance operator () paired with contradiction detection to surgically excise shadowed context. Evaluated across a rigorous, behaviorally inferred benchmark of 137,760 memory chunks and continuous accumulation sweeps, standard RAG and timestamp re-ranking baselines experience severe degradation. In contrast, GC-Mem empirically recovers conflict resolution accuracy. We establish strict precision and recall deployment thresholds, ensuring state convergence where standard mutable RAG fundamentally fails.
1 Introduction
As autonomous systems graduate from isolated tasks to long-horizon workflows, the consistency of their memory architecture becomes paramount. Retrieval-Augmented Generation (RAG) is the consensus memory framework Lewis et al. (2020), yet it operates under the implicit assumption of a static knowledge base. In real-world agentic deployments, memory is an append-only stream where factual states mutate over time (e.g., user preferences shift, project goals update, infrastructure changes) Park et al. (2023).
We identify a foundational failure in the append-only paradigm: when an entity updates, the historical state is not deleted. Because the historical and updated states are semantically equivalent but logically contradictory, dense retrieval algorithms return the statistical majority of stale chunks. We formalize this failure mode as Semantic Shadowing.
This paper establishes the theoretical bounds of retrieval failure under state mutation. We prove three central theorems: (1) valid-state recall decays asymptotically to zero as a system’s interaction history grows; (2) generation fails even when valid chunks are successfully retrieved because attention mass becomes non-discriminating across semantically equivalent contradictions; and (3) multi-factor memory scoring fundamentally violates state convergence by protecting entrenched historical errors.
To address these vulnerabilities, we propose GC-Mem, a lightweight, inference-time garbage collection operator driven strictly by temporal dominance (). Unlike naive timestamp re-ranking—which we demonstrate destroys valid historical reasoning—GC-Mem surgically removes logical contradictions from the retrieved context prior to generation.
2 Related Work
Agentic Memory and Mutable RAG. The deployment of long-horizon autonomous agents necessitates robust memory architectures. Current frameworks like Voyager Wang et al. (2023) and Reflexion Shinn et al. (2023) utilize iterative self-reflection to update agent policies, but rely on localized episodic buffers. MemGPT Packer et al. (2023) introduced an OS-inspired memory hierarchy to manage context limits, while GraphRAG Edge et al. (2024) and HippoRAG Gutiérrez et al. (2024) map global semantic structures for multi-hop reasoning. However, these architectures primarily treat memory as a monotonically growing, static knowledge base. When subjected to state mutation, standard dense retrieval Lewis et al. (2020); Karpov et al. (2024) falters because heuristic time-decay algorithms indiscriminately erase valid historical invariants alongside stale facts. GC-Mem explicitly solves the mutability gap in RAG-driven agent architectures.
Knowledge Editing and Temporal Contradiction. Our work bridges mutable RAG with the literature on knowledge editing and temporal QA. Methodologies like ROME Meng et al. (2022) and MEMIT Meng et al. (2023) directly mutate the parametric weights of LLMs to inject updated facts. Concurrently, TempLAMA Dhingra et al. (2022) and StreamingQA Liska et al. (2022) explore QA over temporally evolving corpora. While parametric editing is computationally prohibitive for continuous, high-frequency multi-agent streams, GC-Mem acts as a non-parametric, inference-time filter. By utilizing Natural Language Inference (NLI) contradiction detection, GC-Mem dynamically resolves temporal conflicts in the retrieved context without requiring weight updates.
Long-Context Dilution and Attention Collapse. The Majority Vote Trap formalized in this paper builds upon the "Lost in the Middle" phenomenon Liu et al. (2023); Levy et al. (2024), which demonstrated that LLM attention degrades when relevant information is flanked by noise. We extend this by proving that in mutable memory, context dilution is not an accidental byproduct of long documents, but a mathematical asymptote. As history grows, the probability of retrieving a correct state approaches zero, and the generation attention mass becomes captive to the statistical majority of stale evidence Wang et al. (2025).
Latency and Self-Correction in LLMs. Recent advancements in agentic reasoning heavily leverage critic-guided reflection loops Zhang et al. (2025) to correct hallucinations and reasoning errors. However, relying on multi-turn generative reflection to prune memory contradictions induces severe latency overhead and token costs. GC-Mem operates as a computationally lightweight, feed-forward inference filter. By excising logical contradictions prior to the primary generation phase, GC-Mem circumvents the need for post-generation reflection loops, ensuring strict factual grounding within bounded operational latency.
3 Theoretical Framework
Let denote the shared memory stream at time , where is a memory chunk and is its timestamp.
3.1 Problem Formulation
Definition 3.1 (Mutable Entity State & Multi-Transition Dynamics).
Consider an entity . The ground truth state is formally defined as a piecewise-constant function over time. Let denote a strictly monotonically increasing sequence of transition timestamps (). For any interval , the entity state is .
For a query issued at current time , the terminal state is the sole valid state. All preceding states where constitute logical contradictions. This formalizes chained state mutations (e.g., ). Because the temporal operator enforces pairwise across all retrieved chunks, it dynamically collapses chained contradictions to the terminal valid state .
Lemma 3.2 (Semantic Equivalence).
For a query targeting the state of , the embedding similarity of the old and new states is mathematically indistinguishable up to a marginal noise term :
| (1) |
Assumption 3.3 (Accumulation Hypothesis ()).
Let denote the count of chunks asserting state semantically similar to a specific attribute. For instance, if an agent interacts with a user 50 times regarding their diet, and the diet mutates once, and . scales per-attribute, not globally. We assume .
3.2 The Shadowing Failure
Theorem 3.4 (Asymptotic Recall Decay).
Assuming the Accumulation Hypothesis (), the expected number of valid chunks in the retrieved set is bounded by:
| (2) |
As attribute history , . Because dense retrievers exhibit inherent semantic bias toward dominant phrasings, this hypergeometric formulation serves as a theoretical worst-case lower bound for recall failure (Proof in Appendix B.1).
Theorem 3.5 (The Majority Vote Trap).
Even if contains valid evidence (e.g., stale chunks and 1 valid chunk), generation collapses. Under Semantic Equivalence (Lemma 3.2), the LLM attention mechanism becomes non-discriminating across the chunks Liu et al. (2023). The probability mass assigned to the stale state scales with its representation:
| (3) |
(Proof in Appendix B.2).
4 The GC-Mem Protocol
To mathematically guarantee state convergence, we introduce GC-Mem. Operationally, the system functions as a linear inference stack from ingested interaction logs to validated generation. We detail the architectural mechanics below.
4.1 Memory Architecture and Candidate Retrieval
Each multi-turn session is segmented and embedded via a fixed sentence encoder, populating the primary medium-term memory (MTM) vector index. Optionally, the architecture supports a Short-Term Memory (STM) recency buffer, implemented as a FIFO queue mirroring the most recent chunks. When a user query is issued, the system executes multi-query expansion to mitigate single-embedding bias. The MTM returns the top- semantically similar chunks. If the STM buffer is enabled, it is unioned with the MTM hits and deduplicated, forming the frozen candidate set . Crucially, serves as the identical baseline context evaluated across all methodologies (Standard RAG, Timestamp Re-ranking, and GC-Mem) to ensure strict experimental parity.
4.2 Conflict Oracle and Temporal Dominance
Each item is simplified to a tuple , where is the strict chronological timestamp and is retrieval relevance.
We define the conflict function which evaluates whether two retrieved statements logically contradict relative to the user query. This step utilizes a pairwise Natural Language Inference (NLI) heuristic operating strictly within , resulting in a bounded operational complexity.
We define the temporal dominance operator over the retrieved set :
| (4) |
Theorem 4.1 (State Recovery).
Applying guarantees that if at least one valid chunk is retrieved, all older contradictory chunks are excised. The context is purged of contradiction, breaking the Majority Vote Trap and forcing .
5 Experimental Methodology
5.1 Dataset Scale and Rationale
We constructed a Temporal Mutation Benchmark consisting of 2,016 experiment instances and 137,760 evaluated memory chunks across continuous parameter sweeps (6 controlled accumulation ratios from 1:1 to 100:1, and 4 model architectures).
We utilize a controlled synthetic environment because organic data cannot isolate the mathematical bounds of Semantic Shadowing. We evaluated external datasets (FactConsolidation and WikiContradict) and found they yielded 0% and 10% Conflict Resolution Accuracy (CR-Acc), respectively, due to the complete absence of controlled temporal contradiction ratios.
5.2 The Behavioral Pipeline
To ensure robust evaluation, we utilize a behavioral generation pipeline to construct the memory contexts. Preliminary templates exhibited up to 14% keyword leakage (where the state is explicitly named, e.g., "Status: employed"). The pipeline relies exclusively on behavior-inferrable state constraints (e.g., Old: "Complained about feeling winded after climbing a single flight of stairs." vs New: "Jogged three miles before breakfast this morning."). Regulated by a secondary GPT-4 quality rater, keyword leakage is suppressed to 0-3%, forcing the retriever to rely purely on complex semantic similarity. The medium dataset contains 48 instances (1,464 chunks), and the large contains 65 instances (1,950 chunks).
6 Results
6.1 Timestamp Baselines vs. GC-Mem
A common heuristic is that simple time-decay or timestamp re-ranking resolves mutable memory. Table 1 empirically refutes this. Timestamp heuristics blindly penalize all historical chunks, discarding valid, non-contradicted long-term facts alongside stale ones.
| Model | Dataset Split | Standard RAG | Timestamp Re-ranking | GC-Mem () |
|---|---|---|---|---|
| deepseek-v3 | Large () | 56.8% | 20.3% | 97.3%* |
| o4-mini | Medium () | 28.9% | 10.5% | 92.1%* |
| gpt-4o | Medium () | 68.4% | 10.5% | 10.5% |
6.2 Short-Term Memory (STM) Dynamics
To evaluate architectural interaction, we activated the Short-Term Memory (STM) recency buffer. As demonstrated in Table 2, enabling STM raises the baseline accuracy of standard RAG by artificially elevating the exposure of new-state evidence in the retrieval window. However, GC-Mem retains a substantially wider performance gap. Because simple recency heuristics merely surface the new state alongside the vast quantity of historical states, the context remains contradictory. GC-Mem explicitly resolves this by pruning the semantically shadowed stale chunks that the STM forces into the context window.
| Dataset | STM Buffer | Standard RAG | GC-Mem () | GC Lift |
|---|---|---|---|---|
| Medium | STM=off | 24.4% | 40.2% | +15.8p |
| Medium | STM=on | 46.1% | 68.1% | +22.0p |
| Large | STM=off | 15.9% | 30.4% | +14.4p |
| Large | STM=on | 34.5% | 62.9% | +28.4p |
6.3 Detector Dependency and Deployment Threshold
GC-Mem operates as a cognitive offloading protocol; its success is strictly bounded by the underlying model’s reasoning capabilities. Table 3 demonstrates that while precision is universally high, recall is the decisive factor.
| Model | Precision | Recall | F1 Score | CR-Acc | Protocol Efficacy |
|---|---|---|---|---|---|
| deepseek-v3 | 98.9% | 95.2% | 0.97 | +69.0 pp | Optimal |
| o4-mini | 98.1% | 99.8% | 0.99 | +79.0 pp | Optimal |
| gpt-4o | 99.7% | 36.6% | 0.54 | +4.0 pp | Marginal |
| gpt-4.1-mini | 100.0% | 0.7% | 0.01 | -0.2 pp | Fails |
6.4 Ablation: The Failure of Multi-Factor Dominance
To evaluate whether multi-factor memory scoring helps resolve contradictions, we test a multi-factor scoring variant (e.g., scoring chunks using ). We rigorously ablated this variant on the o4-mini architecture.
| Variant | CR-Acc (Medium) | CR-Acc (Large) | Status |
|---|---|---|---|
| Eq. 5 (timestamp-only ) | 94.7% | 97.3% | Optimal |
| (+ relevance) | 86.8% | 96.0% | Slight Drop |
| (+ usage) | 10.5% | 18.9% | Severe Crash |
| Full Multi-Factor (+ stability) | 10.5% | 18.9% | Severe Crash |
As demonstrated in Table 4, utilizing the pure temporal operator () yields 94.7% CR-Acc. However, introducing usage frequency () causes accuracy to crash to 10.5%. Because stale chunks have resided in memory longer, they inherently accumulate higher usage and stability scores. Multi-factor scoring systematically assigns higher dominance to the exact contradictions that must be removed, mathematically violating Theorem 4.1. Temporal dominance is uniquely required for state convergence.
6.5 Bag-of-Facts Evaluation: Isolating Protocol Ceiling
To decouple the fundamental efficacy of the operator from the variance of dense retrieval noise, we conducted a "Bag-of-Facts" ablation. In this setting, the retrieval bottleneck is entirely removed (), and all relevant historical and updated chunks are placed directly into the context window.
| Model | Mean Std. RAG | Mean GC-Mem | GC Lift | Shadows Pruned |
|---|---|---|---|---|
| DeepSeek-V3 | 11.9% | 54.3% | +42.4p | 13.28 |
| GPT-4o | 12.9% | 53.3% | +40.3p | 15.70 |
| Phi-4 | 12.3% | 44.6% | +32.3p | 13.73 |
| 04-mini | 19.2% | 33.4% | +14.2p | 6.21 |
As shown in Table 5, when standard RAG is forced to reason over the entire contradictory timeline, its accuracy collapses to roughly 12%. The Majority Vote Trap overwhelms the attention mechanism entirely. However, GC-Mem dynamically prunes an average of 13.28 shadowed chunks per query on DeepSeek-V3, lifting generation accuracy by a massive +42.4 percentage points. This confirms that GC-Mem scales proportionally with retrieval volume: as contexts become more dense with contradictions, the necessity of explicit temporal pruning becomes critical.
6.6 Computational Overhead and Latency
In production architectures, maintaining strict latency bounds is essential. The pairwise conflict detection operates via a lightweight NLI prompt strictly bounded by , running exclusively over the retrieved candidate set rather than the global database.
| Dataset | STM Buffer | Mean Wall Time (s) | Per-Instance Latency (s) | Avg. Shadows |
|---|---|---|---|---|
| Medium | STM=off | 525s | 10.9s | 1.55 |
| Medium | STM=on | 1276s | 26.6s | 3.52 |
| Large | STM=off | 685s | 10.5s | 1.39 |
| Large | STM=on | 973s | 15.0s | 4.07 |
Table 6 details the end-to-end latency. For a standard retrieval without an STM buffer, the GC-Mem protocol operates efficiently at 10.5 seconds per instance. The introduction of an STM buffer naturally inflates the candidate set, thereby increasing the evaluation permutations (elevating latency to 15.0s). However, this overhead remains substantially lower than orchestrating multi-turn, generative LLM self-reflection loops, establishing GC-Mem as a highly viable inference-time architecture.
7 Discussion and Limitations
When NOT to use GC-Mem. Our precision/recall analysis dictates a strict deployment guideline: GC-Mem should only be implemented when paired with a conflict detector capable of recall. Models like gpt-4.1-mini exhibit 100% precision but recall; they fail to detect contradictions, rendering the protocol inert. Furthermore, partial detection (as seen with gpt-4o) can inadvertently leave the context mixed, confusing the generator further.
Limitations. While the benchmark limits keyword leakage, it remains a synthetic environment optimized for single-attribute mutations. Future work must validate GC-Mem on live, concurrent multi-entity mutations utilizing organic interaction logs. Additionally, while the conflict check overhead is modest for typical (adding ms to a standard ms RAG pipeline), it may prove prohibitive for ultra-low latency requirements.
8 Conclusion
This work proves that semantic shadowing fatally compromises standard RAG architectures over long horizons. By establishing the theoretical bounds of the Majority Vote Trap, we demonstrate that heuristic time-decay and multi-factor scoring both fail to preserve state consistency. We offer GC-Mem, utilizing a pure temporal dominance operator (), which empirically restores accuracy and provides a mathematically sound protocol for mutable RAG systems.
References
- Dhingra et al. [2022] Bhuwan Dhingra, Jeremy Cole, Julian Martin Eisenschlos, Dan Gillick, Jacob Eisenstein, and William W. Cohen. Time-aware language models as temporal knowledge bases. Transactions of the Association for Computational Linguistics, 2022.
- Edge et al. [2024] Darren Edge, Ha Trinh, Newman Cheng, et al. Graphrag: Unlocking llm discovery on narrative private data. arXiv preprint arXiv:2404.16130, 2024.
- Gutiérrez et al. [2024] Bernal Jiménez Gutiérrez et al. Hipporag: Neurobiologically inspired long-term memory for large language models. In NeurIPS, 2024.
- Karpov et al. [2024] Andrei Karpov, Yiyang Li, Aman Madaan, Danqi Chen, and Hannaneh Hajishirzi. A survey of retrieval-augmented generation for large language models. arXiv preprint arXiv:2410.12837, 2024.
- Levy et al. [2024] Itay Levy, Michal Moshkovitz, and Reut Tsarfaty. Safe and effective long-context reasoning in code generation. arXiv preprint arXiv:2407.13912, 2024.
- Lewis et al. [2020] Patrick Lewis et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. In NeurIPS, 2020.
- Liska et al. [2022] Adam Liska, Arun Chaganty, Danqi Chen, and Jason Weston. Streamingqa: A benchmark for adaptation to new knowledge over time in question answering models. In International Conference on Machine Learning, 2022.
- Liu et al. [2023] Nelson F Liu et al. Lost in the middle: How language models use long contexts. TACL, 2023.
- Meng et al. [2022] Kevin Meng, Arnab Sharma, Alex Andonian, and Yonatan Belinkov. Locating and editing factual associations in gpt. In Advances in Neural Information Processing Systems, 2022.
- Meng et al. [2023] Kevin Meng, David Sen, Dan Friedman, Yihan Pan, and Yonatan Belinkov. Mass-editing memory in a transformer. In International Conference on Learning Representations, 2023.
- Packer et al. [2023] Charles Packer, Vivian Fang, Shishir Patil, Kevin Lin, and Joseph E. Gonzalez. Memgpt: Towards llms as operating systems. arXiv preprint arXiv:2310.08560, 2023.
- Park et al. [2023] Joon Sung Park et al. Generative agents: Interactive simulacra of human behavior. arXiv, 2023.
- Shinn et al. [2023] Noah Shinn, Federico Cassano, Eli Berman, Ashwin Labash, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. Reflexion: Language agents with verbal reinforcement learning. arXiv preprint arXiv:2303.11366, 2023.
- Wang et al. [2023] Guanzhi Wang, Yuqi Xie, Wenhao Jiang, Ajay Mandlekar, Haoqi Fan, Anima Anandkumar, and Yuke Wang. Voyager: An open-ended embodied agent with large language models. arXiv preprint arXiv:2305.16291, 2023.
- Wang et al. [2025] Z Wang et al. Evaluating memory in llm agents via incremental multi-turn interactions. OpenReview, 2025.
- Zhang et al. [2025] Y Zhang et al. Rag-critic: Leveraging automated critic-guided agentic workflow for retrieval augmented generation. In ACL, 2025.
Appendix A Artifact-Backed Results Appendix
This appendix collects the full experimental tables and figures underlying the main text: dataset statistics, headline aggregates, per-condition breakdowns, ablations, and supplementary plots. Together they document every benchmark cell, including retrieval recalls, conflict removals, latency, and significance summaries.
A.1 Dataset Construction and Composition
| Dataset | Entity | Severity | Total turns | Gen. model | ||||
|---|---|---|---|---|---|---|---|---|
| types | tiers | mean (SD) | mean (SD) | mean (SD) | ||||
| Chat-Medium (n=48) | 48 | 12 | 4 | 27.5 (14.9) | 3.0 (1.2) | 12.5 (1.7) | 2,033 | GPT-4o |
| Chat-Large (n=65) | 65 | 13 | 5 | 27.0 (13.4) | 3.0 (1.1) | 11.4 (1.7) | 2,690 | GPT-4o |
A.2 Primary Benchmark Tables
| Dataset | STM | Std. RAG | Timestamp | GC-Mem | GC | Cells |
|---|---|---|---|---|---|---|
| Medium | STM=off | 24.4% | 24.4% | 40.2% | +15.8p | |
| Medium | STM=on | 46.1% | 71.6% | 68.1% | +22.0p | |
| Large | STM=off | 15.9% | 16.2% | 30.4% | +14.4p | |
| Large | STM=on | 34.4% | 67.5% | 61.5% | +27.1p |
| Dataset | STM | Model | Mode | Std | TS | GC | GC | Recold | Recnew | Recdis | Shadows | Err | Sec | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Medium | STM=off | DeepSeek-V3 | Forced-choice | 25.0% | 20.8% | 45.8% | +20.8p | 24.1% | 37.2% | 5.0% | 1.73 | 48 | 0 | 267 |
| STM=off | DeepSeek-V3 | Allow-unclear | 23.4% | 19.1% | 40.4% | +17.0p | 24.3% | 38.0% | 5.0% | 1.77 | 47 | 1 | 259 | |
| STM=off | GPT-4o | Forced-choice | 20.8% | 22.9% | 47.9% | +27.1p | 24.1% | 37.2% | 5.0% | 2.27 | 48 | 0 | 669 | |
| STM=off | GPT-4o | Allow-unclear | 12.5% | 18.8% | 29.2% | +16.7p | 24.1% | 37.2% | 5.0% | 2.19 | 48 | 0 | 486 | |
| STM=off | GPT-4.1 | Forced-choice | 20.8% | 22.9% | 43.8% | +22.9p | 24.1% | 37.2% | 5.0% | 1.73 | 48 | 0 | 387 | |
| STM=off | GPT-4.1 | Allow-unclear | 22.9% | 22.9% | 35.4% | +12.5p | 24.1% | 37.2% | 5.0% | 1.69 | 48 | 0 | 375 | |
| STM=off | GPT-4.1-mini | Forced-choice | 33.3% | 31.2% | 33.3% | +0.0p | 24.1% | 37.2% | 5.0% | 0.92 | 48 | 0 | 561 | |
| STM=off | GPT-4.1-mini | Allow-unclear | 29.2% | 27.1% | 37.5% | +8.3p | 24.1% | 37.2% | 5.0% | 0.88 | 48 | 0 | 560 | |
| STM=off | GPT-5-Chat | Forced-choice | 34.0% | 29.8% | 48.9% | +14.9p | 23.8% | 38.0% | 5.1% | 1.70 | 47 | 1 | 239 | |
| STM=off | GPT-5-Chat | Allow-unclear | 23.4% | 25.5% | 40.4% | +17.0p | 24.2% | 38.0% | 4.9% | 1.66 | 47 | 1 | 243 | |
| STM=off | o4-mini | Forced-choice | 25.0% | 25.0% | 39.6% | +14.6p | 24.1% | 37.2% | 5.0% | 0.92 | 48 | 0 | 1347 | |
| STM=off | o4-mini | Allow-unclear | 22.9% | 18.8% | 33.3% | +10.4p | 24.1% | 37.2% | 5.0% | 0.90 | 48 | 0 | 1330 | |
| STM=off | Phi-4 | Forced-choice | 31.2% | 35.4% | 47.9% | +16.7p | 24.1% | 37.2% | 5.0% | 1.67 | 48 | 0 | 330 | |
| STM=off | Phi-4 | Allow-unclear | 16.7% | 20.8% | 39.6% | +22.9p | 24.1% | 37.2% | 5.0% | 1.73 | 48 | 0 | 297 | |
| STM=on | DeepSeek-V3 | Forced-choice | 37.5% | 79.2% | 70.8% | +33.3p | 32.1% | 98.2% | 43.3% | 3.81 | 48 | 0 | 868 | |
| STM=on | DeepSeek-V3 | Allow-unclear | 29.2% | 62.5% | 60.4% | +31.2p | 32.1% | 98.2% | 43.3% | 3.77 | 48 | 0 | 914 | |
| STM=on | GPT-4o | Forced-choice | 43.8% | 79.2% | 77.1% | +33.3p | 32.1% | 98.2% | 43.3% | 4.77 | 48 | 0 | 1198 | |
| STM=on | GPT-4o | Allow-unclear | 45.8% | 62.5% | 68.8% | +22.9p | 32.1% | 98.2% | 43.3% | 4.71 | 48 | 0 | 1252 | |
| STM=on | GPT-4.1 | Forced-choice | 46.8% | 76.6% | 70.2% | +23.4p | 32.2% | 98.2% | 43.0% | 4.79 | 47 | 1 | 733 | |
| STM=on | GPT-4.1 | Allow-unclear | 40.4% | 72.3% | 68.1% | +27.7p | 32.2% | 98.2% | 43.0% | 4.91 | 47 | 1 | 720 | |
| STM=on | GPT-4.1-mini | Forced-choice | 58.3% | 72.9% | 66.7% | +8.3p | 32.1% | 98.2% | 43.3% | 1.90 | 48 | 0 | 1514 | |
| STM=on | GPT-4.1-mini | Allow-unclear | 52.1% | 72.9% | 62.5% | +10.4p | 32.1% | 98.2% | 43.3% | 2.17 | 48 | 0 | 1092 | |
| STM=on | GPT-5-Chat | Forced-choice | 53.2% | 72.3% | 72.3% | +19.1p | 32.2% | 98.2% | 43.0% | 3.94 | 47 | 1 | 1194 | |
| STM=on | GPT-5-Chat | Allow-unclear | 53.2% | 68.1% | 70.2% | +17.0p | 32.2% | 98.2% | 43.0% | 3.91 | 47 | 1 | 1060 | |
| STM=on | o4-mini | Forced-choice | 45.8% | 68.8% | 58.3% | +12.5p | 32.1% | 98.2% | 43.3% | 1.44 | 48 | 0 | 3113 | |
| STM=on | o4-mini | Allow-unclear | 41.7% | 62.5% | 56.2% | +14.6p | 32.1% | 98.2% | 43.3% | 1.50 | 48 | 0 | 2874 | |
| STM=on | Phi-4 | Forced-choice | 58.3% | 85.4% | 83.3% | +25.0p | 32.1% | 98.2% | 43.3% | 3.92 | 48 | 0 | 709 | |
| STM=on | Phi-4 | Allow-unclear | 39.6% | 66.7% | 68.8% | +29.2p | 32.1% | 98.2% | 43.3% | 3.71 | 48 | 0 | 623 | |
| Large | STM=off | DeepSeek-V3 | Forced-choice | 15.4% | 13.9% | 38.5% | +23.1p | 22.7% | 29.9% | 4.5% | 1.54 | 65 | 0 | 366 |
| STM=off | DeepSeek-V3 | Allow-unclear | 15.5% | 19.0% | 31.0% | +15.5p | 22.9% | 29.3% | 4.6% | 1.38 | 58 | 7 | 365 | |
| STM=off | GPT-4o | Forced-choice | 15.4% | 16.9% | 35.4% | +20.0p | 22.7% | 29.9% | 4.5% | 2.34 | 65 | 0 | 459 | |
| STM=off | GPT-4o | Allow-unclear | 7.7% | 7.7% | 30.8% | +23.1p | 22.7% | 29.9% | 4.5% | 2.32 | 65 | 0 | 441 | |
| STM=off | GPT-4.1 | Forced-choice | 15.4% | 16.9% | 33.9% | +18.5p | 22.7% | 29.9% | 4.5% | 1.95 | 65 | 0 | 480 | |
| STM=off | GPT-4.1 | Allow-unclear | 16.9% | 21.5% | 29.2% | +12.3p | 22.7% | 29.9% | 4.5% | 1.82 | 65 | 0 | 478 | |
| STM=off | GPT-4.1-mini | Forced-choice | 18.5% | 21.5% | 27.7% | +9.2p | 22.7% | 29.9% | 4.5% | 0.60 | 65 | 0 | 414 | |
| STM=off | GPT-4.1-mini | Allow-unclear | 20.0% | 18.5% | 21.5% | +1.5p | 22.7% | 29.9% | 4.5% | 0.62 | 65 | 0 | 407 | |
| STM=off | GPT-5-Chat | Forced-choice | 20.0% | 16.0% | 36.0% | +16.0p | 22.4% | 29.9% | 5.8% | 1.84 | 50 | 15 | 650 | |
| STM=off | GPT-5-Chat | Allow-unclear | 20.0% | 15.4% | 35.4% | +15.4p | 22.7% | 29.9% | 4.5% | 1.51 | 65 | 0 | 826 | |
| STM=off | o4-mini | Forced-choice | 10.8% | 13.9% | 27.7% | +16.9p | 22.7% | 29.9% | 4.5% | 0.55 | 65 | 0 | 1895 | |
| STM=off | o4-mini | Allow-unclear | 12.3% | 12.3% | 23.1% | +10.8p | 22.7% | 29.9% | 4.5% | 0.60 | 65 | 0 | 2139 | |
| STM=off | Phi-4 | Forced-choice | 18.5% | 20.0% | 30.8% | +12.3p | 22.7% | 29.9% | 4.5% | 1.15 | 65 | 0 | 345 | |
| STM=off | Phi-4 | Allow-unclear | 16.9% | 13.9% | 24.6% | +7.7p | 22.7% | 29.9% | 4.5% | 1.23 | 65 | 0 | 331 | |
| STM=on | DeepSeek-V3 | Forced-choice | 27.7% | 80.0% | 69.2% | +41.5p | 29.1% | 98.5% | 47.8% | 4.51 | 65 | 0 | 1270 | |
| STM=on | DeepSeek-V3 | Allow-unclear | 23.1% | 61.5% | 63.1% | +40.0p | 29.1% | 98.5% | 47.8% | 4.46 | 65 | 0 | 1207 | |
| STM=on | GPT-4o | Forced-choice | 36.9% | 80.0% | 83.1% | +46.2p | 29.1% | 98.5% | 47.8% | 5.51 | 65 | 0 | 1593 | |
| STM=on | GPT-4o | Allow-unclear | 33.9% | 47.7% | 58.5% | +24.6p | 29.1% | 98.5% | 47.8% | 5.43 | 65 | 0 | 1613 | |
| STM=on | GPT-4.1 | Forced-choice | 28.1% | 79.7% | 67.2% | +39.1p | 29.3% | 98.4% | 48.2% | 5.09 | 64 | 1 | 794 | |
| STM=on | GPT-4.1 | Allow-unclear | 33.3% | 55.6% | 55.6% | +22.2p | 28.9% | 98.4% | 48.0% | 4.87 | 63 | 2 | 791 | |
| STM=on | GPT-4.1-mini | Forced-choice | 36.9% | 75.4% | 55.4% | +18.5p | 29.1% | 98.5% | 47.8% | 2.29 | 65 | 0 | 1019 | |
| STM=on | GPT-4.1-mini | Allow-unclear | 35.4% | 60.0% | 47.7% | +12.3p | 29.1% | 98.5% | 47.8% | 2.20 | 65 | 0 | 946 | |
| STM=on | GPT-5-Chat | Forced-choice | 39.7% | 76.2% | 68.2% | +28.6p | 28.9% | 98.4% | 48.0% | 4.25 | 63 | 2 | 1166 | |
| STM=on | GPT-5-Chat | Allow-unclear | 39.1% | 68.8% | 65.6% | +26.6p | 29.3% | 98.4% | 48.2% | 4.31 | 64 | 1 | 982 | |
| STM=on | o4-mini | Forced-choice | 33.9% | 70.8% | 44.6% | +10.8p | 29.1% | 98.5% | 47.8% | 1.62 | 65 | 0 | 3954 | |
| STM=on | o4-mini | Allow-unclear | 32.3% | 58.5% | 46.2% | +13.9p | 29.1% | 98.5% | 47.8% | 1.54 | 65 | 0 | 4030 | |
| STM=on | Phi-4 | Forced-choice | 47.7% | 80.0% | 75.4% | +27.7p | 29.1% | 98.5% | 47.8% | 4.28 | 65 | 0 | 762 | |
| STM=on | Phi-4 | Allow-unclear | 33.9% | 50.8% | 61.5% | +27.7p | 29.1% | 98.5% | 47.8% | 4.42 | 65 | 0 | 792 | |
| STM | Model | Forced-choice GC | Allow-unclear GC |
|---|---|---|---|
| STM=off | DeepSeek-V3 | +22.0p | +16.3p |
| STM=off | GPT-4o | +23.5p | +19.9p |
| STM=off | GPT-4.1 | +20.7p | +12.4p |
| STM=off | GPT-4.1-mini | +4.6p | +4.9p |
| STM=off | GPT-5-Chat | +15.4p | +16.2p |
| STM=off | o4-mini | +15.8p | +10.6p |
| STM=off | Phi-4 | +14.5p | +15.3p |
| STM=on | DeepSeek-V3 | +37.4p | +35.6p |
| STM=on | GPT-4o | +39.7p | +23.8p |
| STM=on | GPT-4.1 | +31.2p | +24.9p |
| STM=on | GPT-4.1-mini | +13.4p | +11.4p |
| STM=on | GPT-5-Chat | +23.9p | +21.8p |
| STM=on | o4-mini | +11.6p | +14.2p |
| STM=on | Phi-4 | +26.3p | +28.4p |
| Dataset | STM | Recallold | Recallnew | Recalldis | Cells |
|---|---|---|---|---|---|
| Medium | STM=off | 24.1% | 37.4% | 5.0% | 14/6 |
| Medium | STM=on | 32.1% | 98.2% | 43.2% | 14/6 |
| Large | STM=off | 22.7% | 29.9% | 4.6% | 14/6 |
| Large | STM=on | 29.1% | 98.5% | 47.9% | 14/6 |
| STM | Model | Mode | Avg. Shadows Removed | Datasets |
|---|---|---|---|---|
| STM=off | DeepSeek-V3 | Forced-choice | 1.64 | 2/2 |
| STM=off | DeepSeek-V3 | Allow-unclear | 1.57 | 2/2 |
| STM=off | GPT-4o | Forced-choice | 2.30 | 2/2 |
| STM=off | GPT-4o | Allow-unclear | 2.25 | 2/2 |
| STM=off | GPT-4.1 | Forced-choice | 1.84 | 2/2 |
| STM=off | GPT-4.1 | Allow-unclear | 1.75 | 2/2 |
| STM=off | GPT-4.1-mini | Forced-choice | 0.76 | 2/2 |
| STM=off | GPT-4.1-mini | Allow-unclear | 0.75 | 2/2 |
| STM=off | GPT-5-Chat | Forced-choice | 1.77 | 2/2 |
| STM=off | GPT-5-Chat | Allow-unclear | 1.58 | 2/2 |
| STM=off | o4-mini | Forced-choice | 0.74 | 2/2 |
| STM=off | o4-mini | Allow-unclear | 0.75 | 2/2 |
| STM=off | Phi-4 | Forced-choice | 1.41 | 2/2 |
| STM=off | Phi-4 | Allow-unclear | 1.48 | 2/2 |
| STM=on | DeepSeek-V3 | Forced-choice | 4.16 | 2/2 |
| STM=on | DeepSeek-V3 | Allow-unclear | 4.12 | 2/2 |
| STM=on | GPT-4o | Forced-choice | 5.14 | 2/2 |
| STM=on | GPT-4o | Allow-unclear | 5.07 | 2/2 |
| STM=on | GPT-4.1 | Forced-choice | 4.94 | 2/2 |
| STM=on | GPT-4.1 | Allow-unclear | 4.89 | 2/2 |
| STM=on | GPT-4.1-mini | Forced-choice | 2.09 | 2/2 |
| STM=on | GPT-4.1-mini | Allow-unclear | 2.19 | 2/2 |
| STM=on | GPT-5-Chat | Forced-choice | 4.09 | 2/2 |
| STM=on | GPT-5-Chat | Allow-unclear | 4.11 | 2/2 |
| STM=on | o4-mini | Forced-choice | 1.53 | 2/2 |
| STM=on | o4-mini | Allow-unclear | 1.52 | 2/2 |
| STM=on | Phi-4 | Forced-choice | 4.10 | 2/2 |
| STM=on | Phi-4 | Allow-unclear | 4.06 | 2/2 |
| Dataset | Model | Mode | Std. RAG | Timestamp | GC-Mem | Winner | Gap |
|---|---|---|---|---|---|---|---|
| Medium | DeepSeek-V3 | Forced-choice | 37.5% | 79.2% | 70.8% | Timestamp | +8.3pp |
| DeepSeek-V3 | Allow-unclear | 29.2% | 62.5% | 60.4% | Timestamp | +2.1pp | |
| GPT-4o | Forced-choice | 43.8% | 79.2% | 77.1% | Timestamp | +2.1pp | |
| GPT-4o | Allow-unclear | 45.8% | 62.5% | 68.8% | GC-Mem | +6.2pp | |
| GPT-4.1 | Forced-choice | 46.8% | 76.6% | 70.2% | Timestamp | +6.4pp | |
| GPT-4.1 | Allow-unclear | 40.4% | 72.3% | 68.1% | Timestamp | +4.3pp | |
| GPT-4.1-mini | Forced-choice | 58.3% | 72.9% | 66.7% | Timestamp | +6.2pp | |
| GPT-4.1-mini | Allow-unclear | 52.1% | 72.9% | 62.5% | Timestamp | +10.4pp | |
| GPT-5-Chat | Forced-choice | 53.2% | 72.3% | 72.3% | Tie | 0.0pp | |
| GPT-5-Chat | Allow-unclear | 53.2% | 68.1% | 70.2% | GC-Mem | +2.1pp | |
| o4-mini | Forced-choice | 45.8% | 68.8% | 58.3% | Timestamp | +10.4pp | |
| o4-mini | Allow-unclear | 41.7% | 62.5% | 56.2% | Timestamp | +6.2pp | |
| Phi-4 | Forced-choice | 58.3% | 85.4% | 83.3% | Timestamp | +2.1pp | |
| Phi-4 | Allow-unclear | 39.6% | 66.7% | 68.8% | GC-Mem | +2.1pp | |
| Large | DeepSeek-V3 | Forced-choice | 27.7% | 80.0% | 69.2% | Timestamp | +10.8pp |
| DeepSeek-V3 | Allow-unclear | 23.1% | 61.5% | 63.1% | GC-Mem | +1.5pp | |
| GPT-4o | Forced-choice | 36.9% | 80.0% | 83.1% | GC-Mem | +3.1pp | |
| GPT-4o | Allow-unclear | 33.9% | 47.7% | 58.5% | GC-Mem | +10.8pp | |
| GPT-4.1 | Forced-choice | 28.1% | 79.7% | 67.2% | Timestamp | +12.5pp | |
| GPT-4.1 | Allow-unclear | 33.3% | 55.6% | 55.6% | Tie | 0.0pp | |
| GPT-4.1-mini | Forced-choice | 36.9% | 75.4% | 55.4% | Timestamp | +20.0pp | |
| GPT-4.1-mini | Allow-unclear | 35.4% | 60.0% | 47.7% | Timestamp | +12.3pp | |
| GPT-5-Chat | Forced-choice | 39.7% | 76.2% | 68.2% | Timestamp | +7.9pp | |
| GPT-5-Chat | Allow-unclear | 39.1% | 68.8% | 65.6% | Timestamp | +3.1pp | |
| o4-mini | Forced-choice | 33.9% | 70.8% | 44.6% | Timestamp | +26.2pp | |
| o4-mini | Allow-unclear | 32.3% | 58.5% | 46.2% | Timestamp | +12.3pp | |
| Phi-4 | Forced-choice | 47.7% | 80.0% | 75.4% | Timestamp | +4.6pp | |
| Phi-4 | Allow-unclear | 33.9% | 50.8% | 61.5% | GC-Mem | +10.8pp |
| Dataset | STM | Mean Wall Time (s) | Per-instance (s) | Avg. Shadows | Cells |
|---|---|---|---|---|---|
| Medium | STM=off | 525 | 10.9 | 1.55 | 14/6 |
| Medium | STM=on | 1276 | 26.6 | 3.52 | 14/6 |
| Large | STM=off | 685 | 10.5 | 1.39 | 14/6 |
| Large | STM=on | 1494 | 23.0 | 3.91 | 14/6 |
A.3 Primary Benchmark Figures
A.4 Example Prompt
A.5 Bag-of-Facts (No-Retrieval) Ablation
| Dataset | Mean Std | Mean TS | Mean GC | Mean GC | (GC) | ||
|---|---|---|---|---|---|---|---|
| Medium | 48 | 20.4% | 10.7 | 18.5% | 55.2% | +34.8p | 12.2 |
| Large | 65 | 12.1% | 4.2 | 11.7% | 36.5% | +24.4p | 11.6 |
| Model | Dataset | Std. RAG | Timestamp | GC-Mem | GC | Shadows | |
|---|---|---|---|---|---|---|---|
| DeepSeek-V3 | Medium | 14.6% | 12.5% | 56.2% | +41.7p | 13.58 | 48 |
| Large | 9.2% | 12.3% | 52.3% | +43.1p | 12.98 | 65 | |
| GPT-4o | Medium | 16.7% | 18.8% | 60.4% | +43.8p | 16.67 | 48 |
| Large | 9.2% | 6.2% | 46.2% | +36.9p | 14.72 | 65 | |
| GPT-4.1 | Medium | 21.7% | 15.2% | 60.9% | +39.1p | 13.02 | 48 |
| Large | 14.1% | 9.4% | 31.2% | +17.2p | 10.47 | 65 | |
| GPT-4.1-mini | Medium | 14.6% | 18.8% | 37.5% | +22.9p | 7.42 | 48 |
| Large | 7.7% | 7.7% | 24.6% | +16.9p | 5.14 | 65 | |
| GPT-5-Chat | Medium | 39.1% | 21.7% | 71.7% | +32.6p | 13.39 | 48 |
| Large | 17.5% | 11.1% | 44.4% | +27.0p | 10.52 | 65 | |
| o4-mini | Medium | 29.2% | 31.2% | 43.8% | +14.6p | 7.25 | 48 |
| Large | 9.2% | 15.4% | 23.1% | +13.9p | 5.17 | 65 | |
| Phi-4 | Medium | 7.0% | 11.6% | 55.8% | +48.8p | 14.02 | 48 |
| Large | 17.6% | 19.6% | 33.3% | +15.7p | 13.45 | 65 |
| Rank | Model | Mean Std. RAG | Mean GC-Mem | Mean GC | Mean Shadows |
|---|---|---|---|---|---|
| 1 | DeepSeek-V3 | 11.9% | 54.3% | +42.4p | 13.28 |
| 2 | GPT-4o | 12.9% | 53.3% | +40.3p | 15.70 |
| 3 | Phi-4 | 12.3% | 44.6% | +32.3p | 13.73 |
| 4 | GPT-5-Chat | 28.3% | 58.1% | +29.8p | 11.96 |
| 5 | GPT-4.1 | 17.9% | 46.1% | +28.2p | 11.75 |
| 6 | GPT-4.1-mini | 11.1% | 31.1% | +19.9p | 6.28 |
| 7 | o4-mini | 19.2% | 33.4% | +14.2p | 6.21 |
| Model | Chat-RAG no-STM | Chat-RAG STM-on | Bag-of-facts (k=) |
|---|---|---|---|
| DeepSeek-V3 | +18.9p | +32.3p | +41.7p |
| GPT-5-Chat | +16.0p | +18.1p | +32.6p |
| Phi-4 | +19.8p | +27.1p | +48.8p |
Appendix B Mathematical Proofs
B.1 Proof of Theorem 1: Asymptotic Recall Decay
Proof.
Let the total memory stream contain chunks asserting the stale state and chunks asserting the valid state . Under the Accumulation Hypothesis (Assumption 3.3), .
We model the retrieval of top- chunks as sampling without replacement from the population . Let be the random variable denoting the number of valid chunks () successfully retrieved. If retrieval were purely uniform, would follow a hypergeometric distribution:
| (5) |
The expected value is .
However, dense retrievers utilize cosine similarity over high-dimensional embeddings. Under Semantic Equivalence (Lemma 3.2), . Because constitutes the vast majority of the embedded semantic space, dense retrieval exhibits a structural bias towards the denser centroid of phrasings. Therefore, the hypergeometric expected value serves as a strict theoretical upper bound.
Taking the limit as the interaction history scales:
| (6) |
As , the probability of retrieving zero valid evidence () approaches 1, proving Asymptotic Recall Decay. ∎
B.2 Proof of Theorem 2: The Majority Vote Trap
Proof.
Assume the retriever successfully circumvents Theorem 1 and retrieves a mixed context containing valid chunk () and stale chunks ().
During generation, the LLM utilizes scaled dot-product attention. Let denote the attention weight assigned to chunk . Under Lemma 3.2, the semantic embeddings of and are equivalent up to . Consequently, the query vector yields roughly identical dot-products across all chunks.
Applying the softmax function over these practically uniform logits results in a non-discriminating attention distribution:
| (7) |
The final generation probability for a state is the sum of the attention mass corresponding to the chunks asserting that state.
| (8) |
| (9) |
For any typical retrieval window (), . The probability mass overwhelmingly favors the stale state. Thus, even when valid evidence is perfectly retrieved, generation collapses due to attention dilution, proving the Majority Vote Trap. ∎