Uncovering Grounding IDs: How External Cues Shape Multimodal Binding
Extracted source text · arXiv 2509.24072
\documentclass{article} % For LaTeX2e
\usepackage{iclr2026_conference,times}
\input{math_commands.tex}
\usepackage{hyperref}
\usepackage{url}
\usepackage{float} % for [H]
\usepackage{needspace} % to keep text+figure together
\usepackage{booktabs} % professional-quality tables
\usepackage{amsfonts} % blackboard math symbols
\usepackage{nicefrac} % compact symbols for 1/2, etc.
\usepackage{microtype} % microtypography
\RequirePackage[dvipsnames]{xcolor}
\usepackage{amssymb}
\usepackage{amsmath}
\usepackage{wrapfig}
\usepackage{algorithm}
\usepackage{algpseudocode}
\usepackage{subcaption}
\usepackage{multirow}
\usepackage{placeins}
\usepackage{graphicx}
\usepackage{array} % For better column definitions
\usepackage{caption} % For caption customization
\usepackage{colortbl} % For coloring table rows and columns
\usepackage{tabularx}
\usepackage{geometry}
\usepackage{diagbox}
\usepackage{arydshln}
\title{Uncovering Grounding IDs:\\How External Cues Shape Multi-Modal Binding}
\author{\textbf{Hosein Hasani}\thanks{Equal contribution.} \;,
\textbf{Amirmohammad Izadi}\footnotemark[1] \;,
\textbf{Fatemeh Askari}\footnotemark[1] \;,
\textbf{Mobin Bagherian}\footnotemark[1] \;, \\
\textbf{Sadegh Mohammadian},
\textbf{Mohammad Izadi},
\textbf{and Mahdieh Soleymani Baghshah} \vspace{2mm} \\
Department of Computer Engineering, Sharif University of Technology
}
\newcommand{\fix}{\marginpar{FIX}}
\newcommand{\new}{\marginpar{NEW}}
\newcommand{\mybullet}[2]{\textbullet\ \textbf{#1}: #2\\}
\iclrfinalcopy % Uncomment for camera-ready version, but NOT for submission.
\begin{document}
\maketitle
\vspace{-2.5mm}
\begin{abstract}
\vspace{-2.5mm}
Large vision–language models (LVLMs) show strong performance across multimodal benchmarks but remain limited in structured reasoning and precise grounding. Recent work has demonstrated that adding simple visual structures, such as partitions and annotations, improves accuracy, yet the internal mechanisms underlying these gains remain unclear. We investigate this phenomenon and propose the concept of \textit{Grounding IDs}, latent identifiers induced by external cues that bind objects to their designated partitions across modalities. Through representation analysis, we find that these identifiers emerge as robust within-partition alignment in embedding space and reduce the modality gap between image and text. Causal interventions further confirm that these identifiers mediate binding between objects and symbolic cues.
We show that Grounding IDs strengthen attention between related components, which in turn improves cross-modal grounding and reduces hallucinations.
Taken together, our results identify Grounding IDs as a key symbolic mechanism that explains how external cues enhance multimodal binding and offers both interpretability and practical improvements in robustness.
\end{abstract}
\vspace{-2.5mm}
\section{Introduction}
Large vision–language models (LVLMs) such as LLaVA \citep{llava}, GPT-4V \citep{gpt4}, and Qwen-VL \citep{qwen_vl} have achieved strong results in multimodal tasks, including image captioning, visual question answering, and embodied tasks. Despite this progress, they remain limited in structured reasoning \citep{binding_problem}, precise grounding, and hallucination \citep{hallucination_survey}.
Very recent studies suggest that external visual structure can systematically improve LVLM reasoning. For instance, \citet{forgotten_polygons} reveal that many LVLMs struggle with basic polygon identification, while adding shape annotations substantially boosts accuracy. Notably, \textit{VISER} \citep{viser} introduces more general visual structure (e.g., grids or horizontal lines) and demonstrates consistent gains across diverse reasoning tasks. Despite compelling advancements, the interpretability and mechanism-level understanding of this phenomenon remain underexplored. Prior work has largely focused on \textbf{what} visual structure can enhance reasoning, but not \textbf{how} it helps.
% leaving a critical open question: \textit{how do LVLMs internally leverage additional visual cues to enhance reasoning?}
% paragraph 3: Gap in interpretability, Our Hypothesis and Contribution: Grounding IDs, Overview of Methodology & Key Findings
To bridge this critical understanding gap, we introduce \textbf{Grounding IDs}—symbolic multimodal identifiers induced by external cues. Our central hypothesis is that structured symbols, presented either visually (e.g., row labels, partitions) or textually (e.g., prompts instructing symbol-based scanning), lead LVLMs to internally generate identifiers that bind objects to their designated partitions. These Grounding IDs propagate through embeddings and attention, enabling consistent correspondence within and across modalities.
We validate this hypothesis through several analyses. First, observational probes show that Grounding IDs shape attention, reinforcing partition-level dynamics across modalities. Alignment experiments further reveal that symbolic cues strengthen within-partition binding and reduce the modality gap. Second, causal interventions confirm that external cues become causally bound to multimodal object tokens through Grounding IDs.
Beyond interpretability, we extend prior work on simple scaffolds (e.g., horizontal lines) to diverse and more effective cues such as digits and character symbols. Furthermore, our ablations demonstrate that both visual and textual cues contribute to binding, with their combination yielding the strongest improvements for cross-modal grounding. Finally, we demonstrate the practical utility of Grounding IDs by showing that enhanced cross-modal attention substantially reduces hallucinations in LVLMs. Overall, these results identify Grounding IDs as a core mechanism of partition-based binding, providing both mechanistic insight into LVLM reasoning and practical gains in robustness.
% Our main contributions are as follows:
\begin{figure}[t]
\centering
\includegraphics[width=0.83\linewidth]{figs/graphical_abstract.pdf}
\vspace{-2.5mm}
\caption{
Conceptual overview of \textbf{Grounding IDs}.
An input image is augmented with simple visual cues (e.g., \{@, \#, \$\}) and paired with a prompt that explicitly includes these symbols.
Embeddings with the same Grounding IDs are displayed in matching colors across modalities, illustrating the binding between partitions and their corresponding textual descriptions.
}
\vspace{-3.5mm}
\label{fig:graphical_abstract}
\end{figure}
\vspace{-2.5mm}
\section{Background and Hypotheses}
% \section{The Grounding ID Hypothesis}
Earlier studies show that adding external artifacts, combined with chain-of-thought (CoT) style prompting, can substantially enhance the reasoning abilities of vision–language models by shifting them from one-pass perception toward more systematic, system-2-like processing. \citet{forgotten_polygons} demonstrated that LVLMs are often “shape-blind”: their vision encoders cluster frequent shapes but fail to distinguish less common ones, leading to errors in side counting and geometric reasoning. Explicit cues, such as annotated edges, encourage more deliberate strategies and yield large accuracy gains. \textit{VISER} \citep{viser} generalizes this idea beyond polygons by introducing versatile and input-agnostic visual structure, such as horizontal lines, paired with sequential scanning prompts that promote structured reasoning. This approach reduces feature binding errors, encourages serial scene parsing, and consistently improves performance across reasoning tasks like counting and visual search.
Building on this foundation, our work probes the internal circuits through which simple external artifacts shape visual reasoning in LVLMs.
Recent advances in mechanistic interpretability show that LLMs solve entity–attribute binding using \textbf{Binding IDs}, latent vectors that link entities with their attributes \citep{binding_id}. Causal mediation analyses support this finding and further show that these identifiers behave additively in representation space. Follow-up work extends this idea to vision–language models, showing that they employ similar vectors linking visual objects with textual references \citep{vision_binding_id}, with properties such as factorizability and position independence.
Inspired by the notion of such abstract identifiers, we investigate the underlying circuit by which external visual structures equipped with textual cues enhance LVLMs’ reasoning.
In this work, we aim to answer a key open question: \textit{why do external cues improve reasoning in LVLMs?} We focus on the observation that when images and prompts are augmented with simple cues that partition them into distinct regions, LVLMs show improved performance on diverse reasoning tasks. The models appear to internally generate abstract identifiers that bind objects to their respective partitions, thereby supporting more systematic visual scanning.
Fig.~\ref{fig:graphical_abstract} illustrates how these identifiers emerge both in representations of partitioned areas and in the generated textual descriptions of those partitions. We refer to these identifiers as Grounding IDs since this partition-based binding enhances multimodal grounding.
In particular, this study seeks to validate the following hypotheses:\\
\mybullet{Existence}{Augmenting the inputs with external cues induce Grounding IDs that propagate through embeddings and attention, establishing within-partition binding across modalities.}
\mybullet{Modality Gap}{Grounding IDs reduce the alignment gap between image and text representations of corresponding tokens.}
\mybullet{Causal Relation}{Grounding IDs link objects to external cues in a causal manner, amplifying embedding alignment and increasing attention between connected parts.}
[0.4em]
To evaluate these hypotheses, the remainder of the paper is organized as follows. In Section~\ref{sec:existence}, we probe model representations and internal dynamics to provide empirical evidence for Grounding IDs, showing how they shape attention patterns and reduce the modality gap. Section~\ref{sec:causality} presents causal intervention experiments that directly test whether Grounding IDs mediate object–cue binding.
Finally, Section~\ref{sec:hallucination} explores the practical implications, demonstrating that enhancing cross-modal binding through Grounding IDs reduces hallucinations in LVLMs.
% These analyses provide converging evidence that external cues induce Grounding IDs, which serve as a core mechanism for partition-based binding in LVLMs.
\section{Empirical Evidence for Existence of Grounding IDs} \label{sec:existence}
% \section{Existence of Grounding IDs (Observational Evidence)}
% \subsection{Experimental Setup}
To investigate why external cues improve performance, we first analyze internal attention patterns of LVLMs. We construct a controlled synthetic dataset where each image contains 15 unique objects, sampled from 35 shape–color combinations (7 shapes $\times$ 5 colors). The model, Qwen2.5-VL \citep{qwen2.5_vl}, is tasked with generating scene descriptions. As external cues, we add symbols (\&, \#, \$, @) to both the image and the prompt, and separate the image into four partitions using three horizontal lines (Fig.~\ref{fig:attention_mat}).
%These symbolic labels represent a new type of visual cue introduced in this work.
Ablations on alternative cue designs are provided in the appendix.
To analyze embeddings and attention, each token must be paired with its counterpart from the other modality and assigned to the corresponding partition. Visual tokens are grouped according to their position within the four rows. Text tokens are mapped to visual objects using regular expressions, aided by the fact that objects are unique within each image. This yields a partition pseudo-label for every visual and textual token, indicating the partition to which it belongs.
\begin{figure}[htb]
\centering
\begin{subfigure}{0.2\textwidth}
\includegraphics[width=\linewidth]{figs/synthetic_example_baseline.pdf}
\end{subfigure}
\hspace{0.02\textwidth}
\begin{subfigure}{0.21\textwidth}
\includegraphics[width=\linewidth]{figs/attention_v2v_baseline.pdf}
\vspace{-4.5mm}
\end{subfigure}
\hspace{0.02\textwidth}
\begin{subfigure}{0.21\textwidth}
\includegraphics[width=\linewidth]{figs/attention_t2v_baseline.pdf}
\vspace{-4.5mm}
\end{subfigure}
\vspace{0.1cm}
\begin{subfigure}{0.2\textwidth}
\includegraphics[width=\linewidth]{figs/synthetic_example_structured.pdf}
\caption{}
\end{subfigure}
\hspace{0.02\textwidth}
\begin{subfigure}{0.21\textwidth}
\includegraphics[width=\linewidth]{figs/attention_v2v_structured.pdf}
\vspace{-6.5mm}
\caption{}
\end{subfigure}
\hspace{0.02\textwidth}
\begin{subfigure}{0.21\textwidth}
\includegraphics[width=\linewidth]{figs/attention_t2v_structured.pdf}
\vspace{-6.5mm}
\caption{}
\end{subfigure}
\caption{
Illustration of attention patterns under baseline and structured inputs.
(a) One dataset sample (top: baseline, bottom: structured).
(b) Within-modality visual attention matrices.
(c) Cross-modality attention matrices.
Values are averaged over 100 samples and layers 22--27 of Qwen2.5-VL.
}
\label{fig:attention_mat}
\end{figure}
\begin{figure}[htb]
\centering
\begin{subfigure}{0.46\linewidth}
\centering
\includegraphics[width=\linewidth]{figs/alignment_across_layers.pdf}
\caption{}
\label{fig:swap_example}
\end{subfigure}
\hspace{0.03\textwidth}
\begin{subfigure}{0.29\linewidth}
\centering
\includegraphics[width=\linewidth]{figs/modality_gap.pdf}
\caption{}
\label{fig:swap_result}
\end{subfigure}
\vspace{-0.5mm}
\caption{
Analysis of the modality gap.
(a) Cross-modal alignment across layers, averaged over 100 samples, showing that improvements emerge in layers 22--27.
(b) Average alignment in layers 22--27, reported separately for four partitions.
Object embeddings under structured inputs achieve higher alignment than the baseline (dashed line), and symbol embeddings achieve even stronger alignment than objects.
}
\label{fig:alignment_mat}
\end{figure}
\paragraph{Attention Analysis.}
For each token, we take the maximum attention score over all heads and then average across tokens within each partition, yielding a $4 \times 4$ matrix. Fig.~\ref{fig:attention_mat} shows both within-modality and cross-modality attention matrices for baseline and structured inputs. Structured inputs exhibit stronger diagonal dominance, with attention concentrated within partitions.
The same trend appears in cross-modal attention between visual and textual tokens, where structured inputs achieve stronger cross-attention than baselines. These results indicate that external cues induce systematic partition-based binding in the model’s attention.
\paragraph{Modality Gap.}
While attention captures binding structure, embedding similarity provides a complementary view of alignment between modalities. We measure cosine similarity between L2-normalized visual and textual embeddings corresponding to correctly generated object tokens. Similarities are computed layer-wise and averaged across samples. Both baseline and structured inputs show alignment strengthening in later layers (after layer 20). Structured inputs consistently achieve higher similarity, particularly in the last four layers, as shown in Fig.~\ref{fig:alignment_mat}. This confirms that external cues reduce the modality gap in VLMs \citep{modality_gap} by enhancing cross-modal alignment. In particular, cosine similarity between activation patches corresponding to external symbols across modalities is higher than that of dataset objects.
\begin{figure}[t]
\centering
\begin{subfigure}{0.58\linewidth}
\centering
\includegraphics[width=\linewidth]{figs/intervention_example.pdf}
\vspace{-2.5mm}
\caption{}
\label{fig:swap_example}
\end{subfigure}
\hspace{0.03\textwidth}
\begin{subfigure}{0.37\linewidth}
\centering
\includegraphics[width=\linewidth]{figs/intervention_log_probs.pdf}
\vspace{-2.5mm}
\caption{}
\label{fig:swap_result}
\end{subfigure}
\vspace{-0.5mm}
\caption{Activation swap experiment.
(a) Procedure in a case where source ($c'$) and target ($c$) contain the same objects.
Activations from the \& and @ partitions of $c'$ are patched into $c$, producing the patched context $c^*$. Predictions in $c^*$ follow the transferred bindings (gray) rather than host symbols.
(b) Average log-probabilities of $c$ and $c^*$ over valid row–symbol–object combinations. Rows and columns indicate the two selected query symbols and their corresponding objects.
}
\label{fig:swap_intervention}
\end{figure}
\section{Causal Evidence of Grounding IDs} \label{sec:causality}
The alignment and attention analyses in Section~\ref{sec:existence} provide correlational evidence that external cues induce partition-based alignment. Our hypothesis is that \textit{Grounding IDs} act as abstract vectors that are induced to related tokens across modalities, increasing alignment and grounding. We now seek causal validation.
For causal mediation analysis, we use a simplified synthetic dataset in which each image contains four rows with one object per row. Rows are labeled with non-ordinal symbols (\&, \#, \$, @) to prevent sequential order cues. The task is discriminative visual question answering: the prompt asks, for example, "What is in row @?", and the model must respond "red circle."
To formalize notation, let us define $\textbf{o}^{s_j}_{s_i}$ as an object $\textbf{o}$ that is located in the partition associated with symbol $s_i$ and bound to symbol $s_j$.
For example, $\textbf{o}^{\$}_{\&}$ denotes an object positioned in the \& partition but bound to \$.
For convenience, we use two shorthand cases: (1) $\textbf{o}^{\sim s}_{s}$ for an object located in the partition of $s$ but bound to a different symbol, and (2) $\textbf{o}^{s}_{\sim s}$ for an object bound to $s$ but located in a different partition.
\subsection{Activation Swapping Experiment}
We follow a causal mediation framework similar to prior studies \citep{vig2020investigating, binding_id}. Two images $c$ and $c'$ are randomly sampled, and their activations are extracted across all layers. We then select two random symbols (e.g., \$ and \#) and swap their corresponding object patch activations between the two contexts. For instance, the object in row~\$ of $c'$ is inserted into row~\# of $c$, while the object in row~\# of $c'$ is patched into row~\$. We pass the patched input $c^{*}$ to the model and record its predictions for the selected symbols.
Fig.~\ref{fig:swap_example} shows a simple case where the swapped objects are the same between $c$ and $c'$.
We intentionally choose the swap strategy to avoid ambiguity arising from the coexistence of $\textbf{o}^{s}_{\sim s}$ and $\textbf{o}^{s}_{s}$.
We find that predictions consistently follow the binding symbols of the swapped objects rather than the symbols present locally in the host context. In other words, for a given partition $s$, the model outputs $\textbf{o}^{s}_{\sim s}$ instead of $\textbf{o}^{\sim s}_{s}$. For example, if the object in row~@ of $c'$ is a green square and it is inserted into row~\& of $c$, the model reports a green square for row~@ even though that object is located beside \&.
This indicates that the model disregards local cues and follows the transferred symbol–object binding (Fig.~\ref{fig:swap_example}).
To quantify this effect across the dataset, we consider all valid swaps (across possible objects, symbols, and locations) and measure average accuracy. If we follow the standard setting without intervention and treat $\textbf{o}^{(\cdot)}_{s}$ as the correct label, accuracy drops sharply from $\mathbf{1.00}$ to $\mathbf{0.02}$ after swapping. In contrast, if we treat $\textbf{o}^{s}_{\sim s}$ as the correct label (i.e., prediction based on transferred bindings), accuracy remains high at $\mathbf{0.98}$, confirming that predictions follow Grounding IDs; thus, object–symbol bindings are causally mediated by these IDs.
Fig.~\ref{fig:swap_result} shows the average log-probability of predicted objects before and after activation swapping.
% To further quantify the model’s confidence in Grounding IDs rather than local visual symbols, we compute the logit difference between $\textbf{o}^{s}_{\sim s}$ and $\textbf{o}^{\sim s}_{s}$ across dataset samples. The average differences are $5 \pm 0.5$ for color and $4 \pm 0.5$ for shape, both of which are significantly greater than zero.
\begin{figure}[t]
\centering
\begin{subfigure}{0.45\linewidth}
\centering
\includegraphics[width=\linewidth]{figs/intervention_logit_lens.pdf}
\vspace{-5mm}
\caption{}
\label{fig:intervention:logit_lens}
\end{subfigure}
\hfill
\begin{subfigure}{0.5\linewidth}
\centering
\includegraphics[width=\linewidth]{figs/intervention_attention_heatmap.pdf}
\vspace{-5mm}
\caption{}
\label{fig:intervention:attention_heatmap}
\end{subfigure}
\vspace{-2mm}
\caption{
Causal mediation analysis across layers.
(a) Average logit differences between $\textbf{o}^{s}_{\sim s}$ and $\textbf{o}^{\sim s}_{s}$ across layers.
(b) Layer- and head-wise signal-to-noise of attention differences between $\textbf{o}^{s}_{\sim s}$ and $\textbf{o}^{\sim s}_{s}$ patches.
}
\label{fig:intervention_layerwise}
\end{figure}
Next, we investigate in which layers the model begins to predict the intervened grounded object ($\textbf{o}^{s}_{\sim s}$) rather than the adjacent object ($\textbf{o}^{\sim s}_{s}$). We apply the logit lens technique \citep{nostalgebraist20_logit_lens} to the single-word response token (using a monochrome dataset for simplicity). By computing the logit difference between the $\textbf{o}^{s}_{\sim s}$ and $\textbf{o}^{\sim s}_{s}$ and plotting averaged values across layers (Fig.~\ref{fig:intervention:logit_lens}), we find that the model shifts toward predicting the intervened grounded object in the later layers (20–27).
We also investigate which attention heads are most responsible for propagating Grounding IDs as opposed to relying on local visual proximity. For each head and layer, we compute the difference in attention from the response token to visual tokens corresponding to $\textbf{o}^{s}_{\sim s}$ versus $\textbf{o}^{\sim s}_{s}$ across samples. To quantify consistency, we divide the mean difference by its standard deviation, yielding a signal-to-noise ratio that reflects how reliably a head prefers grounded objects. To emphasize attention to meaningful regions, this ratio is multiplied by the head’s average attention weight.
The resulting scores are visualized in Fig.~\ref{fig:intervention:attention_heatmap}, showing that Grounding IDs cause significant attention shifts in certain heads, particularly in layer 16, which attends more to grounded objects.
\subsection{The Characteristics of Grounding IDs}
% Activation swap with disjoint symbols
\begin{figure}[H]
\centering
\begin{minipage}{0.602\textwidth}
\citet{binding_id} shows that in LLMs, Binding IDs linking entities and their attributes are largely context independent. In contrast, our causal mediation experiment demonstrates that Grounding IDs are directly predictable from their corresponding symbols. To probe this relationship, we analyze the relational structure of symbols and their induced Grounding IDs. Concretely, for each pair of symbols (e.g., \&, \#), we compute the difference between their symbol patch activations. For the same pairs, we also compute the difference between the corresponding object patch activations. Averaging these differential vectors across the dataset cancels out confounding factors such as shape and position, yielding two structured spaces: one defined by symbol differences, and one by Grounding ID differences.
Fig.~\ref{fig:grounding_alignment} reports cosine similarities between these two spaces, revealing strong correspondence between the symbol space and the Grounding ID space.
\end{minipage}%
\hfill
\begin{minipage}{0.387\textwidth}
\includegraphics[width=\linewidth]{figs/grounding_alignment.pdf}
\caption{Cosine similarity between averaged differential vectors of symbol patches and their corresponding Grounding IDs.}
\label{fig:grounding_alignment}
\end{minipage}
\end{figure}
To further assess this conjecture, we repeat the activation swap experiment but assign the target image a disjoint set of symbols (e.g., ${+, \times, \%, !}$) that do not overlap with those in the source ($c'$). After activation patching, we query the model in $c^*$ using source symbols (e.g., \&). Surprisingly, the model correctly outputs the object bound to the source symbol, even though no explicit occurrence of the symbol \& is present in the host context. The average prediction accuracy reaches $\mathbf{0.86}$, which is considerably higher than the random chance level.
Overall, these experiments clarify the nature of Grounding IDs from complementary perspectives.
\section{Implications of Grounding IDs: Hallucination Reduction} \label{sec:hallucination}
In Section~\ref{sec:existence}, we reported overall attention enhancement across the bound partitions. To test whether this partition-based effect also helps LVLMs remain focused on the image in long responses, we measure cross-attention during generation.
Using the same synthetic dataset as in Section~\ref{sec:existence}, the model is asked to produce detailed descriptions of each image based on the provided external cues.
We compute cross-attention from generated tokens to image patches using a sliding window, taking the maximum value within each window of size 5.
Plotting these values against token position (Fig.~\ref{fig:attention_span_synthetic}) reveals a consistent decline: tokens appearing later in the response attend less to the image, indicating that visual grounding diminishes as generation progresses.
Importantly, the structured baseline shows both higher initial attention and a slower rate of decline compared to the baseline. This indicates that external cues sustain grounding over longer spans of text.
\begin{figure}[t]
\centering
\begin{minipage}{0.37\linewidth}
\centering
\includegraphics[width=\linewidth]{figs/attention_span_synthetic.pdf}
\caption{Cross-attention behavior on the synthetic dataset with 20 objects, averaged over 100 samples. Attention is computed using a max operation with a window size of 5 and stride of 1 across generated tokens.}
\label{fig:attention_span_synthetic}
\end{minipage}\hfill
\begin{minipage}{0.60\linewidth}
\centering
\captionof{table}{Evaluation of the scene description task on synthetic datasets, each containing 100 samples with 10, 15, or 20 unique objects per image.}
\label{tab:synthetic_hallucination}
\resizebox{\linewidth}{!}{%
\begin{tabular}{l l c c c c}
\toprule
\textbf{\# {\small Objects}} & \textbf{Method} & \textbf{Precision} & \textbf{Recall} & \textbf{F1} & \textbf{Accuracy} \\
\midrule
\multirow{4}{*}{\textbf{10}} & Baseline & 0.56 & \underline{0.60} & 0.58 & 0.41 \\
& {\small Structured (text-only)} & 0.57 & \textbf{0.61} & \underline{0.59} & \underline{0.42} \\
& {\small Structured (image-only)} & \underline{0.60} & 0.56 & 0.58 & 0.40 \\
& \textbf{Structured} & \textbf{0.74} & 0.58 & \textbf{0.65} & \textbf{0.48} \\
\midrule
\multirow{4}{*}{\textbf{15}} & Baseline & 0.30 & \underline{0.49} & 0.37 & 0.22 \\
& {\small Structured (text-only)} & 0.37 & \textbf{0.53} & \underline{0.50} & \underline{0.27} \\
& {\small Structured (image-only)} & \underline{0.40} & 0.47 & 0.43 & \underline{0.27} \\
& \textbf{Structured} & \textbf{0.67} & \textbf{0.53} & \textbf{0.59} & \textbf{0.42} \\
\midrule
\multirow{4}{*}{\textbf{20}} & Baseline & 0.18 & \underline{0.47} & 0.26 & 0.15 \\
& {\small Structured (text-only)} & 0.32 & 0.45 & 0.37 & 0.23 \\
& {\small Structured (image-only)} & \underline{0.40} & 0.46 & \underline{0.43} & \underline{0.26} \\
& \textbf{Structured} & \textbf{0.67} & \textbf{0.50} & \textbf{0.57} & \textbf{0.40} \\
\bottomrule
\end{tabular}%
}
\end{minipage}
\end{figure}
Prior work attributes hallucinations in LVLMs to the decay of visual attention and increasing reliance on language priors \citep{m3id, opera}. Motivated by this, we evaluate hallucination on the controlled datasets from Section~\ref{sec:existence}, measuring accuracy, precision, recall, and F1 for object descriptions, as reported in Table~\ref{tab:synthetic_hallucination}.
Structured inputs consistently improve performance across all metrics, with particularly strong gains in precision, which is most relevant for avoiding mentions of nonexistent objects. For images with 10 objects, baseline recall is slightly higher, but as the number of objects increases, structured inputs outperform the baseline across all criteria. The performance gap due to external structure also widens with increasing object counts. Notably, multimodal cues are considerably more effective than unimodal cues.
These results highlight that sustained cross-modal grounding directly improves faithfulness of generated text.
Finally, we evaluate on large-scale hallucination benchmarks using MS-COCO images \citep{ms_coco}, with performance assessed by the hallucination-specific metric CHAIR \citep{chair}. We conduct experiments on two recent LVLMs, Qwen2.5-VL \citep{qwen2.5_vl}, and LLaVA-1.5 \citep{llava1.5}. We observe that for natural scenes, simple horizontal lines are insufficient, and grid-based partitions provide more effective structure for sequential scanning of the image. To ensure visibility against diverse backgrounds, we add thin white margins around the scaffolding. Results (Fig.~\ref{fig:attention_span_coco} and Table~\ref{tab:coco_hallucination}) show substantial reductions in both CHAIR$_s$ and CHAIR$_i$ compared to baseline. Importantly, unlike most existing techniques, the proposed approach is also applicable to black-box, closed-source models such as GPT-4o \citep{gpt4o} and Gemini-2.5-Pro \citep{gemini2.5}, which are considered strong models for visual reasoning. Notably, our simple strategy outperforms or matches specialized hallucination-mitigation methods such as VCD \citep{vcd}, OPERA \citep{opera}, and SPARC \citep{sparc}, while requiring no additional inference modules and maintaining near-zero computational overhead.
We also
% include some failure cases and
report results on another commonly used benchmark, POPE \citep{pope}, in the appendix.
\begin{figure}[t]
\centering
\begin{minipage}{0.42\linewidth}
\centering
\includegraphics[width=\linewidth]{figs/attention_span_coco.pdf}
\caption{Cross-attention behavior on the MS-COCO dataset across generated tokens, computed using a max operation with a window size of 10 and stride of 1.}
\label{fig:attention_span_coco}
\end{minipage}\hfill
\begin{minipage}{0.57\linewidth}
\centering
\captionof{table}{Evaluation on MS-COCO using CHAIR metrics across open- and closed-source models. Results are reported for sentence-level (CHAIR$_S$) and instance-level (CHAIR$_I$) hallucination rates (lower is better). The average inference time measured on a machine with an NVIDIA RTX 4090 GPU.}
\label{tab:coco_hallucination}
\resizebox{\linewidth}{!}{%
\begin{tabular}{l l c c c}
\toprule
\textbf{Model} & \textbf{Method} & \textbf{CHAIR$_S$$\downarrow$} & \textbf{CHAIR$_I$$\downarrow$} & \textbf{{\small Inference Time(s)}} \\
\midrule
\multirow{5}{*}{\textbf{LLaVA-1.5}}
& Baseline & 59.00 & 13.40 & 3.41 \\
& Opera & \underline{49.50} & 11.90 & 20.91\\
& VCD & \underline{49.50} & \underline{11.78} & 7.81\\
& SPARC & 61.00 & 11.93 & 4.50\\
& \textbf{Structured} & \textbf{39.00} & \textbf{11.43} & 3.94\\
\midrule
\multirow{5}{*}{\textbf{Qwen2.5-VL}}
& Baseline & 40.00 & 8.45 & 3.31\\
& Opera & \textbf{28.00} & \underline{7.40} & 23.50\\
& VCD & 35.50 & 8.05 & 9.73\\
& SPARC & 38.50 & 8.45 & 5.50\\
& \textbf{Structured} & \underline{28.50} & \textbf{4.57} & 6.04\\
\midrule
\multirow{2}{*}{\textbf{GPT-4o}}
& Baseline & \underline{29.00} & \underline{6.41} & -\\
& \textbf{Structured} & \textbf{28.50} & \textbf{4.97} & -\\
\midrule
\multirow{2}{*}{\textbf{Gemini-2.5-Pro}}
& Baseline & \underline{49.50} & \underline{8.69} & -\\
& \textbf{Structured} & \textbf{40.00} & \textbf{7.36} & -\\
\bottomrule
\end{tabular}%
}
\end{minipage}
\end{figure}
\section{Related Work}
\paragraph{Interpretability.}
Interpretability research investigates where and how information is represented and routed in neural networks. For \textbf{LLMs}, attention analyses study which tokens heads attend to and how this shapes predictions~\citep{chefer21_generic_attention,clark19_bert_attention}, while circuit-oriented methods identify causal substructures and enable editing through activation or circuit discovery and factual localization~\citep{conmy23_automated_circuit_discovery,meng22_rome_factual_edit,geva23_dissect_recall}. Probing tools such as the \emph{logit lens} decode intermediate states to reveal how token predictions evolve across layers~\citep{nostalgebraist20_logit_lens}.
For \textbf{VLMs}, recent work explores where visual information is stored and how it is transferred into the language pathway~\citep{basu24_storage_transfer_vlm}, and adapts logit-lens–style spatial probes to study grounding and localization inside multimodal models~\citep{jiang24_vl_rep_edit,llava_interp}.
% In parallel, analyses of the \emph{modality gap} in contrastive VLMs show that a small set of embedding dimensions drives the gap and that \emph{information imbalance} between images and captions is a key trigger~\citep{modality_gap}.
Overall, these methods provide the toolset we build on: causal interventions and layerwise probes to expose mechanisms underlying cross-modal binding and grounding.
\paragraph{Abstract latent variables in representation space.}
Recent advances suggest that models internally rely on abstract latent variables to maintain entity–attribute associations. In LLMs, \emph{Binding IDs} are content-independent identifiers that link entities and attributes through a shared latent code; causal interventions that swap these vectors systematically change the inferred associations~\citep{binding_id}. Follow-up work localizes a low-rank subspace that \emph{causally} governs which entity pairs with which attribute~\citep{dai24_binding_order}.
In multimodal models, analogous identifiers appear in VLMs: distinct binding codes are attached to an object’s image tokens and its textual mentions, yielding cross-modal referential consistency~\citep{vision_binding_id}. Complementary evidence points to \emph{symbolic indexing} in VLMs, where attention heads compute content-independent spatial indices and later retrieve attributes by these indices, thereby implementing object-centric binding across modalities~\citep{visual_symbolic_mechanism}.
% Related learning dynamics in synthetic program-tracking tasks show that Transformers acquire variable binding by using the residual stream as an addressable memory and specialized heads to route bindings across positions~\citep{wu25_var_binding}.
These findings highlight the role of hidden symbolic variables in reasoning. While prior analyses primarily examine existing identifiers, we show that simple input-augmented artifacts can \emph{elicit} partition-specific identifiers that propagate across modalities and enhance grounding through tighter cross-modal attention and alignment.
\paragraph{LVLM reasoning.}
% VoT
Efforts to improve reasoning in LVLMs have followed two main directions. Prompt-focused methods such as chain-of-thought prompting, majority voting, and test-time compute scaling aim to enhance reasoning without altering inputs. However, evaluations on multimodal reasoning benchmarks show that these approaches remain ineffective for tasks requiring visual or spatial reasoning, even when scaled substantially \citep{emma}. In contrast, recent studies demonstrate that external scaffolding—adding annotations, grids, or partitions to the input image—consistently improves model performance across counting, spatial relations, and description tasks \citep{forgotten_polygons,viser}. While such findings establish the effectiveness of scaffolding, the mechanisms underlying these improvements remain poorly understood.
\paragraph{Hallucination reduction.}
Hallucination remains a central challenge for LVLMs, mainly arising from the decline of cross-modal attention during long text generation and over-reliance on language priors.
Several inference-time methods have been proposed, including VCD \citep{vcd}, which down-weights tokens favored under distorted inputs; OPERA \citep{opera}, which applies an over-trust penalty and retrospection allocation to rebalance attention; and SPARC \citep{sparc}, which progressively recalibrates visual attention to maintain relevance in long captions. Our work complements these approaches by identifying how visual scaffolding induces Grounding IDs that naturally sustain cross-modal binding, thereby reducing hallucination without additional inference tools.
% \section{Discussion and Future Work}
\section{Conclusion}
In this work, we introduce a conceptual framework to explain how external cues induce abstract \textit{Grounding IDs} across related partitions.
Through attention and embedding alignment analysis, we showed that these identifiers propagate across modalities, supporting partition-specific grounding and reducing the modality gap. Activation patching interventions confirmed that the associations are mediated by abstract identifiers rather than local features. Empirical evaluations further demonstrated that Grounding IDs enhance cross-modal attention, yield more faithful image descriptions, and reduce hallucinations. Since the approach relies only on simple, content-independent structures, it provides a model-agnostic strategy applicable to a wide range of tasks and models, including closed-source LVLMs.
Beyond these empirical contributions, our findings shed light on interpretability in multimodal models by identifying a symbolic mechanism underlying visual reasoning. This opens several directions for future research, particularly in circuit discovery. One is to explore mechanisms supporting system-2 reasoning tasks, such as counting and spatial reasoning. Another stems from a key observation of this study: external cues in VLM inputs can reinforce the model’s inherent grounding capability. Building on this, future work could integrate such cues during RL finetuning to further strengthen the model’s internal ability to perform sequential scanning based on provided cues. Overall, this work bridges mechanistic understanding and practical utility, showing how induced identifiers can both clarify internal dynamics and enhance robustness in LVLMs.
\newpage
\bibliography{iclr2026_conference}
\bibliographystyle{iclr2026_conference}
\newpage
\appendix
\section{Appendix}
\subsection{Visual Traversal and Positional Inductive Bias}
To analyze how the model traverses the visual input, we compute mean
cross-attention maps from textual tokens to image rows. These maps are averaged
across 100 samples, respectively, and aggregated over layers 14--28. Each
column corresponds to a decoding step, while rows are grouped top-to-bottom.
This setup allows us to observe how attention flows across the image during
generation.
\begin{figure}[ht]
\centering
\begin{subfigure}{0.95\textwidth}
\centering
\includegraphics[width=\linewidth]{figs_appendix/mean_heatmap_base.png}
\caption{Baseline input without structural cues (Averaged over 100 samples).}
\label{fig:heatmap_base}
\end{subfigure}
\vspace{0.5em}
\begin{subfigure}{0.95\textwidth}
\centering
\includegraphics[width=\linewidth]{figs_appendix/mean_heatmap.png}
\caption{
Structured input with explicit row cues (Averaged over 100 samples).
}
\label{fig:heatmap_structured}
\end{subfigure}
\caption{Mean cross-attention maps (layers 14–28) from textual tokens to image rows. Structural cues amplify the model’s inherent top-to-bottom, left-to-right traversal bias and produce sharper row-aligned attention patterns.}
\label{fig:heatmap_comparison}
\end{figure}
Fig.~\ref{fig:heatmap_comparison} reveals two
consistent patterns:
\begin{enumerate}
\item \textbf{Inherent top-to-bottom, left-to-right traversal.}
Even without explicit guidance, the model exhibits a natural reading-like
behavior: starting from the upper-left region of the image and progressively
shifting attention downward. This reflects the \emph{positional encoding inductive bias} of the vision tokenizer, which encourages sequential exploration and may facilitate grounding by providing a consistent spatial reference across tokens.
\item \textbf{Effect of structural cues.}
When explicit structure is added to the image (e.g., row separators or
symbolic markers), the attention becomes sharper and more aligned with the
intended reading order. Instead of diffuse activation, the model follows a
clear row-by-row progression from top to bottom. This demonstrates how structural cues can \emph{reinforce inherent grounding}, leading to more consistent visual traversal.
\end{enumerate}
As a qualitative example, Figure~\ref{fig:object_traversal} illustrates cross-attention heatmaps for individual objects. Each panel corresponds to a specific shape–color pair, showing how the model localizes and attends to the correct region during decoding. This highlights the row-by-row traversal pattern on a per-object basis.
\begin{figure}[ht]
\centering
\includegraphics[width=0.95\linewidth]{figs_appendix/sample_heatmap.pdf}
\caption{Examples of per-object traversal heatmaps for a structured image. Each panel shows the attention distribution for a specific shape–color pair. Structural cues guide the model toward sharper localization and promote systematic
top-to-bottom and left-to-right traversal.}
\label{fig:object_traversal}
\end{figure}
\begin{figure}[ht]
\centering
\includegraphics[width=0.95\linewidth]{figs_appendix/image_075_base_grid.pdf}
\caption{Examples of per-object traversal heatmaps for the baseline. Each panel shows the attention distribution for a specific shape–color pair. The baseline also exhibits a general top-to-bottom and left-to-right pattern, but accuracy degrades over generation.}
\label{fig:based_traversal}
\end{figure}
Overall, these results indicate that the model does not scan the visual field randomly. Instead, it exhibits a systematic traversal strategy that can be strengthened by structural modifications to the input image, yielding more interpretable and faithful cross-modal grounding.
\subsection{Logit Lens Analysis and Evidence for Propagation}
To better understand how symbolic cues influence within-partition binding, we apply
a \emph{logit lens} analysis to both raw and structurally manipulated images
from our synthetic dataset containing seven distinct shapes and five colors.
We project patch hidden states into the vocabulary space via the unembedding matrix, applying a softmax over the four symbol tokens (\&, \#, @, \$). This measures how strongly each patch activates symbols, revealing the diffusion of symbolic evidence.
\begin{figure}[H] % requires \usepackage{float}
\centering
\includegraphics[width=0.8\textwidth]{figs_appendix/obj10_symbol_vs_base.pdf}
\caption{Averaged logit lens predictions in the last layer. In the structured condition, row symbols (\&, \#, @, \$) generate strong localized activations that propagate across the entire row, providing row-level binding. As expected, the baseline shows a random, unstructured pattern. Results are based on our synthetic dataset with seven shapes and five colors.}
\label{fig:logit_lens}
\end{figure}
As shown in Figure~\ref{fig:logit_lens}, the manipulated images (left) produce
sharper symbol activations that extend beyond their immediate positions,
spreading across all patches within the corresponding row. This demonstrates
how symbolic structure strengthens local grounding while also enabling coherent
row-level propagation. By comparison, the baseline condition (right) lacks this
structured diffusion, resulting in more diffuse and inconsistent attention
patterns. Together, these findings highlight the role of explicit symbols in
amplifying the model’s evidence propagation and improving cross-modal
grounding.
\subsection{Intra-Visual Attention Patterns}
A key signal of grounding is whether patches from the same row interact more strongly, indicating that the model encodes rows as coherent positional units rather than arbitrary patch collections.
To probe this effect, we compute pairwise cosine similarities between final-layer patch embeddings and compare the average similarity of patches within the same row to that of patches drawn from different rows. A clear gap between within-row and across-row similarity demonstrates that structural cues encourage row-wise grouping, effectively injecting an implicit positional prior into the representation space.
We further quantify this phenomenon with the \textbf{intra--inter cluster
grounding (ICG)} score, defined as the difference between the mean within-row
similarity and the mean across-row similarity:
\begin{equation}
\mathrm{ICG} =
\frac{1}{R}\sum_{r=1}^{R} \text{Sim}_{\mathrm{intra}}(r)
\;-\;
\frac{1}{R(R-1)} \sum_{r \neq r'} \text{Sim}_{\mathrm{inter}}(r,r'),
\label{eq:icg}
\end{equation}
where $R$ is the number of rows, $\text{Sim}_{\mathrm{intra}}(r)$ is the mean
cosine similarity between patches within row $r$, and
$\text{Sim}_{\mathrm{inter}}(r,r')$ is the average similarity between patches
across rows $r$ and $r'$. A larger $\mathrm{ICG}$ score indicates stronger
row-wise clustering and hence a clearer positional alignment in the image
representation.
Figure~\ref{fig:icg_layers} plots the ICG score across layers for both the
baseline and the structured setting. We observe that the structured condition
(symbol-augmented inputs) consistently achieves higher ICG values than the
baseline, indicating that structural cues enhance row-level grouping.
\begin{figure}[H]
\centering
\includegraphics[width=0.6\linewidth]{figs_appendix/icg_Layers.pdf}
\caption{ICG scores across layers for baseline vs. structured inputs. Structured inputs consistently yield higher ICG, reflecting stronger row-level grouping.}
\label{fig:icg_layers}
\end{figure}
\subsection{Evaluation on Synthetic Variants}
We evaluate a range of structural variants of the synthetic dataset
(7 shapes × 5 colors, with 20 objects per image) to understand how explicit
row-level cues affect grounding. Each row in
Table~\ref{tab:metrics_variants} reports \textbf{precision},
\textbf{recall}, \textbf{F1}, and \textbf{accuracy}.
The baseline condition provides no additional cues and yields
weak performance. Introducing explicit structure consistently improves results,
with the following variants:
\begin{itemize}
\item \textbf{Numbers (no line)}: Each row is tagged with a numeric index,
but no horizontal separators are drawn. This already improves both precision
and accuracy compared to the baseline.
\item \textbf{Letters + Line}: Rows are separated by horizontal lines and
tagged with distinct letter labels. This variant yields a significant boost
in precision, indicating clearer disambiguation between rows.
\item \textbf{Numbers + Line}: Rows are separated by lines and also numbered.
This combination achieves the highest recall among all variants, suggesting
that explicit row boundaries help the model correctly cover more objects.
\item \textbf{Symbols + Line}: Each row is separated by a line and prefixed
with a unique symbol (\&, \#, @, \$). This provides the strongest positional
anchor, achieving the best overall F1 and accuracy, reflecting both balanced
precision and recall.
\item \textbf{Grid 4×4}: A baseline layout where objects are arranged in a $4 \times 4$ grid. Two variants were tested: numbered with grid lines, and numbered without grid lines. Performance remained weaker than in the structured row version.
\item \textbf{Numbers Right-Aligned + Line}: A variant of
\texttt{Numbers + Line} where the numeric label appears at the end of the
row rather than the beginning. While recall improves, the overall precision
drops slightly, indicating less consistent alignment.
\end{itemize}
\begin{table}[t]
\centering
\setlength{\tabcolsep}{8pt}
\renewcommand{\arraystretch}{1.2}
\begin{tabular}{lcccc}
\toprule
\textbf{Variant} & \textbf{Precision} & \textbf{Recall} & \textbf{F1} & \textbf{Accuracy} \\
\midrule
Baseline & 0.18 & 0.46 & 0.25 & 0.15 \\
Numbers (no line) & 0.53 & 0.43 & 0.47 & 0.31 \\
Letters + Line & \underline{0.64} & 0.48 & 0.55 & 0.38 \\
Numbers + Line & 0.56 & \textbf{0.58} & \underline{0.57} & \underline{0.40} \\
Symbols + Line & \textbf{0.67} & 0.50 & \textbf{0.58} & \textbf{0.47} \\
Grid 4×4 Numbered & 0.33 & 0.40 & 0.36 & 0.22 \\
Grid 4×4 Numbered (no lines) & 0.33 & 0.35 & 0.34 & 0.20 \\
Numbers Right-Aligned + Line & 0.39 & \underline{0.55} & 0.46 & 0.30 \\
\bottomrule
\end{tabular}
\caption{Performance metrics (precision, recall, F1, accuracy) on the scene description task across synthetic variants with 20 objects. Explicit structural cues (such as lines, labels, or symbols) consistently improve performance compared to the baseline.}
\label{tab:metrics_variants}
\end{table}
\FloatBarrier
\subsection{Implementation Details and Qualitative Example}
We employed two types of prompts for instruction tuning and evaluation:
a \emph{structured prompt} that explicitly encodes row-level layout with
symbols, and a simpler \emph{baseline prompt} without structural cues.
\paragraph{Structured Prompt.}
\begin{quote}
\textbf{Task:} You are presented with an image containing multiple objects.
Your task is to identify all objects with color in the image.
Each object must be exactly \texttt{<color> <shape>}.
Scan the image sequentially based on horizontal lines and rows that exist in the image.
There are exactly 4 horizontal rows in the image.
Use \emph{only} these shapes (exact strings):
\texttt{square, circle, triangle, diamond, star, moon, heart}
Use \emph{only} these colors (exact strings):
\texttt{red, green, blue, yellow, purple}
Important: If the same object appears multiple times in a row, repeat its label
for each instance (e.g., \texttt{blue square, blue square, red circle}).
\textbf{Output format (print \emph{exactly} this structure, no extra text):}
\begin{verbatim}
Row &: <label>, <label>, ...
Row #: <label>, <label>, ...
Row @: <label>, <label>, ...
Row $: <label>, <label>, ...
\end{verbatim}
\end{quote}
\paragraph{Baseline Prompt.}
\begin{quote}
\textbf{Task:} You are presented with an image containing multiple colored objects.
Your task is to identify all objects in the image and report each as \texttt{<color> <shape>}.
Use \emph{only} these shapes (exact strings):
\texttt{square, circle, triangle, diamond, star, moon, heart}
Use \emph{only} these colors (exact strings):
\texttt{red, green, blue, yellow, purple}
If the same object appears multiple times in a row, repeat its label
for each instance (e.g., \texttt{blue square, blue square, red circle}).
\textbf{Output format (print \emph{exactly} this structure, no extra text):}
\begin{verbatim}
Output a single line: a comma-and-space separated list of labels,
where each label is "<color> <shape>".
\end{verbatim}
\end{quote}
% \paragraph{Qualitative Comparison.}
% \begin{figure}[ht]
% \centering
% % Structured image
% \begin{subfigure}{0.41\textwidth}
% \centering
% \fbox{\includegraphics[width=\linewidth]{figs_appendix/image_045.png}}
% \caption{Structured input with row cues.}
% \label{fig:structured_input}
% \end{subfigure}
% \hfill
% % Baseline image
% \begin{subfigure}{0.41\textwidth}
% \centering
% \fbox{\includegraphics[width=\linewidth]{figs_appendix/base.png}}
% \caption{Baseline input without cues.}
% \label{fig:baseline_input}
% \end{subfigure}
% \caption{Comparison between structured and baseline prompts for the same image.}
% \label{fig:structured_vs_base}
% \end{figure}
\noindent \textbf{Structured Prompt Output:}
\begin{verbatim}
Row &: purple moon, purple star, blue moon
Row #: yellow heart, blue star, purple diamond
Row @: blue circle, purple circle
Row $: yellow triangle, blue heart
\end{verbatim}
\noindent \textbf{Baseline Prompt Output:}
\begin{verbatim}
purple moon, purple star, purple diamond, yellow heart,
blue circle, blue square, blue circle, blue circle,
blue circle, blue circle, yellow triangle, blue heart
\end{verbatim}
% \subsection{Qualitative Examples of our method}
% \label{appendix:qualitative_examples}
% To complement our quantitative results, we present a qualitative example that illustrates how structured scaffolding improves visual grounding and reduces hallucination in LVLM outputs.
% We show side-by-side captions with and without scaffolding, highlighting hallucinated objects (in red) in the baseline output.
\begin{figure}[h]
\centering
\includegraphics[width=0.8\linewidth]{Example/Example_Scan.pdf}
\caption{Qualitative example comparing captions generated with and without structured scaffolding. The figure shows the input image, the applied scaffolding structure, the caption produced by our method, and the corresponding baseline caption. Hallucinated objects in the baseline output are highlighted in \textcolor{red}{red}.}
\end{figure}
\subsection{Evaluation Metrics for Object Hallucination}
\label{appendix:hallucination_metrics}
Object hallucination is a key failure mode of LVLMs, occurring when models generate content that is unsupported by the visual input. To quantify this phenomenon, we adopt two complementary evaluation frameworks: \textbf{CHAIR} and \textbf{POPE}. While both focus on grounding and image relevance, they differ in format, granularity, and the types of hallucination they expose.
\subsubsection{CHAIR: Caption Hallucination Assessment with Image Relevance}
The \textit{CHAIR} metric evaluates whether objects mentioned in generated captions are actually present in the image. Using ground-truth segmentations and reference captions from the MSCOCO dataset, CHAIR measures hallucination at two levels:
\begin{align}
\text{CHAIR}_{i} &= \frac{|\{\text{hallucinated objects}\}|}{|\{\text{all objects mentioned}\}|}, \\
\text{CHAIR}_{s} &= \frac{|\{\text{sentences with hallucinated objects}\}|}{|\{\text{all sentences}\}|}.
\end{align}
Here, $\text{CHAIR}_{i}$ quantifies hallucination at the object-instance level, while $\text{CHAIR}_{s}$ captures the proportion of captions containing hallucinated objects. Lower scores indicate better grounding and fewer hallucinated mentions.
We compute CHAIR scores on 200 randomly selected images from the MSCOCO validation set, using model-generated captions and official COCO object annotations as references.
\subsubsection{POPE: Probing Object-Presence Hallucination}
The \textit{POPE} benchmark probes whether models falsely predict the presence of objects not found in the image. Unlike CHAIR, which evaluates free-form captioning, POPE uses templated binary questions of the form: ``\textit{Is there a \{object\} in the image?}'' and compares the model’s answer to COCO annotations. The focus is on identifying \textit{false positives}, i.e., cases where the model incorrectly affirms the presence of objects that are absent.
POPE defines three targeted subsets to assess different sources of hallucination:
\begin{itemize}
\item \textbf{Random}: Object categories are randomly sampled and paired with images in which the object is absent, probing baseline hallucination without context.
\item \textbf{Adversarial}: Object prompts are selected to be semantically plausible within the scene (e.g., ``fork'' in a kitchen) but are not present, testing model susceptibility to co-occurrence priors.
\item \textbf{Popular}: High-frequency object categories are paired with unrelated images to measure overprediction due to training frequency bias.
\end{itemize}
To ensure comparability with CHAIR, we evaluate POPE using questions corresponding to the same 200 randomly selected images from the MSCOCO validation set. For each model response, we compute standard classification metrics: \textbf{precision}, \textbf{recall}, \textbf{F1 score}, and \textbf{accuracy}, defined as follows:
\begin{align}
\text{Precision} &= \frac{\text{TP}}{\text{TP} + \text{FP}}, &\text{Recall} &= \frac{\text{TP}}{\text{TP} + \text{FN}}, \\
\text{F1 Score} &= \frac{2 \cdot \text{Precision} \cdot \text{Recall}}{\text{Precision} + \text{Recall}}, &\text{Accuracy} &= \frac{\text{TP} + \text{TN}}{\text{TP} + \text{FP} + \text{TN} + \text{FN}},
\end{align}
where TP, FP, TN, and FN denote true/false positives and negatives. These metrics together capture hallucination behavior, balancing precision (avoiding false affirmations) with recall and accuracy (correctly rejecting absent objects).
% \subsubsection{Implementation Details for Baseline Comparisons}
% To enable fair comparisons across models, we evaluate hallucination mitigation methods including VCD, OPERA, and SPARC on both LLaVA-1.5 and Qwen2.5-VL. While official implementations are available for LLaVA, no publicly available implementations exist for these methods on Qwen2.5-VL. Accordingly, we re-implemented each method for Qwen2.5-VL following the descriptions in the original papers.
% Below, we provide the specific hyperparameters and implementation choices used in our Qwen2.5-VL experiments to ensure reproducibility and transparency.
\subsubsection{Evaluation on POPE Benchmark}
\label{appendix:pope_results}
In addition to CHAIR, we evaluate our structured scaffolding method using the POPE benchmark, which probes object hallucination through structured binary questions. As described in Appendix~\ref{appendix:hallucination_metrics}, POPE defines three subsets—\textit{Random}, \textit{Adversarial}, and \textit{Popular}—each targeting different hallucination biases such as language priors, scene co-occurrence, and object frequency.
While our proposed strategy is designed to strengthen grounding during \textit{long-form generation}, we also evaluate on POPE to ensure coverage across widely used hallucination benchmarks. Although POPE is less aligned with our method’s strengths, results remain robust and comparable, demonstrating that the approach generalizes beyond descriptive settings.
We use the same 200 MSCOCO validation images as in the CHAIR evaluation. From the POPE benchmark, we select yes/no question subsets corresponding to these images. Each image has six questions per subset (Random, Adversarial, Popular), yielding \textbf{1,200 questions per subset} and \textbf{3,600 in total} per model. We evaluate both baseline and structured versions of LLaVA-1.5 and Qwen2.5-VL using standard binary classification metrics: precision, recall, F1 score, and accuracy.
\begin{table*}[ht!]
\centering
\caption{Results of POPE evaluation on the MSCOCO dataset across Random, Popular, and Adversarial splits. Metrics reported are Accuracy, Precision, Recall, F1 Score, and Yes (\%) for LLaVA-1.5.}
\label{tab:pope_results}
\begin{tabular}{llcccccc} % <-- 8 columns: ll + six c's
\toprule
\textbf{Model} & \textbf{POPE} & \textbf{Method} & \textbf{Accuracy} & \textbf{Precision} & \textbf{Recall} & \textbf{F1 Score} & \textbf{Yes (\%)} \\
\midrule
\multirow{15}{*}{LLaVA-1.5} % <-- 3 blocks * 5 rows = 15
& \multirow{5}{*}{\textit{Random}}
& Base & \underline{87.25} & \underline{97.45} & \underline{76.50} & \underline{85.71} & 39.25 \\
& & OPERA & 86.17 & 96.97 & 74.67 & 84.37 & 38.50 \\
& & VCD & 85.42 & 93.81 & 75.83 & 83.87 & 40.42 \\
& & SPARC & 85.08 & \textbf{98.85} & 71.16 & 82.74 & 50.25 \\
& & Ours & \textbf{89.25} & 95.20 & \textbf{82.67} & \textbf{88.49} & 43.42 \\
\cmidrule(l){2-8} % <-- spans columns 2..8
& \multirow{5}{*}{\textit{Popular}}
& Base & \underline{85.92} & \underline{94.25} & \underline{76.50} & \underline{84.45} & 40.58 \\
& & OPERA & 84.92 & 93.92 & 74.67 & 83.19 & 39.75 \\
& & VCD & 83.67 & 89.82 & 75.83 & 82.28 & 42.17 \\
& & SPARC & 84.67 & \textbf{97.06} & 71.50 & 82.34 & 36.83 \\
& & Ours & \textbf{86.08} & 88.73 & \textbf{82.67} & \textbf{85.59} & 46.58 \\
\cmidrule(l){2-8}
& \multirow{5}{*}{\textit{Adversarial}}
& Base & 81.42 & 86.04 & 75.00 & 80.14 & 43.58 \\
& & OPERA & \underline{82.08} & 87.67 & 74.67 & \underline{80.65} & 42.58 \\
& & VCD & 80.58 & 83.79 & \underline{75.83} & 79.62 & 45.25 \\
& & SPARC & \textbf{84.92} & \textbf{98.84} & 70.72 & 82.46 & 50.08 \\
& & Ours & \underline{83.50} & \underline{88.95} & \textbf{76.50} & \textbf{82.26} & 43.00 \\
\bottomrule
\end{tabular}
\end{table*}
\begin{table*}[ht!]
\centering
\caption{Results of POPE evaluation on the MSCOCO dataset across Random, Popular, and Adversarial splits. Metrics reported are Accuracy, Precision, Recall, F1 Score, and Yes (\%) for Qwen2.5-VL.}
\label{tab:pope_results}
\begin{tabular}{llcccccc} % <-- 8 columns: ll + six c's
\toprule
\textbf{Model} & \textbf{POPE} & \textbf{Method} & \textbf{Accuracy} & \textbf{Precision} & \textbf{Recall} & \textbf{F1 Score} & \textbf{Yes (\%)} \\
\midrule
\multirow{15}{*}{Qwen2.5-VL} % <-- 3 blocks * 5 rows = 15
& \multirow{5}{*}{\textit{Random}}
& Base & \underline{89.75} & 98.38 & \underline{80.83} & \underline{88.75} & 41.08 \\
& & OPERA & 88.83 & \textbf{98.74} & 78.67 & 87.57 & 39.83 \\
& & VCD & \textbf{89.91} & \underline{98.58} & \textbf{81.00} & \textbf{88.93} & 41.08 \\
& & SPARC & 85.33 & 95.85 & 71.50 & 82.98 & 36.17 \\
& & Ours & 85.67 & 98.20 & 72.67 & 83.52 & 37.00 \\
\cmidrule(l){2-8} % <-- spans columns 2..8
& \multirow{5}{*}{\textit{Popular}}
& Base & \underline{88.83} & 96.05 & \underline{81.00} & \underline{87.88} & 42.17 \\
& & OPERA & 87.41 & 96.67 & 77.50 & 86.03 & 40.08 \\
& & VCD & \textbf{89.00} & 96.06 & \textbf{81.33} & \textbf{88.09} & 42.33 \\
& & SPARC & 84.75 & \underline{96.85} & 71.83 & 82.49 & 37.83 \\
& & Ours & 85.08 & \textbf{96.88} & 72.50 & 82.94 & 37.42 \\
\cmidrule(l){2-8}
& \multirow{5}{*}{\textit{Adversarial}}
& Base & \textbf{87.42} & 93.09 & 80.93 & \underline{86.53} & 43.42 \\
& & OPERA & 86.42 & \textbf{94.32} & 77.50 & 85.09 & 41.08 \\
& & VCD & \underline{87.41} & 92.60 & \underline{81.33} & \textbf{86.60} & 43.92 \\
& & SPARC & 81.17 & 80.25 & \textbf{82.67} & 81.44 & 51.50 \\
& & Ours & 83.75 & \underline{93.55} & 72.50 & 81.69 & 38.75 \\
\bottomrule
\end{tabular}
\end{table*}
Importantly, we observe that the structured version achieves lower \textbf{recall} than the baseline. Analyzing the false negatives reveals systematic patterns, such as objects positioned across grid boundaries or large objects spanning multiple cells. In this work we adopt a general prompting strategy, but more tailored prompts that explicitly define such corner cases could further reduce false negatives. Additionally, techniques such as ensembling over diverse structural partitions may help compensate for the limitations of any single structure.
% ========================= Appendix: Interventions =========================
\FloatBarrier
\subsection{Activation swapping (interchange intervention)}
\label{app:act-swap}
\paragraph{Data generation.}
We generate 100 synthetic scenes (“samples”). Each scene is a four-row grid with exactly one \emph{symbol} and one \emph{object} per row. We draw four \emph{distinct} shapes (e.g., circle, diamond, square, triangle) and four \emph{distinct} colors (chosen without replacement from a nine-color palette) and assign one unique (shape, color) pair to each row. Symbols are randomly permuted over the physical rows (top$\rightarrow$bottom) in every sample.
\paragraph{Pairing and target selection.}
For each sample $x$, we select a paired sample $x'$ and two distinct target symbols. Because each scene contains four unique (shape, color) pairs, targets are unambiguous within a scene. To isolate intervention effects, we impose a \emph{symmetric mismatch} between $x$ and $x'$: for each chosen symbol $s$, the associated object in $x$ and the associated object in $x'$ must differ in \emph{both} shape and color (i.e., $\text{shape}_x(s)\neq\text{shape}_{x'}(s)$ and $\text{color}_x(s)\neq\text{color}_{x'}(s)$). This design also rules out the \emph{symbol-activation} alternative hypothesis—namely, that the model might answer by reading object attributes cached in the symbol’s own representation. Because our swaps patch \textbf{only object image tokens} with a one-token dilation (\textbf{pad}~=~1) and \emph{never} include symbol tokens, and because paired objects differ on both attributes, any post-swap answer that follows the injected attributes cannot be explained by information stored in symbol activations.
\paragraph{Intervention.}
For each pair $(x,x')$: (i) we first query both contexts \emph{without intervention} to obtain baseline answers of the form “What is the \emph{shape} / \emph{color} of the object associated with symbol $S$?”; (ii) we then perform an \emph{object-only activation swap}. Let $\mathcal{I}_r$ be the set of \emph{image-token} indices belonging to the \textbf{object} in the referenced row $r$ (obtained by mapping patch centers to the object’s bounding box); we dilate this mask by one token in each axis to get $\tilde{\mathcal{I}}_r$ (\textbf{pad}=1). We swap the hidden activations at $\tilde{\mathcal{I}}_r$ between the two runs and leave all other positions \emph{unchanged}—in particular, we do \emph{not} alter (a) any \textbf{text tokens} that mention symbols, or (b) image tokens occupied by the \textbf{symbol glyphs} themselves. (iii) We re-ask the same questions and record post-swap answers for the two targets.
\paragraph{Outputs.}
For each context we log pre-/post-swap answers and token-level logits for the queried attributes.
\paragraph{Prompt.}
For each target symbol, we use the same wording across both contexts and substitute \texttt{<row\_symbol>} with one of \texttt{\&}, \texttt{\$}, \texttt{\#}, \texttt{@}:
\begin{quote}\small\ttfamily
Scan the image using the symbols on the left (\&, \$, \#, @) as row labels.\\
What is the shape of the object in the ``<row\_symbol>'' row?
\end{quote}
(For color queries, replace “shape” with “color”.)
% ----------------------------------------------------------------------
\subsubsection{Disjoint-symbol swap (no-visual-cue prompt)}
To further assess the role of abstract identifiers, we repeat the activation-swap experiment with \emph{disjoint symbol sets} across contexts. The source image uses \{\&,\$,\#,@\}, while the target image uses \{+, $\times$, \%, !\}, with no overlap (Fig. \ref{fig:disjoint_swap_stimuli}). After object-only activation patching from the source into the target (pad $=1$; symbol tokens never swapped), we \emph{intentionally query the target} using a \textbf{source} symbol (e.g., \&), which is not physically present in the target image. The query omits any enumeration of the available symbols so as not to contradict the target’s visual glyphs.
\paragraph{Prompt.}
We use the same wording as above, but without listing the four symbols. For a chosen \texttt{<row\_symbol>} (e.g., \texttt{\&}) we ask:
\begin{quote}\small\ttfamily
Scan the image using the symbols on the left as row labels.\\
What is the shape of the object in the ``<row\_symbol>'' row?\\
If there is no object corresponding to ``<row\_symbol>'' in the image, answer \emph{none}.
\end{quote}
(For color queries, replace “shape” with “color”.)
\paragraph{Bias control and evaluation protocol.}
Allowing the response \emph{none} mitigates bias toward hallucinating an answer when the queried symbol is not present. For evaluation, the accuracy reported in the paper is computed on the subset of examples where, in the \emph{baseline} (non-intervened) condition, the model correctly answered \emph{none} for the queried symbol. This isolates the effect of the intervention from cases where the model would have produced a spurious non-none answer even without patching.
% Keep text and figure together with minimal extra space.
\Needspace*{14\baselineskip}
\vspace{-0.2\baselineskip}
\begin{figure}[H]
\captionsetup{skip=3pt} % tighter caption spacing
\centering
\begin{subfigure}{0.42\linewidth}
\centering
\includegraphics[width=\linewidth]{figs_appendix/tgt_symbols_disjoint_f.pdf}
\caption{Source: symbols \&,\$,\#,@.}
\end{subfigure} \hspace{0.02\textwidth}
\begin{subfigure}{0.42\linewidth}
\centering
\includegraphics[width=\linewidth]{figs_appendix/src_symbols_disjoint_f.pdf}
\caption{Target: symbols !,\%,$\times$,+.}
\end{subfigure}
\caption{Disjoint-symbol control for the activation-swap test. Object-image activations are transferred with pad $=1$; symbol tokens are never swapped. The target is queried with a \emph{source} symbol that does not appear in the image, and the prompt allows the answer \emph{none} to avoid bias.}
\label{fig:disjoint_swap_stimuli}
\end{figure}
\end{document}
%%%%% NEW MATH DEFINITIONS %%%%%
\usepackage{amsmath,amsfonts,bm}
% Mark sections of captions for referring to divisions of figures
\newcommand{\figleft}{{\em (Left)}}
\newcommand{\figcenter}{{\em (Center)}}
\newcommand{\figright}{{\em (Right)}}
\newcommand{\figtop}{{\em (Top)}}
\newcommand{\figbottom}{{\em (Bottom)}}
\newcommand{\captiona}{{\em (a)}}
\newcommand{\captionb}{{\em (b)}}
\newcommand{\captionc}{{\em (c)}}
\newcommand{\captiond}{{\em (d)}}
% Highlight a newly defined term
\newcommand{\newterm}[1]{{\bf #1}}
% Figure reference, lower-case.
\def\figref#1{figure~\ref{#1}}
% Figure reference, capital. For start of sentence
\def\Figref#1{Figure~\ref{#1}}
\def\twofigref#1#2{figures \ref{#1} and \ref{#2}}
\def\quadfigref#1#2#3#4{figures \ref{#1}, \ref{#2}, \ref{#3} and \ref{#4}}
% Section reference, lower-case.
\def\secref#1{section~\ref{#1}}
% Section reference, capital.
\def\Secref#1{Section~\ref{#1}}
% Reference to two sections.
\def\twosecrefs#1#2{sections \ref{#1} and \ref{#2}}
% Reference to three sections.
\def\secrefs#1#2#3{sections \ref{#1}, \ref{#2} and \ref{#3}}
% Reference to an equation, lower-case.
\def\eqref#1{equation~\ref{#1}}
% Reference to an equation, upper case
\def\Eqref#1{Equation~\ref{#1}}
% A raw reference to an equation---avoid using if possible
\def\plaineqref#1{\ref{#1}}
% Reference to a chapter, lower-case.
\def\chapref#1{chapter~\ref{#1}}
% Reference to an equation, upper case.
\def\Chapref#1{Chapter~\ref{#1}}
% Reference to a range of chapters
\def\rangechapref#1#2{chapters\ref{#1}--\ref{#2}}
% Reference to an algorithm, lower-case.
\def\algref#1{algorithm~\ref{#1}}
% Reference to an algorithm, upper case.
\def\Algref#1{Algorithm~\ref{#1}}
\def\twoalgref#1#2{algorithms \ref{#1} and \ref{#2}}
\def\Twoalgref#1#2{Algorithms \ref{#1} and \ref{#2}}
% Reference to a part, lower case
\def\partref#1{part~\ref{#1}}
% Reference to a part, upper case
\def\Partref#1{Part~\ref{#1}}
\def\twopartref#1#2{parts \ref{#1} and \ref{#2}}
\def\ceil#1{\lceil #1 \rceil}
\def\floor#1{\lfloor #1 \rfloor}
\def\1{\bm{1}}
\newcommand{\train}{\mathcal{D}}
\newcommand{\valid}{\mathcal{D_{\mathrm{valid}}}}
\newcommand{\test}{\mathcal{D_{\mathrm{test}}}}
\def\eps{{\epsilon}}
% Random variables
\def\reta{{\textnormal{$\eta$}}}
\def\ra{{\textnormal{a}}}
\def\rb{{\textnormal{b}}}
\def\rc{{\textnormal{c}}}
\def\rd{{\textnormal{d}}}
\def\re{{\textnormal{e}}}
\def\rf{{\textnormal{f}}}
\def\rg{{\textnormal{g}}}
\def\rh{{\textnormal{h}}}
\def\ri{{\textnormal{i}}}
\def\rj{{\textnormal{j}}}
\def\rk{{\textnormal{k}}}
\def\rl{{\textnormal{l}}}
% rm is already a command, just don't name any random variables m
\def\rn{{\textnormal{n}}}
\def\ro{{\textnormal{o}}}
\def\rp{{\textnormal{p}}}
\def\rq{{\textnormal{q}}}
\def\rr{{\textnormal{r}}}
\def\rs{{\textnormal{s}}}
\def\rt{{\textnormal{t}}}
\def\ru{{\textnormal{u}}}
\def\rv{{\textnormal{v}}}
\def\rw{{\textnormal{w}}}
\def\rx{{\textnormal{x}}}
\def\ry{{\textnormal{y}}}
\def\rz{{\textnormal{z}}}
% Random vectors
\def\rvepsilon{{\mathbf{\epsilon}}}
\def\rvtheta{{\mathbf{\theta}}}
\def\rva{{\mathbf{a}}}
\def\rvb{{\mathbf{b}}}
\def\rvc{{\mathbf{c}}}
\def\rvd{{\mathbf{d}}}
\def\rve{{\mathbf{e}}}
\def\rvf{{\mathbf{f}}}
\def\rvg{{\mathbf{g}}}
\def\rvh{{\mathbf{h}}}
\def\rvu{{\mathbf{i}}}
\def\rvj{{\mathbf{j}}}
\def\rvk{{\mathbf{k}}}
\def\rvl{{\mathbf{l}}}
\def\rvm{{\mathbf{m}}}
\def\rvn{{\mathbf{n}}}
\def\rvo{{\mathbf{o}}}
\def\rvp{{\mathbf{p}}}
\def\rvq{{\mathbf{q}}}
\def\rvr{{\mathbf{r}}}
\def\rvs{{\mathbf{s}}}
\def\rvt{{\mathbf{t}}}
\def\rvu{{\mathbf{u}}}
\def\rvv{{\mathbf{v}}}
\def\rvw{{\mathbf{w}}}
\def\rvx{{\mathbf{x}}}
\def\rvy{{\mathbf{y}}}
\def\rvz{{\mathbf{z}}}
% Elements of random vectors
\def\erva{{\textnormal{a}}}
\def\ervb{{\textnormal{b}}}
\def\ervc{{\textnormal{c}}}
\def\ervd{{\textnormal{d}}}
\def\erve{{\textnormal{e}}}
\def\ervf{{\textnormal{f}}}
\def\ervg{{\textnormal{g}}}
\def\ervh{{\textnormal{h}}}
\def\ervi{{\textnormal{i}}}
\def\ervj{{\textnormal{j}}}
\def\ervk{{\textnormal{k}}}
\def\ervl{{\textnormal{l}}}
\def\ervm{{\textnormal{m}}}
\def\ervn{{\textnormal{n}}}
\def\ervo{{\textnormal{o}}}
\def\ervp{{\textnormal{p}}}
\def\ervq{{\textnormal{q}}}
\def\ervr{{\textnormal{r}}}
\def\ervs{{\textnormal{s}}}
\def\ervt{{\textnormal{t}}}
\def\ervu{{\textnormal{u}}}
\def\ervv{{\textnormal{v}}}
\def\ervw{{\textnormal{w}}}
\def\ervx{{\textnormal{x}}}
\def\ervy{{\textnormal{y}}}
\def\ervz{{\textnormal{z}}}
% Random matrices
\def\rmA{{\mathbf{A}}}
\def\rmB{{\mathbf{B}}}
\def\rmC{{\mathbf{C}}}
\def\rmD{{\mathbf{D}}}
\def\rmE{{\mathbf{E}}}
\def\rmF{{\mathbf{F}}}
\def\rmG{{\mathbf{G}}}
\def\rmH{{\mathbf{H}}}
\def\rmI{{\mathbf{I}}}
\def\rmJ{{\mathbf{J}}}
\def\rmK{{\mathbf{K}}}
\def\rmL{{\mathbf{L}}}
\def\rmM{{\mathbf{M}}}
\def\rmN{{\mathbf{N}}}
\def\rmO{{\mathbf{O}}}
\def\rmP{{\mathbf{P}}}
\def\rmQ{{\mathbf{Q}}}
\def\rmR{{\mathbf{R}}}
\def\rmS{{\mathbf{S}}}
\def\rmT{{\mathbf{T}}}
\def\rmU{{\mathbf{U}}}
\def\rmV{{\mathbf{V}}}
\def\rmW{{\mathbf{W}}}
\def\rmX{{\mathbf{X}}}
\def\rmY{{\mathbf{Y}}}
\def\rmZ{{\mathbf{Z}}}
% Elements of random matrices
\def\ermA{{\textnormal{A}}}
\def\ermB{{\textnormal{B}}}
\def\ermC{{\textnormal{C}}}
\def\ermD{{\textnormal{D}}}
\def\ermE{{\textnormal{E}}}
\def\ermF{{\textnormal{F}}}
\def\ermG{{\textnormal{G}}}
\def\ermH{{\textnormal{H}}}
\def\ermI{{\textnormal{I}}}
\def\ermJ{{\textnormal{J}}}
\def\ermK{{\textnormal{K}}}
\def\ermL{{\textnormal{L}}}
\def\ermM{{\textnormal{M}}}
\def\ermN{{\textnormal{N}}}
\def\ermO{{\textnormal{O}}}
\def\ermP{{\textnormal{P}}}
\def\ermQ{{\textnormal{Q}}}
\def\ermR{{\textnormal{R}}}
\def\ermS{{\textnormal{S}}}
\def\ermT{{\textnormal{T}}}
\def\ermU{{\textnormal{U}}}
\def\ermV{{\textnormal{V}}}
\def\ermW{{\textnormal{W}}}
\def\ermX{{\textnormal{X}}}
\def\ermY{{\textnormal{Y}}}
\def\ermZ{{\textnormal{Z}}}
% Vectors
\def\vzero{{\bm{0}}}
\def\vone{{\bm{1}}}
\def\vmu{{\bm{\mu}}}
\def\vtheta{{\bm{\theta}}}
\def\va{{\bm{a}}}
\def\vb{{\bm{b}}}
\def\vc{{\bm{c}}}
\def\vd{{\bm{d}}}
\def\ve{{\bm{e}}}
\def\vf{{\bm{f}}}
\def\vg{{\bm{g}}}
\def\vh{{\bm{h}}}
\def\vi{{\bm{i}}}
\def\vj{{\bm{j}}}
\def\vk{{\bm{k}}}
\def\vl{{\bm{l}}}
\def\vm{{\bm{m}}}
\def\vn{{\bm{n}}}
\def\vo{{\bm{o}}}
\def\vp{{\bm{p}}}
\def\vq{{\bm{q}}}
\def\vr{{\bm{r}}}
\def\vs{{\bm{s}}}
\def\vt{{\bm{t}}}
\def\vu{{\bm{u}}}
\def\vv{{\bm{v}}}
\def\vw{{\bm{w}}}
\def\vx{{\bm{x}}}
\def\vy{{\bm{y}}}
\def\vz{{\bm{z}}}
% Elements of vectors
\def\evalpha{{\alpha}}
\def\evbeta{{\beta}}
\def\evepsilon{{\epsilon}}
\def\evlambda{{\lambda}}
\def\evomega{{\omega}}
\def\evmu{{\mu}}
\def\evpsi{{\psi}}
\def\evsigma{{\sigma}}
\def\evtheta{{\theta}}
\def\eva{{a}}
\def\evb{{b}}
\def\evc{{c}}
\def\evd{{d}}
\def\eve{{e}}
\def\evf{{f}}
\def\evg{{g}}
\def\evh{{h}}
\def\evi{{i}}
\def\evj{{j}}
\def\evk{{k}}
\def\evl{{l}}
\def\evm{{m}}
\def\evn{{n}}
\def\evo{{o}}
\def\evp{{p}}
\def\evq{{q}}
\def\evr{{r}}
\def\evs{{s}}
\def\evt{{t}}
\def\evu{{u}}
\def\evv{{v}}
\def\evw{{w}}
\def\evx{{x}}
\def\evy{{y}}
\def\evz{{z}}
% Matrix
\def\mA{{\bm{A}}}
\def\mB{{\bm{B}}}
\def\mC{{\bm{C}}}
\def\mD{{\bm{D}}}
\def\mE{{\bm{E}}}
\def\mF{{\bm{F}}}
\def\mG{{\bm{G}}}
\def\mH{{\bm{H}}}
\def\mI{{\bm{I}}}
\def\mJ{{\bm{J}}}
\def\mK{{\bm{K}}}
\def\mL{{\bm{L}}}
\def\mM{{\bm{M}}}
\def\mN{{\bm{N}}}
\def\mO{{\bm{O}}}
\def\mP{{\bm{P}}}
\def\mQ{{\bm{Q}}}
\def\mR{{\bm{R}}}
\def\mS{{\bm{S}}}
\def\mT{{\bm{T}}}
\def\mU{{\bm{U}}}
\def\mV{{\bm{V}}}
\def\mW{{\bm{W}}}
\def\mX{{\bm{X}}}
\def\mY{{\bm{Y}}}
\def\mZ{{\bm{Z}}}
\def\mBeta{{\bm{\beta}}}
\def\mPhi{{\bm{\Phi}}}
\def\mLambda{{\bm{\Lambda}}}
\def\mSigma{{\bm{\Sigma}}}
% Tensor
\DeclareMathAlphabet{\mathsfit}{\encodingdefault}{\sfdefault}{m}{sl}
\SetMathAlphabet{\mathsfit}{bold}{\encodingdefault}{\sfdefault}{bx}{n}
\newcommand{\tens}[1]{\bm{\mathsfit{#1}}}
\def\tA{{\tens{A}}}
\def\tB{{\tens{B}}}
\def\tC{{\tens{C}}}
\def\tD{{\tens{D}}}
\def\tE{{\tens{E}}}
\def\tF{{\tens{F}}}
\def\tG{{\tens{G}}}
\def\tH{{\tens{H}}}
\def\tI{{\tens{I}}}
\def\tJ{{\tens{J}}}
\def\tK{{\tens{K}}}
\def\tL{{\tens{L}}}
\def\tM{{\tens{M}}}
\def\tN{{\tens{N}}}
\def\tO{{\tens{O}}}
\def\tP{{\tens{P}}}
\def\tQ{{\tens{Q}}}
\def\tR{{\tens{R}}}
\def\tS{{\tens{S}}}
\def\tT{{\tens{T}}}
\def\tU{{\tens{U}}}
\def\tV{{\tens{V}}}
\def\tW{{\tens{W}}}
\def\tX{{\tens{X}}}
\def\tY{{\tens{Y}}}
\def\tZ{{\tens{Z}}}
% Graph
\def\gA{{\mathcal{A}}}
\def\gB{{\mathcal{B}}}
\def\gC{{\mathcal{C}}}
\def\gD{{\mathcal{D}}}
\def\gE{{\mathcal{E}}}
\def\gF{{\mathcal{F}}}
\def\gG{{\mathcal{G}}}
\def\gH{{\mathcal{H}}}
\def\gI{{\mathcal{I}}}
\def\gJ{{\mathcal{J}}}
\def\gK{{\mathcal{K}}}
\def\gL{{\mathcal{L}}}
\def\gM{{\mathcal{M}}}
\def\gN{{\mathcal{N}}}
\def\gO{{\mathcal{O}}}
\def\gP{{\mathcal{P}}}
\def\gQ{{\mathcal{Q}}}
\def\gR{{\mathcal{R}}}
\def\gS{{\mathcal{S}}}
\def\gT{{\mathcal{T}}}
\def\gU{{\mathcal{U}}}
\def\gV{{\mathcal{V}}}
\def\gW{{\mathcal{W}}}
\def\gX{{\mathcal{X}}}
\def\gY{{\mathcal{Y}}}
\def\gZ{{\mathcal{Z}}}
% Sets
\def\sA{{\mathbb{A}}}
\def\sB{{\mathbb{B}}}
\def\sC{{\mathbb{C}}}
\def\sD{{\mathbb{D}}}
% Don't use a set called E, because this would be the same as our symbol
% for expectation.
\def\sF{{\mathbb{F}}}
\def\sG{{\mathbb{G}}}
\def\sH{{\mathbb{H}}}
\def\sI{{\mathbb{I}}}
\def\sJ{{\mathbb{J}}}
\def\sK{{\mathbb{K}}}
\def\sL{{\mathbb{L}}}
\def\sM{{\mathbb{M}}}
\def\sN{{\mathbb{N}}}
\def\sO{{\mathbb{O}}}
\def\sP{{\mathbb{P}}}
\def\sQ{{\mathbb{Q}}}
\def\sR{{\mathbb{R}}}
\def\sS{{\mathbb{S}}}
\def\sT{{\mathbb{T}}}
\def\sU{{\mathbb{U}}}
\def\sV{{\mathbb{V}}}
\def\sW{{\mathbb{W}}}
\def\sX{{\mathbb{X}}}
\def\sY{{\mathbb{Y}}}
\def\sZ{{\mathbb{Z}}}
% Entries of a matrix
\def\emLambda{{\Lambda}}
\def\emA{{A}}
\def\emB{{B}}
\def\emC{{C}}
\def\emD{{D}}
\def\emE{{E}}
\def\emF{{F}}
\def\emG{{G}}
\def\emH{{H}}
\def\emI{{I}}
\def\emJ{{J}}
\def\emK{{K}}
\def\emL{{L}}
\def\emM{{M}}
\def\emN{{N}}
\def\emO{{O}}
\def\emP{{P}}
\def\emQ{{Q}}
\def\emR{{R}}
\def\emS{{S}}
\def\emT{{T}}
\def\emU{{U}}
\def\emV{{V}}
\def\emW{{W}}
\def\emX{{X}}
\def\emY{{Y}}
\def\emZ{{Z}}
\def\emSigma{{\Sigma}}
% entries of a tensor
% Same font as tensor, without \bm wrapper
\newcommand{\etens}[1]{\mathsfit{#1}}
\def\etLambda{{\etens{\Lambda}}}
\def\etA{{\etens{A}}}
\def\etB{{\etens{B}}}
\def\etC{{\etens{C}}}
\def\etD{{\etens{D}}}
\def\etE{{\etens{E}}}
\def\etF{{\etens{F}}}
\def\etG{{\etens{G}}}
\def\etH{{\etens{H}}}
\def\etI{{\etens{I}}}
\def\etJ{{\etens{J}}}
\def\etK{{\etens{K}}}
\def\etL{{\etens{L}}}
\def\etM{{\etens{M}}}
\def\etN{{\etens{N}}}
\def\etO{{\etens{O}}}
\def\etP{{\etens{P}}}
\def\etQ{{\etens{Q}}}
\def\etR{{\etens{R}}}
\def\etS{{\etens{S}}}
\def\etT{{\etens{T}}}
\def\etU{{\etens{U}}}
\def\etV{{\etens{V}}}
\def\etW{{\etens{W}}}
\def\etX{{\etens{X}}}
\def\etY{{\etens{Y}}}
\def\etZ{{\etens{Z}}}
% The true underlying data generating distribution
\newcommand{\pdata}{p_{\rm{data}}}
% The empirical distribution defined by the training set
\newcommand{\ptrain}{\hat{p}_{\rm{data}}}
\newcommand{\Ptrain}{\hat{P}_{\rm{data}}}
% The model distribution
\newcommand{\pmodel}{p_{\rm{model}}}
\newcommand{\Pmodel}{P_{\rm{model}}}
\newcommand{\ptildemodel}{\tilde{p}_{\rm{model}}}
% Stochastic autoencoder distributions
\newcommand{\pencode}{p_{\rm{encoder}}}
\newcommand{\pdecode}{p_{\rm{decoder}}}
\newcommand{\precons}{p_{\rm{reconstruct}}}
\newcommand{\laplace}{\mathrm{Laplace}} % Laplace distribution
\newcommand{\E}{\mathbb{E}}
\newcommand{\Ls}{\mathcal{L}}
\newcommand{\R}{\mathbb{R}}
\newcommand{\emp}{\tilde{p}}
\newcommand{\lr}{\alpha}
\newcommand{\reg}{\lambda}
\newcommand{\rect}{\mathrm{rectifier}}
\newcommand{\softmax}{\mathrm{softmax}}
\newcommand{\sigmoid}{\sigma}
\newcommand{\softplus}{\zeta}
\newcommand{\KL}{D_{\mathrm{KL}}}
\newcommand{\Var}{\mathrm{Var}}
\newcommand{\standarderror}{\mathrm{SE}}
\newcommand{\Cov}{\mathrm{Cov}}
% Wolfram Mathworld says $L^2$ is for function spaces and $\ell^2$ is for vectors
% But then they seem to use $L^2$ for vectors throughout the site, and so does
% wikipedia.
\newcommand{\normlzero}{L^0}
\newcommand{\normlone}{L^1}
\newcommand{\normltwo}{L^2}
\newcommand{\normlp}{L^p}
\newcommand{\normmax}{L^\infty}
\newcommand{\parents}{Pa} % See usage in notation.tex. Chosen to match Daphne's book.
\DeclareMathOperator*{\argmax}{arg\,max}
\DeclareMathOperator*{\argmin}{arg\,min}
\DeclareMathOperator{\sign}{sign}
\DeclareMathOperator{\Tr}{Tr}
\let\ab\allowbreak
\begin{thebibliography}{34}
\providecommand{\natexlab}[1]{#1}
\providecommand{\url}[1]{\texttt{#1}}
\expandafter\ifx\csname urlstyle\endcsname\relax
\providecommand{\doi}[1]{doi: #1}\else
\providecommand{\doi}{doi: \begingroup \urlstyle{rm}\Url}\fi
\bibitem[Achiam et~al.(2023)Achiam, Adler, Agarwal, Ahmad, Akkaya, Aleman, Almeida, Altenschmidt, Altman, Anadkat, et~al.]{gpt4}
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia~Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et~al.
\newblock Gpt-4 technical report.
\newblock \emph{arXiv preprint arXiv:2303.08774}, 2023.
\bibitem[Assouel et~al.(2025)Assouel, Campbell, and Webb]{visual_symbolic_mechanism}
Rim Assouel, Declan Campbell, and Taylor Webb.
\newblock Visual symbolic mechanisms: Emergent symbol processing in vision language models.
\newblock \emph{arXiv preprint arXiv:2506.15871}, 2025.
\bibitem[Bai et~al.(2023)Bai, Bai, Yang, Wang, Tan, Wang, Lin, Zhou, and Zhou]{qwen_vl}
Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou.
\newblock Qwen-vl: A versatile vision-language model for understanding, localization, text reading, and beyond, 2023.
\bibitem[Bai et~al.(2025)Bai, Chen, Liu, Wang, Ge, Song, Dang, Wang, Wang, Tang, Zhong, Zhu, Yang, Li, Wan, Wang, Ding, Fu, Xu, Ye, Zhang, Xie, Cheng, Zhang, Yang, Xu, and Lin]{qwen2.5_vl}
Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, Humen Zhong, Yuanzhi Zhu, Mingkun Yang, Zhaohai Li, Jianqiang Wan, Pengfei Wang, Wei Ding, Zheren Fu, Yiheng Xu, Jiabo Ye, Xi~Zhang, Tianbao Xie, Zesen Cheng, Hang Zhang, Zhibo Yang, Haiyang Xu, and Junyang Lin.
\newblock Qwen2.5-vl technical report, 2025.
\bibitem[Basu et~al.(2024)Basu, Grayson, Morrison, Nushi, Feizi, and Massiceti]{basu24_storage_transfer_vlm}
Samyadeep Basu, Martin Grayson, Cecily Morrison, Besmira Nushi, Soheil Feizi, and Daniela Massiceti.
\newblock Understanding information storage and transfer in multi-modal large language models.
\newblock \emph{arXiv preprint arXiv:2406.04236}, 2024.
\bibitem[Campbell et~al.(2024)Campbell, Rane, Giallanza, De~Sabbata, Ghods, Joshi, Ku, Frankland, Griffiths, Cohen, et~al.]{binding_problem}
Declan Campbell, Sunayana Rane, Tyler Giallanza, Camillo~Nicol{\`o} De~Sabbata, Kia Ghods, Amogh Joshi, Alexander Ku, Steven Frankland, Tom Griffiths, Jonathan~D Cohen, et~al.
\newblock Understanding the limits of vision language models through the lens of the binding problem.
\newblock \emph{Advances in Neural Information Processing Systems}, 37:\penalty0 113436--113460, 2024.
\bibitem[Chefer et~al.(2021)Chefer, Gur, and Wolf]{chefer21_generic_attention}
Hila Chefer, Shir Gur, and Lior Wolf.
\newblock Generic attention-model explainability for interpreting bi-modal and encoder-decoder transformers.
\newblock In \emph{Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)}, pp.\ 397--406, 2021.
\bibitem[Clark et~al.(2019)Clark, Khandelwal, Levy, and Manning]{clark19_bert_attention}
Kevin Clark, Urvashi Khandelwal, Omer Levy, and Christopher~D. Manning.
\newblock What does {BERT} look at? an analysis of {BERT}'s attention.
\newblock In \emph{Proceedings of the 3rd Workshop on BlackboxNLP}, pp.\ 276--286. ACL, 2019.
\bibitem[Comanici et~al.(2025)Comanici, Bieber, Schaekermann, Pasupat, Sachdeva, Dhillon, Blistein, Ram, Zhang, Rosen, et~al.]{gemini2.5}
Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, et~al.
\newblock Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities.
\newblock \emph{arXiv preprint arXiv:2507.06261}, 2025.
\bibitem[Conmy et~al.(2023)Conmy, Mavor-Parker, Lynch, Heimersheim, and Garriga-Alonso]{conmy23_automated_circuit_discovery}
Arthur Conmy, Augustine Mavor-Parker, Aengus Lynch, Stefan Heimersheim, and Adri{\`a} Garriga-Alonso.
\newblock Towards automated circuit discovery for mechanistic interpretability.
\newblock In \emph{Advances in Neural Information Processing Systems (NeurIPS)}, 2023.
\bibitem[Dai et~al.(2024)Dai, Heinzerling, and Inui]{dai24_binding_order}
Qin Dai, Benjamin Heinzerling, and Kentaro Inui.
\newblock Representational analysis of binding in language models.
\newblock In \emph{Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP)}, 2024.
\bibitem[Favero et~al.(2024)Favero, Zancato, Trager, Choudhary, Perera, Achille, Swaminathan, and Soatto]{m3id}
Alessandro Favero, Luca Zancato, Matthew Trager, Siddharth Choudhary, Pramuditha Perera, Alessandro Achille, Ashwin Swaminathan, and Stefano Soatto.
\newblock Multi-modal hallucination control by visual information grounding.
\newblock In \emph{Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, pp.\ 14303--14312, 2024.
\bibitem[Feng \& Steinhardt(2023)Feng and Steinhardt]{binding_id}
Jiahai Feng and Jacob Steinhardt.
\newblock How do language models bind entities in context?
\newblock \emph{arXiv preprint arXiv:2310.17191}, 2023.
\bibitem[Geva et~al.(2023)Geva, Bastings, Filippova, and Globerson]{geva23_dissect_recall}
Mor Geva, Jasmijn Bastings, Katja Filippova, and Amir Globerson.
\newblock Dissecting recall of factual associations in auto-regressive language models.
\newblock In \emph{Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP)}, pp.\ 12198--12217. ACL, 2023.
\bibitem[Hao et~al.(2025)Hao, Gu, Wang, Li, Yang, Wang, and Cheng]{emma}
Yunzhuo Hao, Jiawei Gu, Huichen~Will Wang, Linjie Li, Zhengyuan Yang, Lijuan Wang, and Yu~Cheng.
\newblock Can mllms reason in multimodality? emma: An enhanced multimodal reasoning benchmark, 2025.
\bibitem[Huang et~al.(2024)Huang, Dong, Zhang, Wang, He, Wang, Lin, Zhang, and Yu]{opera}
Qidong Huang, Xiaoyi Dong, Pan Zhang, Bin Wang, Conghui He, Jiaqi Wang, Dahua Lin, Weiming Zhang, and Nenghai Yu.
\newblock Opera: Alleviating hallucination in multi-modal large language models via over-trust penalty and retrospection-allocation.
\newblock In \emph{Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition}, pp.\ 13418--13427, 2024.
\bibitem[Hurst et~al.(2024)Hurst, Lerer, Goucher, Perelman, Ramesh, Clark, Ostrow, Welihinda, Hayes, Radford, et~al.]{gpt4o}
Aaron Hurst, Adam Lerer, Adam~P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ~Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, et~al.
\newblock Gpt-4o system card.
\newblock \emph{arXiv preprint arXiv:2410.21276}, 2024.
\bibitem[Izadi et~al.(2025)Izadi, Banayeeanzade, Askari, Rahimiakbar, Vahedi, Hasani, and Baghshah]{viser}
Amirmohammad Izadi, Mohammad~Ali Banayeeanzade, Fatemeh Askari, Ali Rahimiakbar, Mohammad~Mahdi Vahedi, Hosein Hasani, and Mahdieh~Soleymani Baghshah.
\newblock Visual structures helps visual reasoning: Addressing the binding problem in vlms.
\newblock \emph{arXiv preprint arXiv:2506.22146}, 2025.
\bibitem[Jiang et~al.(2024)Jiang, Kachinthaya, Petryk, and Gandelsman]{jiang24_vl_rep_edit}
Nick Jiang, Anish Kachinthaya, Suzie Petryk, and Yossi Gandelsman.
\newblock Interpreting and editing vision-language representations to mitigate hallucinations.
\newblock \emph{arXiv preprint arXiv:2410.02762}, 2024.
\bibitem[Jung et~al.(2025)Jung, Lee, Kim, and Yoon]{sparc}
Mingi Jung, Saehyung Lee, Eunji Kim, and Sungroh Yoon.
\newblock Visual attention never fades: Selective progressive attention recalibration for detailed image captioning in multimodal large language models.
\newblock \emph{arXiv preprint arXiv:2502.01419}, 2025.
\bibitem[Leng et~al.(2024)Leng, Zhang, Chen, Li, Lu, Miao, and Bing]{vcd}
Sicong Leng, Hang Zhang, Guanzheng Chen, Xin Li, Shijian Lu, Chunyan Miao, and Lidong Bing.
\newblock Mitigating object hallucinations in large vision-language models through visual contrastive decoding.
\newblock In \emph{Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition}, pp.\ 13872--13882, 2024.
\bibitem[Li et~al.(2023)Li, Du, Zhou, Wang, Zhao, and Wen]{pope}
Yifan Li, Yifan Du, Kun Zhou, Jinpeng Wang, Wayne~Xin Zhao, and Ji-Rong Wen.
\newblock Evaluating object hallucination in large vision-language models.
\newblock \emph{arXiv preprint arXiv:2305.10355}, 2023.
\bibitem[Lin et~al.(2014)Lin, Maire, Belongie, Hays, Perona, Ramanan, Doll{\'a}r, and Zitnick]{ms_coco}
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll{\'a}r, and C~Lawrence Zitnick.
\newblock Microsoft coco: Common objects in context.
\newblock In \emph{European conference on computer vision}, pp.\ 740--755. Springer, 2014.
\bibitem[Liu et~al.(2024)Liu, Xue, Chen, Chen, Zhao, Wang, Hou, Li, and Peng]{hallucination_survey}
Hanchao Liu, Wenyuan Xue, Yifei Chen, Dapeng Chen, Xiutian Zhao, Ke~Wang, Liping Hou, Rongjun Li, and Wei Peng.
\newblock A survey on hallucination in large vision-language models.
\newblock \emph{arXiv preprint arXiv:2402.00253}, 2024.
\bibitem[Liu et~al.(2023{\natexlab{a}})Liu, Li, Li, and Lee]{llava1.5}
Haotian Liu, Chunyuan Li, Yuheng Li, and Yong~Jae Lee.
\newblock Improved baselines with visual instruction tuning, 2023{\natexlab{a}}.
\bibitem[Liu et~al.(2023{\natexlab{b}})Liu, Li, Wu, and Lee]{llava}
Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong~Jae Lee.
\newblock Visual instruction tuning.
\newblock In \emph{NeurIPS}, 2023{\natexlab{b}}.
\bibitem[Meng et~al.(2022)Meng, Bau, Andonian, and Belinkov]{meng22_rome_factual_edit}
Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov.
\newblock Locating and editing factual associations in {GPT}.
\newblock In \emph{Advances in Neural Information Processing Systems (NeurIPS)}, 2022.
\bibitem[Neo et~al.(2024)Neo, Ong, Torr, Geva, Krueger, and Barez]{llava_interp}
Clement Neo, Luke Ong, Philip Torr, Mor Geva, David Krueger, and Fazl Barez.
\newblock Towards interpreting visual information processing in vision-language models.
\newblock \emph{arXiv preprint arXiv:2410.07149}, 2024.
\bibitem[nostalgebraist(2020)]{nostalgebraist20_logit_lens}
nostalgebraist.
\newblock Interpreting {GPT}: The logit lens.
\newblock \url{https://www.lesswrong.com/posts/AcKRB8wDpdaN6v6ru/interpreting-gpt-the-logit-lens}, 2020.
\newblock Blog post.
\bibitem[Rohrbach et~al.(2018)Rohrbach, Hendricks, Burns, Darrell, and Saenko]{chair}
Anna Rohrbach, Lisa~Anne Hendricks, Kaylee Burns, Trevor Darrell, and Kate Saenko.
\newblock Object hallucination in image captioning.
\newblock \emph{arXiv preprint arXiv:1809.02156}, 2018.
\bibitem[Rudman et~al.(2025)Rudman, Golovanevsky, Bar, Palit, LeCun, Eickhoff, and Singh]{forgotten_polygons}
William Rudman, Michal Golovanevsky, Amir Bar, Vedant Palit, Yann LeCun, Carsten Eickhoff, and Ritambhara Singh.
\newblock Forgotten polygons: Multimodal large language models are shape-blind.
\newblock \emph{arXiv preprint arXiv:2502.15969}, 2025.
\bibitem[Saravanan et~al.(2025)Saravanan, Tapaswi, and Gandhi]{vision_binding_id}
Darshana Saravanan, Makarand Tapaswi, and Vineet Gandhi.
\newblock Investigating mechanisms for in-context vision language binding.
\newblock In \emph{Proceedings of the Computer Vision and Pattern Recognition Conference}, pp.\ 4852--4856, 2025.
\bibitem[Schrodi et~al.(2024)Schrodi, Hoffmann, Argus, Fischer, and Brox]{modality_gap}
Simon Schrodi, David~T Hoffmann, Max Argus, Volker Fischer, and Thomas Brox.
\newblock Two effects, one trigger: On the modality gap, object bias, and information imbalance in contrastive vision-language representation learning.
\newblock \emph{arXiv preprint arXiv:2404.07983}, 2024.
\bibitem[Vig et~al.(2020)Vig, Gehrmann, Belinkov, Qian, Nevo, Singer, and Shieber]{vig2020investigating}
Jesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian, Daniel Nevo, Yaron Singer, and Stuart Shieber.
\newblock Investigating gender bias in language models using causal mediation analysis.
\newblock \emph{Advances in neural information processing systems}, 33:\penalty0 12388--12401, 2020.
\end{thebibliography}