MIC: Explaining Image–Claim Inconsistencies in AI-Generated Multimodal Misinformation

Ruihong Zeng ^†^†thanks: Work done during an internship at UKP Lab. Jonathan Tonglet Affiliation: Department of Electrical Engineering, KU Leuven, Belgium Affiliation: Department of Computer Science, KU Leuven, Belgium Preslav Nakov Iryna Gurevych Affiliation: Ubiquitous Knowledge Processing Lab (UKP Lab), Department of Computer ScienceTU Darmstadt and National Research Center for Applied Cybersecurity ATHENE, Germany Affiliation: Mohamed bin Zayed University of Artificial Intelligence, UAE

Abstract

Claims paired with AI-generated images are a rapidly growing form of misinformation. Existing automated fact-checking (AFC) methods mainly treat this as a provenance problem, detecting low-level synthesis artifacts to decide whether an image is AI-generated. However, such methods do not verify what human fact-checkers often check: whether an image’s content is consistent with the context implied by its accompanying claim. To address this gap, we introduce MIC (Multimodal Inconsistency Checking), an AFC framework that assists human fact-checkers by detecting AI-generated multimodal misinformation and explaining inconsistencies using world knowledge. MIC first uses supervised fine-tuning (SFT) for task adaptation and then applies Group Relative Policy Optimization (GRPO) to directly optimize component-level verifiable rewards for verdict prediction, inconsistency type classification, visual evidence description, and world-knowledge explanation. We further introduce MIC-Bench, a benchmark comprising 8,812 image–claim instances derived from 4,406 claims, where each claim is paired with an authentic image and an AI-generated counterpart that introduces a controlled contextual inconsistency. Compared with SFT alone, GRPO further improves Macro-F1 by 4.67 and 4.11 points in the in-distribution and out-of-distribution settings, respectively, while also improving the semantic similarity of visual evidence descriptions and world-knowledge explanations to reference annotations. Our code and data are available at https://github.com/UKPLab/arxiv2026-mic.

1 Introduction

AI-generated images paired with claims are an increasingly pressing form of misinformation Dufour et al. (2024); Drolsbach and Pröllochs (2025). Journalists and fact-checkers have developed practical verification strategies over time, many of which rely on identifying inconsistencies between the image and its claimed context (van Ess, 2025). Figure 1 (A) illustrates a real-world example in which AI-generated multimodal misinformation is exposed by a human fact-checker using knowledge of Nigerian driving rules (Awosoro, 2026).

Refer to caption — Figure 1: (A) A real-world example of AI-generated multimodal misinformation fact-checked by a human expert (Awosoro, 2026). (B) A MIC-Bench example of AI-generated multimodal misinformation fact-checked by MIC using visual evidence and world knowledge.

While photorealistic images can be rapidly generated and disseminated alongside false claims Wack et al. (2024); Cazzamatta and Sarısakaloğlu (2025), verifying them often requires hours for human fact-checkers van Ess (2025). To support this process, prior work has focused on detecting AI-generated images through synthesis artifacts, such as subtle pixel-level irregularities in texture or noise patterns Karageorgiou et al. (2025); Gye et al. (2025); Xu et al. (2025b). Recent methods also explain detection results by describing detected artifacts Zhou et al. (2025); Ji et al. (2026). However, these methods face two key limitations. First, synthesis artifacts become increasingly subtle as generative models improve, placing detectors in a continual arms race Liu et al. (2024); Xu et al. (2025a); Pei et al. (2026). Second, even when these methods detect that an image is AI-generated, they do not identify whether a specific visual element conflicts with the context implied by the accompanying claim (van Ess, 2025). OOC detection studies authentic images paired with misleading captions (Qi et al., 2024; Tonglet et al., 2025), while AI-generated news detection distinguishes real from generated news (Huang et al., 2024; Zhang et al., 2025c). Neither directly addresses cases where an AI-generated image broadly depicts the claimed event but contains a localized, context-dependent inconsistency. Identifying and explaining such inconsistencies requires localizing the relevant visual evidence and applying world knowledge about the claimed context, which remains time-consuming for human fact-checkers.

To address this gap, we study claim-grounded visual inconsistency detection for AI-generated multimodal misinformation. Given an image–claim pair, the model predicts whether the pair is consistent. When an inconsistency is detected, the model also identifies its type, describes the relevant visual evidence, and uses world knowledge to explain why this evidence conflicts with the claim.

To tackle this challenge, we propose MIC, a multimodal large language model (MLLM) for structured and explainable verification of AI-generated multimodal misinformation. Rather than producing an unconstrained binary verdict or free-form rationale, MIC decomposes verification into four structured outputs: (i) a consistency verdict, (ii) an inconsistency type, (iii) a visual evidence description, and (iv) a world-knowledge explanation. To align generation with these objectives, MIC adopts a two-stage training framework. First, SFT teaches the model to produce structured reasoning traces that identify the relevant visual evidence and explain how it supports or contradicts the claim context. Next, GRPO refines the model using verifiable rewards over the four task components, jointly improving verdict accuracy, inconsistency type prediction, visual evidence description, and knowledge-based explanation generation. This formulation transforms explanation generation from unconstrained free-form reasoning into a set of grounded and verifiable objectives.

To support training and evaluation, we introduce MIC-Bench, a benchmark of 8,812 image–claim instances derived from 4,406 real news image–claim pairs, where each claim is paired with one authentic image and one AI-generated counterpart containing a single, visually plausible inconsistency drawn from one of nine inconsistency types rooted in the practices and accumulated experience of journalists and fact-checkers (van Ess, 2025). In addition to binary verdicts, MIC-Bench provides structured annotations for inconsistency types, visual evidence descriptions, and world-knowledge explanations, enabling fine-grained evaluation of both prediction accuracy and explanation quality. Our experiments against eleven strong baselines show that MIC substantially improves Macro-F1 while generating explanations that more closely match the reference annotations across both in-distribution and out-of-distribution settings, and outperforms all baselines on images from an unseen generator.

We make the following contributions:

•

We formulate claim-grounded visual inconsistency detection as a specific setting of image–claim consistency verification, focusing on AI-generated images that broadly depict the claimed event but contain a localized visual detail conflicting with the geographic, cultural, or temporal context implied by the claim.
•

We introduce MIC-Bench, a benchmark of 8,812 image–claim instances, where each claim is paired with an authentic image and an AI-generated counterpart containing a single controlled inconsistency, annotated with its type, a visual evidence description, and a world-knowledge explanation.
•

We propose MIC, which uses GRPO to directly optimize component-level verifiable rewards for verdict prediction, inconsistency type classification, visual evidence description, and world-knowledge explanation.

2 Related Work

AI-Generated Image Detection.

Detecting whether an image is AI-generated has been extensively studied as generative models evolved from GANs to diffusion-based systems Xu et al. (2025a); Pei et al. (2026). Early approaches relied on CNN-based image-domain cues and frequency-domain artifacts Wang et al. (2020); Frank et al. (2020), while more recent methods incorporate CLIP-based representations Tan et al. (2025b); Keita et al. (2025), commonsense reasoning over physically implausible content Tan et al. (2025a); Yang et al. (2025b), and natural language rationales to explain the detection decisions Zhou et al. (2025); Ji et al. (2026). Other work has focused on provenance signals and content authentication rather than passive detection Rosenthol (2022); Gowal et al. (2025). Collectively, these approaches provide valuable signals for human fact-checking. However, most of them primarily address whether an image is AI-generated, rather than whether the depicted visual content is consistent with the context implied by the claim.

Multimodal AFC.

AFC aims to support human fact-checkers by automating parts of their workflow Nakov et al. (2021); Guo et al. (2022); Akhtar et al. (2023); Geng et al. (2025). Within multimodal AFC, prior work has studied out-of-context (OOC) misinformation, where authentic images are paired with claims that misrepresent their event, location, or time (Qi et al., 2024; Papadopoulos et al., 2025; Tonglet et al., 2025). For AI-generated news, MiRAGeNews generates fictional captions and corresponding images, framing detection as distinguishing real from generated image–caption pairs (Huang et al., 2024). For explainable verification, Fact-R1 Zhang et al. (2025a) studies video misinformation detection and its FakeVV dataset constructs out-of-context misinformation by replacing entities in news titles while retaining the original videos. In MIC-Bench, we instead keep each real-event claim fixed and pair it with an authentic source image and an AI-generated counterpart containing a single localized visual inconsistency. Our setting targets visual details that conflict with the geographic, cultural, or temporal context implied by the claim, while the image broadly depicts the claimed event.

3 The MIC-Bench Dataset

While AI-generated multimodal misinformation is growing rapidly, real-world fact-checked instances remain too limited and sparsely annotated to support supervised training Geng et al. (2025). Existing image–claim misinformation benchmarks do not jointly provide an authentic image and a controlled edited counterpart paired with the same real-event claim, together with fine-grained annotations of the inconsistency type, visual evidence, and world-knowledge explanation. We therefore construct MIC-Bench, a synthetic dataset based on real news image–caption pairs from TARA Fu et al. (2022). We treat each caption as a claim $c$ and its image as the consistent source image $I_{\text{con}}$ . Appendix A.5 provides a detailed comparison with related benchmarks.

3.1 Inconsistency Taxonomy

Prior work emphasizes designing AFC from the perspective of professional fact-checkers (Nakov et al., 2021). Accordingly, to define the scope of inconsistencies represented in MIC-Bench, we introduce a taxonomy of nine types grounded in journalism fact-checking guidelines (van Ess, 2025). Each selected type involves a visual element that can be localized and modified through a controlled edit, but judging its consistency with the claim requires relevant world knowledge about the event and its geographic, cultural, or temporal context. As summarized in Table 1, the taxonomy includes clothing, flag, gesture, signage, architecture, infrastructure, technology, branding, and environment, with representative examples provided in Appendix A.6.

3.2 Dataset Construction

As shown in Figure 2, our pipeline introduces one controlled inconsistency into each selected source image. We first use GPT-4o-mini OpenAI (2024) to select image–claim pairs with visible elements that can be edited to create an inconsistency with the claim’s context. We then use GPT-5.5 to check whether the visual elements associated with each of the nine inconsistency types are clearly visible, without inferring their presence from the claim. We then assign one target type per retained pair using a constrained-first and rarest-first strategy to balance taxonomy coverage. For the selected type, GPT-5.5 OpenAI (2026b) generates a detailed edit instruction, an initial visual evidence description $v_{0}$ , and an initial world-knowledge explanation $e_{0}$ . GPT-Image-1.5 OpenAI (2025) then generates the inconsistent counterpart $I_{\text{inc}}$ by modifying only the target visual element while preserving the rest of the image. This design controls what is edited, which inconsistency type is introduced, and why it contradicts the claimed context.

Inconsistency type	Representative visual elements
clothing	Uniforms, traditional clothing, religious attire
flag	National flags, regional flags, protest flags
gesture	Cultural greetings, public-speech gestures
signage	Storefront signs, government signs, street signs
architecture	Religious buildings, civic landmarks, arches, facades
infrastructure	Road signs, transit signs, traffic signals
technology	Consumer electronics, broadcast devices
branding	Brand logos, campaign materials, event marks
environment	Vegetation, weather, seasonal cues, landscapes

Table 1: The nine inconsistency types in MIC-Bench.

3.3 Annotation Schema

Each claim $c$ is paired with a source image $I_{\text{con}}$ and an edited image $I_{\text{inc}}$ . The inconsistent image is annotated with $(k,v,e)$ , where $k$ is an inconsistency type from $\mathcal{K}$ , the set of the nine inconsistency types, $v$ describes the manipulated visual element, and $e$ explains why the edit contradicts the claimed context. The consistent image uses None for these fields. To support structured reasoning supervision, we provide two rationales for each claim: $r_{\text{con}}$ for why $I_{\text{con}}$ is consistent with $c$ , and $r_{\text{inc}}$ for why $I_{\text{inc}}$ contradicts $c$ . These rationales are initialized by GPT-5.5 and human-verified to remain grounded in the image and consistent with the final annotations. For test-set quality control, two annotators determine whether to keep each candidate based on visual realism, edit fidelity, and the factual correctness of the explanation. They achieved 97.4% agreement on whether each candidate should be kept or rejected, with Krippendorff’s $\alpha=0.81$ Hayes and Krippendorff (2007). Retained examples were revised when necessary to ensure that their rationales remained grounded in the image and consistent with $(k,v,e)$ .

The final dataset comprises 4,406 claims, each paired with one consistent source image and one AI-generated inconsistent counterpart, yielding 8,812 image–claim instances in total. We use a temporal split and report two test settings: in-distribution replacement, where the visual elements introduced by the edit also appear in the training data, and out-of-distribution replacement, where the introduced visual elements are held out from training. Details are provided in Appendix A.

4 Problem Formulation

Given a news image $I$ and a claim $c$ , the goal of claim-grounded visual inconsistency detection is to determine whether the image is consistent with the context implied by the claim, yielding a verdict $y\in\{\textsc{consistent},\textsc{inconsistent}\}$ . For consistent cases, the inconsistency-specific outputs are set to None. For inconsistent cases, the model additionally predicts: (i) an inconsistency type $k\in\mathcal{K}$ from the taxonomy defined in Section 3.1, (ii) a description $v$ of the visual element for the inconsistency, and (iii) an explanation $e$ that grounds the inconsistency in relevant world knowledge.

5 Method

5.1 Overall Framework

MIC trains an MLLM through two stages: (i) MIC first applies SFT DeepSeek-AI (2025) to teach the MLLM the structured output schema and initialize its ability to generate explanations grounded in world knowledge. (ii) The SFT-initialized model is then refined using GRPO Shao et al. (2024), where rule-based verifiable rewards are used to improve the reliability of inconsistency detection and explanation generation.

To support structured generation and reward computation, MIC serializes each model output into five fixed fields: <think>, <verdict>, <type>, <visual>, and <explanation>. The <think> field contains the reasoning trace $r$ , i.e., $r_{\text{con}}$ for consistent image–claim pairs and $r_{\text{inc}}$ for inconsistent pairs. The remaining fields correspond to the structured prediction $(y,k,v,e)$ . This separation makes the reasoning process and verifiable outputs independently parseable, enabling per-field supervision during SFT and per-field reward optimization during GRPO.

5.2 SFT

We perform SFT using the reference reasoning traces and annotations introduced in Section 3.3. For each training instance, the target sequence contains a reference reasoning trace in the <think> field, using $r_{\text{con}}$ for consistent image–claim pairs and $r_{\text{inc}}$ for inconsistent pairs, followed by the structured targets $(y,k,v,e)$ in the remaining fields. For consistent instances, inconsistency-specific fields are filled with None. For parameter-efficient adaptation, we use LoRA Hu et al. (2022) by inserting low-rank adaptation modules into the linear layers of the vision encoder, the vision–language projector, and the language model, while keeping the pretrained weights frozen.

5.3 Reward Functions Design

We use a format reward $R_{\text{fmt}}$ following previous work DeepSeek-AI (2025) and define four task-specific rewards for verdict prediction ( $R_{\text{ver}}$ ), inconsistency type classification ( $R_{\text{type}}$ ), visual evidence description ( $R_{\text{desc}}$ ), and world-knowledge explanation ( $R_{\text{exp}}$ ).

Given an image–claim pair $(I,c)$ , the policy model $\pi_{\theta}$ generates a structured response $o$ , which is parsed by $P(\cdot)$ into predictions $(\hat{y},\hat{k},\hat{v},\hat{e})=P(o)$ . For inconsistent examples, the overall reward is computed as a weighted combination of the five reward components:

$\displaystyle R(I,c,o)=$	$\displaystyle\ \lambda_{\text{fmt}}R_{\text{fmt}}(o)+\lambda_{\text{ver}}R_{\text{ver}}(o)$
	$\displaystyle+\lambda_{\text{type}}R_{\text{type}}(o)+\lambda_{\text{desc}}R_{\text{desc}}(o)$
	$\displaystyle+\lambda_{\text{exp}}R_{\text{exp}}(o),$	(1)

where $\lambda_{\text{fmt}}$ , $\lambda_{\text{ver}}$ , $\lambda_{\text{type}}$ , $\lambda_{\text{desc}}$ , and $\lambda_{\text{exp}}$ denote the corresponding reward weights. For consistent examples, the overall reward includes only $R_{\text{fmt}}$ and $R_{\text{ver}}$ , excluding inconsistency-specific rewards from the weighted sum.

Format Reward.

To ensure reliable reward extraction, we use a binary format reward that assigns a score 1 when the generated response can be parsed into $P(o)$ and contains all required fields, and 0 otherwise.

Accuracy-based Rewards.

$R_{\text{ver}}$ and $R_{\text{type}}$ are binary accuracy rewards for the predicted verdict $\hat{y}$ and predicted inconsistency type $\hat{k}$ , respectively, assigning 1 to correct predictions and 0 otherwise.

Embedding-based Semantic Rewards.

We define $R_{\text{desc}}$ and $R_{\text{exp}}$ as the cosine similarity between the generated visual evidence description $\hat{v}$ or world-knowledge explanation $\hat{e}$ and ground-truth annotation, computed using Qwen3-Embedding-0.6B Zhang et al. (2025b).

5.4 GRPO Optimization

After SFT, we further train the model using GRPO Shao et al. (2024). For each image–claim pair $(I,c)$ , the model samples a group of $G$ structured responses $\{o_{i}\}_{i=1}^{G}$ . Each response is assigned a reward according to the reward function defined in Section 5.3, i.e., $\rho_{i}=R(I,c,o_{i})$ . These response-level rewards can therefore be used directly for policy optimization.

GRPO computes a group-relative advantage score $A_{i}$ by normalizing the rewards within the sampled response group:

\displaystyle A_{i}=\frac{\rho_{i}-\mathrm{mean}(\{\rho_{1},\ldots,\rho_{G}\})}{\mathrm{std}(\{\rho_{1},\ldots,\rho_{G}\})+\epsilon},

(2)

where $\epsilon$ is a small constant introduced for numerical stability. This group-relative normalization favors higher-reward responses within the sampled group without requiring a separate value model. We further compare GRPO with DPO (Rafailov et al., 2023) in Appendix C.8 and find that GRPO performs better overall.

6 Experiments

6.1 Baselines

We compare MIC against various baselines: (i) a generic vision-language encoder, CLIP; (ii) multimodal misinformation detectors, SNIFFER (Qi et al., 2024) and MiRAGe Huang et al. (2024); (iii) closed-source VLM, GPT-5.4-mini OpenAI (2026a); and (iv) open-source VLMs, including Qwen2.5-VL-3B-Instruct (Bai et al., 2025), Qwen3-VL variants (Team, 2025), LLaVA-OneVision-7B (Li et al., 2025), and InternVL3-8B (Zhu et al., 2025).

	In-Distribution Replacement				Out-of-Distribution Replacement
Model	Macro-F1	TypeAcc	VisualSim	ExplSim	Macro-F1	TypeAcc	VisualSim	ExplSim
CLIP	39.91	–	–	–	40.72	–	–	–
MiRAGe	53.13	–	–	–	51.70	–	–	–
SNIFFER	46.69	–	–	10.66	44.07	–	–	8.49
GPT-5.4-mini	53.89	11.52	20.14	17.88	53.00	12.18	19.43	17.02
Qwen2.5-VL-3B-Instruct	40.47	15.79	13.83	29.11	38.98	13.32	11.83	28.08
Qwen3-VL-4B-Instruct	58.90	19.06	23.16	25.24	59.44	19.63	24.18	27.18
Qwen3-VL-8B-Instruct	59.95	23.33	26.74	28.55	58.14	19.77	25.13	26.88
Qwen3-VL-30B-A3B	63.96	32.01	37.95	37.42	63.14	33.81	38.45	36.61
LLaVA-OneVision-7B	56.01	9.25	13.97	18.65	52.06	7.59	10.43	16.45
InternVL3-8B	55.52	13.66	18.24	22.65	55.56	14.18	17.82	22.51
Qwen3-VL-8B-Thinking	59.79	40.40	43.41	46.19	59.09	37.54	42.64	46.28
MIC	94.88	89.76	83.04	82.54	90.26	78.65	72.09	75.78

Table 2: Performance (in %) of MIC and baselines on MIC-Bench. In-Distribution Replacement uses edited-in visual elements seen during training, whereas Out-of-Distribution Replacement uses edited-in visual elements held out from training. The best performance per dataset per metric is marked in boldface.

6.2 Implementation Details

We implement MIC in PyTorch (Paszke et al., 2019) and conduct all experiments on 8 AMD MI210 GPUs, each with 64 GB of memory. During SFT, we adopt Qwen3-VL-4B-Instruct (Team, 2025) as the backbone model and use LoRA adapters with rank $r=64$ and scaling factor $\alpha=128$ . The model is trained for 3 epochs using AdamW with a learning rate of $2\times 10^{-4}$ and a batch size of 8. For GRPO training, we initialize the model from the SFT checkpoint and optimize it using a batch size of 8 with 8 sampled rollouts per prompt. More implementation details are provided in Appendix B.2.

6.3 Evaluation Metrics

We report Macro-F1 over consistent and inconsistent verdicts. For inconsistent examples, TypeAcc measures inconsistency-type accuracy, while VisualSim and ExplSim measure the semantic similarity of generated visual evidence and world-knowledge explanations to their respective references. Following Section 5.3, both similarity metrics are computed using Qwen3-Embedding-0.6B Zhang et al. (2025b). We assess robustness across embedding models in Appendix C.4 and report reference-based VisualJudge and ExplJudge scores in Appendix C.5.

Figure 3: Verdict prediction performance on the test set.

6.4 Main Results

We provide our main experimental results in this section. Additional results are in Appendix C.

MIC achieves a higher Macro-F1 in verdict classification.

Figure 3 compares the per-class F1 scores of MIC and representative baselines. $F_{1}^{\mathrm{inc}}$ measures inconsistency detection, while $F_{1}^{\mathrm{con}}$ measures the ability to correctly identify genuine claim-consistent images. Existing methods tend to favor one class over the other, suggesting a mismatch between their original assumptions and claim-grounded visual inconsistency detection. For example, SNIFFER transfers poorly because out-of-context misinformation assumes authentic images with misleading contexts, while MIC-Bench contains localized AI-generated edits that create claim-grounded inconsistencies. MiRAGe over-predicts inconsistency, yielding high $F_{1}^{\mathrm{inc}}$ but low $F_{1}^{\mathrm{con}}$ , whereas GPT-5.4-mini shows the opposite bias and misses many subtle inconsistencies. Overall, MIC achieves high F1 on both classes, leading to a stronger Macro-F1 and indicating that task-specific supervision and rewards better capture claim-grounded visual inconsistencies.

MIC substantially improves fine-grained inconsistency detection.

Table 2 shows that MIC substantially outperforms all baselines across both verdict prediction and fine-grained explanation metrics. While several large VLM baselines, such as Qwen3-VL-30B-A3B and Qwen3-VL-8B-Thinking, achieve moderate Macro-F1, their much lower TypeAcc, VisualSim, and ExplSim indicate that they struggle to identify the specific inconsistent element and explain why it contradicts the claim context. In contrast, MIC achieves strong performance on both the in-distribution and out-of-distribution splits, suggesting that task-specific supervision and verifiable rewards better align the model with the structured verification process. The performance gap remains large even when edited-in visual elements are held out from training, indicating generalization beyond memorized patterns.

7 Analysis and Discussion

Ablation Study.

To analyze the contribution of each training stage, we compare the full MIC framework with an SFT-only model and the base MLLM. As shown in Figure 4, the base MLLM performs poorly across all metrics, with TypeAcc dropping from $89.76\%$ to approximately $20\%$ on the in-distribution split. This shows that general multimodal pretraining alone is insufficient for fine-grained claim-grounded inconsistency detection. SFT closes most of this gap, indicating that SFT is the main driver of structured output generation and task adaptation. Adding GRPO further improves TypeAcc, VisualSim, and ExplSim across both test splits, suggesting that verifiable reward optimization enhances explanation grounding beyond likelihood-based supervision.

Figure 4: Ablation study of the MIC training stages.

Figure 5: Impact of visual and textual inputs of MIC.

Impact of Visual and Textual Inputs.

To investigate whether MIC relies on both modalities and whether MIC-Bench contains caption-only shortcuts, we evaluate two input-perturbation settings: removing the claim and removing the image. As shown in Figure 5, removing the claim degrades performance, especially on Macro-F1 and ExplSim, indicating that textual context is necessary for determining whether a visual element contradicts the claimed event. Removing the image by replacing it with a black canvas leads to a more severe drop, particularly on TypeAcc, VisualSim, and ExplSim. This suggests that the model cannot reliably infer inconsistencies from the claim alone, providing evidence against caption-only shortcuts in the data-generation process and confirming that visual evidence is essential for grounded prediction.

Figure 6: Fine-grained performance of MIC across different inconsistency types.

Performance across Inconsistency Types.

To evaluate the fine-grained capabilities of MIC, we analyze performance across the nine inconsistency types in Figure 6. MIC consistently outperforms GPT-5.4-mini and Qwen3-VL-8B-Instruct across all categories, achieving the best TypeAcc for every inconsistency type. This indicates that MIC can distinguish among different inconsistency types, rather than only detecting that a mismatch exists. The gains are especially large for VisualSim and ExplSim, suggesting that baseline models often struggle to describe the manipulated visual element or provide a grounded world-knowledge explanation. Overall, these results show that MIC captures type-specific inconsistency patterns while grounding its predictions in relevant world knowledge.

Figure 7: Generalization performance of MIC on images generated by FLUX.2-klein-9B.

Generalization to Unseen Image Generators.

To evaluate generalization to unseen image generators, we test MIC and representative baselines on images synthesized by FLUX.2-klein-9B Black Forest Labs (2026) using the same edit instructions and evaluation protocol as MIC-Bench. As shown in Figure 7, MIC outperforms all baselines on FLUX-generated images, especially on TypeAcc, VisualSim, and ExplSim. At the same time, MIC shows a noticeable drop when evaluated on FLUX-generated images compared with GPT-generated images. This suggests that task-specific fine-tuning improves inconsistency detection, but may also make the model partially adapted to the visual distribution of the training generator. Nevertheless, MIC still substantially outperforms all baselines on FLUX-generated images.

Figure 8: Generalization performance of MIC on recent 2026 news images.

Generalization to Recent News Images.

To evaluate generalization to emerging events, we collect real-world news images from 25 recent events in 2026 using Wikimedia Commons and Wikipedia, and construct an additional benchmark following the same pipeline as MIC-Bench. Representative examples are provided in Appendix E. As shown in Figure 8, MIC outperforms all baselines, indicating that its claim-grounded inconsistency patterns transfer to emerging events. However, the smaller gains on TypeAcc, VisualSim, and ExplSim suggest that fine-grained reasoning remains challenging for events outside current MLLMs’ parametric knowledge. This motivates extending MIC with retrieval to support evolving-event reasoning. Appendix C.6 further shows that MIC does not rely solely on whether an image appears AI-generated.

Failure mode	Count
Missed cultural edit	11
Missed object or scene edit	4
Evidence describes feature not in image	5
Evidence describes unedited element	1
Wrong country or brand attribution	9

Table 3: Manual analysis of 30 MIC failure cases from the MIC-Bench test splits.

Error Analysis.

To characterize the error patterns of MIC, we manually analyze 30 failure cases sampled from the MIC-Bench test splits. Table 3 summarizes the failure categories, with examples in Appendix D. Most errors involve missed cultural, object, or scene-level edits that appear plausible in isolation but conflict with the claim context, highlighting the need for reasoning beyond object recognition. Others involve unsupported visual evidence or incorrect country/brand attribution, where MIC identifies the right region but assigns the wrong contextual origin. These errors motivate future work on evidence-grounded explanations for subtle geopolitical, cultural, and temporal inconsistencies.

8 Conclusion and Future Work

We presented MIC, an explainable framework for detecting AI-generated multimodal misinformation through image–claim consistency verification. Our work studies claim-grounded visual inconsistency detection as a specific setting of image–claim consistency verification, focusing on localized visual details that conflict with the context implied by the claim. Using SFT and GRPO, MIC jointly predicts verdicts, inconsistency types, visual evidence descriptions, and world-knowledge explanations.

We also introduced MIC-Bench, a benchmark of 8,812 image–claim instances derived from 4,406 claims, with fine-grained annotations across nine inconsistency types. GRPO improves verdict prediction and explanation similarity to reference annotations over SFT alone. Further evaluations support transfer to held-out replacement entities, unseen image generators, and controlled tests based on recent news images.

Future work will incorporate external evidence retrieval for evolving world knowledge, extend the framework to broader forms of multimodal misinformation, and explore deployment in professional fact-checking workflows.

Limitations

Our work has three limitations:

First, MIC-Bench focuses on a single controlled inconsistency per AI-generated image, enabling isolated evaluation of the introduced edit. Although our two-inconsistency evaluation provides initial evidence of transfer beyond single-inconsistency training, evaluating more complex combinations of inconsistencies remains a direction for future work.

Second, MIC-Bench is limited to nine inconsistency categories and therefore does not cover all forms of world-knowledge inconsistency that may arise in real-world AI-generated news imagery. The current taxonomy is grounded in GIJN fact-checking guidelines and captures a practically relevant subset of such inconsistencies. Extending the taxonomy to broader and more diverse forms of inconsistency, ideally in collaboration with journalists and fact-checkers, remains an important direction for future work.

Third, like other MLLM-based approaches, MIC draws on the parametric knowledge of its underlying model, and its coverage is therefore tied to the model’s training data. This knowledge may be incomplete or outdated, particularly for recent events. Future work will investigate retrieving background facts from text sources such as Wikipedia to support image–claim consistency judgments.

Ethics and Broader Impact

This work aims to support journalists and professional fact-checkers by improving the verification of AI-generated multimodal misinformation through structured and interpretable explanations grounded in world knowledge. By moving beyond binary provenance prediction, MIC is designed to provide more transparent and actionable verification signals that can better support real-world fact-checking workflows.

At the same time, research on AI-generated misinformation detection raises broader ethical considerations. Although MIC-Bench is intended to advance defensive research, the same image-editing pipelines used to construct the dataset could potentially be misused to create deceptive or manipulative content outside research settings. To reduce this risk, MIC-Bench is built exclusively from publicly available news image–claim pairs from TARA, all edited images are explicitly labeled as AI-generated, and the dataset is released solely for research and benchmarking purposes.

Our work also has important limitations related to knowledge reliability and cultural coverage. Since MIC relies on the parametric knowledge of the underlying MLLM, its explanations may occasionally contain factual inaccuracies, outdated information, or culturally biased assumptions. Such risks may be amplified for underrepresented regions, languages, and visual cultures. Consequently, the outputs of MIC should not be treated as definitive factual judgments, but rather as decision-support signals that require human verification.

Human annotation was conducted by trained annotators for verification and explanation tasks and did not involve the collection of private or sensitive personal data. We emphasize that MIC is intended to assist rather than replace professional fact-checkers. Any deployment in public-facing verification systems should therefore include expert review, transparency about model limitations, and appropriate safeguards against overreliance on automated predictions.

Acknowledgments

This work has been funded by the LOEWE initiative (Hesse, Germany) within the emergenCITY center (Grant Number: LOEWE/1/12/519/03/05.001(0016)/72), and the German Federal Ministry of Research, Technology and Space and the Hessian Ministry of Higher Education, Research, Science and the Arts through their joint support of the National Research Center for Applied Cybersecurity ATHENE. The figures have been designed using resources from Flaticon.com.

References

Akhtar et al. (2023) M. Akhtar, M. Schlichtkrull, Z. Guo, O. Cocarascu, E. Simperl, and A. Vlachos Multimodal automated fact-checking: a survey. In Findings of the Association for Computational Linguistics: EMNLP 2023, H. Bouamor, J. Pino, and K. Bali (Eds.), Singapore, pp. 5430–5448. External Links: Link, Document Cited by: §2.
Awosoro (2026) S. Awosoro Photo of muslims worshipping on abuja road, ai-generated. Note: DubawaAccessed: 2026-05-12 External Links: Link Cited by: Figure 1, §1.
Bai et al. (2025) S. Bai, K. Chen, X. Liu, J. Wang, W. Ge, S. Song, K. Dang, P. Wang, S. Wang, J. Tang, H. Zhong, Y. Zhu, M. Yang, Z. Li, J. Wan, P. Wang, W. Ding, Z. Fu, Y. Xu, J. Ye, X. Zhang, T. Xie, Z. Cheng, H. Zhang, Z. Yang, H. Xu, and J. Lin Qwen2.5-vl technical report. CoRR abs/2502.13923. External Links: Link, Document, 2502.13923 Cited by: §B.1, §6.1.
Black Forest Labs (2026) Black Forest Labs FLUX.2 [klein]: towards interactive visual intelligence. Note: Black Forest Labs BlogAccessed: 2026-05-12 External Links: Link Cited by: §A.1, §7.
Cazzamatta and Sarısakaloğlu (2025) R. Cazzamatta and A. Sarısakaloğlu AI-generated misinformation: a case study on emerging trends in fact-checking practices across brazil, germany, and the united kingdom. Emerging Media 3 (2), pp. 214–251. External Links: Link Cited by: §1.
DeepSeek-AI (2025) DeepSeek-AI DeepSeek-r1: incentivizing reasoning capability in llms via reinforcement learning. CoRR abs/2501.12948. External Links: Link, Document, 2501.12948 Cited by: §5.1, §5.3.
Drolsbach and Pröllochs (2025) C. Drolsbach and N. Pröllochs Characterizing ai-generated misinformation on social media. CoRR abs/2505.10266. External Links: Link, Document, 2505.10266 Cited by: §1.
Dufour et al. (2024) N. Dufour, A. Pathak, P. Samangouei, N. Hariri, S. Deshetti, A. Dudfield, C. Guess, P. H. Escayola, B. Tran, M. Babakar, and C. Bregler AMMeBa: A large-scale survey and dataset of media-based misinformation in-the-wild. CoRR abs/2405.11697. External Links: Link, Document, 2405.11697 Cited by: §1.
Frank et al. (2020) J. Frank, T. Eisenhofer, L. Schönherr, A. Fischer, D. Kolossa, and T. Holz Leveraging frequency analysis for deep fake image recognition. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event, Proceedings of Machine Learning Research, pp. 3247–3258. External Links: Link Cited by: §2.
Fu et al. (2022) X. Fu, B. Zhou, I. Chandratreya, C. Vondrick, and D. Roth There’s a time and place for reasoning beyond the image. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), S. Muresan, P. Nakov, and A. Villavicencio (Eds.), Dublin, Ireland, pp. 1138–1149. External Links: Link, Document Cited by: §A.1, §3.
Geng et al. (2025) J. Geng, J. Tonglet, and I. Gurevych M4FC: a multimodal, multilingual, multicultural, multitask real-world fact-checking dataset. arXiv preprint arXiv:2510.23508. Cited by: §2, §3.
Gowal et al. (2025) S. Gowal, R. Bunel, F. Stimberg, D. Stutz, G. Ortiz-Jiménez, C. Kouridi, M. Vecerík, J. Hayes, S. Rebuffi, P. Bernard, C. Gamble, M. Z. Horváth, F. Kaczmarczyck, A. Kaskasoli, A. Petrov, I. Shumailov, M. Thotakuri, O. Wiles, J. Yung, Z. Ahmed, V. Martin, S. Rosen, C. Savcak, A. Senoner, N. Vyas, and P. Kohli SynthID-image: image watermarking at internet scale. CoRR abs/2510.09263. External Links: Link, Document, 2510.09263 Cited by: §2.
Guo et al. (2022) Z. Guo, M. Schlichtkrull, and A. Vlachos A survey on automated fact-checking. Transactions of the Association for Computational Linguistics 10, pp. 178–206. External Links: Link, Document Cited by: §2.
Gye et al. (2025) S. Gye, J. Ko, H. Shon, M. Kwon, and J. Kim Reducing the content bias for ai-generated image detection. In IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2025, Tucson, AZ, USA, February 26 - March 6, 2025, pp. 399–408. External Links: Link, Document Cited by: §1.
Hayes and Krippendorff (2007) A. F. Hayes and K. Krippendorff Answering the call for a standard reliability measure for coding data. Communication methods and measures 1 (1), pp. 77–89. Cited by: §3.3.
Hu et al. (2022) E. J. Hu, yelong shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen LoRA: low-rank adaptation of large language models. In International Conference on Learning Representations, External Links: Link Cited by: §5.2.
Huang et al. (2024) R. Huang, L. Dugan, Y. Yang, and C. Callison-Burch MiRAGeNews: multimodal realistic AI-generated news detection. In Findings of the Association for Computational Linguistics: EMNLP 2024, Y. Al-Onaizan, M. Bansal, and Y. Chen (Eds.), Miami, Florida, USA, pp. 16436–16448. External Links: Link, Document Cited by: §A.5, §B.1, §C.9, §1, §2, §6.1.
Ji et al. (2026) Y. Ji, Y. Hong, Q. Fan, jun lan, H. Zhu, W. Wang, L. Zhang, and J. Zhang FakeXplain: AI-generated image detection via human-aligned grounded reasoning. In The Fourteenth International Conference on Learning Representations, External Links: Link Cited by: §1, §2.
Karageorgiou et al. (2025) D. Karageorgiou, S. Papadopoulos, I. Kompatsiaris, and E. Gavves Any-resolution ai-generated image detection by spectral learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2025, Nashville, TN, USA, June 11-15, 2025, pp. 18706–18717. External Links: Link, Document Cited by: §1.
Keita et al. (2025) M. Keita, W. Hamidouche, H. B. Eutamene, A. Taleb-Ahmed, and A. Hadid DeeCLIP: A robust and generalizable transformer-based framework for detecting ai-generated images. In Advanced Concepts for Intelligent Vision Systems - 22nd International Conference, ACIVS 2025, Tokyo, Japan, July 28-30, 2025, Proceedings, J. Blanc-Talon, P. Delmas, H. Takahashi, and M. Yasuhiro (Eds.), Lecture Notes in Computer Science, pp. 146–158. External Links: Link, Document Cited by: §2.
Li et al. (2025) B. Li, Y. Zhang, D. Guo, R. Zhang, F. Li, H. Zhang, K. Zhang, P. Zhang, Y. Li, Z. Liu, and C. Li LLaVA-onevision: easy visual task transfer. Trans. Mach. Learn. Res. 2025. External Links: Link Cited by: §B.1, §6.1.
Liu et al. (2021) F. Liu, Y. Wang, T. Wang, and V. Ordonez Visual news: benchmark and challenges in news image captioning. In Proceedings of the 2021 conference on empirical methods in natural language processing, pp. 6761–6771. Cited by: §A.1.
Liu et al. (2024) P. Liu, Q. Tao, and J. T. Zhou Evolving from single-modal to multi-modal facial deepfake detection: progress and challenges. arXiv preprint arXiv:2406.06965. External Links: Link Cited by: §1.
Nakov et al. (2021) P. Nakov, D. P. A. Corney, M. Hasanain, F. Alam, T. Elsayed, A. Barrón-Cedeño, P. Papotti, S. Shaar, and G. D. S. Martino Automated fact-checking for assisting human fact-checkers. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, Z. Zhou (Ed.), pp. 4551–4558. External Links: Link, Document Cited by: §2, §3.1.
OpenAI (2024) OpenAI GPT‑4o mini: advancing cost-efficient intelligence. External Links: Link Cited by: §3.2.
OpenAI (2025) OpenAI The new ChatGPT Images is here. External Links: Link Cited by: §3.2.
OpenAI (2026a) OpenAI GPT-5.4 mini. Note: https://developers.openai.com/api/docs/models/gpt-5.4-mini Cited by: §6.1.
OpenAI (2026b) OpenAI Introducing GPT-5.5. External Links: Link Cited by: §3.2.
Papadopoulos et al. (2025) S. Papadopoulos, C. Koutlis, S. Papadopoulos, and P. C. Petrantonakis Similarity over factuality: are we making progress on multimodal out-of-context misinformation detection?. In IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2025, Tucson, AZ, USA, February 26 - March 6, 2025, pp. 5041–5050. External Links: Link, Document Cited by: §2.
Paszke et al. (2019) A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, A. Desmaison, A. Köpf, E. Z. Yang, Z. DeVito, M. Raison, A. Tejani, S. Chilamkurthy, B. Steiner, L. Fang, J. Bai, and S. Chintala PyTorch: an imperative style, high-performance deep learning library. pp. 8024–8035. External Links: Link Cited by: §B.2, §6.2.
Pei et al. (2026) G. Pei, J. Zhang, M. Hu, Z. Zhang, C. Wang, Y. Wu, G. Zhai, J. Yang, and D. Tao Deepfake generation and detection: A benchmark and survey. ACM Comput. Surv. 58 (11), pp. 273:1–273:41. External Links: Link, Document Cited by: §1, §2.
Qi et al. (2024) P. Qi, Z. Yan, W. Hsu, and M. Lee Sniffer: multimodal large language model for explainable out-of-context misinformation detection. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024, Seattle, WA, USA, June 16-22, 2024, pp. 13052–13062. External Links: Link, Document Cited by: §A.5, §B.1, §1, §2, §6.1.
Radford et al. (2021) A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark, G. Krueger, and I. Sutskever Learning transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, M. Meila and T. Zhang (Eds.), Proceedings of Machine Learning Research, pp. 8748–8763. External Links: Link Cited by: §B.1.
Rafailov et al. (2023) R. Rafailov, A. Sharma, E. Mitchell, C. D. Manning, S. Ermon, and C. Finn Direct preference optimization: your language model is secretly a reward model. Advances in neural information processing systems 36, pp. 53728–53741. Cited by: §5.4.
Reimers and Gurevych (2019) N. Reimers and I. Gurevych Sentence-bert: sentence embeddings using siamese bert-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3-7, 2019, K. Inui, J. Jiang, V. Ng, and X. Wan (Eds.), pp. 3980–3990. External Links: Link, Document Cited by: §C.4.
Rosenthol (2022) L. Rosenthol C2pa: the world’s first industry standard for content provenance (conference presentation). In Applications of Digital Image Processing XLV, Vol. 12226, pp. 122260P. External Links: Link Cited by: §2.
Shao et al. (2024) Z. Shao, P. Wang, Q. Zhu, R. Xu, J. Song, M. Zhang, Y. K. Li, Y. Wu, and D. Guo DeepSeekMath: pushing the limits of mathematical reasoning in open language models. CoRR abs/2402.03300. External Links: Link, Document, 2402.03300 Cited by: §5.1, §5.4.
Tan et al. (2025a) C. Tan, X. Ming, J. Wang, R. Tao, B. Li, Y. Wei, Y. Zhao, and Y. Lu Semantic visual anomaly detection and reasoning in ai-generated images. CoRR abs/2510.10231. External Links: Link, Document, 2510.10231 Cited by: §2.
Tan et al. (2025b) C. Tan, R. Tao, H. Liu, G. Gu, B. Wu, Y. Zhao, and Y. Wei C2P-CLIP: injecting category common prompt in CLIP to enhance generalization in deepfake detection. In Thirty-Ninth AAAI Conference on Artificial Intelligence, Thirty-Seventh Conference on Innovative Applications of Artificial Intelligence, Fifteenth Symposium on Educational Advances in Artificial Intelligence, AAAI 2025, Philadelphia, PA, USA, February 25 - March 4, 2025, T. Walsh, J. Shah, and Z. Kolter (Eds.), pp. 7184–7192. External Links: Link, Document Cited by: §2.
Team (2025) Q. Team Qwen3-vl technical report. CoRR abs/2511.21631. External Links: Link, Document, 2511.21631 Cited by: §B.1, §B.1, §B.2, §6.1, §6.2.
Tonglet et al. (2025) J. Tonglet, G. Thiem, and I. Gurevych COVE: COntext and VEracity prediction for out-of-context images. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), L. Chiruzzo, A. Ritter, and L. Wang (Eds.), Albuquerque, New Mexico, pp. 2029–2049. External Links: Link, Document, ISBN 979-8-89176-189-6 Cited by: §A.5, §1, §2.
Tran et al. (2020) A. Tran, A. Mathews, and L. Xie Transform and tell: entity-aware news image captioning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 13035–13045. Cited by: §A.1.
van Ess (2025) H. van Ess Reporter’s guide to detecting ai-generated content. Note: Global Investigative Journalism NetworkAccessed: 2026-05-12 External Links: Link Cited by: §1, §1, §1, §3.1.
Wack et al. (2024) M. Wack, K. Duskin, and D. Hodel Political fact-checking efforts are constrained by deficiencies in coverage, speed, and reach. CoRR abs/2412.13280. External Links: Link, Document, 2412.13280 Cited by: §1.
Wang et al. (2024) L. Wang, N. Yang, X. Huang, L. Yang, R. Majumder, and F. Wei Improving text embeddings with large language models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024, L. Ku, A. Martins, and V. Srikumar (Eds.), pp. 11897–11916. External Links: Link, Document Cited by: §C.4.
Wang et al. (2020) S. Wang, O. Wang, R. Zhang, A. Owens, and A. A. Efros CNN-generated images are surprisingly easy to spot… for now. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, pp. 8692–8701. External Links: Link, Document Cited by: §2.
Wei et al. (2022) J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems 35, pp. 24824–24837. Cited by: §B.1.
Xu et al. (2025a) Q. Xu, C. Wang, J. Chen, S. Lyu, and D. Chen Fully ai-generated image detection: definition, recent advances and challenges. CoRR abs/2502.19716. External Links: Link Cited by: §1, §2.
Xu et al. (2025b) Z. Xu, X. Zhang, R. Li, Z. Tang, Q. Huang, and J. Zhang FakeShield: explainable image forgery detection and localization via multi-modal large language models. In The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025, External Links: Link Cited by: §1.
Yang et al. (2025a) A. Yang, A. Li, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Gao, C. Huang, C. Lv, et al. Qwen3 technical report. arXiv preprint arXiv:2505.09388. Cited by: §C.5.
Yang et al. (2025b) F. Yang, R. Zhen, J. Wang, Y. Zhang, H. Chen, H. Lu, S. Zhao, and G. Ding HEIE: mllm-based hierarchical explainable AIGC image implausibility evaluator. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2025, Nashville, TN, USA, June 11-15, 2025, pp. 3856–3866. External Links: Link, Document Cited by: §2.
Zhang et al. (2025a) F. Zhang, D. Li, Q. Zhang, J. Chen, Sinbadliu, J. Lin, J. Yan, J. Liu, and Z. Zha Fact-r1: towards explainable video misinformation detection with deep reasoning. In Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, NeurIPS 2025, San Diego, CA, USA, December 2-7, 2025 / Mexico City, Mexico, November 30 - December 5, 2025, D. Belgrave, C. Zhang, L. N. Montoya, H. Lin, R. Pascanu, P. Koniusz, M. Ghassemi, N. Chen, I. V. M. Ruíz, and A. Loaiza-Bonilla (Eds.), External Links: Link Cited by: §2.
Zhang et al. (2025b) Y. Zhang, M. Li, D. Long, X. Zhang, H. Lin, B. Yang, P. Xie, A. Yang, D. Liu, J. Lin, F. Huang, and J. Zhou Qwen3 embedding: advancing text embedding and reranking through foundation models. CoRR abs/2506.05176. External Links: Link, Document, 2506.05176 Cited by: §5.3, §6.3.
Zhang et al. (2025c) Z. Zhang, Y. Zhang, X. Zhou, L. Huang, I. Razzak, P. Nakov, and U. Naseem From generation to detection: a multimodal multi-task dataset for benchmarking health misinformation. In Findings of the Association for Computational Linguistics: EMNLP 2025, C. Christodoulopoulos, T. Chakraborty, C. Rose, and V. Peng (Eds.), Suzhou, China, pp. 24245–24260. External Links: Link, Document, ISBN 979-8-89176-335-7 Cited by: §1.
Zhou et al. (2025) Z. Zhou, Y. Luo, Y. Wu, K. Sun, J. Ji, K. Yan, S. Ding, X. Sun, Y. Wu, and R. Ji Aigi-holmes: towards explainable and generalizable ai-generated image detection via multimodal large language models. In IEEE/CVF International Conference on Computer Vision, ICCV 2025, Honolulu, HI, USA, October 19-25, 2025, pp. 18746–18758. External Links: Link, Document Cited by: §1, §2.
Zhu et al. (2025) J. Zhu, W. Wang, Z. Chen, Z. Liu, S. Ye, L. Gu, H. Tian, Y. Duan, W. Su, J. Shao, Z. Gao, E. Cui, X. Wang, Y. Cao, Y. Liu, X. Wei, H. Zhang, H. Wang, W. Xu, H. Li, J. Wang, N. Deng, S. Li, Y. He, T. Jiang, J. Luo, Y. Wang, C. He, B. Shi, X. Zhang, W. Shao, J. He, Y. Xiong, W. Qu, P. Sun, P. Jiao, H. Lv, L. Wu, K. Zhang, H. Deng, J. Ge, K. Chen, L. Wang, M. Dou, L. Lu, X. Zhu, T. Lu, D. Lin, Y. Qiao, J. Dai, and W. Wang InternVL3: exploring advanced training and test-time recipes for open-source multimodal models. CoRR abs/2504.10479. External Links: Link, Document, 2504.10479 Cited by: §B.1, §6.1.

Appendix A Dataset Details

A.1 Inconsistency Generation Pipeline

Source corpus.

We use the 16,000-image New York Times portion of TARA (Fu et al., 2022), whose explicit time and location information supports the construction of context-dependent inconsistencies and temporally separated data splits. In contrast, VisualNews (Liu et al., 2021) and NYTimes800k (Tran et al., 2020) primarily target news image captioning rather than spatiotemporal grounding. Starting from these image–claim pairs, we construct the dataset through applicability filtering, target-type assignment, edit prompt generation, and image synthesis.

Applicability filtering.

For each image–claim pair, we identify which taxonomy types can support a plausible world-knowledge inconsistency. A type $k$ is applicable to $(I_{\text{con}},c)$ if its associated visual element is clearly visible in $I_{\text{con}}$ and the claim $c$ provides enough context for modifying that element to create an inconsistency. We first retain TARA examples with valid image URLs and a width and height of at least 1,024 pixels, yielding 13,507 pairs from the original 16,000 examples. We then use GPT-4o-mini to screen each image–claim pair for editing suitability. A pair is retained if at least one inconsistency type has both a visible visual element and sufficient context in the claim or accompanying metadata for an edit to create a meaningful inconsistency. Next, GPT-5.5 checks whether the visual elements associated with each of the nine types are clearly visible and records the supporting visual evidence. This check requires direct observation of the image rather than assumptions based on the claim.

Type assignment.

Each retained image–claim pair may support multiple applicable inconsistency types, while each edited sample is designed to contain only a single controlled inconsistency. We therefore assign exactly one target type $k$ to each pair using a greedy strategy that combines constrained-first ordering with rarest-first selection. Specifically, pairs with fewer applicable types are processed first to prioritize samples with limited assignment options. Within each pair, we then select the applicable type with the smallest accumulated sample count, encouraging a balanced distribution across the inconsistency taxonomy.

Edit prompt design and image generation.

For each assigned tuple $(I_{\text{con}},c,k)$ , we use GPT-5.5 to generate edit instructions, an initial description of the edited visual element $v_{0}$ , and an initial world-knowledge explanation $e_{0}$ describing the intended inconsistency. The edit instructions ensure that the resulting image remains visually plausible, that the modified element contradicts the claimed event while remaining coherent with the surrounding visual context, and that detecting the inconsistency requires contextual or world knowledge rather than reliance on obvious synthesis artifacts. To reduce substitution bias, we use rotating geographic and contextual constraints instead of a fixed set of edited-in visual elements. We generate edited images $I_{\text{inc}}$ using GPT-Image-1.5. For cross-generator evaluation, we additionally construct a FLUX.2-klein-9B Black Forest Labs (2026) test set using the same edit instructions and human verification procedure. The resulting candidate tuples $(I_{\text{con}},I_{\text{inc}},c,k,v_{0},e_{0})$ are then passed to human annotation. All prompts are provided in Appendix F.

A.2 Human Annotation

Human verification.

To ensure reliable evaluation, each test-set candidate tuple $(I_{\text{con}},I_{\text{inc}},c)$ and its preliminary annotations $(k,v_{0},e_{0})$ are independently reviewed by two human annotators. Annotators evaluate three criteria: (i) the visual realism of $I_{\text{inc}}$ , (ii) the fidelity of the edit to the intended modification $v_{0}$ while preserving non-target regions, and (iii) the factual correctness of $e_{0}$ as a world-knowledge explanation of the inconsistency. To assess factual correctness, annotators verify the key factual claims in $e_{0}$ against independent external evidence, prioritizing official sources and established fact-checking pages, with Wikipedia as a supplementary source. We retain a candidate only when both annotators approve all criteria and discard all cases with conflicting judgments. This verification process removes 132 candidate samples in total. For retained examples, annotators further verify and revise the preliminary annotations to obtain the final structured annotations $(k,v,e)$ .

Reasoning process generation.

We further augment each candidate with Chain-of-Thought (CoT) rationales generated by GPT-5.5. The inconsistent rationale $r_{\text{inc},0}$ explains why $I_{\text{inc}}$ contradicts the claim $c$ , while the consistent rationale $r_{\text{con},0}$ explains why $I_{\text{con}}$ remains consistent with the claim. Human annotators revise both rationales to ensure that they are grounded in the image and aligned with the final annotations $(k,v,e)$ . The final MIC-Bench dataset contains 4,406 claims, each paired with a consistent source image $I_{\text{con}}$ and an inconsistent edited image $I_{\text{inc}}$ . Each claim also includes structured annotations $(k,v,e)$ for the inconsistent counterpart and rationales $(r_{\text{con}},r_{\text{inc}})$ for both image versions. Together, these yield 8,812 image–claim instances.

A.3 Dataset Statistics

Stage	Input	Retained	Removed	Criterion
Source-image URL and resolution filtering	16,000	13,507	2,493	Valid URL and resolution $\geq 1024\times 1024$
Sample screening for editing (GPT-4o-mini)	13,507	10,301	3,206	At least one feasible inconsistency type
Visual element visibility check (GPT-5.5)	10,301	5,984	4,317	Clearly visible target without caption-only inference
Edit generation and post-generation filtering	5,984	5,818	166	Successful generation passing moderation and size checks
Human verification (test subset)	1,533	1,401	132	Both annotators approve realism, edit fidelity, and the factual correctness of the explanation
Final split construction	5,818	4,406	1,412	Temporal and entity-disjoint splits with the verified test set

Table 4: Filtering statistics and decision criteria for the MIC-Bench construction pipeline.

Filtering statistic.

Table 4 reports the number of pairs retained and removed at each construction stage together with the corresponding decision criteria. The first four stages reduce 16,000 source pairs to 5,818 successfully generated candidates. Human verification is applied separately to the 1,533 candidate test examples, retaining 1,401, while final split construction yields 4,406 claims.

Dataset composition.

Table 5 summarizes the four data splits. Each claim contributes two image–claim instances: the original image paired with the claim and labeled as consistent, and an edited image paired with the same claim and labeled as inconsistent. Consequently, the 4,406 claims in MIC-Bench produce 4,406 consistent instances and 4,406 inconsistent instances, yielding a total of 8,812 image–claim instances. Table 6 further reports the per-type statistics for the inconsistent portion of the dataset. The nine inconsistency categories are kept approximately balanced, with per-type counts in the training set ranging from 244 to 315 samples.

Split construction.

We construct the dataset splits using both temporal and replacement-entity separation. For temporal separation, the training and validation sets contain claims from 2010 to 2017, while both test splits contain claims from 2018 to 2021. For replacement-entity separation, the in-distribution test split uses edited-in visual elements observed during training but in unseen image contexts, whereas the out-of-distribution split uses a disjoint set of held-out replacement entities, such as previously unseen country flags or brand logos. This setup disentangles generalization to novel image contexts from generalization to unseen semantic substitutions.

Introduced-element statistics.

Table 7 reports the distribution of introduced visual elements for each inconsistency type at the canonical entity level. The distribution is long-tailed, with no single element accounting for more than $12.8\%$ of its type. Across all types, the out-of-distribution split holds out 426 globally unique replacement entities, none of which appears in training.

A.4 Inter-Annotator Agreement

We compute inter-annotator agreement over the initial binary keep-or-reject decisions for the double-annotated test-set candidates. The two annotators agree on 97.4% of candidates, with Krippendorff’s $\alpha=0.81$ . Only candidates approved by both annotators are retained, and their structured annotations are subsequently finalized.

Split	#Claims	#Consistent	#Inconsistent	Total
Train	2,561	2,561	2,561	5,122
Validation	444	444	444	888
Test (In-distribution)	703	703	703	1,406
Test (Out-of-Distribution)	698	698	698	1,396
Total	4,406	4,406	4,406	8,812

Table 5: Dataset split statistics for MIC-Bench.

Inconsistency type	Train	Validation	Test (In-distribution)	Test (Out-of-Distribution)
clothing	295	59	68	73
flag	244	45	100	97
gesture	263	35	79	77
signage	263	52	88	89
architecture	293	59	80	77
infrastructure	301	56	75	64
technology	315	44	60	71
branding	309	53	74	75
environment	278	41	79	75
Total	2561	444	703	698

Table 6: Distribution of inconsistency types in MIC-Bench across data splits.

Type	Edits	Distinct elements	Most frequent element (share)	OOD held-out entities
Clothing	495	189	Pakistani shalwar kameez ( $3.8\%$ )	59
Flag	486	48	Chinese flag ( $12.3\%$ )	17
Gesture	454	48	Indian namaste ( $12.8\%$ )	22
Signage	492	99	Spanish text ( $7.1\%$ )	36
Architecture	509	175	Mughal architecture ( $8.8\%$ )	57
Infrastructure	496	245	Pakistani motorway sign ( $6.9\%$ )	60
Technology	490	338	BMC Kirpi ( $2.0\%$ )	61
Branding	511	203	Blockbuster Video ( $8.2\%$ )	67
Environment	473	99	Scandinavian birch ( $12.1\%$ )	48

Table 7: Introduced-element statistics at the canonical entity level for each inconsistency type.

Benchmark	Primary task	Misinformation input	Inconsistency structure	Controlled edit	Inconsistency annotations
MiRAGeNews	Real vs. generated news	Fictional claim + AI-generated image	No controlled image–claim inconsistency	No	No
OOC benchmarks	Consistent vs. inconsistent	Different event/context + authentic image	Broad contextual mismatch	No	No
MIC-Bench	Consistency and explanation	Same real-event claim + AI-generated image	Localized inconsistency and broader event preserved	Yes	9 types, visual evidence, and world-knowledge explanation

Table 8: Comparison of MIC-Bench with related multimodal misinformation benchmarks.

A.5 Benchmark Comparison

Table 8 summarizes the differences between MIC-Bench and related multimodal misinformation benchmarks. MiRAGeNews pairs a fictional claim with an AI-generated image and frames the task as distinguishing real from generated image–caption pairs (Huang et al., 2024). As the image is generated to depict the fictional claim it accompanies, the pair contains no controlled image–claim inconsistency. The misinformation lies in the fabrication of the pair as a whole rather than in a conflict between an AI-generated image and a real-event claim, and inconsistencies with world knowledge arise only incidentally during generation. OOC benchmarks instead pair an authentic image with a claim that describes a different event, location, or time (Qi et al., 2024; Tonglet et al., 2025). Although the image and real-event claim may share an entity or topic, the image originates from a different context, so the resulting mismatch is global rather than localized to a specific visual element. Neither setting provides an authentic source image together with a controlled edited counterpart that isolates the visual element responsible for the inconsistency, and neither annotates the inconsistency type, the supporting visual evidence, or the world-knowledge explanation.

A.6 Examples by Inconsistency Types

Table 9 presents one representative example for each inconsistency type in MIC-Bench. For each category, the table shows the original image and its corresponding AI-generated counterpart, together with the associated news claim. It additionally highlights the manipulated visual element responsible for the inconsistency and provides the corresponding world-knowledge explanation describing why the edited content contradicts the claimed geopolitical, cultural, temporal, or contextual setting. These examples illustrate the diversity of inconsistency patterns covered by MIC-Bench and demonstrate how visually plausible inconsistencies can create subtle yet semantically misleading image–claim pairs.

[Uncaptioned image] — Table 9: Representative visual examples for all nine inconsistency types in MIC-Bench.

Inconsistent Type	Claim	What Changed	Why Contradicts
clothing	Muhammadu Buhari Wins Second Term as Nigeria’s President. President Muhammadu Buhari of Nigeria after casting his vote in his hometown Daura on Saturday.	Buhari’s light blue Nigerian traditional robe and patterned cap $\rightarrow$ Ghanaian Ashanti kente ceremonial garment.	The caption identifies Nigeria’s president voting in his hometown, so dressing him in distinctly Ghanaian ceremonial clothing conflicts with the Nigerian electoral context.
flag	‘Suffering and Hardship Belong to Me’: A Voice From a Chinese Prison. A protester holding a photo of Xu Zhiyong outside the Chinese liaison office in Hong Kong in 2014.	Chinese five-star red flag $\rightarrow$ South African multicolor Y-design flag.	The caption identifies the scene as outside the Chinese liaison office in Hong Kong in 2014, where a Chinese national flag would be contextually expected, not South Africa’s flag.
gesture	Retracing the Photographic Steps of a 1951 New York City Shoot. Central Park. April 2, 1951.	Man filming communal meal $\rightarrow$ man and nearby diners exchanging Indian namaste greeting.	A formal South Asian namaste-style greeting changes the scene from a 1951 Central Park social dining gathering into a culturally different ceremonial interaction that does not fit the caption’s New York context.
signage	Gandhi Biographer Arrested as Protests Over Citizenship Law Sweep India. Protesters denouncing a new citizenship law near the historic Red Fort in New Delhi on Thursday.	English protest placard text “No CAA. & NRC.” $\rightarrow$ German placard text “Nein zu CAA und NRC”.	A German-language anti-CAA/NRC protest sign is inconsistent with a street protest described as taking place near the Red Fort in New Delhi, where such signage would ordinarily be in English, Hindi, or Urdu rather than German.
architecture	Italy’s Populist Parties, on Precipice of Power, Fail to Form Government. Italy’s prime minister-designate, Giuseppe Conte, center, leaving a meeting with Italy’s president, Sergio Mattarella, on Sunday in Rome.	Italian official interior doorway/wall detailing $\rightarrow$ Brazilian Portuguese-colonial blue-and-white azulejo-tiled doorway surround with shallow colonial arch.	The caption places the scene in Rome at Italy’s presidential residence, but the edited architecture implies a Brazilian Portuguese-colonial governmental interior instead of an Italian one.
infrastructure	Snowstorm That Wasn’t Finds City Well Prepared. A city truck spread salt on 18th Avenue in Brooklyn on Friday.	Brooklyn U.S. parking regulation sign $\rightarrow$ Mexico City Metrobus-style Spanish transit-lane sign.	A Mexican transit-corridor sign is inconsistent with a caption placing the scene on 18th Avenue in Brooklyn, New York City.
technology	When the Face of America Falls Ill: A Virus’s Toll on Diplomats. Andrew Young, the American ambassador to Burkina Faso, during the opening ceremony of a joint military exercise last year. Mr. Young tested positive for the coronavirus.	Ceremonial rifles with fixed bayonets $\rightarrow$ Italian Beretta ARX160 assault rifles.	The caption describes the opening ceremony of a joint military exercise in Burkina Faso, but equipping the ceremonial guard with modern Italian Beretta ARX160 rifles implies a different military sourcing pattern and ceremonial practice than the Burkinabé setting shown.
branding	The Radical Empathy of Dan Weiner. Broadway, New York City, 1951.	Vertical “PIZZA” food sign $\rightarrow$ 2014 FIFA World Cup “BRAZIL 2014” promotional poster.	A 2014 FIFA World Cup advertisement is impossible in a street scene captioned as Broadway, New York City, 1951.
environment	Trump’s Financial Disclosure Form: Five Takeaways. The Trump International Hotel and Tower in Chicago, where profits declined last year.	Leafless Chicago winter street trees and dormant planting $\rightarrow$ Sub-Saharan savanna acacia trees with dry golden grass and scrub.	The caption identifies the scene as the Trump International Hotel and Tower in Chicago, but savanna acacia landscaping and dry tropical vegetation imply a Sub-Saharan African climate rather than a cold-season Midwestern U.S. city.

Appendix B Experimental Setup

B.1 Baseline Hyperparameters

This section summarizes the hyperparameter settings used for all baseline methods. Unless otherwise specified, all prompted VLM baselines use the same zero-shot Chain-of-Thought (CoT) instruction Wei et al. (2022) as MIC.

CLIP.

(Radford et al., 2021) We use openai/clip-vit-large-patch14 to encode image–claim pairs and compute image–text cosine similarity scores. Verdicts are predicted using a threshold selected on the validation split to maximize F1, where pairs with similarity scores below the threshold are classified as inconsistent.

SNIFFER.

(Qi et al., 2024) We use the official SNIFFER checkpoint with Vicuna-13B-v1.1 as the language backbone.

MiRAGe.

(Huang et al., 2024) We use the official MiRAGe-Img checkpoint, which combines a frozen BLIP-2-Flan-T5-XL vision encoder with a learned CBM-style concept layer concatenated with a CLIP-based linear logit, yielding a 301-dimensional feature passed to a linear classification head with sigmoid activation. We adopt threshold of $0.639$ , classifying images with scores above the threshold as inconsistent.

GPT-5.4-mini.

For GPT-5.4-mini, we set the maximum completion length to 4,096 tokens. Since GPT-5.4-mini is a reasoning-oriented model, no decoding temperature is specified.

Qwen and Other Open-Source VLMs.

For Qwen2.5-VL-3B-Instruct (Bai et al., 2025), Qwen3-VL-4B-Instruct, Qwen3-VL-8B-Instruct, Qwen3-VL-30B-A3B (Team, 2025), LLaVA-OneVision-7B (Li et al., 2025), and InternVL3-8B (Zhu et al., 2025), we use greedy decoding with a maximum generation length of 8,192 tokens.

For Qwen3-VL-8B-Thinking (Team, 2025), we use a maximum context length of 65,536 tokens and a maximum generation length of 32,768 tokens. Decoding hyperparameters are set to temperature $1.0$ , top- $p$ $0.95$ , top- $k$ $20$ , and presence penalty $1.5$ .

B.2 Implementation Details

All training is conducted in PyTorch (Paszke et al., 2019) on $8\times$ AMD MI210 GPUs, each equipped with 64 GB of VRAM. We use Qwen3-VL-4B-Instruct (Team, 2025) as the backbone model. LoRA adapters are inserted into the linear layers of the vision encoder, the vision–language projector, and the language model, while all pretrained model weights remain frozen. The adapters use rank $r=64$ , scaling factor $\alpha=128$ , and dropout rate $0.05$ . For SFT, we train for 3 epochs using AdamW with a peak learning rate of $2\times 10^{-4}$ , cosine learning-rate scheduling, and a warmup ratio of $0.10$ . Training uses a batch size of 8. For GRPO training, optimization is initialized from the merged SFT checkpoint. We train for 3 epochs with a learning rate of $1\times 10^{-5}$ , training batch size 8, and 8 sampled responses per prompt. The reward function follows Section 5.3 and includes rewards for format validity, verdict exact match, inconsistency type exact match, visual-description similarity, and explanation similarity. The corresponding weights are set to $\lambda_{\text{fmt}}=0.10$ , $\lambda_{\text{ver}}=0.35$ , $\lambda_{\text{type}}=0.25$ , $\lambda_{\text{desc}}=0.15$ , and $\lambda_{\text{exp}}=0.15$ . The semantic similarity rewards are computed using Qwen3-Embedding-0.6B. The KL regularization coefficient is set to $0.01$ . DPO is initialized from the same SFT checkpoint as GRPO, with a frozen copy serving as the reference model. Using the same reward, we pair the highest- and lowest-scoring of eight SFT responses per instance, retaining 3,000 preference pairs after filtering. We update all language-model parameters while freezing the vision encoder and vision–language projector, using sigmoid DPO with $\beta=0.1$ , AdamW with learning rate $10^{-6}$ , and an effective batch size of 8. For FLUX.2-klein-9B image generation, we use 28 inference steps.

Appendix C Additional Experimental Results

C.1 Fine-Grained Type Confusion Analysis

To assess whether the nine inconsistency categories are reliably distinguishable, we report type-level confusion matrices for both test splits in Figure 9. Both matrices exhibit strong diagonal dominance, indicating that MIC can accurately discriminate among the nine inconsistency types in most cases.

Importantly, boundary cases discussed in Section 3.1 are well separated. For example, confusion between signage and branding occurs only 3 times in the in-distribution split and 2 times in the out-of-distribution split, suggesting that our taxonomy design and disambiguation rules produce clean and semantically coherent category boundaries.

The remaining off-diagonal errors are sparse rather than systematic, and are mainly concentrated in context-dependent categories such as signage and technology. This behavior is expected, as these categories often require fine-grained contextual knowledge and are therefore more sensitive to unseen edited-in visual elements. Overall, these results demonstrate that MIC captures fine-grained distinctions across all nine inconsistency categories, providing empirical support for the effectiveness of our inconsistency taxonomy.

Figure 10: Precision-Recall curves and AUPRC of MIC and CLIP on the combined in-distribution and out-of-distribution test set.

/* Qwen3-Embedding-0.6B */
	In-Distribution		Out-of-Distribution
Model	VisualSim	ExplSim	VisualSim	ExplSim
GPT-5.4-mini	20.14	17.88	19.43	17.02
Qwen3-VL-4B-Instruct	23.16	25.24	24.18	27.18
MIC	83.04	82.54	72.09	75.78
/* all-mpnet-base-v2 */
GPT-5.4-mini	14.06	15.73	12.97	14.60
Qwen3-VL-4B-Instruct	15.44	23.42	15.54	24.81
MIC	69.70	74.70	58.99	67.39
/* e5-mistral-7b-instruct */
GPT-5.4-mini	18.88	19.44	17.59	18.19
Qwen3-VL-4B-Instruct	25.38	30.89	26.65	32.63
MIC	81.97	82.67	71.38	72.67

Table 10: Robustness of VisualSim and ExplSim to the choice of evaluation embedding model. The best performance per dataset per metric is marked in boldface.

C.2 AUPRC Analysis

To assess whether the verdict performance of MIC depends on a specific decision threshold, we report the area under the precision–recall curve (AUPRC) on the combined in-distribution and out-of-distribution test sets for the two methods for which we extract calibrated continuous confidence scores: CLIP and MIC. For CLIP, we use the image–text cosine similarity score as the prediction confidence. For MIC, we use the softmax probability assigned to the inconsistent label token at the <verdict> position, normalized over the consistent and inconsistent label tokens. As shown in Figure 10, MIC achieves an AUPRC of $94.20\%$ , substantially outperforming the $64.90\%$ obtained by CLIP. This result indicates that the precision–recall advantage of MIC is maintained consistently across a wide range of decision thresholds, rather than depending on a single operating point. At their default operating thresholds, MIC achieves a precision of $94.40\%$ and a recall of $90.50\%$ , whereas CLIP attains a recall of $95.10\%$ at a substantially lower precision of only $50.90\%$ . Overall, these findings demonstrate that the verdict improvements of MIC reflect robust threshold-invariant gains in classification quality.

Figure 11: Impact of reward weight on MIC.

C.3 Reward Weight Sensitivity Analysis

To investigate the sensitivity of MIC to the GRPO reward coefficients, we train the model from the same SFT checkpoint under three reward-weight configurations, while keeping the backbone, training data, and optimization schedule fixed. The first configuration follows the default reward weights reported in Appendix B.2. The second configuration assigns larger weights to the accuracy-based rewards, namely verdict prediction and inconsistency type classification. The third configuration assigns larger weights to the semantic rewards, namely visual evidence description and world-knowledge explanation. As shown in Figure 11, MIC exhibits a similar overall performance pattern across the three configurations on both in-distribution and out-of-distribution replacement splits. Although individual metrics fluctuate as the reward weights change, no single configuration consistently outperforms the others across all evaluation metrics. These results suggest that the performance of MIC is relatively robust to moderate changes in the reward-weight configuration.

C.4 Robustness Across Embedding Models

Since MIC uses Qwen3-Embedding-0.6B both as the semantic reward signal during GRPO training and as the evaluation model for VisualSim and ExplSim, we investigate whether the observed gains generalize across different embedding families. To this end, we recompute VisualSim and ExplSim using two additional embedding models: all-mpnet-base-v2 Reimers and Gurevych (2019) and e5-mistral-7b-instruct Wang et al. (2024). As shown in Table 10, MIC consistently outperforms representative baselines across all three embedding models on both test splits. These results show that the gains in reference-based semantic similarity persist across the three evaluated embedding models.

	In-Distribution Replacement				Out-of-Distribution Replacement
Model	VisualSim	ExplSim	VisualJudge	ExplJudge	VisualSim	ExplSim	VisualJudge	ExplJudge
SNIFFER	–	10.66	–	3.50	–	8.49	–	2.32
GPT-5.4-mini	20.14	17.88	21.05	20.74	19.43	17.02	19.89	19.71
Qwen2.5-VL-3B-Instruct	13.83	29.11	10.87	9.87	11.83	28.08	8.60	8.22
Qwen3-VL-4B-Instruct	23.16	25.24	23.53	22.84	24.18	27.18	25.42	24.21
Qwen3-VL-8B-Instruct	26.74	28.55	27.68	26.60	25.13	26.88	25.16	25.21
Qwen3-VL-30B-A3B	37.95	37.42	38.35	37.58	38.45	36.61	38.40	36.48
LLaVA-OneVision-7B	13.97	18.65	8.73	8.39	10.43	16.45	7.39	6.25
InternVL3-8B	18.24	22.65	17.38	17.75	17.82	22.51	17.05	17.02
Qwen3-VL-8B-Thinking	43.41	46.19	42.30	41.42	42.64	46.28	41.72	40.89
MIC	83.04	82.54	81.02	85.29	72.09	75.78	69.20	74.64

Table 11: Reference-based evaluation of MIC on MIC-Bench. The best performance per dataset per metric is marked in boldface.

C.5 Reference-Based Evaluation with an LLM Judge

To test whether the explanation-quality gains are specific to embedding-based evaluation, we complement the VisualSim and ExplSim metrics in Table 2 with reference-based evaluation using Qwen3-32B Yang et al. (2025a) as an LLM judge. VisualJudge evaluates the predicted visual evidence description against its reference annotation, while ExplJudge evaluates the predicted world-knowledge explanation against its reference. Table 11 shows that the advantage of MIC is preserved under LLM-based evaluation. On the in-distribution split, MIC achieves $81.02$ VisualJudge and $85.29$ ExplJudge, compared with $42.30$ and $41.42$ for the strongest baseline on these metrics. The same pattern holds out of distribution, where MIC achieves $69.20$ and $74.64$ , respectively. These results show that the advantage of MIC in reference-based evaluation is consistent across embedding-based similarity and LLM-based scoring.

Model	$F_{1}^{\mathrm{inc}}$	$F_{1}^{\mathrm{con}}$	Macro-F1
CLIP	65.31	3.77	34.54
GPT-5.4-mini	38.24	68.18	53.21
Qwen2.5-VL-3B-Instruct	50.56	59.55	55.05
Qwen3-VL-8B-Instruct	53.12	68.75	60.94
InternVL3-8B	57.82	68.98	63.40
MIC	85.98	83.87	84.93

Table 12: Robustness to the AI-generation shortcut.

Claim	Benign Addition	Why It Remains Consistent
Gov. Greg Abbott of Texas said on Thursday that access to clean water remained a problem even as power was restored.	a weathered pickup truck	Pickup trucks are common in Texas, so the addition is plausible and does not alter the depicted event.
Police officers in tactical gear left the site of a shooting in Bangkok on Friday.	a street vendor cart with snacks	Street vendor carts are common in Bangkok and add a local element without changing the depicted event.
President Trump with Prime Minister Narendra Modi at Motera Stadium in Ahmedabad, India.	an Indian flag on a pole	An Indian flag is expected at an event held in India, introducing no contradiction with the claim.
An M.T.A. worker disinfected a subway car at the Coney Island Yard in Brooklyn on Tuesday.	a small yellow traffic cone	Traffic cones are routine in a subway maintenance yard, matching the claimed context.
Michael R. Bloomberg speaking in Clarksville, Tenn., on Friday.	a small American flag pin	Flag pins are a common accessory for U.S. politicians at public speaking events.
Activists gathered outside City Hall calling for an extension of the eviction moratorium in New York on Monday.	a yellow taxi cab	Yellow taxis are ubiquitous in New York City, so the addition fits the setting.
Finance Minister Nirmala Sitharaman of India before presenting the annual budget to Parliament in New Delhi.	a potted green plant	Potted plants are common decor in Indian public buildings and fit the Parliament setting.

Model	Macro-F1	TypeAcc	VisualSim	ExplSim
Qwen3-VL-4B-Instruct	65.20	43.00	39.90	43.50
GPT-5.4-mini	50.70	9.00	9.70	11.60
Qwen3-VL-8B-Instruct	54.00	54.00	50.90	54.80
Qwen3-VL-8B-Thinking	68.50	21.00	17.50	18.80
MIC	95.50	65.00	52.50	59.90

Table 14: Performance (in %) on the two-inconsistency evaluation set. The best performance per metric is marked in boldface.

/* In-Distribution Replacement */
Method	Macro-F1	TypeAcc	VisualSim	ExplSim
Zero-shot CoT	58.90	19.06	23.16	25.24
SFT	90.21	86.77	77.52	78.98
SFT + DPO	75.08	84.64	80.40	83.91
SFT + GRPO (MIC)	94.88	89.76	83.04	82.54
/* Out-of-Distribution Replacement */
Zero-shot CoT	59.44	19.63	24.18	27.18
SFT	86.15	74.50	69.03	72.72
SFT + DPO	74.09	75.07	72.89	73.89
SFT + GRPO (MIC)	90.26	78.65	72.09	75.78

Table 15: Comparison of training strategies. DPO and GRPO are initialized from the same SFT checkpoint.

Model	$F_{1}^{\mathrm{con}}$	$F_{1}^{\mathrm{inc}}$	Macro-F1
Qwen2.5-VL-3B-Instruct	7.70	67.60	37.60
InternVL3-8B	51.20	66.10	58.70
Qwen3-VL-4B-Instruct	79.10	82.60	80.80
Qwen3-VL-8B-Instruct	83.90	86.00	84.90
GPT-5.4-mini	93.50	92.50	93.00
MIC	95.20	94.70	95.00

Table 16: Cross-benchmark consistency evaluation on a balanced, human-verified subset of MiRAGeNews. Results are reported in %.

C.6 AI-Generation Shortcut Control

To test whether MIC relies on whether an image appears AI-generated rather than on claim-grounded inconsistencies, we construct a control set of 200 test claims approximately balanced across the nine inconsistency types. For each claim, we use GPT-4o-mini to generate a benign, context-preserving edit prompt, and use FLUX.2-klein-9B to synthesize a claim-consistent AI-generated image, with examples shown in Table 13. We pair each AI-consistent image with an AI-generated inconsistent counterpart produced by the same generator for the same claim, so both classes contain AI-generated images. As shown in Table 12, MIC achieves balanced performance, with $85.98\%$ $F_{1}^{\mathrm{inc}}$ , $83.87\%$ $F_{1}^{\mathrm{con}}$ , and $84.93\%$ Macro-F1. In contrast, CLIP obtains only $3.77\%$ $F_{1}^{\mathrm{con}}$ , suggesting that it largely predicts AI-generated images as inconsistent regardless of claim consistency. Overall, this control suggests that MIC is not driven solely by image provenance cues, but instead captures claim-grounded visual consistency.

C.7 Multiple-Inconsistency Evaluation

To evaluate generalization beyond single-inconsistency training, we construct a test set of 100 claims, with 50 in-distribution and 50 out-of-distribution cases. Each claim is paired with an authentic image and a human-verified counterpart containing two inconsistencies, yielding 200 image–claim instances. For each two-inconsistency image, models are prompted to identify both inconsistencies and provide their corresponding types, visual evidence descriptions, and world-knowledge explanations in a single response. TypeAcc requires both types to be correct, while VisualSim and ExplSim are averaged over the two predicted findings. As shown in Table 14, MIC performs best across all metrics. Despite being trained only on single-inconsistency examples, it achieves $95.50\%$ Macro-F1 and $65.00\%$ strict TypeAcc, indicating that its verification ability transfers to multiple simultaneous inconsistencies.

C.8 Training Strategy Comparison

To evaluate the contribution of GRPO, we compare zero-shot CoT, SFT, SFT followed by DPO, and SFT followed by GRPO using the same Qwen3-VL-4B-Instruct backbone. DPO and GRPO are initialized from the same SFT checkpoint, and the DPO preference pairs are constructed by ranking sampled responses using the same component-level reward as GRPO. As shown in Table 15, SFT provides most of the task adaptation, while GRPO further improves SFT across all eight metrics, including gains of 4.67 and 4.11 Macro-F1 points on the in-distribution and out-of-distribution splits. DPO improves selected semantic-similarity metrics but substantially reduces Macro-F1 on both splits. Overall, these results support the use of GRPO for jointly improving consistency prediction and fine-grained explanation quality.

C.9 Cross-Dataset Evaluation

To investigate whether MIC transfers beyond MIC-Bench, we evaluate MIC and five baselines on a balanced, human-verified subset of MiRAGeNews Huang et al. (2024) without further training or adaptation. We randomly sample candidate image–claim pairs from MiRAGeNews and manually screen them for claim consistency. The resulting evaluation subset contains 50 generated image–claim pairs verified to exhibit a world-knowledge inconsistency, such as an incorrect national flag, a police uniform from the wrong country, or a public figure depicted with the wrong identity, and 50 consistent real-image pairs. As shown in Table 16, MIC achieves $95.20\%$ $F_{1}^{\mathrm{con}}$ , $94.70\%$ $F_{1}^{\mathrm{inc}}$ , and $95.00\%$ Macro-F1, obtaining the highest Macro-F1 among the evaluated models. These results provide evidence that MIC transfers to a task-relevant subset of an independently constructed dataset.

Model	Macro-F1	TypeAcc	VisualSim	ExplSim
Qwen2.5-VL-3B-Instruct	36.52	12.50	10.66	13.70
LLaVA-OneVision-7B	53.43	13.75	24.07	27.93
InternVL3-8B	60.03	31.75	23.31	27.67
GPT-5.4-mini	59.94	29.00	21.53	23.67
Qwen3-VL-8B-Instruct	63.42	38.25	32.33	34.48
Qwen3-VL-4B-Instruct	59.53	36.00	24.01	29.80
MIC	83.86	46.00	63.91	68.59

Table 17: Performance (in %) on the held-out flag and signage types. The best performance per metric is marked in boldface.

C.10 Held-Out Inconsistency Type Evaluation

To evaluate whether MIC generalizes to inconsistency types absent from task-specific training, we train a variant of MIC on seven of the nine categories, excluding all flag and signage examples, and evaluate it on these two held-out types. As shown in Table 17, MIC outperforms all baselines across all metrics, achieving $83.86\%$ Macro-F1, $46.00\%$ TypeAcc, $63.91\%$ VisualSim, and $68.59\%$ ExplSim. These results indicate that its verification ability transfers to inconsistency types not observed during task-specific training.

Appendix D Error Examples

Table 18 presents representative failure cases of MIC for qualitative analysis. These examples complement the aggregate error statistics by illustrating different failure modes encountered during inconsistency detection and explanation generation. In some cases, MIC fails to identify the manipulated visual evidence altogether. In others, the model predicts the correct verdict but justifies it using hallucinated or unedited visual features. We also observe cases where the model attends to the manipulated region but assigns it the wrong real-world identity or contextual origin. For each example, we provide the ai-generated image, the associated claim, the model output, and a brief diagnosis explaining why the given image and the claim are inconsistent.

Failure Mode	Claim	MIC Output	Why This Is Incorrect
Missed cultural edit	President Trump defied the governor of Nevada by holding an indoor rally near Las Vegas.	<verdict>: CONSISTENT <type>: None <visual>: None <explanation>: None	The candidate’s dark suit has been replaced by a Filipino barong Tagalog, an attire that does not fit a U.S. campaign rally. MIC fails to register the cultural mismatch and incorrectly predicts CONSISTENT.
Missed object or scene edit	Residents of Kenosha, Wis., watched President Trump’s motorcade this month.	<verdict>: CONSISTENT <type>: None <visual>: None <explanation>: None	The sidewalk in a Wisconsin street scene has been replaced with shallow muddy water and rice-paddy seedlings, an environmental cue that does not fit an urban Midwestern setting. MIC overlooks the scene-level edit entirely and predicts CONSISTENT.
Evidence describes feature not in image	Activists were arrested for planning an anti-corruption demonstration in Manara Square, Ramallah.	<verdict>: INCONSISTENT <type>: branding <visual>: Dell-branded storefront/logo <explanation>: A Dell storefront logo introduces a distinctly American consumer-tech brand into a Palestinian protest scene, creating a cultural mismatch.	MIC reaches the correct verdict but justifies it using hallucinated evidence: the cited Dell storefront does not exist in the image. The actual edit, Arabic storefront signs replaced by Urdu Nastaliq script, is never identified.
Evidence describes unedited element	Firefighters pronounced three children dead at an apartment complex in Los Angeles.	<verdict>: INCONSISTENT <type>: architecture <visual>: Spanish colonial-style arched stucco facade with terracotta tile roofline <explanation>: The edited architecture suggests a Latin American Spanish colonial setting rather than a typical California urban residential building.	MIC bases its verdict on an unedited architectural feature already present in the original image. The actual edit, an apartment leasing sign replaced by an Occupy Wall Street banner, is missed.
Wrong country/brand attribution	Andrew Young, the American ambassador to Burkina Faso, during the opening ceremony of a joint military exercise.	<verdict>: INCONSISTENT <type>: technology <visual>: Russian AK-12 assault rifles <explanation>: Equipping the ceremonial honor guard with Russian-service AK-12 rifles shifts the implied military equipment and alliance context away from the Burkinabé setting in the caption.	MIC attends to the correct edited object, the ceremonial rifles, and reaches the correct verdict, but misattributes their identity: the actual edit introduces Italian Beretta ARX160 rifles, not Russian AK-12s. The verdict and visual region are correct, but the entity-to-country link fails.

Appendix E Recent News Examples

Table 19 presents representative examples from the recent-news benchmark introduced in Section 7. The AI-generated images are created using GPT-Image-1.5. Each example includes the original news image, the edited counterpart, the associated claim, the manipulated visual element, and the world-knowledge explanation. These examples illustrate temporally grounded and context-dependent inconsistencies in recent news events, where successful verification requires up-to-date geopolitical, cultural, or event-specific knowledge.

Inconsistency Type	Claim	What Changed	Why Contradicts
clothing	Meeting of French mountain troops and Danish soldiers as part of the Arctic endurance mission.	Danish-style red patch with white cross $\rightarrow$ Indonesian TNI red-over-white flag patches and “TNI” identifiers.	The caption frames the scene as a meeting between French and Danish forces. Replacing the visible uniform identifiers with Indonesian TNI patches changes the represented military affiliation.
flag	U.S. Marine Corps Maj. Sean Gunn speaks to Philippine Air Force leadership.	Philippine flag $\rightarrow$ Indian tricolor flag with navy Ashoka Chakra.	The claim anchors the scene in a Philippine Air Force meeting. Replacing the Philippine flag with India’s national flag misidentifies the host-country context.
gesture	Kaja Kallas and S. Jaishankar signing a Security and Defence Partnership in New Delhi.	Two officials signing documents $\rightarrow$ two officials performing a mutual Japanese deep bow while seated.	The claim describes a diplomatic signing ceremony in India. The edited body language changes the action into a Japanese-style bowing greeting, so the depicted interaction no longer matches the claimed event.
signage	Aircraft attached to Carrier Air Wing (CVW) 9 sit on the flight deck of Nimitz-class aircraft carrier USS Abraham Lincoln (CVN 72) in support of Operation Epic Fury.	Aircraft fuselage text “VFA-41” $\rightarrow$ Japanese Air Self-Defense Force text.	The claim describes U.S. Navy aircraft aboard the USS Abraham Lincoln. The edited Japanese military marking assigns the aircraft to a different national force, creating a direct mismatch with the carrier-air-wing context.
architecture	Korpaskhas evacuates victims of the Cisarua landslide in West Bandung.	Damaged slanted greenhouse roofs $\rightarrow$ damaged Japanese shrine/temple-style curved kawara tile roofs.	The claim places the landslide site in West Bandung, Indonesia, but the edited roof forms suggest Japanese religious or traditional architecture rather than local agricultural structures.
infrastructure	The front of the march in support of Ukraine with flags and banners; behind the trees is the Washington Monument on 17th Street NW, Washington, DC.	Washington, DC road markings $\rightarrow$ Japanese Tokyo-style zebra crosswalk and diamond warning marking.	The claim identifies the scene as 17th Street NW in Washington, DC, while the edited road markings are characteristic of Japanese urban traffic infrastructure.
technology	On 21 March 2026, a protest was held outside the Scottish Parliament against immigration to the country.	UK police van $\rightarrow$ Chinese public-security police van with Chinese markings.	The claim places the protest outside the Scottish Parliament, where policing would be associated with Scottish or UK authorities. The edited Chinese police van introduces the wrong national security context.
branding	The Artemis II stack being rolled out of the VAB before its February launch attempt.	NASA logo on the Vehicle Assembly Building $\rightarrow$ vintage Pan Am globe logo.	The caption refers to a contemporary NASA Artemis II rollout at the Vehicle Assembly Building. The edited Pan Am branding introduces a defunct airline identity in place of the expected NASA visual context.
environment	NASA’s Artemis II mission launched four astronauts aboard the SLS rocket and Orion spacecraft from Kennedy Space Center on April 1, 2026.	Kennedy Space Center coastal vegetation $\rightarrow$ tropical rainforest vegetation with banana plants and coconut palms.	The claim places the launch at Kennedy Space Center in Florida, but the edited vegetation suggests a Southeast Asian tropical rainforest rather than the Florida Space Coast environment.

Appendix F Prompts

This section presents the prompt templates used during the construction of MIC-Bench. The prompts correspond to the automated stages described in Section A.1.