Chameleon: Benchmarking Detection and Backtracking on Commercial-Grade AI-Generated Videos
Extracted source text · arXiv 2503.06624
% ICCV 2025 Paper Template
\documentclass[10pt,twocolumn,letterpaper]{article}
%%%%%%%%% PAPER TYPE - PLEASE UPDATE FOR FINAL VERSION
% \usepackage{iccv} % To produce the CAMERA-READY version
\usepackage[pagenumbers]{iccv} % To produce the REVIEW version
% \usepackage[pagenumbers]{iccv} % To force page numbers, e.g. for an arXiv version
\usepackage{bbding}
\usepackage{booktabs}
\usepackage{arydshln}
\usepackage{float}
\usepackage{graphicx}
\usepackage[table]{xcolor} % 允许表格使用颜色
\usepackage{algorithm}
% \usepackage{graphicx}
\usepackage{algorithmicx}
\usepackage{algpseudocode}
\usepackage{amsmath}
% \usepackage{booktabs}
% Import additional packages in the preamble file, before hyperref
\input{preamble}
% It is strongly recommended to use hyperref, especially for the review version.
% hyperref with option pagebackref eases the reviewers' job.
% Please disable hyperref *only* if you encounter grave issues,
% e.g. with the file validation for the camera-ready version.
%
% If you comment hyperref and then uncomment it, you should delete *.aux before re-running LaTeX.
% (Or just hit 'q' on the first LaTeX run, let it finish, and you should be clear).
\definecolor{iccvblue}{rgb}{0.21,0.49,0.74}
\usepackage{hyperref}
%%%%%%%%% PAPER ID - PLEASE UPDATE
\def\paperID{13504} % *** Enter the Paper ID here
\def\confName{ICCV}
\def\confYear{2025}
%%%%%%%%% TITLE - PLEASE UPDATE
\title{Chameleon: On the Scene Diversity and Domain Variety of AI-Generated Videos Detection}
%%%%%%%%% AUTHORS - PLEASE UPDATE
\author{Meiyu Zeng$^{1}$,\ \ Xingming Liao$^{1 \dagger}$,\ \ Canyu Chen$^{1}$,\ \ Nankai Lin$^{2 \dagger}$, \\
Zhuowei Wang$^{1}$,\ \ Chong Chen$^{1}$,\ \ Aimin Yang$^{1}$\\
$^{1}$Guangdong University of Technology, Guangzhou\\ $^{2}$Guangdong University of Foreign Studies, Guangzhou \\
\tt\small lxim@mail2.gdut.edu.cn\ \ neakail@outlook.com\\}
\begin{document}
% \usepackage{amssymb} % For \checkmark
% \usepackage{pifont} % For \ding
% \usepackage{pifont} % Include this in the preamble
% \newcommand{\xmark}{\ding{55}} % Define the cross mark
\maketitle
% \usepackage{bbding}
\let\thefootnote\relax\footnotetext{$^{\dagger}$ Corresponding author}
\input{sec/0_abstract}
\input{sec/1_intro}
\input{sec/2_related}
\input{sec/3_finalcopy}
{
\small
\bibliographystyle{ieeenat_fullname}
\bibliography{main}
}
\clearpage
\appendix
\input{sec/appendix}
\end{document}
%
% --- inline annotations
%
\newcommand{\red}[1]{{\color{red}#1}}
\newcommand{\todo}[1]{{\color{red}#1}}
\newcommand{\TODO}[1]{\textbf{\color{red}[TODO: #1]}}
\usepackage{multirow}
% --- disable by uncommenting
% \renewcommand{\TODO}[1]{}
% \renewcommand{\todo}[1]{#1}
\begin{figure*}[h]
\centering
\vspace{-10pt} % Adjust vertical spacing if needed
% Subfigure (a)
\begin{subfigure}[t]{0.95\textwidth}
\centering
\includegraphics[width=\linewidth]{picture/abst_2.1.png} % Ensure "abst_1.png" is in the working directory
\caption{}
\label{fig:pict_1a}
\end{subfigure}
\vspace{10pt} % Add vertical space between subfigures
% Subfigure (b)
\begin{subfigure}[t]{0.95\textwidth}
\centering
\includegraphics[width=\linewidth]{picture/abst_2_compressed.png} % Ensure "abst_2.png" is in the working directory
\caption{}
\label{fig:pict_1b}
\end{subfigure}
\caption{Examples of Chameleon. Frame sequences are used to show the dynamics of the video. Subfigure (a) represents real-world videos from News, Speech, and Recommendation, and the second column on the left represents AI-generated videos based on the first column. Subfigure (b) shows the scene diversity and domain diversity of Chameleon. The green arrows for scene diversity and the yellow boxes show domain diversity.}
\label{fig:pict_1}
\end{figure*}
\begin{abstract}
Artificial intelligence generated content (AIGC), known as DeepFakes, has emerged as a growing concern because it is being utilized as a tool for spreading disinformation. While much research exists on identifying AI-generated text and images, research on detecting AI-generated videos is limited. Existing datasets for AI-generated videos detection exhibit limitations in terms of diversity, complexity, and realism. To address these issues, this paper focuses on AI-generated videos detection and constructs a diverse dataset named Chameleon. We generate videos through multiple generation tools and various real video sources. At the same time, we preserve the videos' real-world complexity, including scene switches and dynamic perspective changes, and expand beyond face-centered detection to include human actions and environment generation. Our work bridges the gap between AI-generated dataset construction and real-world forensic needs, offering a valuable benchmark to counteract the evolving threats of AI-generated content.
\end{abstract}
\section{Introduction}
\label{sec:intro}
Artificial intelligence generated content (AIGC) \cite{10.1145/3576915.3623189,DBLP:journals/wc/DuLNKXSK24} refers to content generated by artificial intelligence technology, including text \cite{DBLP:journals/corr/abs-2308-05341}, images \cite{DBLP:conf/nips/ZhengL0WGL024}, videos \cite{ciftci2020fakecatcher}, etc. In recent years, rapid advancements in deep learning-based generative models have significantly improved the quality and realism of such content, making it increasingly difficult to discern. Moreover, AIGC can be misused for improper purposes, threatening social, political, and economic security. In this case, effective detection of AIGC \cite{chaka2023detecting} not only helps maintain network order but also provides a strong guarantee for ethical construction in the digital age.
Currently, a substantial amount of research has been conducted on the identification of AI-generated text \cite{DBLP:journals/corr/abs-2308-05341,DBLP:conf/nips/GuoHZZFHM24,DBLP:conf/nips/Guo0J000S024} and AI-generated images \cite{DBLP:conf/nips/ZhengL0WGL024,DBLP:conf/nips/PalKPBYCH24,DBLP:conf/ccs/HaPBSSZZ24}. With the development of large vision models (LVMs), such as Runway and Sora \cite{DBLP:journals/corr/abs-2402-17177}, it is easier to generate fake videos. However, research on the detection of AI-generated videos remains limited. Videos inherently contain dynamic and continuous elements, making their detection more challenging. Consequently, this complexity requires more rigorous and comprehensive benchmarks for AI-generated videos detection.
\begin{table}[h]
\centering
\caption{Comparisons of different datasets. MGT: Multi-Generation Techniques, MS: Multi-Source, SD: Scene Diversity, DV: Domain Variety.}
\label{tab:dataset_comparison}
\setlength{\tabcolsep}{10pt}
\renewcommand{\arraystretch}{1.27}
\begin{tabular}{ccccc}
\toprule
Dataset & MGT & MS & SD & DV \\
\midrule
FF++ \cite{DBLP:conf/iccv/RosslerCVRTN19} & \CheckmarkBold & \XSolidBrush & \XSolidBrush & \XSolidBrush \\
DFDC \cite{DBLP:journals/corr/abs-1910-08854} & \CheckmarkBold & \XSolidBrush & \XSolidBrush & \XSolidBrush \\
Wilddeepfake \cite{zi2020wilddeepfake}& \CheckmarkBold & \CheckmarkBold & \XSolidBrush &\XSolidBrush \\
CoReD \cite{kim2021cored}& \CheckmarkBold & \CheckmarkBold & \XSolidBrush &\XSolidBrush \\
CDDB \cite{Li_2023_WACV}& \CheckmarkBold & \CheckmarkBold & \XSolidBrush &\XSolidBrush \\
\cdashline{1-5} % Dotted line above the last row
Chameleon & \CheckmarkBold & \CheckmarkBold & \CheckmarkBold & \CheckmarkBold \\
\bottomrule
\end{tabular}
\end{table}
Existing datasets for AI-generated videos detection exhibit limitations in terms of diversity, complexity, and realism, which pose challenges to the development of reliable and precise detection algorithms. Although FaceForensics++ \cite{DBLP:conf/iccv/RosslerCVRTN19} and DFDC \cite{DBLP:journals/corr/abs-1910-08854} employ various generated techniques, it is restricted to a single data source scenario, which may limit their comprehensiveness in AI-generated videos detection tasks. Wilddeepfake \cite{zi2020wilddeepfake}, CoReD \cite{kim2021cored}, and CDDB \cite{Li_2023_WACV} use multi-source data for generation to make up for this deficiency. However, existing AI-generated videos detection datasets still lack scene transitions and solely focus on facial manipulation, thus failing to comprehensively simulate real-world video scenarios and cope with more complex detection requirements.
To fill these gaps, we focus on the detection task of AI-generated videos and use advanced AI generation technology to build a diverse AI-generated videos dataset, \textbf{Chameleon}. As shown in Table \ref{tab:dataset_comparison}, Chameleon not only inherits the core features of existing mainstream datasets but also breaks through the limitations of traditional datasets. Specifically, we generate videos through multiple generation tools (\textbf{Multi-Generation Techniques}) and a variety of real video sources (\textbf{Multi-Source}). At the same time, we preserve the videos' real-world complexity, including scene switches and dynamic perspective changes (\textbf{Scene Diversity}), and expand beyond face-centered detection to include human actions, and environment generation (\textbf{Domain Variety}). These comparisons highlight the relevance of the Chameleon dataset in the field of AI-generated videos detection, which not only encompasses a wide range of video categories and covers multiple advanced AI generation techniques, but also has a richer set of scenarios and domains. Figure \ref{fig:pict_1} shows examples of our dataset. In summary, this paper provides three primary contributions:
\begin{itemize}
\item To comprehensively simulate real-world scenarios, we construct a new AI-generated videos detection dataset with scene diversity and domain variety, Chameleon.
\item We explore the performance of different detection methods and and backtracking methods in Chameleon, evaluating and understanding their capabilities and limitations.
\item This work bridges the gap between AI-generated dataset construction and real-world forensic needs, offering a valuable benchmark to counteract the evolving threats of AI-generated videos.
\end{itemize}
\section{Related Work}
\label{sec:formatting}
\subsection{Datasets and Benchmarks}
Recent research on datasets for AI-generated videos detection has primarily concentrated on two categories. The first type includes datasets like DFDC \cite{DBLP:journals/corr/abs-1910-08854}, Celeb-DF \cite{DBLP:conf/cvpr/LiYSQL20}, and Faceforensics++ \cite{DBLP:conf/iccv/RosslerCVRTN19}. These focus on face replacement and expression manipulation, generating fake content through synchronous changes in faces or mouth parts of fixed lenses. Although these datasets are large-scale and the existing methods can achieve good performance on the dataset, they are limited by their single-scene nature and reliance on local features \cite{Wang_2020_CVPR}, such as GAN artifact detection\cite{9792208}. The second category comprises generalized AI-generated datasets like ForenSynths and VideoGPT \cite{DBLP:journals/corr/abs-2104-10157}. These expand the types of tampering to include gestures and background replacements and introduce temporal dynamics \cite{guillaro2023trufor}. However, they still struggle with accurately simulating real attack patterns and lack sufficient domain coverage, often focusing solely on single objects or faces.
To fill these gaps, we construct a multi-scenario and multi-domain AI-generated videos detection dataset. By enhancing scene diversity and domain variety, this dataset offers an improved benchmark over existing works.
\subsection{Detection Method}
AI-generated videos detection mainly focuses on two directions: data-driven feature analysis \cite{li2018ictu,ciftci2020fakecatcher} and deep-learning based methods \cite{she2024using,kamat2023revisiting}. Nowadays, detection techniques mainly focus on deep-learning based methods. Early deep-learning based methods were mostly based on convolutional neural networks (CNN) to extract local texture features. Tan et al. \cite{DBLP:conf/cvpr/TanLZWGLW24} proposed that artifacts introduced by the up-sampling operation can be reversed and applied to detection. In addition, they also proposed a frequency domain sensing detection framework\cite{tan2024frequency}. To meet the real-time detection requirements, Romeo et al. \cite{lanzino2024faster} designed a lightweight detector based on a binary neural network, providing a feasible solution for end-to-end deployment.
With the diversification of generation technologies, researchers began to explore a broader AI-generated detection paradigm. Davide et al. \cite{DBLP:conf/cvpr/CozzolinoPCNV22} proposed a lightweight detection strategy based on CLIP features \cite{zhang2022pointclip}. Gu et al. \cite{DBLP:conf/aaai/GuCYDLM22} designed a dynamic inconsistency Learning (DIL) model to capture spatiotemporal anomalies from densely sampled video footage. With the emergence of LVMs, they have performed well in cross-modal understanding \cite{10.1145/3672758.3672824,DBLP:journals/corr/abs-2304-03086}. Jia et al. \cite{DBLP:journals/corr/abs-2403-14077} proposed to use LVMs such as GPT 4V and Gemini 1.0 Pro \cite{zhang2024gpt,team2023gemini} to detect forged face images, and designed text prompts.
However, the above methods still face two major challenges: First, the existing datasets are not diverse in scene and domain diversity, resulting in the model overfitting specific artifacts; Second, the generalization ability of the detection algorithm to new generation models (such as Runway and Kling) \cite{zhang2023toward} is insufficient. Muhammad et al. further explored the performance of advanced LVMs in AI-generated videos detection by introducing prompt learning \cite{DBLP:journals/corr/abs-2401-02418,Khattak_2023_CVPR}, revealing the potential of LVMs in AI-generated videos detection and providing a new idea for building a robust inspection system.
\begin{figure}[t]
\centering
% \fbox{\rule{0pt}{2in} \rule{0.9\linewidth}{0pt}}
\includegraphics[width=1\linewidth]{picture/framework_7.png}
\caption{Framework building for Chameleon. Blue for AI-generated videos and black for real-world videos. A cross and a check mark indicate that the video is judged to be an AI-generated video and a real-world video, respectively.}
\label{fig:framework}
\end{figure}
\section{Chameleon}
In this section, we introduce our self-constructed AI-generated dataset, Chameleon, which considers the AI-generated videos' \textbf{scene diversity} and \textbf{domain variety}. The construct process for Chameleon is illustrated in Figure \ref{fig:framework}. Section 3.1 details the selection of original videos used as the foundation for the dataset. Section 3.2 describes the strategy employed to generate synthetic videos from these originals. Finally, Section 3.3 presents the division of Chameleon into training, validation, and test sets, accompanied by illustrative examples. Algorithms for generating datasets are in Appendix A.
\subsection{Original Videos}
In this work, we select \textbf{multi-source (MS)} videos from news broadcasts (News), public speeches (Speech), and product recommendations (Recommendation) as raw videos. Specifically, the three video features are as follows:
\begin{itemize}
\item \textbf{News}: These videos from news broadcasts contain frequent scene transitions (e.g., abrupt cuts from studio anchors to live field reports) and mixed camera angles (e.g., wide shots, close-ups).
\item \textbf{Speech}: These videos of public speeches contain feature dynamic human-object interactions (e.g., gesturing with props, switching presentation slides) and variable lighting conditions (e.g., stage spotlights, audience shadows).
\item \textbf{Recommendation}: These videos of product recommendations contain object-centric manipulations (e.g., rotating gadgets, demonstrating functionalities) and natural environmental changes (e.g., indoor/outdoor transitions).
\end{itemize}
The source data are selected from three public video platforms, namely CNN, TED, and YouTube. The raw data covered 40 videos each of news broadcasts, public speeches, and product recommendation videos. Additionally, these videos have a duration ranging from 2 to 20 minutes.
\subsection{AI-generated Videos Creation}
We design a rigorous preprocessing pipeline consisting of three key stages: video segmentation and selection, metadata generation, and AI-generated videos creation.
\vspace{-10pt}
\paragraph{Video Segmentation and Selection.}
Raw videos are first segmented into non-overlapping 5-second video segments using FFmpeg. To ensure the selected videos exhibited \textbf{scene diversity} and \textbf{domain variety}, we manually fliter the segments based on two criteria: \textbf{(1) the presence of scene transitions} such as abrupt cuts in news broadcasts, slide changes in speeches, or environmental shifts in product recommendations and \textbf{(2) diversity in domains} like interactions between humans, objects, and backgrounds. Three annotators independently score each video on a 5-point scale, retaining only the top 5 video segments per raw video. After aggregation, the final dataset comprises 200 videos per category (600 total), denoted as $V^R$.
\vspace{-10pt}
\paragraph{Metadata Generation.}
For each video in $V^R$, we generate structured metadata to guide subsequent video generation. First, we invite three professional researchers with multi-modal knowledge to provide a detailed textual description of the video from three core aspects: Key Objects, Actions, and Scene Transitions. The annotation is carried out by two experts, and when there is ambiguity about the description of the video, it will be annotated by a third expert. Next, the first and last frames of $V^R$ are extracted using FFmpeg to serve as anchor points for temporal consistency. Finally, the caption and first and last frames are regarded as metadata to guide the model to generate the video.
\vspace{-10pt}
\paragraph{Final Generation.}
The metadata comprised of anchor frames and captions are used to generate videos using state-of-the-art generative models, including \textbf{Runway Gen 3}\footnote{https://runwayml.com/}, \textbf{Jimeng}\footnote{https://jimeng.jianying.com/ai-tool/home/}, and \textbf{Kling}\footnote{https://klingai.kuaishou.com/}. We adopt a selective synthesis strategy that randomly divides the real video into two equal parts. The metadata of half of the videos is used to generate the synthesized video, while the other half is left raw and not generated. This strategy aims to enhance the generalization ability of the model and maintain the balance of the dataset. AI-generated Videos with motion blur, heavy compression artifacts, or occlusions are discarded.
\subsection{Data Contents}
\paragraph{Dataset Setting.} In our study, we build a dataset of 600 real-world videos and 600 AI-generated videos, for a total of 1,200 video samples. To systematically evaluate the performance of the model, we divide the data set into a 6:2:2 ratio of training set, validation set, and test set. Specifically, the training set contains 720 samples (60\% of the total) for the parameter learning of the model. The validation set contains 240 samples (20\% of the total) for model selection and hyperparameter tuning. The test set also contains 240 samples (20\% of the total) for the final assessment of the generalization ability of the model. Each type of dataset of real-world video and AI-generated videos has a ratio of 1:1.
\vspace{-10pt}
\paragraph{Example.} In Figure \ref{fig:pict_1}, we present video samples from the Chameleon dataset. The figure covers three categories: News, Speech, and Recommendation. We randomly select one real-world video sample and one AI-generated videos sample from each category, totaling 6 samples, and display these samples in the form of frames. As shown in the figure, the changes of the body movements of the characters, specifically the changes of the hands and the different angles of the characters in Figure \ref{fig:pict_1b} show the diversity of the chameleon's field, while the distance changes of the lens clearly reveal the diversity of the scene. More information about our dataset is presented in Appendix B and C.
\section{Task Definition}
\label{sec:definition}
\subsection{Formal Problem Description}
In the task of detecting AI-generated videos, the objective is to develop a binary classification detector capable of accurately identifying AI-generated videos. We consider a collection of real-world and AI-generated videos sampled from various sources, denoted as $V^{R} = \{V_1^{R}, V_2^{R}, ..., V_n^{R}\}$ and $V^{F} = \{V_1^{F}, V_2^{F}, ..., V_n^{F}\}$, respectively, where the $n$ represents the number of the videos. The purpose of the detector is to output the corresponding label $Y^R=\{Y_1^R, Y_2^R,..., Y_n^R\}$ and $Y^F=\{Y_1^F, Y_2^F,..., Y_n^F\}$ for each video, where $Y=1$ indicates the AI-generated video and $Y=0$ indicates the real-world video. In this study, we also propose a backward tracking task for AI-generated videos aimed at identifying the real-world video used to generate that AI-generated video. Specifically, the labels of real-world videos are denoted as $L^R=\{L_1^R,L_2^R,...,L_n^R\}$, for AI-generated videos, their labels are denoted as $L^F=\{L_1^F,L_2^F,...,L_n^F\}$. As for an AI-generated $V_i^{F}$ $(i
\in{1,2,...,n})$, the real-world video from which it comes is represented as $L_{i}^F\in{\{L_1^R,L_2^R,...,L_n^R\}}$.
\subsection{AI-generated Detection}
For an input video $V_i$, the detector first extracts the video into frames. Extract a sequence of frames from $V_i$ at a fixed sampling rate $r$ (e.g., $r=2$ frames per second):
\begin{equation}{S_i}=\left\{I_{i_t}\mid t\in\{1,2,\ldots,k\}\right\},\quad k=\lfloor T\cdot r\rfloor,
\end{equation}
where $I_{t}\in\mathbb{R}^{H\times W\times3}$ represents the $t$-th frame with spatial resolution $H\times W$. $T$ represents the duration of the video. And a video contains $k$ frames. This step converts the continuous video stream into a discrete frame sequence for computational processing. For each extracted frame $I_{i_t} \in {S_i}$, a binary classifier $f_\theta:\mathbb{R}^{H\times W\times3}\to\{0,1\}$ predicts its authenticity:
\begin{equation}
\small
L_{\text{frame}} = -\frac{1}{K} \sum_{t=1}^{K} \left[ w \cdot y_{i_t} \log(p_{i_t}) + w' \cdot (1 - y_{i_t}) \log(1 - p_{i_t}) \right].
\end{equation}
\begin{equation}
\hat{y}_{i_t}= f_\theta(I_{i_t}), \quad \text{where}
\begin{cases}
\hat{y}_{i_t} = 1, & p_{i_t} \geq \tau, \\
\hat{y}_{i_t} = 0, & p_{i_t} < \tau,
\end{cases}
\end{equation}
where $ p_{i_t}$ represents the likelihood of frame being AI-generated and $\tau$ represents the threshold. $w$ and $w'$ represent the learnable weight. $y_{i_t}$ represents the true label of the $t$-th frame. Specifically, each video frame $\hat{y}_{i_t}$ is labeled with 0 or 1, indicating whether it belongs to the category of real-world video ($y=0$) or AI-generated video ($y=1$).
To aggregate frame-level predictions into a video-level authenticity decision, we count the number of correctly predicted frames in the video and calculate their proportion, and then convert into video-level decision.
\begin{equation}
P_{i} = \frac{\sum_{t=1}^k \mathbb{I}(y_{i_t}= \hat{y}_{i_t})}{k},
\end{equation}
where $P_v^{i}$ denotes the correct prediction rate for all frames in the $i$-th video, namely, confidence probability. $\mathbb{I}$(·) is an indicator function that returns 1 if the condition in parentheses holds, and 0 otherwise. Further, for video detector, the calculation is as follows:
\begin{equation}
\hat{Y_i}^{F} =
\begin{cases}
1, & P_{i} \geq \theta, \\
0, & P_{i} < \theta,
\end{cases}
\end{equation}
\begin{equation}
\hat{Y_i}^{R} =
\begin{cases}
0, & P_{i} \geq \theta, \\
1, & P_{i} < \theta.
\end{cases}
\end{equation}
Specifically, when the prediction probability $P_{i}$ of the whole video exceeds the confidence threshold $\theta$, AI-generated videos will be labeled as 1, and real-world videos will be labeled as 0, otherwise, AI-generated and real-world videos will be incorrectly labeled as 0 and 1, respectively.
\subsection{AI-generated Videos Backtracking}
% \subsubsection{Backtracking Method}
The AI-generated videos backtracking process mainly contains video feature extraction and similarity tracking, which is detailed as follows.
\vspace{-10pt}
\paragraph{Video Feature Extraction.}
For AI-generated and real-world video, their frame sequences are denoted as $S_i^F=\{I_{i_1}^F, I_{i_2}^F,..., I_{i_k}^F\}$ and $S_j^R=\{I_{j_1}^R, I_{j_2}^R,..., I_{j_k}^R\}$. We extract the spatial features of each frame as follows:
\begin{equation}
\mathbf{h}_{i_t}^{F} = \text{Encoder}(I_{i_t}^{F}), \quad t \in \{1, 2, \ldots, k\},
\end{equation}
\begin{equation}
\mathbf{h}_{j_s}^{R} = \text{Encoder}(I_{j_s}^{R}), \quad s \in \{1, 2, \ldots, k\}.
\end{equation}
\vspace{-10pt}
\paragraph{Similarity Tracking.}
In the backtracking process, the similarity between AI-generated videos and real-world videos needs to be calculated by the following formula:
\begin{equation}
\text{Sim}(I_{i_t}^{F}, I_{j_s}^{R}) = \frac{\mathbf{h}_{i_t}^{F} \cdot \mathbf{h}_{j_s}^{R}}{\|\mathbf{h}_{i_t}^{F}\| \cdot \|\mathbf{h}_{j_s}^{R}\|},
\end{equation}
\begin{equation}
t^*= \arg \max_{j \in \{1, \ldots, n\}, s \in \{1, \ldots, k\}} \text{Sim}(I_{i_t}^F, I_{j_s}^R).
\end{equation}
We use cosine similarity to find the real-world video frame that is most similar to the frame $I_{i_t}^{F}$ and the real video index to which it belongs to. The index of the matched real-world video is $t^*$. The matching results of all the frames of the video are counted, and the prediction probability of the real label is as follows:
\begin{equation}C_i(t^*)=\sum_{t=1}^k\mathbb{I}(L_{i}^F=L_{t^*}^R),\end{equation}
\begin{equation}P_{Li}=\frac{C_i(t^*)}{k}.\end{equation}
\begin{table}[h]
\centering
\caption{Accuracy of different methods for detecting AI-generated and real-world videos in the Chameleon dataset under varying confidence thresholds. The light blue label represents the best performance in deep learning methods, and the light pink label represents the best performance in LVMs.}
\label{tab:accuracy_methods}
\renewcommand{\arraystretch}{1.25}
\resizebox{\columnwidth}{!}{ % 自动缩放到单栏宽度
\begin{tabular}{lccccc}
\toprule
\multirow{2}{*}{\textbf{Method}}
& \multicolumn{5}{c}{\textbf{Chameleon}} \\
\cmidrule(lr){2-6}
& $acc@0.6$ & $acc@0.7$ & $acc@0.8$ & $acc@0.9$ & $acc@1.0$ \\
\midrule
NPR \cite{DBLP:conf/iccv/RosslerCVRTN19} & \cellcolor{pink!20}0.7958& \cellcolor{pink!20}0.7708 & \cellcolor{pink!20}0.7375 & \cellcolor{pink!20}0.6958 & \cellcolor{pink!20}0.5833 \\
FreqNet \cite{tan2024frequency} & 0.7833 & 0.7417 & 0.6958 & 0.6292 & 0.5292 \\
BNet \cite{lanzino2024faster} & 0.7458 & 0.7000 & 0.6417 & 0.6042 & 0.4958 \\
\cdashline{1-6}
Claude 3.5 \cite{kurokawa2024diagnostic} & 0.5083 & 0.5042 & 0.4958 & \cellcolor{cyan!10}0.4833 & \cellcolor{cyan!10}0.4417 \\
Gemini-1.5-flash \cite{team2023gemini} & 0.4417 & 0.3917 & 0.3375 & 0.3000 & 0.2167 \\
GPT-4o \cite{islam2024gpt} & 0.5917 & 0.5292 & 0.4708 & 0.4167 & 0.3125 \\
GPT-4V \cite{zhang2024gpt} & \cellcolor{cyan!10}0.6417 & \cellcolor{cyan!10}0.5958 & \cellcolor{cyan!10}0.5333 & 0.4292 & 0.2292 \\
\bottomrule
\end{tabular}
}
\end{table}
\begin{table}[h]
\centering
\caption{Accuracy of different models under varying confidence thresholds.}
\label{tab:model_accuracy}
\renewcommand{\arraystretch}{1.25} % Adjust row height
\resizebox{\columnwidth}{!}{ % Automatically scale the table to fit within the page width
\begin{tabular}{lccccc} % Specify column alignment (left and centered columns)
\toprule
\multirow{2}{*}{\textbf{Model}}
& \multicolumn{5}{c}{\textbf{Chameleon}} \\
\cmidrule(lr){2-6}
& $acc@0.6$ & $acc@0.7$ & $acc@0.8$ & $acc@0.9$ & $acc@1.0$ \\
\midrule
ResNet-50 \cite{koonce2021resnet} & 0.7067 & 0.6633 & \cellcolor{green!10}0.6050 & 0.5100 & 0.4233 \\
VGG16 \cite{theckedath2020detecting} & 0.6900 & 0.6317 & 0.5633 & 0.4933 & 0.4050 \\
DenseNet161 \cite{bhuria2024innovative} & 0.7133 & \cellcolor{green!10}0.6700 & 0.6017 & 0.5233 & 0.4400 \\
EfficientNet B0 \cite{koonce2021efficientnet}& \cellcolor{green!10}0.7217 & 0.6683 & 0.6067 & \cellcolor{green!10}0.5300 & \cellcolor{green!10}0.4450 \\
ViT-B/16 \cite{touvron2022deit} & 0.7000 & 0.6417 & 0.5617 & 0.4917 & 0.3967 \\
Swin Transformer \cite{liu2021swin} & 0.6867 & 0.6350 & 0.5733 & 0.5083 & 0.4183 \\
\bottomrule
\end{tabular}
}
\end{table}
\begin{figure}[t]
\centering
% \fbox{\rule{0pt}{2in} \rule{0.9\linewidth}{0pt}}
\includegraphics[width=1\linewidth]{picture/all.png}
\caption{ROC curve compares the performance of different models in detecting AI-generated and real-world videos.}
\label{fig:ROCALL}
\end{figure}
\section{Benchmarking Results}
\subsection{Evaluation Metric}
To assess video-level detection performance, we introduce \textbf{Accuracy (ACC)} and \textbf{Area Under the ROC Curve (AUC)}, forming a multi-dimensional evaluation.
\textbf{ACC} is used to evaluate the proportion of correctly classified videos in the test set:
\begin{equation}
\text{ACC} = \frac{\text{TP} + \text{TN}}{\text{TP} + \text{TN} + \text{FP} + \text{FN}},
\end{equation}
where TP is the number of generated videos correctly identified, TN is the number of real videos correctly identified, FP is the number of real videos misclassified as synthetic, and FN is the number of generated videos misclassified.
\textbf{AUC} measures the model’s overall discriminative power by evaluating the area under the True Positive Rate (TPR) and False Positive Rate (FPR) curve across all possible thresholds $\theta \in [0, 1]$:
\begin{equation}
\text{AUC} = \int_{0}^{1} \text{TPR}(\theta) \, d\text{FPR}(\theta),
\end{equation}
\begin{equation}
\text{TPR} = \frac{\text{TP}}{\text{TP} + \text{FN}},
\end{equation}
\begin{equation}
\text{FPR} = \frac{\text{FP}}{\text{FP} + \text{TN}}.
\end{equation}
% \subsection{Implement Details}
\subsection{Baseline}
We explore the performance of video detection methods based on deep learning and large vision models in detecting the construction datasets. The three deep learning based methods for comparison are \textbf{NPR} \cite{DBLP:conf/cvpr/TanLZWGLW24}, \textbf{FreqNet} \cite{tan2024frequency} and \textbf{BNet} \cite{lanzino2024faster}. To evaluate the capability of current large-scale AI generation models for AI-generated videos detection, we selected four advanced LVMs: GPT-4V \cite{zhang2024gpt}\footnote{https://openai.com/index/gpt-4v-system-card/}, GPT-4o \cite{islam2024gpt}\footnote{https://openai.com/index/hello-gpt-4o/}, Claude 3.5 \cite{kurokawa2024diagnostic}\footnote{https://claude.ai/}, and Gemini-1.5-flash \cite{team2023gemini}\footnote{https://gemini.google.com/app?hl=zh-cn}. We provide specific prompts for these models to test. Similar to the previous work of Jia et al. \cite{DBLP:journals/corr/abs-2403-14077}, we design a prompt ``\textit{Analyze the given image and determine whether it contains synthesis artifacts. Respond strictly with: 1) `Yes' or `No' to indicate the presence of artifacts. 2) If `Yes,' provide a detailed description of where the artifacts appear, such as specific regions (e.g., facial areas, background, edges) and the characteristics of the artifacts (e.g., blurriness, unnatural textures, inconsistent lighting, distortions).}" related to detection to test samples from scene and domain. A detailed introduction to the baseline methodology is presented in Appendix D.
\begin{figure*}
\centering
\begin{subfigure}{0.49\linewidth}
\includegraphics[width=1\linewidth]{picture/class_1.0.png}
\caption{Accuracy of different methods across News, Speech, and Recommendation categories with confidence thresholds equal to 1.0. Claude 3.5: Claude, Gemini-1.5-flash: Gemini.}
\label{fig:short-a}
\end{subfigure}
\hfill
\begin{subfigure}{0.49\linewidth}
\includegraphics[width=1\linewidth]{picture/model_1.0.png}
\caption{Accuracy of different methods across Kling, Runway Gen 3, and Jimeng techniques with confidence thresholds equal to 1.0. Claude 3.5: Claude, Gemini-1.5-flash: Gemini.}
\label{fig:short-b}
\end{subfigure}
\caption{Accuracy of different methods across categories and generation techniques with confidence thresholds equal to 1.0. }
\label{fig:short}
\end{figure*}
\begin{figure*}[h] % Use [h] to place it right after the title
\centering
\vspace{-10pt} % Adjust vertical spacing if needed
\includegraphics[width=1\linewidth]{picture/pict_2.png} % Ensure "pict_1.png" is in the working directory
\caption{Examples of LVMs detection of AI-generated and real-world video frames in the Chameleon dataset. The left section presents detection results for AI-generated video frames, while the right section shows detection results for real-world video frames. Each section includes three categories: News, Recommendation, and Speech. The green checkmarks indicate correct predictions, while the red crosses represent incorrect predictions.
}
\label{fig:LVM}
\end{figure*}
\subsection{Basic Benchmarking Results}
We describe the experimental results based on deep learning and LVMs, the specific results are shown in the Table \ref{tab:accuracy_methods}. When the confidence threshold increases from $acc@0.6$ to $acc@1.0$, the accuracy of all models shows a decreasing trend. This phenomenon shows that as the confidence threshold increases, the difficulty of correct prediction increases significantly. At different thresholds, the NPR model demonstrates superior performance and consistently maintains the highest accuracy, indicating a significant advantage in distinguishing AI-generated videos. This is followed by FreqNet and BNet, which also excel in this task. In contrast, LVMs such as Claude 3.5, Gemini-1.5-Flash, GPT-4o, and GPT-4V perform poorly overall, with GPT-4V having the lowest accuracy. At high confidence thresholds, the accuracy of these models drops dramatically, highlighting the challenges they face in making fully correct predictions. This result shows that while some models perform well under low confidence requirements, the robust detection of AI-generated videos under high confidence conditions remains a challenge.
Figure \ref{fig:ROCALL} demonstrates the Receiver Operating Characteristic (ROC) curve, which compares the performance of different models in detecting AI-generated videos. NPR achieves the highest AUC (0.8748), followed closely by FreqNet (0.8605) and BNet (0.8364), demonstrating strong detection capabilities. In contrast, GPT-4V (0.7332) and GPT-4o (0.6488) perform moderately, indicating some predictive power but less reliability. Claude 3.5 (0.5466) and Gemini-1.5-flash (0.5067) perform poorly, close to random guessing, making them unsuitable for this task. Overall, the deep learning method (NPR, FreqNet, BNet) outperforms LVMs, indicating that there is still a large improvement space for LVMs in detection. ROC curves under different thresholds for categories and generation techniques are included in Appendix E.
To show the concrete work on LVMs, we demonstrate the prompt template in Figure \ref{fig:LVM}. Specifically, six examples of predictions are given in the figure, containing correct and incorrect predictions for AI-generated videos and real-world videos across three categories.
\subsection{Backtracking Benchmarking Results}
% \textbf{Main Results:}
The results of backtracking under different thresholds are shown in the Table \ref{tab:model_accuracy}. We also compare the backtracking effects of different backbone network models: ResNet-50, VGG16, DenseNet161, EfficientNet B0, ViT-B/16, and Swin Transformer \cite{koonce2021resnet, theckedath2020detecting,bhuria2024innovative,koonce2021efficientnet,touvron2022deit,liu2021swin}. The experimental data show that the models with EfficientNet B0 as the backbone network have better results than the other models. Specifically, when the threshold is at 0.6, EfficientNet B0 achieves the best predictions with a correct rate of 0.7217. What's more, EfficientNet B0 and DenseNet161 show relatively small decreases at high thresholds, showing good robustness. In all, the results indicating that the constructed backtracking model can effectively clarify the original real-world video of the AI-generated video.
\subsection{Further Study}
In this section, we elaborate on the performance of various models and methods in practical applications. We compare and analyze their recognition effectiveness in three different categories of video: News, Speech, and Recommendation. In addition, we also evaluate the ability of these methods to identify video content generated by three advanced generation techniques. We present the results when the threshold value is 1.0 in Figure \ref{fig:short}.
\vspace{-10pt}
\paragraph{Quantitative Analysis of Different Categories.} As shown in Figure \ref{fig:short-a}, in the three categories of News, Speech, and Recommendation, the detection model based on deep-learning performs better on Recommendation than the other two types of News and Speech. Compared with News and Speech, Recommendation may involve more dynamic elements, object interactions, or complex background information, enabling deep-learning based methods to better capture patterns and distinguish AI-generated content from real content. Besides, the models perform worse on the Speech category, which indicates that the generated speech-like videos have a high degree of authenticity. The results reflect that current deep learning detection methods still face challenges in processing highly simulated human expression videos, suggesting that future research needs to pay more attention to subtle inconsistencies in scenes and regions to improve detection capabilities.
In LVMs, Claude 3.5 and GPT-4V perform better in the News category than the other two models (Gemini-1.5-Flash and GPT-4o). This may be because news videos often have a more standardized visual structure, such as the fixed position of the anchor and clear camera-cutting patterns. Claude 3.5 and GPT-4V may be able to make better use of these visual features to identify typical patterns in news videos, thus showing higher accuracy in that category. In contrast, Gemini-1.5-Flash and GPT-4o outperformed the other two models in the detection of Speech video. This may be due to the more diverse visual content of speech videos, which often include rich body language, audience reactions, and complex scenes. Gemini-1.5-Flash and GPT-4o may have greater adaptability and recognition of complex visual information, especially when dealing with the dynamic presentation of the speaker and subtle changes in the scene, thus demonstrating stronger detection performance in this category.
This difference suggests that different large models may be influenced by their architecture, training data distribution, and sensitivity to visual information when processing specific types of video content.
\vspace{-10pt}
\paragraph{Quantitative Analysis of Different Generation Techniques.} As shown in Figure \ref{fig:short-b}, we conduct a contrastive analysis of the recognition effects of three different techniques (Kling, Runway Gen 3, and Jimeng) to assess the difference in performance between different methods on these techniques. The experiment results show that Jimeng is relatively effective, while the Kling and Runway techniques show significant differences in performance between different methods. Specifically, Jimeng's performance is relatively stable and accurate using different methods. In contrast, the detection of Kling and Runway Gen 3 techniques is more difficult and sensitive to the choice of methods. These results suggest that the videos generated by Kling and Runway Gen 3 have a higher authenticity, and the circulation of these videos may have a greater impact on online social networking.
In conclusion, the experimental results show that the mainstream detection methods have great potential for Chameleon, and Chameleon can provide a basis for subsequent studies. Detailed accuracy for categories and generation techniques are included in Appendix F.
\section{Conclusion}
Addressing the limitations of existing AI-generated video datasets, we introduce Chameleon, a novel dataset specifically created using advanced AI generation models. We explore detection performance using existing deep learning methods and large vision models, and construct tracking models based on backbone networks for source retrieval. Chameleon overcomes the single domain and static limitations and provides a benchmark for detecting AI-generated videos in realistic scenarios. In the future, we would focus on the long-video and multi-modal detection with advancing generation techniques.
\section*{Supplementary Materials}
\section{Construction Algorithm of the Chameleon}
As stated in the main paper, the construction of Chameleon consists of selecting the original video from the public video platforms, the segmentation of the video, filtering and constructing the metadata (captions and the first and last frames of the video) to generate the video, and finally generating the video using the existing AI generation technology. Specific process, such as algorithm \ref{alg:chameleon}.
\begin{algorithm}
\caption{Chameleon Dataset Construction}
\label{alg:chameleon}
\begin{algorithmic}[1]
\State \textbf{Input:} Real-world videos $R_{raw} = \{R_1, R_2, \ldots, R_{120}\}$, each labeled as News, Speech, or Recommendation
\State \textbf{Output:} Chameleon dataset $\mathcal{D}$ with 600 real-world videos and 600 AI-generated videos
\State \textbf{Step 1: Video Segmentation}
\For{each $R_i \in R_{raw}$}
\State Split $R_i$ into multiple 5-second segments
\State Manually select 5 high-quality segments
\State Store the selected segments as $V^{R}$
\EndFor
\State \textbf{Step 2: Metadata Extraction}
\State \textbf{Initialize} $V^R_{meta} = \{\}$ \Comment{Store metadata of all segments}
\For{each segment $V_j^R \in V^R$}
\State Generate captions $G_j = \text{GenerateCaption}(V_j^R)$
\State Extract first and last frames $(F_j^{(first)}, F_j^{(last)})$
\State $M_j \leftarrow (G_j, F_j^{(first)}, F_j^{(last)})$
\State $V^R_{meta} \leftarrow V^R_{meta} \cup \{M_j\}$
\EndFor
\State \textbf{Step 3: AI-Generated Video Creation}
\State Randomly select half of $V^R_{meta}$ for AI generation, denote this subset as $\hat{V}^R_{meta}$
\For{each metadata $M_j \in \hat{V}^R_{meta}$}
\State Generate multiple AI videos $V^F_{j} = \{V^F_{j,1}, V^F_{j,2}, \ldots\}$ using an AI-generation model
\State Manually screen $V^F_{j}$, remove distorted samples
\State Retain the two most realistic AI videos $V^F_{j} = \{V^F_{j1}, V^F_{j2}\}$
\EndFor
\State \textbf{Step 4: Final Dataset Construction}
\State Let $S_{real}$ be the set of original 600 segments \Comment{since 120 base videos $\times$ 5 segments each = 600}
\State Let $S_{AI}$ be the final AI-generated videos retained \Comment{also 600 in total}
\State $\mathcal{D} \leftarrow S_{real} \cup S_{AI}$
\State \textbf{Return} $\mathcal{D}$
\end{algorithmic}
\end{algorithm}
Specifically, we selected 40 real-world videos in each of the three categories `` News, Speech, and Recommendation" for a total of 120 videos as the base material. In order to increase the diversity and practicability of the data set, each video is divided into several 5-second segments, from which 5 segments are selected manually, and finally, 200 segments of News, Speech, and Recommendation are obtained, totaling 600 high-quality segments. To further enrich the data set, we generate corresponding captions for each of the 600 videos and extract the first and last frames as metadata. To ensure the diversity of the training data, we took half of each type of metadata to generate AI-generated videos and left the other half unprocessed. With this approach, a set of metadata can generate multiple AI-generated videos, which are then manually screened to remove those that are highly distorted or distorted, leaving only the two most realistic AI-generated videos as the final AI-generated samples. Finally, 600 real-world videos and 600 retained AI-generated videos are used as final samples.
\begin{figure*}[h] % Use [h] to place it right after the title
\centering
\vspace{-10pt} % Adjust vertical spacing if needed
\includegraphics[width=1\linewidth]{picture/pic_news.png} % Ensure "pict_1.png" is in the working directory
\caption{Examples of real-world video and AI-generated video in the News category in Chameleon. The video is presented in ten orderly spaced frames, placed in chronological order from left to right and top to bottom. The text content is the caption corresponding to the video. First and second lines: real-world video. The third and fourth lines: AI-generated video.
}
\label{fig:pict_news}
\end{figure*}
\section{Demonstration of Chameleon}
As shown in the Figures \ref{fig:pict_news}, \ref{fig:pict_speech}, \ref{fig:pict_rec}, we randomly selected six videos in Chameleon to display in the form of frames, and each category contains one real-world video and one AI-generated video. The text in the Figures represents the manually annotated captions corresponding to the videos. In the News (Figure \ref{fig:pict_news}) category of videos, human interactions can be easily observed, switching from single to multi-person scenes; in the Speech (Figure \ref{fig:pict_speech}) category of videos, there are more obvious changes in the distance and proximity of the camera, and the display of the characters goes from local to global or global to local; and in the Recommendation (Figure \ref{fig:pict_rec}) category of videos, there is a rich variety of interactions between people and objects. These samples fully reflect the scene diversity and domain diversity unique to Chameleon.
\begin{figure*}[h] % Use [h] to place it right after the title
\centering
\vspace{-10pt} % Adjust vertical spacing if needed
\includegraphics[width=1\linewidth]{picture/pic_speech.png} % Ensure "pict_1.png" is in the working directory
\caption{Examples of real-world video and AI-generated video in the Speech category in Chameleon. The video is presented in ten orderly spaced frames, placed in chronological order from left to right and top to bottom. The text content is the caption corresponding to the video. First and second lines: real-world video. The third and fourth lines: AI-generated video.
}
\label{fig:pict_speech}
\end{figure*}
\begin{figure*}[h] % Use [h] to place it right after the title
\centering
\vspace{-10pt} % Adjust vertical spacing if needed
\includegraphics[width=1\linewidth]{picture/pic_rec.png} % Ensure "pict_1.png" is in the working directory
\caption{Examples of real-world video and AI-generated video in the Recommendation category in Chameleon. The video is presented in ten orderly spaced frames, placed in chronological order from left to right and top to bottom. The text content is the caption corresponding to the video. First and second lines: real-world video. The third and fourth lines: AI-generated video.
}
\label{fig:pict_rec}
\end{figure*}
\section{Comparison of samples generated by different AI generation techniques}
Due to the limitations of the generation technology, some filtered AI-generated videos still have some shortcomings. We present some frames from the videos generated by different generation techniques (Kling, Runway Gen 3, Jimeng) in the Figure \ref{fig:comparison}. As shown in the Figure, three types of AI generation technologies are not good at restoring the details of human hands. At the same time, there will be the defect of facial distortion in the generation of far lens pictures.
\section{Comparison Methods}
The baseline approach based on deep learning is as follows:
\textbf{NPR} \cite{DBLP:conf/cvpr/TanLZWGLW24}: "Neighboring Pixel Relationships (NPR)" rethinks the impact of upsampling operations in common CNN-based networks. Specifically, the NPR method focuses on the dependencies between local pixels that upsampling operations introduce when generating images.
\textbf{FreqNet} \cite{tan2024frequency}: By learning in the frequency domain, the FreqNet is forced to continuously pay attention to high frequency information, using the high-frequency representation of features in the spatial and channel dimensions. In addition, FreqNet introduces a simple frequency domain learning module to learn source-independent features.
\textbf{BNet} \cite{lanzino2024faster}: In the BNet, Fast Fourier Transform (FFT) and Local Binary Pattern (LBP) are combined as additional channel features to reveal forged traces in the frequency and texture domains.
The detailed information of four selected four advanced LLMs is as follows:
\textbf{GPT-4V} \cite{zhang2024gpt} \footnote{https://openai.com/index/gpt-4v-system-card/}: GPT-4V is the first multimodal model to deeply integrate vision capabilities into the GPT architecture. It supports combined text and image input, can analyze medical images, interpret engineering drawings, and guide students to complete math problems with handwritten formulas. The breakthrough lies in the realization of cross-modal understanding through visual-language joint training, but in practical application, only static image analysis is supported, which needs to be called through API.
\textbf{GPT-4o} \cite{islam2024gpt} \footnote{https://openai.com/index/hello-gpt-4o/}: The GPT-4o model processes text, speech, and image input in an end-to-end architecture, and can complete cross-modal conversion, such as real-time translation of foreign language conversations with body language. Its emotion-sensing module can recognize user emotions through intonation and generate emotion-rich voice responses, which makes it advantageous in barrier-free interactive devices and anthropomorphic customer service scenarios.
\textbf{Claude 3.5} \cite{kurokawa2024diagnostic} \footnote{https://claude.ai/}: Claude 3.5 supports the processing of texts up to 200,000 tokens, and can analyze entire literary works at once. In the field of code generation, it has a 90.7\% accuracy rate in HumanEval tests, a self-correcting mechanism and multi-document cross-validation.
\textbf{Gemini-1.5-flash } \cite{team2023gemini} \footnote{https://gemini.google.com/app?hl=zh-cn}: Gemini is developed by Google DeepMind, there is a hybrid architecture (MoE+ Dense network) that balances speed with precision. The model is an ultra-long context that supports millions of tokens and can parse 3 hours of video content or tens of thousands of lines of code base while maintaining a processing speed of 4,000 tokens per second. In seven multi-modal benchmark tests, such as MMLU and VQA, its performance exceeds that of similar lightweight models, and its low-power characteristics enable it to be deployed on mobile terminals.
\section{ROC Curve of Different Categories and AI Generation Techniques}
In Figure \ref{fig:ROC}, we provide ROC curves for the three categories of News, Speech and Recommendation (Figure \ref{fig:a}, \ref{fig:c}, \ref{fig:e}) and the three generation technologies of Kling, Runway Gen 3 and Jimeng (Figure \ref{fig:b}, \ref{fig:d}, \ref{fig:f}).
Among the detection of AI-generated videos across different categories, the detection effect of News videos is significantly better than that of other categories, mainly due to its highly structured features, such as fixed scenes, relatively stable camera switching patterns, etc., which provide a clear basis for the model to differentiate, resulting in a higher AUC value and a lower false positive rate. In contrast, Speech video is difficult for the model to capture key features stably due to background interference (e.g., body language), resulting in a significant increase in the false positive rate and a weaker AUC performance.
Detectors performs better on the videos generated by Kling, possibly due to their relatively simple generation logic and regularity of feature distribution (e.g., fixed rendering style, low dynamic complexity), which makes the detection model easy to differentiate by texture, lighting, or motion features. Runway Gen 3, on the other hand, as a cutting-edge generative technology, generates videos with a high degree of realism, which may incorporate multimodal enhancements (e.g., dynamic lighting simulation, natural speech synthesis) and random noise injection, resulting in a narrowing of the feature differences between the generated content and the real video. This makes it difficult for the detection model to discriminate by traditional features, which is manifested by the ROC curve being closer to the upper left corner (lower AUC).
\begin{figure*}
\centering
% 第一行：三个类别
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/kling_good.png}
\caption{A good example from Kling.}
\label{fig:a}
\end{subfigure}
\hfill
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/runway_good.png}
\caption{A good example from Runway Gen 3.}
\label{fig:c}
\end{subfigure}
\hfill
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/jimeng_g.png}
\caption{A good example from Jimeng.}
\label{fig:e}
\end{subfigure}
\\ % 换行
% 第二行：三个技术
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/kling_bad.png}
\caption{A bad example from Kling.}
\label{fig:b}
\end{subfigure}
\hfill
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/runway_bad.png}
\caption{A bad example from Runway Gen 3.}
\label{fig:d}
\end{subfigure}
\hfill
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/jimeng_b.png}
\caption{A bad example from Jimeng.}
\label{fig:f}
\end{subfigure}
\caption{Comparison of partial frames extracted from videos generated by three techniques (Kling, Runway Gen 3, Jimeng).}
\label{fig:comparison}
\end{figure*}
\begin{figure*}
\centering
% 第一行：三个类别
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/new.png}
\caption{ROC curves of News.}
\label{fig:a}
\end{subfigure}
\hfill
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/speech.png}
\caption{ROC curves of Speech.}
\label{fig:c}
\end{subfigure}
\hfill
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/recommend.png}
\caption{ROC curves of Recommendation.}
\label{fig:e}
\end{subfigure}
\\ % 换行
% 第二行：三个技术
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/Kling.png}
\caption{ROC curves of Kling.}
\label{fig:b}
\end{subfigure}
\hfill
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/Runway_Gen_3.png}
\caption{ROC curves of Runway Gen 3.}
\label{fig:d}
\end{subfigure}
\hfill
\begin{subfigure}{0.32\linewidth}
\includegraphics[width=1\linewidth]{picture/jimeng.png}
\caption{ROC curves of Jimeng.}
\label{fig:f}
\end{subfigure}
\caption{ROC curves of different categories and AI generation techniques. The first row presents ROC curves for the three categories (News, Speech, Recommendation), and the second row shows ROC curves for the three AI technologies (Kling, Runway Gen 3, Jimeng).}
\label{fig:ROC}
\end{figure*}
\begin{figure*}[h] % Use [h] to place it right after the title
\centering
\vspace{-10pt} % Adjust vertical spacing if needed
\includegraphics[width=1\linewidth]{picture/multi_acc.png}
\caption{The prediction accuracies of various models for different categories of videos and using different AI generation techniques at different thresholds (from 0.6 to 1.0) are shown. Specifically, the top graphs show the prediction accuracies of the models for three categories of videos, News, Speech and Recommendation, under each threshold. In addition, the bottom charts present the prediction accuracies using three different AI generation techniques: Kling, Runway Gen 3, and Jimeng. Each subgraph corresponds to a specific threshold, from left to right, $\theta = 0.6$, $\theta = 0.7$, $\theta = 0.8$, $\theta = 0.9$, and $\theta = 1.0$. }
\label{fig:multi_acc}
\end{figure*}
\section{Detailed Accuracy under Different Threshold for Categories and AI Generation Techniques}
We further show in the Figure \ref{fig:multi_acc} the prediction accuracy of the models for different categories of videos and videos using different AI generation techniques (Kling, Runway Gen 3, and Jimeng) when the threshold is from 0.6 to 1.0. Under different thresholds, among the predictions for different categories, the prediction for the category of Recommendation is better, which indicates that the models perform better in recognizing the interaction of a large number of people and objects in Recommendation; among the predictions for the videos of different AI generation techniques, the video generated by Kling is predicted to be better, which indicates that the Kling-generated fake features are more easily recognized by the model compared to other techniques-generated videos.
\begin{thebibliography}{46}
\providecommand{\natexlab}[1]{#1}
\providecommand{\url}[1]{\texttt{#1}}
\expandafter\ifx\csname urlstyle\endcsname\relax
\providecommand{\doi}[1]{doi: #1}\else
\providecommand{\doi}{doi: \begingroup \urlstyle{rm}\Url}\fi
\bibitem[Bhuria and Gupta(2024)]{bhuria2024innovative}
Ruchika Bhuria and Sheifali Gupta.
\newblock Innovative ai solutions for pneumonia detection: Exploring densenet-161 in medical imaging.
\newblock In \emph{2024 5th International Conference on Data Intelligence and Cognitive Informatics (ICDICI)}, pages 638--643. IEEE, 2024.
\bibitem[Chaka(2023)]{chaka2023detecting}
Chaka Chaka.
\newblock Detecting ai content in responses generated by chatgpt, youchat, and chatsonic: The case of five ai content detection tools.
\newblock \emph{Journal of Applied Learning and Teaching}, 6\penalty0 (2):\penalty0 94--104, 2023.
\bibitem[Ciftci et~al.(2020)Ciftci, Demir, and Yin]{ciftci2020fakecatcher}
Umur~Aybars Ciftci, Ilke Demir, and Lijun Yin.
\newblock Fakecatcher: Detection of synthetic portrait videos using biological signals.
\newblock \emph{IEEE transactions on pattern analysis and machine intelligence}, 2020.
\bibitem[Cozzolino et~al.(2024)Cozzolino, Poggi, Corvi, Nie{\ss}ner, and Verdoliva]{DBLP:conf/cvpr/CozzolinoPCNV22}
Davide Cozzolino, Giovanni Poggi, Riccardo Corvi, Matthias Nie{\ss}ner, and Luisa Verdoliva.
\newblock Raising the bar of ai-generated image detection with {CLIP}.
\newblock In \emph{{IEEE/CVF} Conference on Computer Vision and Pattern Recognition, {CVPR} 2024 - Workshops, Seattle, WA, USA, June 17-18, 2024}, pages 4356--4366. {IEEE}, 2024.
\bibitem[Dolhansky et~al.(2019)Dolhansky, Howes, Pflaum, Baram, and Canton{-}Ferrer]{DBLP:journals/corr/abs-1910-08854}
Brian Dolhansky, Russ Howes, Ben Pflaum, Nicole Baram, and Cristian Canton{-}Ferrer.
\newblock The deepfake detection challenge {(DFDC)} preview dataset.
\newblock \emph{CoRR}, abs/1910.08854, 2019.
\bibitem[Du et~al.(2024)Du, Li, Niyato, Kang, Xiong, Shen, and Kim]{DBLP:journals/wc/DuLNKXSK24}
Hongyang Du, Zonghang Li, Dusit Niyato, Jiawen Kang, Zehui Xiong, Xuemin Shen, and Dong~In Kim.
\newblock Enabling ai-generated content services in wireless edge networks.
\newblock \emph{{IEEE} Wirel. Commun.}, 31\penalty0 (3):\penalty0 226--234, 2024.
\bibitem[Gu et~al.(2022)Gu, Chen, Yao, Ding, Li, and Ma]{DBLP:conf/aaai/GuCYDLM22}
Zhihao Gu, Yang Chen, Taiping Yao, Shouhong Ding, Jilin Li, and Lizhuang Ma.
\newblock Delving into the local: Dynamic inconsistency learning for deepfake video detection.
\newblock In \emph{Thirty-Sixth {AAAI} Conference on Artificial Intelligence, {AAAI} 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, {IAAI} 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, {EAAI} 2022 Virtual Event, February 22 - March 1, 2022}, pages 744--752. {AAAI} Press, 2022.
\bibitem[Guillaro et~al.(2023)Guillaro, Cozzolino, Sud, Dufour, and Verdoliva]{guillaro2023trufor}
Fabrizio Guillaro, Davide Cozzolino, Avneesh Sud, Nicholas Dufour, and Luisa Verdoliva.
\newblock Trufor: Leveraging all-round clues for trustworthy image forgery detection and localization.
\newblock In \emph{Proceedings of the IEEE/CVF conference on computer vision and pattern recognition}, pages 20606--20615, 2023.
\bibitem[Guo et~al.(2024{\natexlab{a}})Guo, Cheng, Jin, Zhang, Zhang, Tao, Shen, and Zhang]{DBLP:conf/nips/Guo0J000S024}
Hanxi Guo, Siyuan Cheng, Xiaolong Jin, Zhuo Zhang, Kaiyuan Zhang, Guanhong Tao, Guangyu Shen, and Xiangyu Zhang.
\newblock Biscope: Ai-generated text detection by checking memorization of preceding tokens.
\newblock In \emph{Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15, 2024}, 2024{\natexlab{a}}.
\bibitem[Guo et~al.(2024{\natexlab{b}})Guo, He, Zhang, Zhang, Feng, Huang, and Ma]{DBLP:conf/nips/GuoHZZFHM24}
Xun Guo, Yongxin He, Shan Zhang, Ting Zhang, Wanquan Feng, Haibin Huang, and Chongyang Ma.
\newblock Detective: Detecting ai-generated text via multi-level contrastive learning.
\newblock In \emph{Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15, 2024}, 2024{\natexlab{b}}.
\bibitem[Ha et~al.(2024)Ha, Passananti, Bhaskar, Shan, Southen, Zheng, and Zhao]{DBLP:conf/ccs/HaPBSSZZ24}
Anna Yoo~Jeong Ha, Josephine Passananti, Ronik Bhaskar, Shawn Shan, Reid Southen, Hai{-}Tao Zheng, and Ben~Y. Zhao.
\newblock Organic or diffused: Can we distinguish human art from ai-generated images?
\newblock In \emph{Proceedings of the 2024 on {ACM} {SIGSAC} Conference on Computer and Communications Security, {CCS} 2024, Salt Lake City, UT, USA, October 14-18, 2024}, pages 4822--4836. {ACM}, 2024.
\bibitem[Huang et~al.(2023)Huang, Zheng, Wang, Yin, Wang, Ding, Yin, Xu, Yang, Zheng, and Shi]{DBLP:journals/corr/abs-2304-03086}
Hanyao Huang, Ou Zheng, Dongdong Wang, Jiayi Yin, Zijin Wang, Shengxuan Ding, Heng Yin, Chuan Xu, Renjie Yang, Qian Zheng, and Bing Shi.
\newblock Chatgpt for shaping the future of dentistry: The potential of multi-modal large language model.
\newblock \emph{CoRR}, abs/2304.03086, 2023.
\bibitem[Islam and Moushi(2024)]{islam2024gpt}
Raisa Islam and Owana~Marzia Moushi.
\newblock Gpt-4o: The cutting-edge advancement in multimodal llm.
\newblock \emph{Authorea Preprints}, 2024.
\bibitem[Jia et~al.(2024)Jia, Lyu, Zhao, Chen, Yan, Ju, Hu, Li, Wu, and Lyu]{DBLP:journals/corr/abs-2403-14077}
Shan Jia, Reilin Lyu, Kangran Zhao, Yize Chen, Zhiyuan Yan, Yan Ju, Chuanbo Hu, Xin Li, Baoyuan Wu, and Siwei Lyu.
\newblock Can chatgpt detect deepfakes? a study of using multimodal large language models for media forensics.
\newblock \emph{CoRR}, abs/2403.14077, 2024.
\bibitem[Jiang et~al.(2023)Jiang, Zhang, and Gong]{10.1145/3576915.3623189}
Zhengyuan Jiang, Jinghuai Zhang, and Neil~Zhenqiang Gong.
\newblock Evading watermark based detection of ai-generated content.
\newblock In \emph{Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security}, page 1168–1181, New York, NY, USA, 2023. Association for Computing Machinery.
\bibitem[Kamat et~al.(2023)Kamat, Agarwal, Darrell, and Rohrbach]{kamat2023revisiting}
Sarthak Kamat, Shruti Agarwal, Trevor Darrell, and Anna Rohrbach.
\newblock Revisiting generalizability in deepfake detection: Improving metrics and stabilizing transfer.
\newblock In \emph{Proceedings of the IEEE/CVF International Conference on Computer Vision}, pages 426--435, 2023.
\bibitem[Khattak et~al.(2023)Khattak, Rasheed, Maaz, Khan, and Khan]{Khattak_2023_CVPR}
Muhammad~Uzair Khattak, Hanoona Rasheed, Muhammad Maaz, Salman Khan, and Fahad~Shahbaz Khan.
\newblock Maple: Multi-modal prompt learning.
\newblock In \emph{Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, pages 19113--19122, 2023.
\bibitem[Khattak et~al.(2024)Khattak, Naeem, Naseer, Gool, and Tombari]{DBLP:journals/corr/abs-2401-02418}
Muhammad~Uzair Khattak, Muhammad~Ferjad Naeem, Muzammal Naseer, Luc~Van Gool, and Federico Tombari.
\newblock Learning to prompt with text only supervision for vision-language models.
\newblock \emph{CoRR}, abs/2401.02418, 2024.
\bibitem[Kim et~al.(2021)Kim, Tariq, and Woo]{kim2021cored}
Minha Kim, Shahroz Tariq, and Simon~S Woo.
\newblock Cored: Generalizing fake media detection with continual representation using distillation.
\newblock In \emph{Proceedings of the 29th ACM International Conference on Multimedia}, pages 337--346, 2021.
\bibitem[Koonce(2021)]{koonce2021efficientnet}
Brett Koonce.
\newblock Efficientnet.
\newblock In \emph{Convolutional neural networks with swift for Tensorflow: image recognition and dataset categorization}, pages 109--123. Springer, 2021.
\bibitem[Koonce and Koonce(2021)]{koonce2021resnet}
Brett Koonce and Brett Koonce.
\newblock Resnet 50.
\newblock \emph{Convolutional neural networks with swift for tensorflow: image recognition and dataset categorization}, pages 63--72, 2021.
\bibitem[Kurokawa et~al.(2024)Kurokawa, Ohizumi, Kanzawa, Kurokawa, Sonoda, Nakamura, Kiguchi, Gonoi, and Abe]{kurokawa2024diagnostic}
Ryo Kurokawa, Yuji Ohizumi, Jun Kanzawa, Mariko Kurokawa, Yuki Sonoda, Yuta Nakamura, Takao Kiguchi, Wataru Gonoi, and Osamu Abe.
\newblock Diagnostic performances of claude 3 opus and claude 3.5 sonnet from patient history and key images in radiology’s “diagnosis please” cases.
\newblock \emph{Japanese Journal of Radiology}, pages 1--4, 2024.
\bibitem[Lanzino et~al.(2024)Lanzino, Fontana, Diko, Marini, and Cinque]{lanzino2024faster}
Romeo Lanzino, Federico Fontana, Anxhelo Diko, Marco~Raoul Marini, and Luigi Cinque.
\newblock Faster than lies: Real-time deepfake detection using binary neural networks.
\newblock In \emph{Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition}, pages 3771--3780, 2024.
\bibitem[Li et~al.(2023)Li, Huang, Paudel, Wang, Shahbazi, Hong, and Van~Gool]{Li_2023_WACV}
Chuqiao Li, Zhiwu Huang, Danda~Pani Paudel, Yabin Wang, Mohamad Shahbazi, Xiaopeng Hong, and Luc Van~Gool.
\newblock A continual deepfake detection benchmark: Dataset, methods, and essentials.
\newblock In \emph{Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)}, pages 1339--1349, 2023.
\bibitem[Li et~al.(2018)Li, Chang, and Lyu]{li2018ictu}
Yuezun Li, Ming-Ching Chang, and Siwei Lyu.
\newblock In ictu oculi: Exposing ai created fake videos by detecting eye blinking.
\newblock In \emph{2018 IEEE International workshop on information forensics and security (WIFS)}, pages 1--7. Ieee, 2018.
\bibitem[Li et~al.(2020)Li, Yang, Sun, Qi, and Lyu]{DBLP:conf/cvpr/LiYSQL20}
Yuezun Li, Xin Yang, Pu Sun, Honggang Qi, and Siwei Lyu.
\newblock Celeb-df: {A} large-scale challenging dataset for deepfake forensics.
\newblock In \emph{2020 {IEEE/CVF} Conference on Computer Vision and Pattern Recognition, {CVPR} 2020, Seattle, WA, USA, June 13-19, 2020}, pages 3204--3213. Computer Vision Foundation / {IEEE}, 2020.
\bibitem[Liang et~al.(2024)Liang, Xu, Hong, Shang, Wang, Fu, and Liu]{10.1145/3672758.3672824}
Zijing Liang, Yanjie Xu, Yifan Hong, Penghui Shang, Qi Wang, Qiang Fu, and Ke Liu.
\newblock A survey of multimodel large language models.
\newblock In \emph{Proceedings of the 3rd International Conference on Computer, Artificial Intelligence and Control Engineering}, page 405–409, New York, NY, USA, 2024. Association for Computing Machinery.
\bibitem[Liu et~al.(2024)Liu, Zhang, Li, Yan, Gao, Chen, Yuan, Huang, Sun, Gao, He, and Sun]{DBLP:journals/corr/abs-2402-17177}
Yixin Liu, Kai Zhang, Yuan Li, Zhiling Yan, Chujie Gao, Ruoxi Chen, Zhengqing Yuan, Yue Huang, Hanchi Sun, Jianfeng Gao, Lifang He, and Lichao Sun.
\newblock Sora: A review on background, technology, limitations, and opportunities of large vision models.
\newblock \emph{CoRR}, abs/2402.17177, 2024.
\bibitem[Liu et~al.(2021)Liu, Lin, Cao, Hu, Wei, Zhang, Lin, and Guo]{liu2021swin}
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo.
\newblock Swin transformer: Hierarchical vision transformer using shifted windows.
\newblock In \emph{Proceedings of the IEEE/CVF international conference on computer vision}, pages 10012--10022, 2021.
\bibitem[Mindner et~al.(2023)Mindner, Schlippe, and Schaaff]{DBLP:journals/corr/abs-2308-05341}
Lorenz Mindner, Tim Schlippe, and Kristina Schaaff.
\newblock Classification of human- and ai-generated texts: Investigating features for chatgpt.
\newblock \emph{CoRR}, abs/2308.05341, 2023.
\bibitem[Pal et~al.(2024)Pal, Kruk, Phute, Bhattaram, Yang, Chau, and Hoffman]{DBLP:conf/nips/PalKPBYCH24}
Anisha Pal, Julia Kruk, Mansi Phute, Manognya Bhattaram, Diyi Yang, Duen~Horng Chau, and Judy Hoffman.
\newblock Semi-truths: {A} large-scale dataset of ai-augmented images for evaluating robustness of ai-generated image detectors.
\newblock In \emph{Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15, 2024}, 2024.
\bibitem[R{\"{o}}ssler et~al.(2019)R{\"{o}}ssler, Cozzolino, Verdoliva, Riess, Thies, and Nie{\ss}ner]{DBLP:conf/iccv/RosslerCVRTN19}
Andreas R{\"{o}}ssler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, and Matthias Nie{\ss}ner.
\newblock Faceforensics++: Learning to detect manipulated facial images.
\newblock In \emph{2019 {IEEE/CVF} International Conference on Computer Vision, {ICCV} 2019, Seoul, Korea (South), October 27 - November 2, 2019}, pages 1--11. {IEEE}, 2019.
\bibitem[She et~al.(2024)She, Hu, Liu, Li, and Li]{she2024using}
Huimin She, Yongjian Hu, Beibei Liu, Jicheng Li, and Chang-Tsun Li.
\newblock Using graph neural networks to improve generalization capability of the models for deepfake detection.
\newblock \emph{IEEE Transactions on Information Forensics and Security}, 2024.
\bibitem[Tan et~al.(2024{\natexlab{a}})Tan, Liu, Zhao, Wei, Gu, Liu, and Wei]{DBLP:conf/cvpr/TanLZWGLW24}
Chuangchuang Tan, Huan Liu, Yao Zhao, Shikui Wei, Guanghua Gu, Ping Liu, and Yunchao Wei.
\newblock Rethinking the up-sampling operations in cnn-based generative network for generalizable deepfake detection.
\newblock In \emph{{IEEE/CVF} Conference on Computer Vision and Pattern Recognition, {CVPR} 2024, Seattle, WA, USA, June 16-22, 2024}, pages 28130--28139. {IEEE}, 2024{\natexlab{a}}.
\bibitem[Tan et~al.(2024{\natexlab{b}})Tan, Zhao, Wei, Gu, Liu, and Wei]{tan2024frequency}
Chuangchuang Tan, Yao Zhao, Shikui Wei, Guanghua Gu, Ping Liu, and Yunchao Wei.
\newblock Frequency-aware deepfake detection: Improving generalizability through frequency space domain learning.
\newblock In \emph{Proceedings of the AAAI Conference on Artificial Intelligence}, pages 5052--5060, 2024{\natexlab{b}}.
\bibitem[Team et~al.(2023)Team, Anil, Borgeaud, Alayrac, Yu, Soricut, Schalkwyk, Dai, Hauth, Millican, et~al.]{team2023gemini}
Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew~M Dai, Anja Hauth, Katie Millican, et~al.
\newblock Gemini: a family of highly capable multimodal models.
\newblock \emph{arXiv preprint arXiv:2312.11805}, 2023.
\bibitem[Theckedath and Sedamkar(2020)]{theckedath2020detecting}
Dhananjay Theckedath and RR Sedamkar.
\newblock Detecting affect states using vgg16, resnet50 and se-resnet50 networks.
\newblock \emph{SN Computer Science}, 1\penalty0 (2):\penalty0 79, 2020.
\bibitem[Touvron et~al.(2022)Touvron, Cord, and J{\'e}gou]{touvron2022deit}
Hugo Touvron, Matthieu Cord, and Herv{\'e} J{\'e}gou.
\newblock Deit iii: Revenge of the vit.
\newblock In \emph{European conference on computer vision}, pages 516--533. Springer, 2022.
\bibitem[Wang et~al.(2020)Wang, Wang, Zhang, Owens, and Efros]{Wang_2020_CVPR}
Sheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens, and Alexei~A. Efros.
\newblock Cnn-generated images are surprisingly easy to spot... for now.
\newblock In \emph{Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, 2020.
\bibitem[Xia et~al.(2023)Xia, Zhang, Yang, Xue, Zhou, and Yang]{9792208}
Weihao Xia, Yulun Zhang, Yujiu Yang, Jing-Hao Xue, Bolei Zhou, and Ming-Hsuan Yang.
\newblock Gan inversion: A survey.
\newblock \emph{IEEE Transactions on Pattern Analysis and Machine Intelligence}, 45\penalty0 (3):\penalty0 3121--3138, 2023.
\bibitem[Yan et~al.(2021)Yan, Zhang, Abbeel, and Srinivas]{DBLP:journals/corr/abs-2104-10157}
Wilson Yan, Yunzhi Zhang, Pieter Abbeel, and Aravind Srinivas.
\newblock Videogpt: Video generation using {VQ-VAE} and transformers.
\newblock \emph{CoRR}, abs/2104.10157, 2021.
\bibitem[Zhang et~al.(2023)Zhang, Zhu, and Su]{zhang2023toward}
Bo Zhang, Jun Zhu, and Hang Su.
\newblock Toward the third generation artificial intelligence.
\newblock \emph{Science China Information Sciences}, 66\penalty0 (2):\penalty0 121101, 2023.
\bibitem[Zhang et~al.(2022)Zhang, Guo, Zhang, Li, Miao, Cui, Qiao, Gao, and Li]{zhang2022pointclip}
Renrui Zhang, Ziyu Guo, Wei Zhang, Kunchang Li, Xupeng Miao, Bin Cui, Yu Qiao, Peng Gao, and Hongsheng Li.
\newblock Pointclip: Point cloud understanding by clip.
\newblock In \emph{Proceedings of the IEEE/CVF conference on computer vision and pattern recognition}, pages 8552--8562, 2022.
\bibitem[Zhang et~al.(2024)Zhang, Ma, and Vosoughi]{zhang2024gpt}
Zhehao Zhang, Weicheng Ma, and Soroush Vosoughi.
\newblock Is gpt-4v (ision) all you need for automating academic data visualization? exploring vision-language models’ capability in reproducing academic charts.
\newblock In \emph{Findings of the Association for Computational Linguistics: EMNLP 2024}, pages 8271--8288, 2024.
\bibitem[Zheng et~al.(2024)Zheng, Lin, Zhao, Wang, Guo, Liu, and Shen]{DBLP:conf/nips/ZhengL0WGL024}
Chende Zheng, Chenhao Lin, Zhengyu Zhao, Hang Wang, Xu Guo, Shuai Liu, and Chao Shen.
\newblock Breaking semantic artifacts for generalized ai-generated image detection.
\newblock In \emph{Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15, 2024}, 2024.
\bibitem[Zi et~al.(2020)Zi, Chang, Chen, Ma, and Jiang]{zi2020wilddeepfake}
Bojia Zi, Minghao Chang, Jingjing Chen, Xingjun Ma, and Yu-Gang Jiang.
\newblock Wilddeepfake: A challenging real-world dataset for deepfake detection.
\newblock In \emph{Proceedings of the 28th ACM international conference on multimedia}, pages 2382--2390, 2020.
\end{thebibliography}