Beyond Motion Cues and Structural Sparsity: Revisiting Small Moving Target Detection
Extracted source text · arXiv 2509.07654
\documentclass[lettersize,journal]{IEEEtran}
\usepackage{amsmath,amsfonts,amssymb}
\usepackage{algorithmic}
\usepackage{algorithm}
\usepackage{booktabs}
\usepackage{multicol}
\usepackage{multirow}
\usepackage{booktabs}
\usepackage{enumerate}
\usepackage{xcolor}
\usepackage{colortbl}
\usepackage{tabularray}
\usepackage{microtype}
\usepackage[utf8]{inputenc}
\usepackage[T1]{fontenc}
\UseTblrLibrary{booktabs}
\usepackage{tabularx}
\usepackage{hhline}
\usepackage{tikz}
\usepackage{paralist}
%\usepackage{marvosym}
\usepackage{bbding}
\usepackage{array}
\usepackage[caption=false,font=scriptsize,labelfont=sf,textfont=sf]{subfig}
\usepackage{textcomp}
\usepackage{stfloats}
\usepackage{soul}
\usepackage{url}
\usepackage{verbatim}
\usepackage{graphicx}
\usepackage{hhline}
\usepackage{cite}
\usepackage[colorlinks,
linkcolor=black,
anchorcolor=black,
citecolor=black]{hyperref}
\usepackage{orcidlink}
\hyphenation{op-tical net-works semi-conduc-tor IEEE-Xplore}
\usepackage{amsthm}
\newtheoremstyle{tpamiPhenomenon} % name
{\topsep} % Space above
{\topsep} % Space below
{} % Body font
{} % Indent amount (empty = no indent, \parindent = para indent)
{\bfseries} % Theorem head font
{.} % Punctuation after theorem head
{ } % Space after theorem head
{\thmname{#1}\ \thmnumber{#2}} % Theorem head spec
\theoremstyle{tpamiPhenomenon}
\newtheorem{phenomenon}{Phenomenon}
% updated with editorial comments 8/9/2021
\newcommand{\tabincell}[2]{\begin{tabular}{@{}#1@{}}#2\end{tabular}}
\def\ie{\emph{i.e.}}
\def\eg{\emph{e.g.}}
\def\etc{\emph{etc}}
\def\etal{{\em et al.~}}
\def\vs{{\em vs.}}
\newtheorem{theorem}{\bfseries Theorem}
\newtheorem{definition}{\bfseries Definition}
\newtheorem{prop}{\bfseries Proposition}
\newtheorem{lemma}{\noindent\bfseries Lemma}
\newcommand{\C}{\mathbb{C}}
\newcommand{\R}{\mathbb{R}}
\newcommand{\Q}{\mathbb{Q}}
\newcommand{\Z}{\mathbb{Z}}
\newcommand{\N}{\mathbb{N}}
\newcommand{\bx}{\mathbf{x}}
\newcommand{\bz}{\mathbf{z}}
\newcommand{\bE}{\mathbf{E}}
\newcommand{\bPsi}{\mathbf{\Psi}}
\newcommand{\Pb}{\mathbb{P}}
\newcommand{\Eb}{\mathbb{E}}
\newcommand{\Xb}{\mathbb{X}}
\newcommand{\Db}{\mathbb{D}}
\newcommand{\Hb}{\mathbb{H}}
\newcommand{\Wb}{\mathbb{W}}
\newcommand{\Lc}{\mathcal{L}}
\newcommand{\Fc}{\mathcal{F}}
\newcommand{\Dc}{\mathcal{D}}
\newcommand{\la}{\langle}
\newcommand{\ra}{\rangle}
\newcommand{\1}{\mathbbm{1}}
\newcommand{\sds}{\, \cdot \,}
\begin{document}
\title{Beyond Motion Cues and Structural Sparsity: Revisiting Small Moving Target Detection}
\author{Guoyi~Zhang~\orcidlink{0009-0004-2931-6698},~Siyang~Chen~\orcidlink{0009-0008-9465-6647},~Guangsheng~Xu~\orcidlink{0009-0006-4235-9398},~Zhihua~Shen,~Han~Wang~\orcidlink{0009-0008-2794-2520}~and~Xiaohu~Zhang~\orcidlink{0000-0003-4907-1451}
% <-this % stops a space
\thanks{Manuscript received xxx, xxx; revised xxx, xxx.}
\thanks{Corresponding authors: \emph{Han Wang and Xiaohu Zhang}}
\thanks{All authors are with AVP lab, the School of Aeronautics and Astronautics, Sun Yat-sen University, Shenzhen 518107, Guangdong, China.(email:\href{mailto:zhanggy57@mail2.sysu.edu.cn}{\textcolor{black}{zhanggy57}}@mail2.sysu.edu.cn;zhangxiaohu@mail.sysu.edu.cn)}
}
% The paper headers
\markboth{Journal of \LaTeX\ Class Files,~Vol.~14, No.~8, August~2021}%
{Guoyi Zhang \MakeLowercase{\textit{et al.}}: Beyond Motion Cues and Structural Sparsity: Revisiting Small Moving Target Detection}
%\IEEEpubid{0000--0000/00\$00.00~\copyright~2021 IEEE}
% Remember, if you use this you must call \IEEEpubidadjcol in the second
% column for its text to clear the IEEEpubid mark.
\maketitle
\begin{abstract}
Small moving target detection is crucial for many defense applications but remains highly challenging due to low signal-to-noise ratios, ambiguous visual cues, and cluttered backgrounds. In this work, we propose a novel deep learning framework that differs fundamentally from existing approaches, which often rely on target-specific features or motion cues and tend to lack robustness in complex environments.
Our key insight is that small target detection and background discrimination are inherently coupled, even cluttered video backgrounds often exhibit strong low-rank structures that can serve as stable priors for detection. We reformulate the task as a tensor-based low-rank and sparse decomposition problem and conduct a theoretical analysis of the background, target, and noise components to guide model design.
Building on these insights, we introduce TenRPCANet, a deep neural network that requires minimal assumptions about target characteristics. Specifically, we propose a tokenization strategy that implicitly enforces multi-order tensor low-rank priors through a self-attention mechanism. This mechanism captures both local and non-local self-similarity to model the low-rank background without relying on explicit iterative optimization. In addition, inspired by the sparse component update in tensor RPCA, we design a feature refinement module to enhance target saliency.
The proposed method achieves state-of-the-art performance on two highly distinct and challenging tasks: multi-frame infrared small target detection and space object detection. These results demonstrate both the effectiveness and the generalizability of our approach.
\end{abstract}
\begin{IEEEkeywords}
Infrared small target, space object, image segmentation, tensor decomposition, vision transformer.
\end{IEEEkeywords}
\section{Introduction} \label{Section:Introduction}
\IEEEPARstart{S}{mall} moving target detection \cite{10914515} is crucial for national defense tasks such as missile early warning \cite{gao2013infrared,liu2023infrared}, reconnaissance \cite{UIUNet,DNANet}, and space surveillance \cite{lin2021new}. However, detecting small targets is challenging due to low signal-to-noise ratios (SNR), severe foreground-background imbalance, diverse target appearances, and lack of distinctive features \cite{9217948,10298041,CSRNet,11080263}.
Recent deep learning methods leverage target sparsity and motion cues, achieving promising results \cite{11130659, MSHNet}. However, the weak and diverse visual/motion characteristics of small targets limit their robustness and generalization \cite{8106808, li2023direction}, leading to poor cross-task transferability \cite{chen2024convolutional}.
To address the aforementioned challenges, this paper proposes a novel deep learning paradigm for small moving target detection. We observe that target detection and background discrimination are inherently coupled. Due to structural redundancy in video sequences, backgrounds exhibit stable low-rank properties \cite{7488247,6820779,9749010,8017459}, while targets appear as spatiotemporally structured outliers \cite{8543221,6781644,6216381}. Based on this observation, the detection problem can be reformulated as a low-rank and sparse decomposition task (Fig.~\ref{fig:fig_trpcaill}):
\begin{equation}
\begin{aligned}
\min_{\boldsymbol{\mathcal{L}},\boldsymbol{\mathcal{S}},\boldsymbol{\mathcal{N}}}\ rank(\boldsymbol{\mathcal{L}})+&\lambda J_{\boldsymbol{\mathcal{S}}}(\boldsymbol{\mathcal{S}}) + \eta J_{\boldsymbol{\mathcal{N}}}(\boldsymbol{\mathcal{N}})\\ \mathrm{s.t.}\quad \boldsymbol{\mathcal{X}}=&\boldsymbol{\mathcal{L}}+\boldsymbol{\mathcal{S}} + \boldsymbol{\mathcal{N}}
\label{Eq:forma}
\end{aligned}
\end{equation}
where $\boldsymbol{\mathcal{X}}$ denotes the observed tensor, $\boldsymbol{\mathcal{L}}$ $\boldsymbol{\mathcal{S}}$ and $\boldsymbol{\mathcal{N}}$ correspond to the low-rank background, sparse target components and noise component, respectively. The parameters $\lambda > 0$ and $\eta > 0$ are scalar regularization weights that control the trade-off between the three objective terms. The function $rank(\cdot)$ imposes the low-rank constraint on the background component, while $J_{\boldsymbol{\mathcal{S}}}(\cdot)$ denotes the structured sparsity-inducing regularization applied to the target component. The third term, $J_{\boldsymbol{\mathcal{N}}}(\cdot)$, penalizes the noise component to ensure robustness against background clutter, sensor noise, or modeling errors.
\begin{figure}
\centering
\includegraphics[width=1.0\linewidth]{fig_trpcaill.pdf}
\caption{Illustration of the problem formulation. The target tensor contains motion trajectories sampled from real image sequences \cite{RDIAN}. It can be intuitively observed that the motion cues are inherently non-robust. Different colors represent targets from different sequences.}
\label{fig:fig_trpcaill}
\end{figure}
Next, we conduct a theoretical analysis of the background, foreground, and noise components in Eq.~(\ref{Eq:forma}), while imposing minimal assumptions on the target to ensure broad generalizability \cite{ge2024gated,li2023direction}. Building upon this theoretical foundation, we design TenRPCANet, an architecture aligned with the theoretical model of background and target structures.
However, designing effective structural constraints is challenging and often task-specific \cite{10496551,11015692,7508483}. This difficulty is compounded by the non-uniqueness of tensor rank definitions \cite{9585029,10153488,8066348}. Choosing a specific tensor formulation inevitably introduces strong inductive biases \cite{feng2025learnable,10078018,10354352}, limiting model flexibility and cross-task adaptability \cite{10684569,8606166}
To mitigate these limitations, rather than relying on deep unfolding methods \cite{10601492,joukovsky2023interpretable}, we directly exploit the intrinsic low-rank structure by leveraging both local and non-local self-similarity properties inherent in video data \cite{11104998,9782722}.
Finally, to comprehensively validate the effectiveness of the proposed method, we conduct experiments on two challenging tasks: multi-frame infrared small target detection and space object detection (the formulation of the latter, a relatively uncommon task, is illustrated in Fig.~\ref{fig:RSO}). Specifically, the infrared small target detection task involves identifying dim targets under strong background clutter. In contrast, the space object detection task requires distinguishing space debris from tens of millions of stars in astronomical images \cite{wang2024robust}. Both tasks are highly challenging and differ significantly in terms of target appearance and motion characteristics \cite{chen2024convolutional}, making them well-suited for evaluating the generalizability of the proposed approach.
Extensive evaluations on multiple public datasets across both tasks confirm the effectiveness of our method, particularly under low signal-to-noise ratio conditions and strong background interference. Unlike existing high-performing methods that struggle to generalize across domains, our approach consistently delivers robust and transferable performance in both scenarios.
\begin{figure}[!t]
\centering
\includegraphics[width=1\linewidth]{RSO.pdf}
\caption{With the increasing frequency of space activities, the number of space object in Earth's low Earth orbit (LEO) has grown dramatically. These debris typically travel at an average collision velocity of nearly 10 kilometers per second. When impacting satellites, such high-speed collisions can cause irreversible damage or even lead to complete satellite failure, posing significant challenges to the safety and sustainability of space missions \cite{steindorfer2025space}. space object detection focuses on identifying and distinguishing non-stellar objects, such as space object, from stars in astronomical image sequences. This task is essential for space situational awareness and orbital safety.}
\label{fig:RSO}
\end{figure}
The main contributions of this work can be summarized as follows:
\begin{itemize}
\item We introduce a novel deep learning paradigm for small moving target detection, founded on the dual modeling principle that foreground localization and background suppression are inherently interdependent and mutually reinforcing.
\item We conduct a theoretical analysis of the background, foreground, and noise characteristics in small moving target detection, while making minimal assumptions about the properties of the foreground to ensure broad applicability.
\item Building upon the theoretical insights, we design TenRPCANet, a highly interpretable architecture that leverages spatiotemporal local and non-local self-similarity to represent the low-rank structure of video data.
\item Extensive experiments on multi-frame infrared small target detection and space object detection tasks validate the effectiveness of our method.
\end{itemize}
The remainder of this paper is organized as follows.
Section~\ref{Section:Related_Work} reviews related work.
Section~\ref{Section:Method} presents our theoretical analysis and introduces the method developed based on this theoretical foundation.
Experimental results and discussions are provided in Section~\ref{Section:Experiment}.
Finally, Section~\ref{Section:Conclusion} concludes the paper.
\section{Related Work} \label{Section:Related_Work}
\subsection{Multi-Frame Infrared Small Target Detection}
Single-frame infrared small target detection \cite{gao2013infrared,9217948,DNANet,UIUNet,CSRNet,liu2023infrared,11080263,11146868} often struggles in complex scenarios due to the semantic ambiguity of the targets and the lack of auxiliary information such as color and texture in the infrared modality. To address these challenges, multi-frame infrared small target detection has been proposed to exploit temporal information for enhanced detection performance.
Many existing methods adopt detector-based approaches \cite{11130659,10381806}; however, the center of the predicted bounding box often does not align with the actual center of the target, which poses challenges for accurately localizing small targets. Moreover, many downstream tasks, such as sequence unmixing \cite{11080063}, rely on the masks obtained from detection results.
Compared with model-driven approaches \cite{liuT2023infrared}, deep learning methods \cite{li2023direction,ying2025infrared,li2025probing} have achieved remarkable progress in segmentation-based multi-frame infrared small target detection. However, these methods often rely on motion cues and the structural sparsity of the targets, resulting in limited robustness and poor generalization to other tasks.
In contrast to these studies, our core insight is that target detection and background discrimination are two sides of the same coin. The low-rank nature of the background remains consistent across various complex scenarios, making it more robust to identify targets by distinguishing the background. Furthermore, since no assumptions are made about target properties, the proposed approach is more transferable to related tasks.
\subsection{Space Object Detection}
In recent years, space object detection utilizing spaceborne observation platforms has garnered increasing attention and become a prominent area of research \cite{11029687}. The dominant technical paradigm remains traditional model-driven approaches, which typically rely on the detect-before-track (DBT) framework \cite{lin2021new}. These methods first extract thousands of candidate targets from individual frames \cite{wang2025anomalous}, followed by multi-frame trajectory association to identify true targets \cite{9185021}. However, this pipeline is often complex \cite{cite-spmht,cite-stmht,cite-tmqht}, involving multiple stages with numerous hyperparameters \cite{schuckman2022using}. Moreover, it is generally difficult for such methods to simultaneously handle both streak-like and point-like targets under different operational modes \cite{zingarelli2014improving}, such as star tracking and target tracking. In recent years, some researchers have begun exploring deep learning-based approaches \cite{cite-sdebrisnet}. These methods heavily rely on structural sparsity priors and motion cues of the targets \cite{li2023direction}. However, the LSTM-based models they employ often struggle to effectively exploit temporal information \cite{chen2024convolutional}. Moreover, these methods typically require initialization during the detection process, which often leads to the exclusion of the initial frames.
Unlike the aforementioned methods, we take into account the similar kinematic properties shared among stars, as well as the resulting self-similarity induced by these kinematic patterns. This perspective allows us to reformulate the space object detection problem within a low-rank and sparse decomposition framework, while minimizing assumptions about the target characteristics. This is particularly important since artifacts in astronomical imagery often distort target features.
Furthermore, we employ a self-attention mechanism to capture the spatiotemporal self-similarity among stars, and explicitly model the consistency of topological relationships across frames to enhance star discrimination.
\subsection{Convolutional Stem in Vision Transformer}
Extensive research has demonstrated that introducing early convolutional layers can substantially improve the inductive bias of Vision Transformers, enabling them to better capture local structures in visual data \cite{NEURIPS2021_ff1418e8}. This insight has led to the emergence of a variety of Conv-Stem architectures, such as HR-Stem \cite{10475592} and MSPE \cite{10962317}, which aim to enhance early-stage feature extraction. Beyond architectural innovations, several Conv-Stem variants have also been integrated into downstream tasks \cite{10124835,11091531}, consistently yielding notable performance gains.
However, most of these designs remain largely heuristic in nature \cite{khan2023survey}. In particular, they tend to emphasize either spatial-channel features or spatial-channel-temporal representations, often without a unified modeling framework. To compensate for limited theoretical grounding, these methods typically rely on the insertion of nonlinear activation functions within the stem to increase representational capacity \cite{Wang_Wang_Luo_Zhou_Zhou_Wang_Li_Jin_2022}.
Unlike prior methods, we propose Locally Subspace Embedding (LSE), which integrates low-rank priors from third- and fourth-order tensors \cite{9115254,9780890,8618436,10742301,9730793} to jointly model spatial-channel and temporal features. To avoid overfitting and enhance generalization, LSE omits activation functions, preserving the inductive bias of low-rank structures.
\section{Methodology} \label{Section:Method}
We begin this section with a theoretical analysis of the intrinsic characteristics of the background, foreground, and noise. Guided by the resulting priors, we develop TenRPCANet, a model tailored to leverage these structural properties.
\subsection{Analysis of the Intrinsic Properties of the Background}
To analyze the intrinsic priors of the background in the small moving target detection task and to motivate the appropriateness of both third-order \cite{9115254,9780890} and fourth-order \cite{8618436,10742301,9730793} low-rank tensor modeling strategies, which we argue are complementary in nature, we begin by examining two key empirical observations.
\begin{phenomenon}
\textit{It is well-known that, video data inherently possesses structural information and multidimensional redundancies.}
\end{phenomenon}
\noindent Video data intrinsically contains rich multidimensional structural information and redundancy \cite{6820779}, which can be formally characterized as spatial local correlations and non-local self-similarities \cite{8000407}. Specifically, let a video sequence be represented as a tensor
\begin{equation}
\boldsymbol{\mathcal{V}} \in \mathbb{R}^{H \times W \times T},
\end{equation}
where \(H, W, T\) denote the spatial height, spatial width, and temporal length respectively. To effectively capture the underlying low-rank structure, a natural approach is to extract overlapping spatiotemporal patches of size \(h \times w \times t\), i.e.,
\begin{equation}
\boldsymbol{\mathcal{P}}_i = \boldsymbol{\mathcal{V}}[x_i : x_i+h-1,\, y_i : y_i+w-1,\, z_i : z_i+t-1] \in \mathbb{R}^{h \times w \times t}, \label{Eq:patch}
\end{equation}
where \((x_i, y_i, z_i)\) indicates the spatial-temporal coordinates of the patch, and \(i = 1, \ldots, P\) indexes the extracted patches. Due to the inherent non-local self-similarity in video data, patches \(\{\boldsymbol{\mathcal{P}}_i\}\) that exhibit similar structural patterns across different spatial locations can be grouped and stacked along an additional mode to form a fourth-order tensor \cite{8618436,10742301,9730793}:
\begin{equation}
\boldsymbol{\mathcal{X}} \in \mathbb{R}^{h \times w \times t \times P}.
\end{equation}
Here, the first three modes \((h, w, t)\) represent the local spatiotemporal content of each patch, encoding strong local correlations, while the fourth mode aggregates non-local self-similar patches across the video volume, capturing long-range redundancies. This tensorial construction thus inherently leverages both local smoothness and non-local repetitive structures.
Importantly, the background in small moving target detection typically exhibits high spatiotemporal redundancy and regularity, which manifests as pronounced low-rankness in the tensor \(\boldsymbol{\mathcal{X}}\). Formally, the low-rank property can be expressed as
\begin{equation}
\mathrm{rank}(\boldsymbol{\mathcal{X}}) \ll \min(h w t, P),\quad\text{\eg, Tucker rank \cite{10354352}}
\end{equation}
providing a principled basis for discriminating background from sparse, anomalous moving targets. Consequently, modeling video data with such a fourth-order tensor effectively integrates the spatial, temporal, and patch similarity dimensions, forming a robust framework for background modeling in complex dynamic scenes.
\begin{phenomenon}
\textit{False alarm sources typically exhibit relatively stable contextual patterns over time, whereas the context surrounding true targets tends to be unstable due to the targets’ inherent motion.}
\end{phenomenon}
\noindent As shown in Fig. \ref{fig:Star}, despite differences in imaging modalities, both infrared small target detection and space object detection share a common prior. In the infrared domain, false alarms often arise from heterogeneous background structures or man-made objects with persistent appearance across frames. In space-based scenarios, false alarms are mainly caused by static background stars, whose apparent motion stems from platform drift but whose relative configuration remains unchanged~\cite{lin2023registration}. In contrast, true targets such as space object follow independent trajectories, resulting in transient and contextually inconsistent appearances.
\begin{figure}
\centering
\includegraphics[width=1.0\linewidth]{Star.pdf}
\caption{An important phenomenon is that false alarm sources may exhibit motion, yet they maintain relatively stable context. (a) In the space object detection task, the stellar objects have relatively stable topological relationships. We randomly sampled the topological relationships between some stars, and it is visually apparent that, despite significant displacements between frames, the triangular configurations remain stable. (b) In the multi-frame infrared small target detection task, false alarm sources also exhibit relatively stable context.}
\label{fig:Star}
\end{figure}
While the fourth-order tensor construction \(\boldsymbol{\mathcal{X}} \in \mathbb{R}^{h \times w \times t \times P}\) captures both local spatiotemporal correlations and non-local self-similarities, it is insensitive to small-scale motion. Although this representation excels at reconstructing the background and suppressing noise, it cannot effectively detect candidate targets or determine them based on contextual information. Therefore, it is necessary to adopt a more conservative strategy that decouples spatial and temporal modeling. Specifically, we extract overlapping \(h \times w\) spatial patches from each frame independently and stack them into a third-order tensor \cite{9115254,9780890}:
\begin{equation}
\boldsymbol{\mathcal{X}} = \mathrm{Stack} \left( \left\{ \boldsymbol{P}^{(t)}_i \right\} \right) \in \mathbb{R}^{h \times w \times N},
\end{equation}
where \(N\) is the total number of patches across all frames. This representation aggregates spatial appearance patterns while discarding strict temporal alignment, thereby enhancing robustness against minor background fluctuations and structured noise.
\subsection{Analysis of the Intrinsic Properties of Small Moving Targets} \label{Section:Target}
The concept of structured sparsity $J_{\boldsymbol{\mathcal{S}}}(\boldsymbol{\mathcal{S}})$ implies that small targets, while sparse in their spatial distribution, tend to exhibit consistent visual structures, such as compact support and smooth intensity profiles. These characteristics are fundamentally influenced by the underlying physical image formation process. In particular, the imaging properties of small targets are significantly shaped by the optical system’s point spread function (PSF), especially in long-range observation scenarios.
In ideal diffraction-limited systems, the PSF follows the Airy pattern derived from Fraunhofer diffraction theory~\cite{zhang2024dtnet}:
\begin{equation}
\mathrm{PSF}(r) = \left[ \frac{2 J_1(\pi D r / \lambda f)}{\pi D r / \lambda f} \right]^2,
\end{equation}
where \(J_1(\cdot)\) is the first-order Bessel function, \(D\) is the aperture diameter, \(\lambda\) the wavelength, and \(f\) the focal length. This leads to a spatially compact, smooth intensity profile centered on the target \cite{zhang2024dtnet}.
Moreover, long-exposure imaging and relative motion introduce motion blur, yielding a combined degradation model \cite{lin2021new}:
\begin{equation}
I(x, y) = \left[O(x, y) \otimes \mathrm{PSF}(x, y)\right] \otimes \mathcal{M}(x, y),
\end{equation}
where \(\mathcal{M}(x, y)\) denotes the motion blur kernel. Despite variability in target dynamics and sensor conditions, the resulting observations consistently exhibit two key properties: \textit{local intensity smoothness}, imposed by diffraction and motion blur, and \textit{spatial compactness}, due to the small physical size of the targets.
These physically grounded priors motivate detection strategies that emphasize spatial structure and appearance consistency, rather than relying on potentially unreliable temporal dynamics in high-velocity scenarios~\cite{9098052}.
\subsection{Analysis of Noise Characteristics} \label{Section:Noise}
In practical applications, noise often exhibits structured patterns that neural networks can exploit due to their strong representational capacity \cite{10507231,11029687}. In contrast, we focus on general, unstructured noise without semantic consistency or learnable patterns. Let \(\boldsymbol{\mathcal{V}}\), \(\boldsymbol{\mathcal{Y}}\), and \(\boldsymbol{\mathcal{N}}\) denote the observed video tensor, clean video, and additive noise respectively, modeled as
\begin{equation}
\boldsymbol{\mathcal{V}} = \boldsymbol{\mathcal{Y}} + \boldsymbol{\mathcal{N}},
\end{equation}
where \(\boldsymbol{\mathcal{N}}\) follows an unknown, potentially complex distribution.
Although our unified model in Eq.~\eqref{Eq:forma} imposes an explicit regularization term $J_{\boldsymbol{\mathcal{N}}}(\boldsymbol{\mathcal{N}})$ to suppress noise, in practice the noise distribution is often unknown and complex. To address this, we adopt a Bayesian framework~\cite{10433564} and formulate the recovery of the clean video \(\boldsymbol{\mathcal{Y}}\) as a MAP estimation problem~\cite{5339210}:
\begin{equation}
\boldsymbol{\mathcal{Y}}^\ast = \arg\max_{\boldsymbol{\mathcal{Y}}} \, p(\boldsymbol{\mathcal{Y}} \mid \boldsymbol{\mathcal{V}}) = \arg\max_{\boldsymbol{\mathcal{Y}}} \, p(\boldsymbol{\mathcal{V}} \mid \boldsymbol{\mathcal{Y}}) \cdot p(\boldsymbol{\mathcal{Y}}),
\end{equation}
where \(p(\boldsymbol{\mathcal{V}} \mid \boldsymbol{\mathcal{Y}})\) denotes the likelihood term, and \(p(\boldsymbol{\mathcal{Y}})\) encodes prior assumptions about the clean video, $p(\boldsymbol{\mathcal{Y}} \mid \boldsymbol{\mathcal{V}}) \propto p(\boldsymbol{\mathcal{V}} \mid \boldsymbol{\mathcal{Y}}) \cdot p(\boldsymbol{\mathcal{Y}}).$
To facilitate optimization, we take the negative logarithm of the posterior and obtain:
\begin{equation}
\boldsymbol{\mathcal{Y}}^\ast = \arg\min_{\boldsymbol{\mathcal{Y}}} \, -\log p(\boldsymbol{\mathcal{V}} \mid \boldsymbol{\mathcal{Y}}) - \log p(\boldsymbol{\mathcal{Y}}).
\end{equation}
Given the unknown noise, the prior \(p(\boldsymbol{\mathcal{Y}})\) plays a key role \cite{5339210}. In the analysis of background characteristics, we incorporate a tensor low-rank prior \cite{7327182,4011956}. Leveraging neural networks, we introduce an implicit deep prior \cite{ulyanov2018deep,dmitry2020deep} via \(\boldsymbol{\mathcal{Y}} = f_\theta(\boldsymbol{z})\), where \(f_\theta\) is a neural network parameterized by \(\theta\) with fixed input \(\boldsymbol{z}\). This Deep Image Prior \cite{ulyanov2018deep,dmitry2020deep} biases the reconstruction toward structured content over noise.
Unlike standard denoising \cite{8590763}, our goal is small target detection, not full recovery, which simplifies the problem and allows more flexible modeling.
\subsection{Overview of the Proposed TenRPCANet}
\begin{figure*}[!t]
\centering
\includegraphics[width=1\linewidth]{model_arch.pdf}
\caption{The overall architecture of the proposed TenRPCANet is designed based on our theoretical framework and consists of three core components. First, the Locally Subspace Embedding (LSE) introduces a novel tokenization strategy that implicitly regularizes subsequent self-attention mechanisms. Second, the Encoder and Decoder, constructed from Video Swin Transformer blocks \cite{liu2022video}, utilize spatiotemporal self-attention to effectively capture the low-rank structure of the background. Third, the Progressive Feature Refinement (PFR) Module, inspired by sparse tensor updates in Tensor RPCA, progressively refines the target features with minimal prior constraints.}
\label{fig:OverallofAMRI-Net}
\end{figure*}
Motivated by the preceding analysis of background structure, target characteristics, and noise behavior, we propose TenRPCANet, a unified detection framework. Its overall architecture is illustrated in Fig.~\ref{fig:OverallofAMRI-Net}. The input feature map has a shape of $B \times T \times C \times H \times W$, where $B$, $T$, $C$, $H$, and $W$ denote the batch size, temporal length, number of channels, height, and width, respectively. All frames within the temporal window are processed in parallel, and segmentation results for all $T$ frames are generated in a single forward pass.
Both encoder and decoder are designed to exploit low-rank structures (Fig.~\ref{fig:OverallofAMRI-Net}), leveraging non-local self-similarity inherent in such representations. This enables effective modeling of low-rank priors without iterative optimization. To this end, Video Swin Transformer (VST) blocks \cite{liu2022video} are embedded in both encoder and decoder.
\subsection{Locally Subspace Embedding Module}
To enforce low-rank priors on background structures modeled by third- and fourth-order tensors \cite{9115254,9780890,8618436,10742301,9730793}, we treat the tokenization strategy \(\mathcal{E}\) as an \textit{implicit regularizer} that shapes the geometry of self-attention. Specifically, \(\mathcal{E}\) defines an embedding manifold \(\mathcal{M} = \{\mathbf{z}_i = \mathcal{E}_i(\mathbf{X})\} \subset \mathbb{R}^d\), which governs the self-attention operator \cite{dosovitskiy2020vit}:
\begin{equation}
\mathrm{SA}_i = \sum \alpha_{ij} \mathbf{v}_j\ \text{where}\ \alpha_{ij} = \frac{\exp(\mathbf{q}_i^\top \mathbf{k}_j)}{\sum_l \exp(\mathbf{q}_i^\top \mathbf{k}_l)},
\end{equation}
where \(\mathbf{q}_i = \mathbf{W}_q \mathbf{z}_i\), \(\mathbf{k}_j = \mathbf{W}_k \mathbf{z}_j\).
Assuming \(\mathcal{M}\) is a smooth manifold, the local inner products approximate geodesic distances \cite{meilua2024manifold}:
\begin{equation}
\mathbf{q}_i^\top \mathbf{k}_j \approx -\frac{1}{2} d_{\mathcal{M}}^2(\mathbf{z}_i, \mathbf{z}_j), \label{Eq:geo}
\end{equation}
with \(d_{\mathcal{M}}\) the geodesic metric induced by \(\mathcal{E}\). Consequently, the attention weights correspond to a heat kernel on \(\mathcal{M}\) \cite{chen2023primal}:
\begin{equation}
\alpha_{ij} \approx \exp\left(-\frac{d_{\mathcal{M}}^2(\mathbf{z}_i, \mathbf{z}_j)}{2\sigma^2}\right),
\end{equation}
and the self-attention operator acts as a diffusion process \cite{lafferty2005diffusion}:
\begin{equation}
\mathcal{A}f(i) = \sum \alpha_{ij} f(j) \approx e^{-\sigma^2 \Delta_{\mathcal{M}}} f(i), \label{Eq:diff}
\end{equation}
where \(f(i)\) denotes the feature at point \(i\) on \(\mathcal{M}\), and \(\Delta_{\mathcal{M}}\) is the associated Laplace-Beltrami operator \cite{lafferty2005diffusion}.
This formulation introduces a geometric inductive bias through \(\mathcal{E}\), implicitly regularizing self-attention without modifying its parametric form.
\noindent\textbf{Detail of the proposed Locally Subspace Embedding module}. To incorporate third- and fourth- low-rank tensor priors, we propose the LSE module, consisting of two complementary branches: a 3D patch branch and a 2D patch construction branch. Such a dual-branch design not only captures different priors but also encourages a richer manifold embedding space for the self-attention mechanism. Specifically, the 3D patch branch approximates the fourth-order tensor patch construction described in Eq.~\eqref{Eq:patch}, thereby embedding local spatial-temporal structures into a compact representation, processes the input feature map $\mathbf{X} \in \mathbb{R}^{B \times C \times T \times H \times W}$ as follow:
\begin{equation}
\mathbf{Y} = \text{Conv3D}_{3\times4\times4}(\mathbf{X}, \textit{Stride}=(1, 4, 4)).
\end{equation}
This operation implicitly captures local spatial features without explicitly constructing overlapping patches, significantly reducing computational complexity.
In the 2D patch construction branch, we pursue two objectives: (i) introducing a third-order tensor low-rank prior to regularize the self-attention mechanism, and (ii) capturing contextual dependencies of false alarm sources. As shown in Eq.~\eqref{Eq:geo} and ~\eqref{Eq:diff}, improved local embeddings induce locally flatter geometry (i.e., reduced curvature), thereby stabilizing the geodesic metric and improving similarity estimation. To encourage such geometric properties, we incorporate traditional multilinear manifold dimensionality reduction methods \cite{6021368,4032832}, which leverage low-rank tensor priors to preserve local linearity and mitigate geometric distortion. Building upon this, we design a Locally Linear Embedding (LLE) module that explicitly preserves neighborhood structures in a geometry-aware fashion. For an input feature map $\mathbf{X}$:
\begin{equation}
\mathbf{Z} = \hat{\mathbf{X}} = \text{Conv2D}_{1\times1}(\text{Concatenate}(\mathbf{X}_3,\mathbf{X}_5,\mathbf{X}_7)),
\end{equation}
where $\mathbf{X}_k = \text{Conv2D}_{k\times k}(\mathbf{{X}})$, the output feature map is then downsampling \cite{chen2024convolutional}.
Finally, the outputs from the two branches are fused via element-wise addition, integrating spatial-temporal cues for downstream encoding and decoding.
\subsection{Progressive Feature Refinement Module}
Since the encoder and decoder effectively capture the low-rank structure of the background, they implicitly determine background regions. Given this, the proposed Progressive Feature Refinement module aims to refine target features under a known background context. Based on the target priors analyzed in Section \ref{Section:Target}, we impose only \textit{structural sparsity} and \textit{local intensity smoothness} constraints on the targets. In particular, as analyzed in Section \ref{Section:Noise}, the complex optimization processes \cite{7994673} associated with intricate noise models \cite{7516720,8741173} become unnecessary.
In fact, this process naturally aligns with the sparse component update step in Tensor RPCA \cite{7488247}:
\begin{equation}
\begin{aligned}
& \min_{\boldsymbol{\mathcal{L}},\boldsymbol{\mathcal{S}}}\ rank(\boldsymbol{\mathcal{L}})+\lambda\|\boldsymbol{\mathcal{S}}\|_1 \\
& \mathrm{s.t.}\quad\mathfrak{M}(\boldsymbol{\mathcal{X}}-\boldsymbol{\mathcal{L}})=\boldsymbol{\mathcal{S}},\quad\|\mathfrak{M}(\boldsymbol{\mathcal{X}}-\boldsymbol{\mathcal{L}})-\mathcal{S}\|^2_F\leq\eta
\label{Eq:diss}
\end{aligned}
\end{equation}
where $\mathfrak{M}(\cdot)$ denotes observation projection operator, and $\|\cdot\|_1$ denotes $\ell_1$-norm. Under the framework of ADMM algorithm, the augmented Lagrangian function of Eq. (\ref{Eq:diss}) can be given as follows:
\begin{equation}\begin{aligned}
&\Gamma(\boldsymbol{\mathcal{L}},\boldsymbol{\mathcal{S}},\boldsymbol{\Lambda},\mu) =rank(\boldsymbol{\mathcal{L}})+\lambda\|\boldsymbol{\mathcal{S}}\|_1\\
&+\frac{\mu}{2}\|\mathfrak{M}(\boldsymbol{\mathcal{X}}-\boldsymbol{\mathcal{L}})-\boldsymbol{\mathcal{S}}\|_F^2 +\langle\boldsymbol{\Lambda},\mathfrak{M}(\boldsymbol{\mathcal{X}}-\boldsymbol{\mathcal{L}})-\boldsymbol{\mathcal{S}}\rangle
\end{aligned}\end{equation}
where $\boldsymbol{\Lambda}$ represents the Lagrange multiplier. Since the background component $\boldsymbol{\mathcal{L}}_t$ has been effectively estimated by the encoder-decoder pathway, it can be treated as fixed in the subsequent optimization. Accordingly, the focus shifts to refining the sparse component $\boldsymbol{\mathcal{S}}$ given a fixed $\boldsymbol{\mathcal{L}}_t$:
\begin{equation}
\begin{aligned}
\boldsymbol{\mathcal{S}}^* &=\arg\min_{\boldsymbol{\mathcal{S}}}\lambda\|\boldsymbol{\mathcal{S}}\|_1 \\
& +\frac{\mu}{2}\|\mathfrak{M}(\boldsymbol{\mathcal{X}}-\boldsymbol{\mathcal{L}}_t)-\boldsymbol{\mathcal{S}}\|_F^2+\langle\boldsymbol{\Lambda},\mathfrak{M}(\boldsymbol{\mathcal{X}}-\boldsymbol{\mathcal{L}}_t)-\boldsymbol{\mathcal{S}}\rangle \\
& =\arg\min_T\frac{1}{2}\left\|\boldsymbol{\mathcal{S}}-\left(\mathfrak{M}(\boldsymbol{\mathcal{X}}-\boldsymbol{\mathcal{L}}_t)\right.+\frac{1}{\mu}\boldsymbol{\Lambda}_{t-1}\right\|^2_F\\
&+\frac{\lambda}{\mu}\|\boldsymbol{\mathcal{S}}\|_1
\end{aligned}
\end{equation}
$\boldsymbol{\mathcal{S}}^*$ can be obtained via the following closed-form expression, which is independent of the specific form of the $rank(\cdot)$ constraint:
\begin{equation}
\boldsymbol{\mathcal{S}}^*=\text{Soft}_{\frac{\lambda}{\mu}}\left(\mathfrak{M}(\boldsymbol{\mathcal{X}}-\boldsymbol{\mathcal{L}}_t)+\frac{1}{\mu}\boldsymbol{\Lambda}_{t-1}\right). \label{Eq:SVT}
\end{equation}
where $\text{Soft}_{\frac{\lambda}{\mu}}(\cdot)$ is the soft threshold operator. Considering that, under the Tensor RPCA setting, the discriminative target estimation becomes a nearly linearized operation once the background region is determined, and that such piecewise linearization demonstrates strong generalizability across different types of rank constraints. This motivates a lightweight linear design that approximates soft-thresholding behavior while preserving structural consistency with traditional Tensor RPCA frameworks.
Notably, after applying Tensor RPCA, the sparse components are typically reconstructed into full-resolution foreground maps via overlapping patch aggregation. This process implicitly encodes local spatial priors, enhancing target continuity and coherence. Although only $\ell_1$-norm regularization is used, the reconstruction induces structured sparsity by favoring spatially contiguous activations, thereby improving the integrity of small targets.
\begin{equation}
\boldsymbol{\mathcal{T}} = \mathrm{Aggregate}\left(\boldsymbol{P}^{(\boldsymbol{\mathcal{S}})}_i\right). \label{Eq:AGG}
\end{equation}
Here, $\boldsymbol{P}^{(\boldsymbol{\mathcal{S}})}_i$ denotes the $i$-th patch extracted from the sparse tensor $\boldsymbol{\mathcal{S}}$. Typically, the operator $\mathrm{Aggregate} (\cdot)$ denotes median pooling aggregation \cite{gao2013infrared}.
This allows for the enforcement of structural sparsity on the targets without imposing strong prior assumptions (\eg~Saliency \cite{6781644}, Continuity \cite{6216381}).
\noindent\textbf{Detail of the proposed Progressive Feature Refinement module}. Grounded in the theoretical framework of sparse component refinement in Tensor RPCA, we propose a lightweight Progressive Feature Refinement module aimed at effectively capturing the structural sparsity inherent to target regions. Given an input feature map
$\mathbf{Z} \in\mathbb{R}^{B \times T \times W\times H \times C}$, it is first reshaped into $\mathbf{X} \in\mathbb{R}^{BT \times C\times W\times H}$ to facilitate subsequent processing.
The proposed Progressive Feature Refinement module is constructed by stacking 2D linear residual blocks and upsampling layers.
The processing pipeline of the 2D linear residual block is as follows. Given two input feature maps $\mathbf{X} \in\mathbb{R}^{BT \times C\times W\times H}$ and $\mathbf{Y} \in\mathbb{R}^{BT \times C\times W\times H}$, with $\mathbf{X}$ coming from the previous layer and $\mathbf{Y}$ from the proposed Locally Subspace Embedding module via a skip connection. To remain consistent with the element-wise target localization process outlined in Eq. (\ref{Eq:SVT}), we employ a lightweight $1\times1$ convolutional layer to implement this functionality.
\begin{equation}
\mathbf{Z} = \text{Conv2D}_{1\times1}(\text{Concatenate}(\mathbf{X}, \mathbf{Y})),
\end{equation}
where $\mathbf{Z} \in\mathbb{R}^{BT \times C\times W\times H}$. Next, considering the \textit{local intensity smoothness} and \textit{spatial compactness} of small targets, we apply a simple $3\times3$ convolution to capture their local characteristics. Importantly, only linear operations are used in this step to remain consistent with the patch-based aggregation process in sparse component reconstruction (Eq.~\eqref{Eq:AGG}). It is worth noting that extensive empirical evidence from model-driven approaches suggests that incorporating locality-aware operators is effective in handling weak targets \cite{PR16MPCM}.
\begin{equation}
\hat{\mathbf{Z}} = \text{Conv2D}_{3\times3}(\mathbf{Z}) + \mathbf{Z}
\end{equation}
An upsampling module \cite{chen2024convolutional} is applied immediately after each 2D linear residual block. To approximate the nonlinear suppression behavior of soft-thresholding operator and promote sparsity in the output, we apply a Sigmoid activation followed by a confidence-based hard thresholding. The final output is computed as:
\begin{equation}
\mathbf{Out} = \sigma(\hat{\mathbf{Z}}) \cdot \mathbb{I}\left[\sigma(\hat{\mathbf{Z}}) \geq \tau \right],
\end{equation}
where \( \sigma(\cdot) \) denotes the Sigmoid function, \( \tau \in (0,1) \) is a confidence threshold, and \( \mathbb{I}[\cdot] \) is the indicator function that outputs 1 when the condition is true and 0 otherwise. This formulation softly maps activations to the confidence domain while enforcing sparsity through binary gating, effectively mimicking the nonlinear suppression behavior of soft-thresholding. The gating mechanism mimics soft-thresholding behavior and effectively suppresses weak activations, thereby reducing false positives in practical detection scenarios.
\subsection{Loss Function}
The small moving target detection task can be formulated as a binary classification problem. We employ the binary cross-entropy loss as the training objective, the overall loss for training is
\begin{equation}
\mathcal{L}=\sum_{k=1}^T\sum_{i=1}^H\sum_{i=1}^W\mathcal{L}_\mathrm{BCE}\left(\mathcal{T}\left(i,j,k\right),\mathcal{GT}\left(i,j,k\right)\right),
\end{equation}
where $\mathcal{T}\left(i,j,k\right)$ and $\mathcal{GT}\left(i,j,k\right)$ denote the predicted confidence map and the ground truth of the point $(i,j)$ at the $k$th frame, respectively.
\section{Experiment}\label{Section:Experiment}
\subsection{Experimental Setup}
\subsubsection{Datasets} In this paper, we validate the effectiveness and generalization ability of the proposed TenRPCANet on two highly challenging downstream tasks: multi-frame infrared small target detection and space object detection, which differ significantly in both target characteristics and motion patterns. For the multi-frame infrared small target detection task, we evaluate our method on two highly challenging benchmarks, NUDT-MIRSDT \cite{li2023direction} and NUDT-MIRSDT-HiNo \cite{li2025probing}, both of which feature complex cluttered backgrounds and low signal-to-noise ratios. For the space object detection task, we conduct experiments on the Synthesis Set and the Real Optical Set \cite{chen2024convolutional}, where the latter is collected by a spaceborne observation platform and reflects realistic imaging conditions in near-Earth orbit.
\subsubsection{Evaluation Metrics} We follow standard evaluation protocols for each task. For multi-frame infrared small target detection \cite{ying2025infrared}, we adopt pixel-level metrics including the Probability of Detection ($P_d$), False Alarm rate ($F_a$), and the Area Under the Curve (AUC). For the space object detection task \cite{chen2024convolutional}, we evaluate both object-level and pixel-level performance. Specifically, we report the Recall ($\text{R}^t$), False Alarms ($\text{FA}^t$), and $\text{F1}^t$-score at the object level, along with the Intersection over Union (IoU) at the pixel level.
\subsubsection{Implementation Details} The proposed method is trained on an NVIDIA A100 GPU using PyTorch 1.8.2 and CUDA 11.2. Adam optimizer with a learning rate schedule (ReduceLROnPlateau, 1e-4 to 1e-8) is used. Inputs for infrared and optical tasks are normalized by 255.0 and 65535.0, respectively, with resolutions of 320$\times$416 and 1024$\times$1024.
\subsection{Comparison with State-of-the-Arts}
\begin{table*}[t!]
\caption{Comparison of experiment results on the NUDT-MIRSDT dataset and the NUDT-MIRSDT-HiNo dataset. The best results are in \textbf{bold}, and the second-best results are \underline{underlined}. \textit{SF} and \textit{MF} refer to single-frame and multi-frame methods, respectively.}\label{tab:SOTA1}
\centering
%\scalebox{0.85}{
\renewcommand{\arraystretch}{1.1}
\begin{tabular}{c c l c c c c c c c c r c}
\noalign{\hrule height 1pt}
\multicolumn{3}{c}{\multirow{2}*{Methods}} & \multicolumn{2}{c}{$SNR\leq 3$} & \multicolumn{3}{c}{NUDT-MIRSDT} & \multicolumn{3}{c}{NUDT-MIRSDT-HiNo} & \multirow{2}*{Param (M)} &\multirow{2}*{FPS}\\
\cline{4-11}
\multicolumn{3}{c}{~} & $P_d$ & $F_a$ & $P_d$ & $F_a$ & AUC & $P_d$ & $F_a$ & AUC & & \\ \noalign{\hrule height 1pt}
\multirow{8}*{\rotatebox{90}{Traditional Methods}} & \multicolumn{1}{c}{\multirow{8}{*}{\rotatebox{90}{\textit{MF}}}} & MSLSTIPT \cite{sun2020infrared} \textit{(TGRS'20)} & 4.16 & 21.70 & 18.97 & 15.37 & 0.9404 & 3.93 & 73.76 & 0.9185 & - & 0.17 \\
& \multicolumn{1}{c}{} & IMNN-LWEC \cite{luo2022imnn} \textit{(TGRS'22)} & 0.00 & 7.22 & 26.43 & 10.74 & 0.6734 & 4.97 & 83.28 & 0.5394 & - & 0.31 \\
& \multicolumn{1}{c}{} & SRSTT \cite{li2023sparse} \textit{(TGRS'23)} & 69.94 & 6.12 & 90.63 & 3.35 & \textbf{0.9989} & 4.34 & 55.04 & 0.5358 & - & 0.06 \\ % 阈值140
& \multicolumn{1}{c}{} & 4DST-BTMD \cite{luo20234dst} \textit{(TGRS'23)} & 41.58 & 23.45 & 44.77 & 74.95 & 0.8488 & 4.80 & 77.29 & 0.6651 & - & 26.09 \\ % 阈值200
& \multicolumn{1}{c}{} & STRL-LBCM \cite{luo2023spatial} \textit{(TAES'23)} & 5.48 & 85.53 & 19.03 & 34.05 & 0.5972 & 2.55 & 77.78 & 0.5238 & - & 0.87 \\ % 阈值200 mu=3
& \multicolumn{1}{c}{} & 4D-TR \cite{wu2023infrared} \textit{(TGRS'23)} & 55.77 & 2.55 & 55.70 & 3.19 & 0.9946 & 4.63 & 120.16 & 0.6633 & - & 0.36 \\ % 阈值200
& \multicolumn{1}{c}{} & 4D-TT \cite{wu2023infrared} \textit{(TGRS'23)} & 24.95 & 1.67 & 30.89 & 3.21 & 0.8287 & 6.94 & 73.18 & 0.5347 & - & 0.82 \\ % 阈值200
& \multicolumn{1}{c}{} & NFTDGSTV \cite{liuT2023infrared} \textit{(TGRS'23)} & 1.51 & 32.31 & 13.77 & 35.32 & 0.8613 & 11.56 & 43.16 & \underline{0.9524} & - & 0.58 \\ \hline % 阈值80
\multirow{14}*{\rotatebox{90}{Deep-Learning Methods}} & \multicolumn{1}{c}{\multirow{10}{*}{\rotatebox{90}{\textit{SF}}}} & ACM \cite{Dai_2021_WACV} \textit{(WACV'21)} & 7.75 & 22.88 & 51.533 & 17.52 & 0.9298 & 0 & - & 0.8727 & 0.398 & 57.89 \\
& \multicolumn{1}{c}{} & ALCNet \cite{ALCNet} \textit{(TGRS'21)} & 3.97 & 37.10 & 52.57 & 25.50 & 0.8435 & 36.09 & 91.99 & 0.9326 & 0.864 & 55.14 \\
& \multicolumn{1}{c}{} & Res-UNet \cite{xiao2018weighted} \textit{(ITME'18)} & 15.83 & 30.32 & 63.27 & 40.83 & 0.9198 & 35.51 & 22.55 & 0.9391 & \underline{0.227} & 77.06 \\
& \multicolumn{1}{c}{} & DNA-Net \cite{DNANet} \textit{(TIP'22)} & 23.74 & 19.23 & 67.38 & 15.07 & 0.8843 & 49.16 & 60.98 & 0.9373 & 4.698 & 12.17 \\
& \multicolumn{1}{c}{} & ISNet \cite{ISNet} \textit{(CVPR'22)} & 17.96 & 8.53 & 65.99 & 19.25 & 0.9123 & 28.40 & 90.17 & 0.9224 & 1.09 & 25.14 \\
& \multicolumn{1}{c}{} & UIUNet \cite{UIUNet} \textit{(TIP'22)} & 15.12 & 17.46 & 61.25 & 14.42 & 0.9436 & 43.67 & 28.87 & 0.9246 & 50.52 & 22.75 \\
& \multicolumn{1}{c}{} & AGPCNet \cite{AGPCNet} \textit{(TAES'23)} & 31.76 & 176.38 & 55.47 & 85.56 & 0.9443 & 42.452 & 13655.20 & 0.7348 & 12.36 & 13.05 \\
& \multicolumn{1}{c}{} & MSHNet \cite{MSHNet} \textit{(CVPR'24)} & 2.46 & 78.07 & 36.78 & 41.91 & 0.7966 & 21.81 & 44.92 & 0.6748 & 4.06 & 17.83 \\
& \multicolumn{1}{c}{} & SCTransNet \cite{SCTransNet} \textit{(TGRS'24)} & 23.63 & 122.24 & 62.81 & 74.20 & 0.9320 & 20.65 & 35.37 & 0.8283 & 11.32 & 10.07 \\
& \multicolumn{1}{c}{} & MiM-ISTD \cite{10740056} \textit{(TGRS'24)} & 0.00 & 71.24 & 15.27 & 50.12 & 0.9152 & 1.91 & 664.24 & 0.6879 & 8.59 & 25.41 \\
& \multicolumn{1}{c}{} & RPCANet \cite{RPCANet} \textit{(WACV'24)} & 30.06 & 81.21 & 61.13 & 41.28 & 0.8694 & 21.81 & 198.14 & 0.8786 & 0.68 & 7.90 \\ \cline{2-13} % 172.728G
& \multicolumn{1}{c}{\multirow{5}{*}{\rotatebox{90}{\textit{MF}}}}
& Res-U+DTUM \cite{li2023direction} \textit{(TNNLS'23)} & 91.68 & 2.37 & 97.46 & 3.00 & 0.9967 & 43.90 & 4.86 & 0.9413 & 0.30 & 25.39 \\
& \multicolumn{1}{c}{} & STDMANet \cite{yan2023stdmanet} \textit{(TGRS'23)} & 92.82 & 2.88 & 96.59 & 3.40 & 0.9908 & 51.65 & \underline{1.95} & 0.8766 & 11.88 & 5.16 \\ %\cline{3-13}
& \multicolumn{1}{c}{} & Res-U+RFR \cite{ying2025infrared} \textit{(TGRS'25)} & 64.65 & 24.09 & 88.61 & 11.58 & 0.9502 & 35.11 & 464.92 & 0.8655 & 1.02 & 34.77 \\ %\cline{3-13}
& \multicolumn{1}{c}{} & DeepPro \cite{li2025probing} \textit{(ARXIV'25)} & \underline{95.84} & \textbf{0.52} & \underline{98.50} & \underline{0.72} & 0.9973 & \underline{59.17} & \textbf{1.76} & \underline{0.9638} & \textbf{0.049} & \underline{155.40} \\ \rowcolor{gray!20}
& \multicolumn{1}{c}{} & TenRPCANet (Ours) & \textbf{98.53} & \underline{1.3} & \textbf{99.33} & \textbf{0.36} & \underline{0.9978} & \textbf{86.62} & 6.37 & \textbf{0.9823} & 1.78 & \textbf{176.24} \\ \noalign{\hrule height 1pt}
\end{tabular}
%}
\end{table*}
\begin{figure}
\centering
\includegraphics[width=0.85\linewidth]{ROCShow.pdf}
\caption{ROC curve on the NUDT-MIRSDT dataset ($SNR \leq 3$).}
\label{fig:ROC}
\end{figure}
\begin{table*}[tbp]
\centering
\caption{Comparison of experiment results on synthetic data and real optical data. The best and second-best results for each metric are indicated in \textbf{bold} and \underline{underline}, respectively.}
\begin{tabular}{l|cccc|cccc|ccc}
\toprule
\multirow{2}{*}{Method} & \multicolumn{4}{c|}{Synthesis Set\dag} & \multicolumn{4}{c|}{Real Optical Set\ddag} & \multicolumn{3}{c}{Scale}\\
\multicolumn{1}{c|}{} & $\text{R}^t$($\uparrow$) & $\text{FA}^t$($\downarrow$) & $\text{F1}^t$($\uparrow$) & IoU($\uparrow$)
& $\text{R}^t$($\uparrow$) & $\text{FA}^t$($\downarrow$) & $\text{F1}^t$($\uparrow$) & IoU($\uparrow$)
& Param (M) & GFLOPs & Time (ms)*
\\
\midrule
\multicolumn{12}{l}{\textit{Traditional Methods}} \\
\hline
SPMHT \cite{cite-spmht}
& 33.01\% & 4.134\% & 36.64\% & -
& 70.52\% & 26.16\% & 72.14\% & -
& - & - & \phantom{00,}974 \\
TMQHT \cite{cite-tmqht}
& 84.52\% & 0.355\% & 87.02\% & -
& 83.69\% & 6.125\% & 86.32\% & -
& - & - & \phantom{0}1,435 \\
STMHT \cite{cite-stmht}
& 52.83\% & 0.243\% & 54.59\% & -
& 71.02\% & \underline{3.827\%} & 76.07\% & -
& - & - & \phantom{0}1,756 \\
\hline
\multicolumn{12}{l}{\textit{Deep-Learning Methods}} \\
\hline
DNA-Net \cite{DNANet}
& 76.63\% & 0.256\% & 78.87\% & 41.45\%
& 95.81\% & 29.51\% & 81.22\% & 55.30\%
& \phantom{00}4.70 & \phantom{0}228.6 & 11,712 \\
UIU-Net \cite{UIUNet}
& 82.63\% & \underline{0.219\%} & 84.69\% & 45.24\%
& 94.20\% & 22.79\% & 84.86\% & 55.84\%
& \phantom{0}50.54 & \phantom{0}872.6 & \phantom{0}1,564 \\
DTUM \cite{li2023direction}
&89.37\% & 84.76\% & 25.85\% & 13.08\%
& 84.86\% & 61.42\% & 51.11\% & 39.59\%
& \phantom{00}\underline{0.30} & \phantom{0}298.3 & \phantom{0}3,503 \\
LMAFormer \cite{cite-lmaformer}
& \underline{92.85\%} & 3.739\% & \bf{93.53\%} & 53.60\%
& 97.67\% & 4.883\% & \underline{96.10\%} & 38.06\%
& 590.05 & 1946.3 & 22,754 \\
DeepPro \cite{li2025probing}
& \bf{93.94\%} & 3.678\% & \underline{93.31\%} & 60.17\%
& 94.90\% & 9.83\% & 91.89\% & 54.56\%
& \phantom{00}\bf{0.049} & \phantom{0}121.78 & 1756 \\
SDebrisNet \cite{cite-sdebrisnet}
& 75.76\% & 1.013\% & 78.48\% & 56.52\%
& 95.39\% & 12.28\% & 91.39\% & 61.94\%
& \phantom{00}1.69 & \phantom{00}\bf{11.0} & \phantom{00,}\bf{386} \\
DnT-Net \cite{chen2024convolutional}
& 87.79\% & 29.54\% & 69.28\% & \underline{59.33\%}
& \underline{98.10\%} & 8.903\% & 94.47\% & \underline{79.04\%}
& \phantom{00}3.37 & \phantom{0}219.8 & \phantom{00,}802 \\
\hline
\multicolumn{12}{l}{\textit{Proposed Method}} \\ \hline \rowcolor{gray!20}
TenRPCANet (Ours)
& 87.81\% & \bf{0.054\%} & 89.73\% & \bf{74.79\%}
& \bf{99.53\%} & \bf{1.000\%} & \bf{99.00\%} & \bf{80.78\%}
& \phantom{00}1.78 & \phantom{00}\underline{79.26} & \phantom{00,}\underline{534} \\
\bottomrule
\multicolumn{12}{l}{\footnotesize{(\dag) The simulation dataset is generated by combining ideal imaging conditions with only additive Gaussian white noise.}}\\
\multicolumn{12}{l}{\footnotesize{(\ddag) The real-world dataset is collected by a near-Earth orbit space-based observation platform, and the imaging deviates from the ideal conditions \cite{11029687}.}}\\
\multicolumn{12}{l}{\footnotesize{(*) The reported time refers to the average inference time per sequence.}}
\end{tabular} \label{tab:SOTA2}
% }
\end{table*}
\subsubsection{Quantitative Evaluation}
The results on the multi-frame infrared small target detection and space object detection tasks are shown in Tab. \ref{tab:SOTA1} and \ref{tab:SOTA2}. Multi-frame methods outperform single-frame ones, and deep learning approaches consistently surpass model-driven methods. Infrared small target detection methods that rely on structural priors of the target perform poorly on real astronomical images. In contrast, our method achieves superior performance on both tasks.
Due to the extremely low target signal-to-noise ratio and the presence of strong noise interference in NUDT-MIRSDT and NUDT-MIRSDT-HiNo, several single-frame methods fail to converge. Although the DTUM method focuses on the spatiotemporal motion cues of the target, accurately extracting such cues from weak targets under heavy noise is highly challenging. The DeepPro method enhances target saliency via temporal slicing, but its lack of spatial information leads to degraded detection performance. In particular, leveraging both local neighborhood and non-local information proves effective in suppressing strong noise. In comparison, our method achieves the best performance, as it emphasizes background discrimination by treating the target as an anomaly. The low-rank nature of the background serves as a stable and reliable prior across diverse conditions. The ROC curves presented in Fig. \ref{fig:ROC} demonstrate the robustness of the proposed method.
Simulated astronomical images are generated under idealized conditions, which implicitly introduce strong priors about the target. As a result, models that focus on target-specific information tend to perform well on simulated data but struggle on real astronomical images. This performance gap arises because the imaging process in real scenarios is influenced by the complex interplay between space-based observation platforms and solar radiation, which can lead to abnormal variations in stellar intensity. Moreover, real astronomical images are affected by complex noise patterns that go far beyond standard Gaussian white noise. In contrast, our method demonstrates stronger adaptability by identifying targets through the discrimination of stars.
\subsubsection{Qualitative Evaluation}
\begin{figure*}[!t]
\centering
\includegraphics[width=1\linewidth]{IR_Result.pdf}
\caption{Visual comparison on the NUDT-MIRSDT dataset ($SNR \le 3$). For better visualization,the target area is enlarged in the top-right corner and highlighted with a \textcolor{red}{red} circle. The false alarm area is marked with a \textcolor[rgb]{1.0, 0.84, 0.0}{yellow} circle.}
\label{fig:IR_Result}
\end{figure*}
\begin{figure*}[!t]
\centering
\includegraphics[width=1\linewidth]{RSO_Result.pdf}
\caption{Visual comparisons on five sequences from real optical dataset are provided, where the raw images and detection results are overlaid for better illustration. Unlike simulated data, real-world imaging conditions are considerably more complex. The intensity of stars may fluctuate drastically due to variations in viewing angles and imaging geometry, and the image noise is far from ideal Gaussian white noise, often exhibiting structured or sensor-specific characteristics. \textcolor{blue}{Blue}, \textcolor[rgb]{1.0, 0.84, 0.0}{yellow} and \textcolor{red}{red} circles indicate true targets omitted by initialization, false alarms and missed detections, respectively.}
\label{fig:RSO_Result}
\end{figure*}
Qualitative results are presented in Fig. \ref{fig:IR_Result} and Fig. \ref{fig:RSO_Result}, where it can be intuitively observed that our method exhibits strong adaptability to extremely weak infrared small targets in complex scenes. In particular, by jointly modeling both local and non-local spatiotemporal relationships, our approach achieves superior structural integrity in the detected targets. At this stage, the performance of deep learning-based methods \cite{Dai_2021_WACV} even falls behind that of model-driven approaches \cite{li2023sparse}. This is because model-driven methods typically employ low-rank and sparse decomposition to discriminate the background and thereby identify potential targets. However, since such methods only capture structural priors rather than semantic information, the resulting target segmentation tends to be suboptimal. Although DeepPro leverages temporal saliency via time-series profiling to enhance weak signal detection, its limited capacity to capture spatial information leads to inferior segmentation performance. For military early warning applications \cite{zhao2022single}, precise target localization heavily relies on structural cues such as shape, further emphasizing the importance of maintaining target integrity.
In the space object detection task, a single frame often fails to reveal the debris target clearly due to its weak signal and transient appearance. Therefore, we aggregate the detection results over the entire sequence for visualization.
Due to interactions with solar radiation, stars may exhibit abnormal intensity fluctuations across frames, which often mislead contrast-based algorithms and result in a high number of false alarms. In contrast, our method focuses on the self-similarity among stellar patterns rather than on the individual appearance of stars, leading to greater robustness against such fluctuations.
For example, in the first row of the visualization, a debris target appears only in two frames before leaving the camera’s field of view. Algorithms that rely on motion cues fail to detect it due to the insufficient temporal support. However, our method treats the target as a spatial–temporal outlier and leverages the global sequence statistics to model stellar structures, allowing for reliable target discrimination.
Moreover, our approach does not rely on initialization or frame discarding strategies that are often employed to stabilize early-stage results. In contrast, methods \cite{cite-sdebrisnet,chen2024convolutional} specifically designed for space object detection typically require initialization, leading to the omission of the first few frames. It is capable of detecting extremely weak targets whose spatial signatures are nearly indistinguishable. In such cases, motion-based cues become unreliable, while treating the target as an outlier from a static perspective provides a more robust and principled detection strategy.
\subsection{Ablation Study}
\begin{table*}[]
\centering
\caption{Quantitative ablation study assessing the impacts of core components LSE and RFR. The metrics considered include $F_a$ ($10^{-5}$).}
\begin{tabular}{c|cc|ccc|cccc|ccc}
\toprule
\multirow{2}{*}{Strategy} & \multicolumn{2}{c|}{Module} & \multicolumn{3}{c|}{NUDT-MIRSDT} & \multicolumn{4}{c|}{Real Optical Set} & \multicolumn{3}{c}{Scale\dag} \\
& LSE & PFR & $P_d$ ($\uparrow$) & $F_a$ ($\downarrow$) & AUC ($\uparrow$) & $\text{R}^t$ ($\uparrow$) & $\text{FA}^t$ ($\downarrow$) & $\text{F1}^t$ ($\uparrow$) & IoU ($\uparrow$) & Param (M) & GFLOPs & FPS \\ \midrule
(a) & \XSolidBrush & \XSolidBrush & 30.14\% & 1.02 & 0.8863 & \multicolumn{4}{c|}{Not Converging} & 1.70 & 2.92 & 603.77 \\
(b) & \CheckmarkBold & \XSolidBrush & 85.43\% & 2.66 & 0.9879 &\multicolumn{4}{c|}{Not Converging} & 1.76 & 16.93 & 187.36 \\
(c) &\Checkmark\kern-1.2ex\raisebox{1ex}{\rotatebox[origin=c]{125}{\textbf{--}}}\ddag & \CheckmarkBold & 97.98\% & 8.82 & 0.9907 & 99.53\% & 1.8\% & 98.80\% & 77.52\% & 1.77 & 18.83 & 178.40 \\
(d) & \CheckmarkBold &\Checkmark\kern-1.2ex\raisebox{1ex}{\rotatebox[origin=c]{125}{\textbf{--}}}¶ & 96.39\% & 7.03 & 0.9921 & 95.65\% & 20.89\% & 86.05\% & 52.40\% & 1.78 & 18.73 & 177.56 \\
(e) & \CheckmarkBold &\Checkmark\kern-1.2ex\raisebox{1ex}{\rotatebox[origin=c]{125}{\textbf{--}}}\# & 99.65\% & 8.9 & 0.9973 & 98.06\% & 8.58\% & 94.35\% & 78.30\% & 1.78 & 19.14 & 177.12 \\
\rowcolor{gray!20}
(f) & \CheckmarkBold & \CheckmarkBold & 99.33\% & 0.36 & 0.9978 & 99.53\% & 1.0\% & 99.00\% & 80.78\% & 1.78 & 20.43 & 176.24 \\
(g) & \CheckmarkBold \S & \CheckmarkBold & 99.25\% & 27.96 & 0.9927 & 86.79\% & 11.18\% & 86.73\% & 47.34\% & 1.78 & 20.43 & 176.24 \\
(h) & \CheckmarkBold & \CheckmarkBold* & 99.65\% & 17.14 & 0.9992 & 63.33\% & 49.03\% & 49.34\% & 9.39\% & 1.78 & 20.43 & 176.24 \\
(i) & \CheckmarkBold \S & \CheckmarkBold* & 99.48\% & 9.14 & 0.9942 & 92.76\% & 11.37\% & 90.35\% & 42.40\% & 1.78 & 20.43 & 176.24 \\
\bottomrule
\multicolumn{12}{l}{\footnotesize{(\dag) The metrics are recorded on the multi-frame infrared small target detection task.}} \\
\multicolumn{12}{l}{\footnotesize{(\ddag) Since the PFR module depends on the output of the LSE module, only the 2D patch branch of LSE is preserved.}}\\
\multicolumn{12}{l}{\footnotesize{(¶) Removing the 3$\times$3 convolution in the PFR module suppresses its ability to perceive structural sparsity.}}\\
\multicolumn{12}{l}{\footnotesize{(\#) Retaining only the final 3$\times$3 convolution in the PFR module suppresses its ability to perceive structural sparsity.}}\\
\multicolumn{12}{l}{\footnotesize{(\S) Nonlinear activation functions (ReLU) are incorporated into the proposed LSE module.}}\\
\multicolumn{12}{l}{\footnotesize{(*) Nonlinear activation functions (ReLU) are incorporated into the proposed PFR module.}}
\end{tabular} \label{Tab:ALL}
\end{table*}
\begin{table}[]
\centering
\caption{Ablation Study on the Branches of the LSE Module.}
\begin{tabular}{cccc|ccc|c}
\toprule
\multicolumn{4}{c|}{Branch} & \multicolumn{3}{c|}{NUDT-MRISTD} & \multirow{2}{*}{Param} \\
3$\times$3 & 5$\times$5 & 7$\times$7 & 9$\times$9 & $P_d$ ($\uparrow$) & $F_a$ ($\downarrow$) & AUC ($\uparrow$) & \\\midrule
\CheckmarkBold & \XSolidBrush & \XSolidBrush & \XSolidBrush & 90.74\% & 15.42 & 0.9901 & 1.70 \\
\CheckmarkBold & \CheckmarkBold & \XSolidBrush & \XSolidBrush & 91.52\% & 4.635 & 0.9913 & 1.73 \\ \rowcolor{gray!20}
\CheckmarkBold & \CheckmarkBold & \CheckmarkBold & \XSolidBrush & 99.33\% & 0.36 & 0.9978 & 1.78 \\
\CheckmarkBold & \CheckmarkBold & \CheckmarkBold & \CheckmarkBold & 99.28\% & 5.731
& 0.9972 & 2.63 \\
\CheckmarkBold & \CheckmarkBold & \XSolidBrush & \CheckmarkBold & 99.45\% & 34.01 & 0.9981 & 2.11 \\
\CheckmarkBold & \XSolidBrush & \CheckmarkBold & \CheckmarkBold & 88.37\% & 6.545 & 0.9886 & 2.59 \\
\XSolidBrush & \CheckmarkBold & \CheckmarkBold & \CheckmarkBold & 98.12\% & 6.132 & 0.9898 & 2.62 \\
\bottomrule
\end{tabular} \label{Tab:Linear}
\end{table}
\begin{table}[]
\centering
\caption{Ablation Study on Spatiotemporal Window Size.}
\begin{tabular}{c|c|ccc|c}
\toprule
\multirow{2}{*}{In $T$-frames} & \multirow{2}{*}{Window-Size} & \multicolumn{3}{c|}{NUDT-MRISTD} & \multirow{2}{*}{FPS} \\
& & $P_d$ ($\uparrow$) & $F_a$ ($\downarrow$) & AUC ($\uparrow$) & \\ \midrule
2 & 2$\times$7$\times$7 & 87.01\% &15.44 &0.9857 &228.12 \\
4 & 2$\times$7$\times$7 & 89.33\% &11.12 &0.9888 &210.74 \\
4 & 4$\times$7$\times$7 & 98.21\% &1.88 &0.9964 &206.61 \\
8 & 2$\times$7$\times$7 & 92.11\% &8.61 &0.9867 &180.34 \\
8 & 4$\times$7$\times$7 & 98.88\% &1.956 &0.9911 &178.60 \\\rowcolor{gray!20}
8 & 8$\times$7$\times$7 & 99.33\% & 0.36 & 0.9978 &176.24 \\
\bottomrule
\end{tabular} \label{Tab:LSE_B}
\end{table}
\begin{table}[]
\centering
\caption{Ablation Study on Model Hyperparameters.}
\begin{tabular}{c|c|c|ccc}
\toprule
\multirow{2}{*}{Channel Size} & \multirow{2}{*}{Param} & \multirow{2}{*}{GFLOPs} & \multicolumn{3}{c}{NUDT-MRISTD} \\
& & & $P_d$ ($\uparrow$) & $F_a$ ($\downarrow$) & AUC ($\uparrow$) \\\midrule
12 &0.46 &5.247 &98.82\% &3.72 &0.9954 \\\rowcolor{gray!20}
24 &1.78 &20.43 &99.33\% & 0.36 & 0.9978 \\
48 &6.94 &79.68 &98.89\% & 0.26 &0.9969 \\
\bottomrule
\end{tabular} \label{Tab:Size}
\end{table}
\subsubsection{Ablation Study on Key Components} Our model’s performance heavily relies on two key components: the Locally Subspace Embedding (LSE) and the Progressive Feature Refinement (PFR) module. Both work synergistically with the encoder-decoder architecture to realize the tensor low-rank and sparse decomposition. Notably, the PFR module cannot function effectively in isolation without LSE, indicating a strong interdependency. Ablation results are presented in Tab. \ref{Tab:ALL}. Without the LSE and PFR modules, the model fails to converge on the space object detection task. Comparing strategies (c) and (f) reveals that the 3D patch construction branch within the LSE module effectively suppresses false alarms. This improvement stems from the introduction of a fourth-order tensor low-rank prior enabled by the 3D patch grouping, which captures the intrinsic spatiotemporal structure of the video sequence.
Comparing strategies (d), (e) and (f) reveals that removing the structural sparsity modeling capability from the PFR module results in a significant performance drop in space object detection. This is primarily because, compared to infrared small target detection, astronomical imagery contains more complex interference sources and much stronger \cite{11029687}, non-Gaussian noise, making the task considerably more challenging.
In our original design, both the LSE and PFR modules are entirely linear. This design choice aims to prevent overfitting to shallow, specific patterns, which could degrade model performance on unseen scenarios. Ablation experiments comparing strategies (g) through (i) confirm this hypothesis, demonstrating that introducing non-linearities in these modules leads to performance drops, thereby validating the effectiveness of maintaining their linearity.
\subsubsection{Ablation Study on the Multi-Branch Design of the LSE} Inspired by the superior performance of tensor low-rank and sparse decomposition following multilinear tensor construction in model-driven approaches \cite{4032832,6482624}, we incorporate a multi-branch design within the LSE module. While the previous subsection presented an ablation study on the effectiveness of linear constructions, this section focuses on evaluating the contribution of the multi-branch architecture. The ablation results are summarized in Tab. \ref{Tab:Linear}.
Since different types of false alarms often require distinct contextual information to be effectively suppressed \cite{li2024lsknet}, adopting a multi-branch architecture is well-suited for this task. In addition, as the spatial scale increases, the optimization becomes more challenging due to the larger search space and increased complexity. On the other hand, neglecting small local windows may lead to the loss of fine-grained details that are crucial for accurately identifying small targets.
\subsubsection{Ablation Study on Hyperparameters}
The hyperparameter analysis, as shown in Tab. \ref{Tab:LSE_B} and \ref{Tab:Size}, indicates that increasing the number of input frames and enlarging the temporal window both lead to improved detection performance. This is because a longer temporal dimension provides richer contextual information, which helps to better distinguish the background and reduces the influence of occasional anomalies.
However, in many real-world applications \cite{gao2013infrared}, it is often challenging to obtain long video sequences due to operational constraints. For example, airborne infrared observation systems typically cannot maintain long-term staring at a fixed region \cite{zhao2022single}; instead, they rely on wide-area search enabled by the motion of electro-optical (EO) pods. To accommodate these practical requirements, we set the temporal window to 8 frames in our experiments.
\subsection{Limitations}
\begin{figure}[!t]
\centering
\subfloat[]{
\includegraphics[width=\linewidth]{Failed.pdf}
\label{fig:Failed}
}
\hfill
\vspace{-7pt}
\subfloat[]{
\includegraphics[width=\linewidth]{Failed2.pdf}
\label{fig:Failed2}
}
\caption{Typical failure cases. (a) The detection fails when the target overlaps with a star. (b) The detection fails when the target signal is very weak.}
\label{fig:main}
\end{figure}
Typical failure cases are shown in Fig. \ref{fig:Failed} and \ref{fig:Failed2}. The causes of these failures stem from our method treating the input $T$-frame sequence equally. Specifically, focusing on short-term information helps distinguish targets obscured by stars, while focusing on long-term information enables the transformation of weak signals into prominent signals in the temporal profile. In the future, we will explore the design of spatiotemporal cooperative self-attention to adaptively leverage both long-term and short-term information.
\section{Conclusion}\label{Section:Conclusion}
In this paper, we propose a novel deep learning paradigm for small moving target detection, which leverages the low-rank property of the background while relaxing conventional assumptions on foreground sparsity and motion cues. We conduct a theoretical analysis of the characteristics of background, target, and noise. Based on these insights, we design TenRPCANet, an end-to-end architecture that implicitly performs low-rank and sparse decomposition. Extensive experiments on multiple public datasets in two representative tasks validate the effectiveness of the proposed method. This work provides a solid foundation for the design of future deep learning-based small moving target detection algorithms.
\bibliographystyle{IEEEtran}
\bibliography{reference}
\newpage
\vfill
\end{document}
% Generated by IEEEtran.bst, version: 1.14 (2015/08/26)
\begin{thebibliography}{100}
\providecommand{\url}[1]{#1}
\csname url@samestyle\endcsname
\providecommand{\newblock}{\relax}
\providecommand{\bibinfo}[2]{#2}
\providecommand{\BIBentrySTDinterwordspacing}{\spaceskip=0pt\relax}
\providecommand{\BIBentryALTinterwordstretchfactor}{4}
\providecommand{\BIBentryALTinterwordspacing}{\spaceskip=\fontdimen2\font plus
\BIBentryALTinterwordstretchfactor\fontdimen3\font minus
\fontdimen4\font\relax}
\providecommand{\BIBforeignlanguage}[2]{{%
\expandafter\ifx\csname l@#1\endcsname\relax
\typeout{** WARNING: IEEEtran.bst: No hyphenation pattern has been}%
\typeout{** loaded for the language `#1'. Using the pattern for}%
\typeout{** the default language instead.}%
\else
\language=\csname l@#1\endcsname
\fi
#2}}
\providecommand{\BIBdecl}{\relax}
\BIBdecl
\bibitem{10914515}
X.~Ying, C.~Xiao, W.~An, R.~Li, X.~He, B.~Li, X.~Cao, Z.~Li, Y.~Wang, M.~Hu,
Q.~Xu, Z.~Lin, M.~Li, S.~Zhou, L.~Liu, and W.~Sheng, ``Visible-thermal tiny
object detection: A benchmark dataset and baselines,'' \emph{IEEE
Transactions on Pattern Analysis and Machine Intelligence}, vol.~47, no.~7,
pp. 6088--6096, 2025.
\bibitem{gao2013infrared}
C.~Gao, D.~Meng, Y.~Yang, Y.~Wang, X.~Zhou, and A.~G. Hauptmann, ``Infrared
patch-image model for small target detection in a single image,'' \emph{IEEE
Transactions on Image Processing}, vol.~22, no.~12, pp. 4996--5009, 2013.
\bibitem{liu2023infrared}
F.~Liu, C.~Gao, F.~Chen, D.~Meng, W.~Zuo, and X.~Gao, ``Infrared small and dim
target detection with transformer under complex backgrounds,'' \emph{IEEE
Transactions on Image Processing}, vol.~32, pp. 5921--5932, 2023.
\bibitem{UIUNet}
X.~Wu, D.~Hong, and J.~Chanussot, ``Uiu-net: U-net in u-net for infrared small
object detection,'' \emph{IEEE Transactions on Image Processing}, vol.~32,
pp. 364--376, 2023.
\bibitem{DNANet}
B.~Li, C.~Xiao, L.~Wang, Y.~Wang, Z.~Lin, M.~Li, W.~An, and Y.~Guo, ``Dense
nested attention network for infrared small target detection,'' \emph{IEEE
Transactions on Image Processing}, vol.~32, pp. 1745--1758, 2023.
\bibitem{lin2021new}
B.~Lin, L.~Zhong, S.~Zhuge, X.~Yang, Y.~Yang, K.~Wang, and X.~Zhang, ``A new
pattern for detection of streak-like space target from single optical
images,'' \emph{IEEE Transactions on Geoscience and Remote Sensing}, vol.~60,
pp. 1--13, 2021.
\bibitem{9217948}
H.~Zhu, H.~Ni, S.~Liu, G.~Xu, and L.~Deng, ``Tnlrs: Target-aware non-local
low-rank modeling with saliency filtering regularization for infrared small
target detection,'' \emph{IEEE Transactions on Image Processing}, vol.~29,
pp. 9546--9558, 2020.
\bibitem{10298041}
F.~Liu, C.~Gao, F.~Chen, D.~Meng, W.~Zuo, and X.~Gao, ``Infrared small and dim
target detection with transformer under complex backgrounds,'' \emph{IEEE
Transactions on Image Processing}, vol.~32, pp. 5921--5932, 2023.
\bibitem{CSRNet}
F.~Lin, K.~Bao, Y.~Li, D.~Zeng, and S.~Ge, ``Learning contrast-enhanced
shape-biased representations for infrared small target detection,''
\emph{IEEE Transactions on Image Processing}, vol.~33, pp. 3047--3058, 2024.
\bibitem{11080263}
B.~Yang, F.~Li, S.~Zhao, W.~Wang, J.~Luo, H.~Pu, M.~Zhou, and Y.~Pi, ``Mtmlnet:
Multi-task mutual learning network for infrared small target detection and
segmentation,'' \emph{IEEE Transactions on Image Processing}, vol.~34, pp.
4414--4425, 2025.
\bibitem{11130659}
H.~Qin, T.~Xu, Y.~Tang, F.~Xu, and J.~Li, ``Osformer: One-step transformer for
infrared video small object detection,'' \emph{IEEE Transactions on Image
Processing}, pp. 1--1, 2025.
\bibitem{MSHNet}
Q.~Liu, R.~Liu, B.~Zheng, H.~Wang, and Y.~Fu, ``Infrared small target detection
with scale and location sensitivity,'' in \emph{Proceedings of the IEEE/CVF
Computer Vision and Pattern Recognition}, 2024.
\bibitem{8106808}
Z.~Zou and Z.~Shi, ``Random access memories: A new paradigm for target
detection in high resolution aerial remote sensing images,'' \emph{IEEE
Transactions on Image Processing}, vol.~27, no.~3, pp. 1100--1111, 2018.
\bibitem{li2023direction}
R.~Li, W.~An, C.~Xiao, B.~Li, Y.~Wang, M.~Li, and Y.~Guo, ``Direction-coded
temporal u-shape module for multiframe infrared small target detection,''
\emph{IEEE Transactions on Neural Networks and Learning Systems}, 2023.
\bibitem{chen2024convolutional}
S.~Chen, H.~Wang, Z.~Shen, K.~Wang, and X.~Zhang, ``Convolutional long-short
term memory network for space debris detection and tracking,''
\emph{Knowledge-Based Systems}, vol. 304, p. 112535, 2024.
\bibitem{7488247}
W.~Cao, Y.~Wang, J.~Sun, D.~Meng, C.~Yang, A.~Cichocki, and Z.~Xu, ``Total
variation regularized tensor rpca for background subtraction from compressive
measurements,'' \emph{IEEE Transactions on Image Processing}, vol.~25, no.~9,
pp. 4075--4090, 2016.
\bibitem{6820779}
L.~Lin, Y.~Xu, X.~Liang, and J.~Lai, ``Complex background subtraction by
pursuing dynamic spatio-temporal models,'' \emph{IEEE Transactions on Image
Processing}, vol.~23, no.~7, pp. 3191--3202, 2014.
\bibitem{9749010}
C.~Zhao, K.~Hu, and A.~Basu, ``Universal background subtraction based on
arithmetic distribution neural network,'' \emph{IEEE Transactions on Image
Processing}, vol.~31, pp. 2934--2949, 2022.
\bibitem{8017459}
S.~E. Ebadi and E.~Izquierdo, ``Foreground segmentation with tree-structured
sparse rpca,'' \emph{IEEE Transactions on Pattern Analysis and Machine
Intelligence}, vol.~40, no.~9, pp. 2273--2280, 2018.
\bibitem{8543221}
L.~Li, Q.~Hu, and X.~Li, ``Moving object detection in video via hierarchical
modeling and alternating optimization,'' \emph{IEEE Transactions on Image
Processing}, vol.~28, no.~4, pp. 2021--2036, 2019.
\bibitem{6781644}
Z.~Gao, L.-F. Cheong, and Y.-X. Wang, ``Block-sparse rpca for salient motion
detection,'' \emph{IEEE Transactions on Pattern Analysis and Machine
Intelligence}, vol.~36, no.~10, pp. 1975--1987, 2014.
\bibitem{6216381}
X.~Zhou, C.~Yang, and W.~Yu, ``Moving object detection by detecting contiguous
outliers in the low-rank representation,'' \emph{IEEE Transactions on Pattern
Analysis and Machine Intelligence}, vol.~35, no.~3, pp. 597--610, 2013.
\bibitem{RDIAN}
H.~Sun, J.~Bai, F.~Yang, and X.~Bai, ``Receptive-field and direction induced
attention network for infrared dim small target detection with a large-scale
dataset irdst,'' \emph{IEEE Transactions on Geoscience and Remote Sensing},
vol.~61, pp. 1--13, 2023.
\bibitem{ge2024gated}
Z.~Ge, H.~Chen, X.~Liang, and L.~Ma, ``Gated mechanism attention transformer
based on wavelet enhanced optical flow field estimation for foreground
detection,'' \emph{IEEE Transactions on Circuits and Systems for Video
Technology}, 2024.
\bibitem{10496551}
W.~Qin, H.~Wang, F.~Zhang, W.~Ma, J.~Wang, and T.~Huang, ``Nonconvex robust
high-order tensor completion using randomized low-rank approximation,''
\emph{IEEE Transactions on Image Processing}, vol.~33, pp. 2835--2850, 2024.
\bibitem{11015692}
B.~Han, Y.~Jia, H.~Liu, and J.~Hou, ``Irregular tensor low-rank representation
for hyperspectral image representation,'' \emph{IEEE Transactions on Image
Processing}, vol.~34, pp. 3239--3252, 2025.
\bibitem{7508483}
C.~Jia and Y.~Fu, ``Low-rank tensor subspace learning for rgb-d action
recognition,'' \emph{IEEE Transactions on Image Processing}, vol.~25, no.~10,
pp. 4641--4652, 2016.
\bibitem{9585029}
S.~E. Sofuoglu and S.~Aviyente, ``Multi-branch tensor network structure for
tensor-train discriminant analysis,'' \emph{IEEE Transactions on Image
Processing}, vol.~30, pp. 8926--8938, 2021.
\bibitem{10153488}
L.~Feng, C.~Zhu, Z.~Long, J.~Liu, and Y.~Liu, ``Multiplex transformed tensor
decomposition for multidimensional image recovery,'' \emph{IEEE Transactions
on Image Processing}, vol.~32, pp. 3397--3412, 2023.
\bibitem{8066348}
P.~Zhou, C.~Lu, Z.~Lin, and C.~Zhang, ``Tensor factorization for low-rank
tensor completion,'' \emph{IEEE Transactions on Image Processing}, vol.~27,
no.~3, pp. 1152--1163, 2018.
\bibitem{feng2025learnable}
L.~Feng, C.~Zhu, Y.~Liu, S.~Ravishankar, and L.~Huang, ``Learnable scaled
gradient descent for guaranteed robust tensor pca,'' \emph{arXiv preprint
arXiv:2501.04565}, 2025.
\bibitem{10078018}
H.~Wang, J.~Peng, W.~Qin, J.~Wang, and D.~Meng, ``Guaranteed tensor recovery
fused low-rankness and smoothness,'' \emph{IEEE Transactions on Pattern
Analysis and Machine Intelligence}, vol.~45, no.~9, pp. 10\,990--11\,007,
2023.
\bibitem{10354352}
Y.~Luo, X.~Zhao, Z.~Li, M.~K. Ng, and D.~Meng, ``Low-rank tensor function
representation for multi-dimensional data recovery,'' \emph{IEEE Transactions
on Pattern Analysis and Machine Intelligence}, vol.~46, no.~5, pp.
3351--3369, 2024.
\bibitem{10684569}
Y.~Luo, X.~Zhao, and D.~Meng, ``Revisiting nonlocal self-similarity from
continuous representation,'' \emph{IEEE Transactions on Pattern Analysis and
Machine Intelligence}, vol.~47, no.~1, pp. 450--468, 2025.
\bibitem{8606166}
C.~Lu, J.~Feng, Y.~Chen, W.~Liu, Z.~Lin, and S.~Yan, ``Tensor robust principal
component analysis with a new tensor nuclear norm,'' \emph{IEEE Transactions
on Pattern Analysis and Machine Intelligence}, vol.~42, no.~4, pp. 925--938,
2020.
\bibitem{10601492}
T.~T.~N. Mai, E.~Y. Lam, and C.~Lee, ``Attention-guided low-rank tensor
completion,'' \emph{IEEE Transactions on Pattern Analysis and Machine
Intelligence}, vol.~46, no.~12, pp. 9818--9833, 2024.
\bibitem{joukovsky2023interpretable}
B.~Joukovsky, Y.~C. Eldar, and N.~Deligiannis, ``Interpretable neural networks
for video separation: Deep unfolding rpca with foreground masking,''
\emph{IEEE Transactions on Image Processing}, vol.~33, pp. 108--122, 2023.
\bibitem{11104998}
Z.~Kong, F.~Deng, and X.~Yang, ``Image denoising using green channel prior,''
\emph{IEEE Transactions on Image Processing}, vol.~34, pp. 4869--4884, 2025.
\bibitem{9782722}
Z.~Jia, Q.~Jin, M.~K. Ng, and X.-L. Zhao, ``Non-local robust quaternion matrix
completion for large-scale color image and video inpainting,'' \emph{IEEE
Transactions on Image Processing}, vol.~31, pp. 3868--3883, 2022.
\bibitem{wang2024robust}
H.~Wang, S.~Chen, Z.~Shen, K.~Wang, M.~Duan, W.~Yang, B.~Lin, and X.~Zhang, ``A
robust space target extraction algorithm based on standardized correlation
space construction,'' \emph{IEEE Journal of Selected Topics in Applied Earth
Observations and Remote Sensing}, vol.~17, pp. 10\,188--10\,202, 2024.
\bibitem{steindorfer2025space}
M.~A. Steindorfer, P.~Wang, F.~Koidl, and G.~Kirchner, ``Space debris and
satellite laser ranging combined using a megahertz system,'' \emph{Nature
Communications}, vol.~16, no.~1, p. 575, 2025.
\bibitem{11146868}
G.~Zhang, G.~Xu, S.~Chen, H.~Wang, and X.~Zhang, ``Learning dynamic local
context representations for infrared small target detection,'' \emph{IEEE
Transactions on Geoscience and Remote Sensing}, pp. 1--1, 2025.
\bibitem{10381806}
S.~Chen, L.~Ji, J.~Zhu, M.~Ye, and X.~Yao, ``Sstnet: Sliced spatio-temporal
network with cross-slice convlstm for moving infrared dim-small target
detection,'' \emph{IEEE Transactions on Geoscience and Remote Sensing},
vol.~62, pp. 1--12, 2024.
\bibitem{11080063}
X.~Zhai, B.~Xu, Y.~Chen, H.~Wang, K.~Guo, and Y.~Dai, ``Seqcsist: Sequential
closely-spaced infrared small target unmixing,'' \emph{IEEE Transactions on
Geoscience and Remote Sensing}, vol.~63, pp. 1--15, 2025.
\bibitem{liuT2023infrared}
T.~Liu, J.~Yang, B.~Li, Y.~Wang, and W.~An, ``Infrared small target detection
via nonconvex tensor tucker decomposition with factor prior,'' \emph{IEEE
Transactions on Geoscience and Remote Sensing}, vol.~61, pp. 1--17, 2023.
\bibitem{ying2025infrared}
X.~Ying, L.~Liu, Z.~Lin, Y.~Shi, Y.~Wang, R.~Li, X.~Cao, B.~Li, S.~Zhou, and
W.~An, ``Infrared small target detection in satellite videos: A new dataset
and a novel recurrent feature refinement framework,'' \emph{IEEE Transactions
on Geoscience and Remote Sensing}, 2025.
\bibitem{li2025probing}
R.~Li, W.~An, X.~Ying, Y.~Wang, Y.~Dai, L.~Wang, M.~Li, Y.~Guo, and L.~Liu,
``Probing deep into temporal profile makes the infrared small target detector
much better,'' \emph{arXiv preprint arXiv:2506.12766}, 2025.
\bibitem{11029687}
H.~Wang, X.~Zhang, S.~Chen, T.~Zhang, G.~Zhang, B.~Lin, and X.~Xu, ``Learn to
represent and suppress smears with imaging mechanism guided neural network,''
\emph{IEEE Transactions on Industrial Informatics}, pp. 1--10, 2025.
\bibitem{wang2025anomalous}
H.~Wang, G.~Zhang, L.~Wang, S.~Chen, Z.~Shen, X.~Yang, X.~Xu, and X.~Zhang,
``Anomalous individuals searching framework for space debris detection in
single optical astronomical image,'' \emph{Advances in Space Research},
vol.~75, no.~4, pp. 3820--3837, 2025.
\bibitem{9185021}
D.~Liu, B.~Chen, T.-J. Chin, and M.~G. Rutten, ``Topological sweep for
multi-target detection of geostationary space objects,'' \emph{IEEE
Transactions on Signal Processing}, vol.~68, pp. 5166--5177, 2020.
\bibitem{cite-spmht}
M.~Li, C.~Yan, C.~Hu, C.~Liu, and L.~Xu, ``Space target detection in
complicated situations for wide-field surveillance,'' \emph{IEEE Access},
vol.~7, pp. 123\,658--123\,670, 2019.
\bibitem{cite-stmht}
D.~Liu, X.~Wang, Z.~Xu, Y.~Li, and W.~Liu, ``Space target extraction and
detection for wide-field surveillance,'' \emph{Astronomy and Computing},
vol.~32, p. 100408, 2020.
\bibitem{cite-tmqht}
J.~Xi, D.~Wen, O.~K. Ersoy, H.~Yi, D.~Yao, Z.~Song, and S.~Xi, ``Space debris
detection in optical image sequences,'' \emph{Applied optics}, vol.~55,
no.~28, pp. 7929--7940, 2016.
\bibitem{schuckman2022using}
M.~Schuckman, R.~Prouty, D.~Chapman, and D.~Engel, ``Using moffat profiles to
register astronomical images,'' in \emph{European Conference on Computer
Vision}.\hskip 1em plus 0.5em minus 0.4em\relax Springer, 2022, pp. 80--95.
\bibitem{zingarelli2014improving}
J.~C. Zingarelli, E.~Pearce, R.~Lambour, T.~Blake, C.~J. Peterson, and S.~Cain,
``Improving the space surveillance telescope's performance using
multi-hypothesis testing,'' \emph{The Astronomical Journal}, vol. 147, no.~5,
p. 111, 2014.
\bibitem{cite-sdebrisnet}
J.~Tao, Y.~Cao, and M.~Ding, ``Sdebrisnet: A spatial--temporal saliency network
for space debris detection,'' \emph{Applied Sciences}, vol.~13, no.~8, p.
4955, 2023.
\bibitem{NEURIPS2021_ff1418e8}
T.~Xiao, M.~Singh, E.~Mintun, T.~Darrell, P.~Dollar, and R.~Girshick, ``Early
convolutions help transformers see better,'' in \emph{Advances in Neural
Information Processing Systems}, vol.~34, 2021, pp. 30\,392--30\,400.
\bibitem{10475592}
T.~Yao, Y.~Li, Y.~Pan, and T.~Mei, ``Hiri-vit: Scaling vision transformer with
high resolution inputs,'' \emph{IEEE Transactions on Pattern Analysis and
Machine Intelligence}, vol.~46, no.~9, pp. 6431--6442, 2024.
\bibitem{10962317}
Z.~Jin, Y.~Qiu, K.~Zhang, H.~Li, and W.~Luo, ``Mb-taylorformer v2: Improved
multi-branch linear transformer expanded by taylor formula for image
restoration,'' \emph{IEEE Transactions on Pattern Analysis and Machine
Intelligence}, vol.~47, no.~7, pp. 5990--6005, 2025.
\bibitem{10124835}
D.~Ye, Z.~Ni, H.~Wang, J.~Zhang, S.~Wang, and S.~Kwong, ``Csformer: Bridging
convolution and transformer for compressive sensing,'' \emph{IEEE
Transactions on Image Processing}, vol.~32, pp. 2827--2842, 2023.
\bibitem{11091531}
W.~Huang, G.~Xu, W.~Jia, S.~Perry, and G.~Gao, ``Revivediff: A universal
diffusion model for restoring images in adverse weather conditions,''
\emph{IEEE Transactions on Image Processing}, vol.~34, pp. 4706--4720, 2025.
\bibitem{khan2023survey}
A.~Khan, Z.~Rauf, A.~Sohail, A.~R. Khan, H.~Asif, A.~Asif, and U.~Farooq, ``A
survey of the vision transformers and their cnn-transformer based variants,''
\emph{Artificial Intelligence Review}, vol.~56, no. Suppl 3, pp. 2917--2970,
2023.
\bibitem{Wang_Wang_Luo_Zhou_Zhou_Wang_Li_Jin_2022}
P.~Wang, X.~Wang, H.~Luo, J.~Zhou, Z.~Zhou, F.~Wang, H.~Li, and R.~Jin,
``Scaled relu matters for training vision transformers,'' \emph{Proceedings
of the AAAI Conference on Artificial Intelligence}, vol.~36, no.~3, pp.
2495--2503, Jun. 2022.
\bibitem{9115254}
T.-X. Jiang, M.~K. Ng, X.-L. Zhao, and T.-Z. Huang, ``Framelet representation
of tensor nuclear norm for third-order tensor completion,'' \emph{IEEE
Transactions on Image Processing}, vol.~29, pp. 7233--7244, 2020.
\bibitem{9780890}
Y.-S. Luo, X.-L. Zhao, T.-X. Jiang, Y.~Chang, M.~K. Ng, and C.~Li,
``Self-supervised nonlinear transform-based tensor nuclear norm for
multi-dimensional image recovery,'' \emph{IEEE Transactions on Image
Processing}, vol.~31, pp. 3793--3808, 2022.
\bibitem{8618436}
Y.~Xu, Z.~Wu, J.~Chanussot, and Z.~Wei, ``Nonlocal patch tensor sparse
representation for hyperspectral image super-resolution,'' \emph{IEEE
Transactions on Image Processing}, vol.~28, no.~6, pp. 3034--3047, 2019.
\bibitem{10742301}
C.~He, Y.~Xu, Z.~Wu, S.~Zheng, and Z.~Wei, ``Multi-dimensional visual data
restoration: Uncovering the global discrepancy in transformed high-order
tensor singular values,'' \emph{IEEE Transactions on Image Processing},
vol.~33, pp. 6409--6424, 2024.
\bibitem{9730793}
W.~Qin, H.~Wang, F.~Zhang, J.~Wang, X.~Luo, and T.~Huang, ``Low-rank high-order
tensor completion with applications in visual data,'' \emph{IEEE Transactions
on Image Processing}, vol.~31, pp. 2433--2448, 2022.
\bibitem{8000407}
Q.~Xie, Q.~Zhao, D.~Meng, and Z.~Xu, ``Kronecker-basis-representation based
tensor sparsity and its applications to tensor recovery,'' \emph{IEEE
Transactions on Pattern Analysis and Machine Intelligence}, vol.~40, no.~8,
pp. 1888--1902, 2018.
\bibitem{lin2023registration}
B.~Lin, X.~Xu, Z.~Shen, X.~Yang, L.~Zhong, and X.~Zhang, ``A registration
algorithm for astronomical images based on geometric constraints and
homography,'' \emph{Remote Sensing}, vol.~15, no.~7, p. 1921, 2023.
\bibitem{zhang2024dtnet}
N.~Zhang, Y.~Liu, H.~Liu, T.~Tian, J.~Ma, and J.~Tian, ``Dtnet: A specialized
dual-tuning network for infrared vehicle detection in aerial images,''
\emph{IEEE Transactions on Geoscience and Remote Sensing}, 2024.
\bibitem{9098052}
C.-Y. Ko, K.~Batselier, L.~Daniel, W.~Yu, and N.~Wong, ``Fast and accurate
tensor completion with total variation regularized tensor trains,''
\emph{IEEE Transactions on Image Processing}, vol.~29, pp. 6918--6931, 2020.
\bibitem{10507231}
L.~Cai, X.~Dong, K.~Zhou, and X.~Cao, ``Exploring video denoising in thermal
infrared imaging: Physics-inspired noise generator, dataset, and model,''
\emph{IEEE Transactions on Image Processing}, vol.~33, pp. 3839--3854, 2024.
\bibitem{10433564}
Z.~Yue, H.~Yong, Q.~Zhao, L.~Zhang, D.~Meng, and K.-Y.~K. Wong, ``Deep
variational network toward blind image restoration,'' \emph{IEEE Transactions
on Pattern Analysis and Machine Intelligence}, vol.~46, no.~11, pp.
7011--7026, 2024.
\bibitem{5339210}
P.~Chatterjee and P.~Milanfar, ``Is denoising dead?'' \emph{IEEE Transactions
on Image Processing}, vol.~19, no.~4, pp. 895--911, 2010.
\bibitem{7327182}
V.~Papyan and M.~Elad, ``Multi-scale patch-based image restoration,''
\emph{IEEE Transactions on Image Processing}, vol.~25, no.~1, pp. 249--261,
2016.
\bibitem{4011956}
M.~Elad and M.~Aharon, ``Image denoising via sparse and redundant
representations over learned dictionaries,'' \emph{IEEE Transactions on Image
Processing}, vol.~15, no.~12, pp. 3736--3745, 2006.
\bibitem{ulyanov2018deep}
D.~Ulyanov, A.~Vedaldi, and V.~Lempitsky, ``Deep image prior,'' in
\emph{Proceedings of the IEEE conference on computer vision and pattern
recognition}, 2018, pp. 9446--9454.
\bibitem{dmitry2020deep}
U.~Dmitry, A.~Vedaldi, and L.~Victor, ``Deep image prior,'' \emph{International
Journal of Computer Vision}, vol. 128, no.~7, pp. 1867--1888, 2020.
\bibitem{8590763}
Y.~Wu, L.~Fang, and S.~Li, ``Weighted tensor rank-1 decomposition for nonlocal
image denoising,'' \emph{IEEE Transactions on Image Processing}, vol.~28,
no.~6, pp. 2719--2730, 2019.
\bibitem{liu2022video}
Z.~Liu, J.~Ning, Y.~Cao, Y.~Wei, Z.~Zhang, S.~Lin, and H.~Hu, ``Video swin
transformer,'' in \emph{Proceedings of the IEEE/CVF conference on computer
vision and pattern recognition}, 2022, pp. 3202--3211.
\bibitem{dosovitskiy2020vit}
A.~Dosovitskiy, L.~Beyer, A.~Kolesnikov, D.~Weissenborn, X.~Zhai,
T.~Unterthiner, M.~Dehghani, M.~Minderer, G.~Heigold, S.~Gelly, J.~Uszkoreit,
and N.~Houlsby, ``An image is worth 16x16 words: Transformers for image
recognition at scale,'' \emph{ICLR}, 2021.
\bibitem{meilua2024manifold}
M.~Meil{\u{a}} and H.~Zhang, ``Manifold learning: What, how, and why,''
\emph{Annual Review of Statistics and Its Application}, vol.~11, no.~1, pp.
393--417, 2024.
\bibitem{chen2023primal}
Y.~Chen, Q.~Tao, F.~Tonin, and J.~Suykens, ``Primal-attention: Self-attention
through asymmetric kernel svd in primal representation,'' \emph{Advances in
Neural Information Processing Systems}, vol.~36, pp. 65\,088--65\,101, 2023.
\bibitem{lafferty2005diffusion}
J.~Lafferty, G.~Lebanon, and T.~Jaakkola, ``Diffusion kernels on statistical
manifolds.'' \emph{Journal of Machine Learning Research}, vol.~6, no.~1,
2005.
\bibitem{6021368}
X.-H. Han, Y.-W. Chen, and X.~Ruan, ``Multilinear supervised neighborhood
embedding of a local descriptor tensor for scene/object recognition,''
\emph{IEEE Transactions on Image Processing}, vol.~21, no.~3, pp. 1314--1326,
2012.
\bibitem{7994673}
Y.~Chen, X.~Cao, Q.~Zhao, D.~Meng, and Z.~Xu, ``Denoising hyperspectral image
with non-i.i.d. noise structure,'' \emph{IEEE Transactions on Cybernetics},
vol.~48, no.~3, pp. 1054--1066, 2018.
\bibitem{7516720}
X.~Cao, Q.~Zhao, D.~Meng, Y.~Chen, and Z.~Xu, ``Robust low-rank matrix
factorization under general mixture noise distributions,'' \emph{IEEE
Transactions on Image Processing}, vol.~25, no.~10, pp. 4677--4690, 2016.
\bibitem{8741173}
Z.~Yue, H.~Yong, D.~Meng, Q.~Zhao, Y.~Leung, and L.~Zhang, ``Robust multiview
subspace learning with nonindependently and nonidentically distributed
complex noise,'' \emph{IEEE Transactions on Neural Networks and Learning
Systems}, vol.~31, no.~4, pp. 1070--1083, 2020.
\bibitem{PR16MPCM}
Y.~Wei, X.~You, and H.~Li, ``Multiscale patch-based contrast measure for small
infrared target detection,'' \emph{Pattern Recognition}, vol.~58, pp.
216--226, 2016.
\bibitem{sun2020infrared}
Y.~Sun, J.~Yang, and W.~An, ``Infrared dim and small target detection via
multiple subspace learning and spatial-temporal patch-tensor model,''
\emph{IEEE Transactions on Geoscience and Remote Sensing}, vol.~59, no.~5,
pp. 3737--3752, 2020.
\bibitem{luo2022imnn}
Y.~Luo, X.~Li, S.~Chen, C.~Xia, and L.~Zhao, ``{IMNN-LWEC}: A novel infrared
small target detection based on spatial-temporal tensor model,'' \emph{IEEE
Transactions on Geoscience and Remote Sensing}, vol.~60, pp. 1--22, 2022.
\bibitem{li2023sparse}
J.~Li, P.~Zhang, L.~Zhang, and Z.~Zhang, ``Sparse regularization-based
spatial-temporal twist tensor model for infrared small target detection,''
\emph{IEEE Transactions on Geoscience and Remote Sensing}, vol.~61, pp.
1--17, 2023.
\bibitem{luo20234dst}
Y.~Luo, X.~Li, S.~Chen, and C.~Xia, ``{4DST-BTMD}: An infrared small target
detection method based on {4-D} data-sphered space,'' \emph{IEEE Transactions
on Geoscience and Remote Sensing}, vol.~62, pp. 1--20, 2023.
\bibitem{luo2023spatial}
Y.~Luo, X.~Li, Y.~Yan, and C.~Xia, ``Spatial-temporal tensor representation
learning with priors for infrared small target detection,'' \emph{IEEE
Transactions on Aerospace and Electronic Systems}, vol.~59, no.~6, pp.
9598--9620, 2023.
\bibitem{wu2023infrared}
F.~Wu, H.~Yu, A.~Liu, J.~Luo, and Z.~Peng, ``Infrared small target detection
using spatiotemporal {4-D} tensor train and ring unfolding,'' \emph{IEEE
Transactions on Geoscience and Remote Sensing}, vol.~61, pp. 1--22, 2023.
\bibitem{Dai_2021_WACV}
Y.~Dai, Y.~Wu, F.~Zhou, and K.~Barnard, ``Asymmetric contextual modulation for
infrared small target detection,'' in \emph{Proceedings of the IEEE/CVF
Winter Conference on Applications of Computer Vision (WACV)}, January 2021,
pp. 950--959.
\bibitem{ALCNet}
------, ``Attentional local contrast networks for infrared small target
detection,'' \emph{IEEE Transactions on Geoscience and Remote Sensing},
vol.~59, no.~11, pp. 9813--9824, 2021.
\bibitem{xiao2018weighted}
X.~Xiao, S.~Lian, Z.~Luo, and S.~Li, ``Weighted {Res-UNet} for high-quality
retina vessel segmentation,'' in \emph{International Conference on
Information Technology in Medicine and Education}, 2018, pp. 327--331.
\bibitem{ISNet}
M.~Zhang, R.~Zhang, Y.~Yang, H.~Bai, J.~Zhang, and J.~Guo, ``Isnet: Shape
matters for infrared small target detection,'' in \emph{2022 IEEE/CVF
Conference on Computer Vision and Pattern Recognition (CVPR)}, 2022, pp.
867--876.
\bibitem{AGPCNet}
T.~Zhang, L.~Li, S.~Cao, T.~Pu, and Z.~Peng, ``Attention-guided pyramid context
networks for detecting infrared small target under complex background,''
\emph{IEEE Transactions on Aerospace and Electronic Systems}, vol.~59, no.~4,
pp. 4250--4261, 2023.
\bibitem{SCTransNet}
S.~Yuan, H.~Qin, X.~Yan, N.~Akhtar, and A.~Mian, ``Sctransnet: Spatial-channel
cross transformer network for infrared small target detection,'' \emph{IEEE
Transactions on Geoscience and Remote Sensing}, vol.~62, pp. 1--15, 2024.
\bibitem{10740056}
T.~Chen, Z.~Ye, Z.~Tan, T.~Gong, Y.~Wu, Q.~Chu, B.~Liu, N.~Yu, and J.~Ye,
``Mim-istd: Mamba-in-mamba for efficient infrared small-target detection,''
\emph{IEEE Transactions on Geoscience and Remote Sensing}, vol.~62, pp.
1--13, 2024.
\bibitem{RPCANet}
F.~Wu, T.~Zhang, L.~Li, Y.~Huang, and Z.~Peng, ``Rpcanet: Deep unfolding rpca
based infrared small target detection,'' in \emph{Proceedings of the IEEE/CVF
Winter Conference on Applications of Computer Vision (WACV)}, January 2024,
pp. 4809--4818.
\bibitem{yan2023stdmanet}
P.~Yan, R.~Hou, X.~Duan, C.~Yue, X.~Wang, and X.~Cao, ``{STDMANet}:
Spatio-temporal differential multiscale attention network for small moving
infrared target detection,'' \emph{IEEE Transactions on Geoscience and Remote
Sensing}, vol.~61, pp. 1--16, 2023.
\bibitem{cite-lmaformer}
Y.~Huang, X.~Zhi, J.~Hu, L.~Yu, Q.~Han, W.~Chen, and W.~Zhang, ``Lmaformer:
Local motion aware transformer for small moving infrared target detection,''
\emph{IEEE Transactions on Geoscience and Remote Sensing}, vol.~62, pp.
1--17, 2024.
\bibitem{zhao2022single}
M.~Zhao, W.~Li, L.~Li, J.~Hu, P.~Ma, and R.~Tao, ``Single-frame infrared
small-target detection: A survey,'' \emph{IEEE Geoscience and Remote Sensing
Magazine}, vol.~10, no.~2, pp. 87--119, 2022.
\bibitem{4032832}
S.~Yan, D.~Xu, Q.~Yang, L.~Zhang, X.~Tang, and H.-J. Zhang, ``Multilinear
discriminant analysis for face recognition,'' \emph{IEEE Transactions on
Image Processing}, vol.~16, no.~1, pp. 212--220, 2007.
\bibitem{6482624}
Z.~Hao, L.~He, B.~Chen, and X.~Yang, ``A linear support higher-order tensor
machine for classification,'' \emph{IEEE Transactions on Image Processing},
vol.~22, no.~7, pp. 2911--2920, 2013.
\bibitem{li2024lsknet}
Y.~Li, X.~Li, Y.~Dai, Q.~Hou, L.~Liu, Y.~Liu, M.-M. Cheng, and J.~Yang,
``Lsknet: A foundation lightweight backbone for remote sensing,''
\emph{International Journal of Computer Vision}, pp. 1--22, 2024.
\end{thebibliography}