The First Challenge on Remote Sensing Infrared Image Super-Resolution at NTIRE 2026: Benchmark Results and Method Overview
Extracted source text · arXiv 2604.21312
% CVPR 2025 Paper Template; see https://github.com/cvpr-org/author-kit
\documentclass[10pt,twocolumn,letterpaper]{article}
%%%%%%%%% PAPER TYPE - PLEASE UPDATE FOR FINAL VERSION
\usepackage{tikz}
\usetikzlibrary{arrows.meta, positioning, calc}
\usepackage{cvpr} % To produce the CAMERA-READY version
% \usepackage[review]{cvpr} % To produce the REVIEW version
% \usepackage[pagenumbers]{cvpr} % To force page numbers, e.g. for an arXiv version
% Import additional packages in the preamble file, before hyperref
\input{preamble}
% It is strongly recommended to use hyperref, especially for the review version.
% hyperref with option pagebackref eases the reviewers' job.
% Please disable hyperref *only* if you encounter grave issues,
% e.g. with the file validation for the camera-ready version.
%
% If you comment hyperref and then uncomment it, you should delete *.aux before re-running LaTeX.
% (Or just hit 'q' on the first LaTeX run, let it finish, and you should be clear).
\definecolor{cvprblue}{rgb}{0.21,0.49,0.74}
\usepackage[pagebackref,breaklinks,colorlinks,citecolor=cvprblue]{hyperref}
%%%%%%%%% PAPER ID - PLEASE UPDATE
\def\paperID{*****} % *** Enter the Paper ID here
\def\confName{CVPR}
\def\confYear{2025}
%%%%%%%%% TITLE - PLEASE UPDATE
\title{The First Challenge on Remote Sensing Infrared Image Super-Resolution at NTIRE 2026: Benchmark Results and Method Overview}
% \title{NTIRE 2025 Challenge on Single Image Super-Resolution ($\times 4$): Methods and Results}
%%%%%%%%% AUTHORS - PLEASE UPDATE
\author{
% Organizer
Kai Liu$^{\dagger}$ \and
Haoyang Yue$^{\dagger}$ \and
Zeli Lin$^{\dagger}$ \and
Zheng Chen$^{\dagger}$ \and
Jingkai Wang$^{\dagger}$ \and
Jue Gong$^{\dagger}$ \and
Jiatong Li$^{\dagger}$ \and
Xianglong Yan$^{\dagger}$ \and
Libo Zhu$^{\dagger}$ \and
Jianze Li$^{\dagger}$ \and
Ziqing Zhang$^{\dagger}$ \and
Zihan Zhou$^{\dagger}$ \and
Xiaoyang Liu$^{\dagger}$ \and
Radu Timofte$^{\dagger}$ \and
Yulun Zhang$^{\dagger*}$ \and
% Team 2 SUATSR
Junye Chen \and
Zhenming Yan \and
Yucong Hong \and
Ruize Han \and
Song Wang \and
% Team 3 XJRes
Li Pang \and
Heng Zhao \and
Xinqiao Wu \and
Deyu Meng \and
Xiangyong Cao \and
% Team 4 I2WM&JNU
Weijun Yuan \and
Zhan Li \and
Zhanglu Chen \and
Boyang Yao \and
Yihang Chen \and
Yifan Deng \and
% Team 5 hit_zzy
Zengyuan Zuo \and
Junjun Jiang \and
% Team 6 KLETech-CEVI
Saiprasad Meesiyawar \and
Sulocha Yatageri \and
Nikhil Akalwadi \and
Ramesh Ashok Tabib \and
Uma Mudenagudi \and
% Team 7 NTR
Jiachen Tu \and
Yaokun Shi \and
Guoyi Xu \and
Yaoxin Jiang \and
Cici Liu \and
% Team 8 Earth4D
Tongyao Mu \and
Qiong Cao \and
Yifan Wang \and
% Team 9 SiGMoid
Kosuke Shigematsu \and
Hiroto Shirono \and
Asuka Shin\and
% Team 10 FengFans
Wei Zhou \and
Linfeng Li \and
Lingdong Kong \and
% Team 11 WHU-VIP
Ce Wang \and
Xingwei Zhong \and
Wanjie Sun \and
% Team 12
Dafeng Zhang \and
% Team 14 NUDT DeepIter
Hongxin Lan \and
Qisheng Xu \and
Mingyue He \and
Hui Geng \and
Tianjiao Wan \and
Kele Xu \and
Changjian Wang \and
% Team 15 CASWiT SR IR
Antoine Carreaud \and
Nicola Santacroce \and
Shanci Li \and
Jan Skaloud \and
Adrien Gressin
}
\begin{document}
\maketitle
\let\thefootnote\relax\footnotetext{$^{\dagger}$Kai Liu, Haoyang Yue, Zeli Lin, Zheng Chen, Jingkai Wang, Jue Gong, Jiatong Li, Yanxiang Long, Libo Zhu, Jianze Li, Ziqing Zhang, Zihan Zhou, Xiaoyang Liu, and Radu Timofte, Yulun Zhang are the challenge organizers, while the other authors participated in the challenge. $^{*}$Corresponding author: Yulun Zhang. Section B in the supplementary materials contains the authors' teams and affiliations. NTIRE 2026 webpage: \url{https://cvlai.net/ntire/2026}. Code: \url{https://github.com/Kai-Liu001/NTIRE2026_infraredSR}.}
\vspace{-10.mm}
\begin{abstract}
This paper presents the NTIRE 2026 Remote Sensing Infrared Image Super-Resolution (×4) Challenge, one of the associated challenges of NTIRE 2026. The challenge aims to recover high-resolution (HR) infrared images from low-resolution (LR) inputs generated through bicubic downsampling with a ×4 scaling factor. The objective is to develop effective models or solutions that achieve state-of-the-art performance for infrared image SR in remote sensing scenarios. To reflect the characteristics of infrared data and practical application needs, the challenge adopts a single-track setting. A total of 115 participants registered for the competition, with 13 teams submitting valid entries. This report summarizes the challenge design, dataset, evaluation protocol, main results, and the representative methods of each team. The challenge serves as a benchmark to advance research in infrared image super-resolution and promote the development of effective solutions for real-world remote sensing applications.
\end{abstract}
%% narrow the gap between equations and sentences
\setlength{\abovedisplayskip}{1pt}
\setlength{\belowdisplayskip}{1pt}
\vspace{-6mm}
\section{Introduction}
\vspace{-2mm}
Infrared image super-resolution aims to enhance the spatial resolution of low-resolution infrared remote sensing images while preserving critical scene details and thermal radiometric consistency. Due to limitations in sensor hardware and imaging conditions, infrared images often suffer from low spatial resolution, which obscures fine-grained structures such as small targets, texture details, and subtle thermal variations. This degradation directly affects the reliability of downstream remote sensing tasks, including target detection, environmental monitoring, and change analysis.
Accurate infrared image super-resolution requires reconstructing high-resolution images that are both structurally consistent and thermally faithful to the original scene.
This task is inherently challenging due to the presence of noise in infrared data, the non-linear relationship between thermal radiation and pixel intensity, and the need to preserve meaningful thermal contrasts across different land-cover types. In addition, variations in atmospheric conditions and sensor characteristics further complicate the generalization of SR models in real-world scenarios.
With the rapid development of deep learning, a wide range of methods have been explored for image super-resolution.
Convolutional neural networks (CNNs) have demonstrated strong capability in learning hierarchical representations for detail reconstruction~\cite{dong2014learning,kim2016accurate,zhang2018image}. Building upon this foundation, subsequent works incorporate deeper architectures, residual connections, and attention mechanisms to improve reconstruction accuracy~\cite{zhang2018residual,dai2019second}. More recently, Transformer-based models enhance performance by modeling long-range dependencies via self-attention~\cite{vaswani2017attention,liu2021swin,chen2023dual}, while state-space models (e.g., Mamba) provide efficient alternatives for large-scale modeling~\cite{gu2023mamba,liu2024vmamba,guo2024mambair}. In addition, generative approaches, including GAN-based methods~\cite{goodfellow2014generative,ledig2017photo} and diffusion models~\cite{ho2020denoising,saharia2022image,xia2023diffir,wu2023seesr,li2024distillation}, have shown strong capability in synthesizing realistic textures and improving reconstruction quality.
To provide a standardized benchmark for infrared image super-resolution, we organize the NTIRE 2026 Remote Sensing Infrared Image Super-Resolution (×4) Challenge, associated with the NTIRE 2026 Workshop. The challenge focuses on reconstructing high-resolution infrared images from low-resolution inputs generated via bicubic downsampling with a ×4 scaling factor.
This challenge adopts a single-track setting, where all submissions are evaluated using a unified image quality assessment (IQA) metric defined as PSNR + 20×SSIM. The evaluation is conducted on single-channel infrared images, consistent with the characteristics of the data.
This challenge is one of the challenges associated with the NTIRE 2026 Workshop~\footnote{\url{https://www.cvlai.net/ntire/2026/}} on:
deepfake detection~\cite{ntire26deepfake},
high-resolution depth~\cite{ntire26hrdepth},
multi-exposure image fusion~\cite{ntire26raim_fusion},
AI flash portrait~\cite{ntire26raim_portrait},
professional image quality assessment~\cite{ntire26raim_piqa},
light field super-resolution~\cite{ntire26lightsr},
3D content super-resolution~\cite{ntire263dsr},
bitstream-corrupted video restoration~\cite{ntire26videores},
X-AIGC quality assessment~\cite{ntire26XAIGCqa},
shadow removal~\cite{ntire26shadow},
ambient lighting normalization~\cite{ntire26lightnorm},
controllable Bokeh rendering~\cite{ntire26bokeh},
rip current detection and segmentation~\cite{ntire26ripdetseg},
low light image enhancement~\cite{ntire26llie},
high FPS video frame interpolation~\cite{ntire26highfps},
Night-time dehazing~\cite{ntire26nthaze,ntire26nthaze_rep},
learned ISP with unpaired data~\cite{ntire26isp},
short-form UGC video restoration~\cite{ntire26ugcvideo},
raindrop removal for dual-focused images~\cite{ntire26dual_focus},
image super-resolution (x4)~\cite{ntire26srx4},
photography retouching transfer~\cite{ntire26retouching},
mobile real-word super-resolution~\cite{ntire26rwsr},
remote sensing infrared super-resolution~\cite{ntire26rsirsr},
AI-Generated image detection~\cite{ntire26aigendet},
cross-domain few-shot object detection~\cite{ntire26cdfsod},
financial receipt restoration and reasoning~\cite{ntire26finrec},
real-world face restoration~\cite{ntire26faceres},
reflection removal~\cite{ntire26reflection},
anomaly detection of face enhancement~\cite{ntire26anomalydet},
video saliency prediction~\cite{ntire26videosal},
efficient super-resolution~\cite{ntire26effsr},
3d restoration and reconstruction in adverse conditions~\cite{ntire26realx3d},
image denoising~\cite{ntire26denoising},
blind computational aberration correction~\cite{ntire26aberration},
event-based image deblurring~\cite{ntire26eventblurr},
efficient burst HDR and restoration~\cite{ntire26bursthdr},
low-light enhancement: `twilight cowboy'~\cite{ntire26twilight},
and efficient low light image enhancement~\cite{ntire26effllie}.
% \vspace{-3.mm}
\section{NTIRE 2026 Remote Sensing Infrared Image Super-Resolution ($\times$4)}
% \vspace{-1.mm}
The NTIRE 2026 Remote Sensing Infrared Image Super-Resolution Challenge, which is one of the associated challenges of NTIRE 2026, has two primary objectives. Firstly, it intends to offer a thorough overview of the latest advancements and emerging tendencies within the field of remote sensing infrared image super-resolution (SR). Secondly, it functions as a platform that enables both academic researchers and industrial professionals to converge and investigate possible collaborative opportunities for the practical application of infrared SR in remote sensing scenarios. The following part delves into the specific aspects.
\vspace{-2.mm}
\subsection{Dataset}
\vspace{-1mm}
The challenge uses the official custom \textbf{InfraredSR} dataset (gratefully acknowledged to Spark Transmission (Beijing) Co., Ltd. for providing the data support). The low-resolution (LR)-high-resolution (HR) image pairs are constructed with the high-quality (HQ) infrared images via bicubic interpolation with a $\times$4 downsampling factor~\cite{li2026satvideodataset}.
The dataset is divided into training set (train), validation set (val) and test set (test), with the detailed image quantity and resolution distribution of each subset as follows:
320$\times$256: 625 images, 120$\times$120: 281 images, 64$\times$64: 99 images, 256$\times$256: 9 images, 160$\times$128: 5 images.
\noindent\textbf{Validation Set}
The validation set contains a total of 100 images, covering 5 resolution types:
320$\times$256: 66 images, 120$\times$120: 20 images, 64$\times$64: 12 images, 256$\times$256: 1 image, 160$\times$128: 1 image.
\noindent\textbf{Test Set}
The test set contains a total of 222 images, covering 3 resolution types:
1280$\times$1024: 188 images, 480$\times$480: 22 images, 256$\times$256: 12 images.
\subsection{Competition}
\label{sec:track}
This year's competition focuses on remote sensing infrared image super-resolution, with a unified evaluation metric for the competition.
\noindent\textbf{Infrared SR}.
All teams are ranked according to the comprehensive IQA score calculated from the enhanced HR images compared to the GT HR images of the InfraredSR testing dataset. The official IQA score calculation formula is defined as:
\begin{equation}
\begin{aligned}
\text{Score} = \text{PSNR} + 20 \times \text{SSIM}.
\end{aligned}
\end{equation}
\noindent\textbf{Challenge Phases.}
\textit{(1) Development and Validation Phase:} During this phase, participants have access to the full InfraredSR training set and validation set. Participants train their models on the training set and submit the restored HR results on the validation set to the Codalab server for evaluation. The server will provide real-time ranking based on the official IQA score.
\textit{(2) Testing Phase:} In the final phase, participants receive the full InfraredSR test set (LR images only, with corresponding HR ground truth images kept confidential). They are required to upload their SR outputs (HR images) to the Codalab server and submit their code and a detailed report to the organizers via email. After the challenge ends, the organizers will validate the code and send the final evaluation results to the participants.
\noindent\textbf{Evaluation Protocol.}
The official evaluation protocol and metric calculation scripts are available in the NTIRE 2026 official GitHub repository: \url{https://github.com/Kai-Liu001/NTIRE2026_infraredSR.git}, and the repository also includes the source code and pre-trained models.
Key evaluation rules are as follows:
\begin{itemize}
\item All metric calculations (PSNR and SSIM) are performed on the \textbf{single channel} of the infrared images (consistent with the characteristic of infrared image data).
\item The final results shall be based on the official test results computed by the organizers. Code submitted by participants is used for reproduction and verification, with small discrepancies in precision being considered acceptable.
\end{itemize}
\begin{table*}[t]
\centering
\small
\begin{adjustbox}{width=\linewidth}
\setlength{\tabcolsep}{0.5cm}
\renewcommand{\arraystretch}{0.95}
\begin{tabular}{l|c|l|c|ccc}
\toprule
\textbf{Team Name} & \textbf{Rank} & \textbf{Leader} & \textbf{Email} & \textbf{Test PSNR} & \textbf{Test SSIM} & \textbf{Total Score} \\
\midrule
WHU-VIP & 1 & Ce Wang & wangcce6@gmail.com & 35.9643 & 0.9236 & 54.4361 \\
XJRes & 2 & Li Pang & pp2373886592@gmail.com & 35.8713 & 0.9210 & 54.2920 \\
FengFans & 3 & Wei Zhou & weichow@u.nus.edu & 35.8211 & 0.9210 & 54.2416 \\
I2WM\&JNU & 4 & Weijun Yuan & yweijun@stu2022.jnu.edu.cn & 35.8263 & 0.9203 & 54.2319 \\
davinci & 5 & davinci & davinci7571@gmail.com & 35.8202 & 0.9204 & 54.2288 \\
Earth4D & 6 & Tongyao Mu & muty.woodnr@gmail.com & 35.7912 & 0.9202 & 54.1956 \\
SUATSR & 7 & Junye Chen & suat24000219@stu.suat-sz.edu.cn & 35.7498 & 0.9198 & 54.1460 \\
SiGMoid & 8 & Kosuke Shigematsu & k-shigematsu@oita-ct.ac.jp & 35.7001 & 0.9189 & 54.0784 \\
hit\_zzy & 9 & Zengyuan Zuo & 3565741165@qq.com & 35.6648 & 0.9185 & 54.0338 \\
KLE Tech-CEVI & 10 & Saiprasad Meesiyawar & saiprasad@cevi.co.in & 35.6604 & 0.9184 & 54.0287 \\
CASWiT\_SR\_IR & 11 & Antoine Carreaud & antoine.carreaud@epfl.ch & 35.6529 & 0.9182 & 54.0162 \\
NTR & 12 & Jiachen Tu & jtu9@illinois.edu & 35.6544 & 0.9180 & 54.0148 \\
NUDT\_DeepIter & 13 & Xinhong Lan & 2304946634@qq.com & 35.5492 & 0.9172 & 53.8936 \\
\bottomrule
\end{tabular}
\end{adjustbox}
\caption{\textbf{Results of the NTIRE 2026 Infrared Image Super-Resolution Challenge (x4).}
Teams are sorted by the official single-track rank. Leader and contact email are provided for each team.}
\label{tab:main_results}
\end{table*}% \vspace{-2mm}
\section{Challenge Results}
% \vspace{-1mm}
The challenge adopts a single-track evaluation protocol focusing on restoration quality. The results and rankings of all participating teams are summarized in Tab.~\ref{tab:main_results}.
\noindent\textbf{Overall Performance.}
The WHU-VIP team achieves the best performance with a PSNR of 35.96 dB and SSIM of 0.9236, followed by XJRes and FengFans.
The top-5 teams exhibit highly competitive results, with marginal differences within 0.15 dB, indicating that the leading approaches have converged to a similar level of reconstruction accuracy.
The SSIM values are consistently high, suggesting structural fidelity is well preserved.
Moreover, the total score follows a similar trend with PSNR, confirming restoration quality dominates the ranking criterion.
Further details on the evaluation protocol are provided in Sec.~\ref{sec:track}.
The team order in Sec.~\ref{sec:teams} follows the same orders as presented in Tab.~\ref{tab:main_results}, where the top teams and their method are highlighted.
Due to space limitations, the remaining teams are included in the supplementary material.
\subsection{Architectures and main ideas}
Throughout the challenge, participants proposed a variety of techniques tailored to the characteristics of infrared imagery. Here, we summarize several key design paradigms observed in the top-performing methods.
\begin{enumerate}
\item \textbf{Transformer-based architectures for capturing global thermal structures.}
Transformer-based models remain dominant due to strong capability in modeling long-range dependencies.
In the context of infrared SR, these architectures are particularly effective for capturing global thermal distributions and structural patterns.
Many teams adopted pre-trained Transformer backbones such as HAT~\cite{chen2023activating}, SwinIR~\cite{liang2021swinir} and fine-tuned them to better adapt to the characteristics of infrared images.
\vspace{2.mm}
\item \textbf{State-space models (Mamba) for efficient long-range dependency modeling.}
To further enhance global context modeling with reduced computational overhead, several teams explored Mamba-based architectures.
These models are well-suited for infrared SR, where spatial correlations tend to be smoother and more globally distributed.
By integrating Mamba modules into Transformer frameworks, participants improved the modeling of large-scale thermal structures and achieved better reconstruction consistency.
\vspace{2.mm}
\item \textbf{Hybrid architectures and model fusion for balancing structure and detail.}
Given the inherent trade-off between structural fidelity and detail enhancement in infrared images, many teams employed hybrid architectures combining Transformers and CNNs.
Transformer branches focus on global structure recovery, while CNN branches emphasize local detail refinement and noise suppression.
Ensemble and fusion strategies further improved overall reconstruction performance.
\vspace{2.mm}
\item \textbf{Frequency-aware learning for enhancing weak high-frequency signals.}
Unlike visible images, infrared images often lack strong high-frequency components.
To address this, participants incorporated frequency-domain supervision to explicitly enhance subtle structural details and edges.
These techniques help mitigate over-smoothing and improve perceptual sharpness without introducing artifacts.
\vspace{2.mm}
\item \textbf{Progressive and curriculum-based training strategies.}
Multi-stage training strategies were widely adopted to stabilize optimization and improve performance.
Typically, models are first trained on smaller patches or easier settings and then progressively refined using more challenging data distributions.
This approach is particularly beneficial for infrared SR, where data diversity is limited and model generalization is critical.
\end{enumerate}
% \vspace{-1mm}
\subsection{Participants}
% \vspace{-0.5mm}
This year, the image SR challenge attracted 115 registered participants, with 13 teams submitting valid entries. These submissions have set a new benchmark for the state-of-the-art in infrared image super-resolution ($\times$4).
% \vspace{-1mm}
\subsection{Fairness}
% \vspace{-0.5mm}
To ensure a fair and reliable comparison across all participating methods, the following rules are enforced throughout the challenge.
\textbf{(1)} The use of ground-truth high-resolution (HR) images from the validation and test sets for training is strictly prohibited. Only the provided training data can be used for supervised learning, while the test HR images remain confidential.
\textbf{(2)} Participants are allowed to utilize additional external datasets for training, provided that no overlap exists with the InfraredSR validation and test sets. Any form of data leakage from the test set is strictly forbidden.
\textbf{(3)} All evaluation metrics are computed on the single-channel infrared images using the official evaluation protocol. Participants must ensure that their methods follow the same preprocessing and evaluation settings.
\textbf{(4)} Final rankings are determined based on the official results computed by the organizers on the hidden test set. Submitted codes are used for reproducibility verification.
\subsection{Conclusions}
The insights gained from analyzing the results of the NTIRE 2026 Infrared Image Super-Resolution Challenge are summarized as follows:
\begin{enumerate}
\item \textbf{Hybrid architectures effectively balance global structure and local detail reconstruction.}
The combination of Transformer-based models and CNNs remains a dominant design paradigm.
Transformers capture global thermal structures and long-range dependencies, while CNNs enhance local detail refinement and suppress noise, leading to consistently strong restoration performance on infrared images.
\item \textbf{Efficient long-range modeling is critical for infrared imagery.}
State-space models such as Mamba have shown promising capability in modeling smooth and globally distributed spatial correlations.
These approaches provide a computationally efficient alternative to self-attention, particularly suitable for infrared data with limited high-frequency content.
\item \textbf{Training strategies play a key role in improving robustness and generalization.}
Multi-stage and curriculum-based training schemes, such as progressive patch size adjustment, are widely adopted to stabilize optimization.
These strategies are especially beneficial for infrared SR, where data diversity is limited and overfitting can easily occur.
\item \textbf{Structure-aware and frequency-aware learning improves detail reconstruction.}
Given the inherently weak high-frequency signals in infrared images, incorporating frequency-domain supervision and structure-aware objectives helps enhance edge sharpness and mitigate over-smoothing effects.
\end{enumerate}
\section*{Acknowledgments}
% other acknowledgments and the following:
This work was partially supported by the Humboldt Foundation. We thank the NTIRE 2026 sponsors: OPPO, Kuaishou, and the University of Wurzburg (Computer Vision Lab).
\section{Challenge Methods and Teams}
\label{sec:teams}
% Team 11
\subsection{WHU-VIP}
\begin{figure*}[htb]
\centering
\includegraphics[width=\textwidth]{figures/team11-QAHAT.pdf}
\caption{Architecture of the proposed Quality-Aware Hybrid Attention Transformer (QAHAT).}
\label{fig:team11}
\end{figure*}
\noindent\textbf{Description.}
Their approach is built upon the Hybrid Attention Transformer (HAT) \cite{chen2023activating}. In the challenge dataset, the low-resolution (LR) images are generated from high-resolution (HR) images using hand-crafted interpolation. However, the HR images themselves exhibit significant quality variations. Specifically, some HR images correspond to true high-resolution satellite observations, while others originate from lower-resolution sources or contain noticeable degradations such as sensor noise or JPEG compression artifacts. As a result, the HR supervision is heterogeneous, and treating all training samples equally may introduce inconsistent learning signals.
To address this issue, they propose a Quality-Aware HAT (QAHAT) that explicitly models the quality variations of HR images which is shown in \cref{fig:team11}. Their framework introduces two complementary components: a Global Quality Branch and a Local Quality Branch. The global branch estimates the overall degradation characteristics of the input, while the local branch captures spatially varying artifacts. By incorporating both global and local quality cues, the proposed method enables the backbone network to adapt its feature processing to different degradation conditions.
They introduce a lightweight Quality Estimation Module (QEM) to estimate the overall degradation of the input image. The QEM consists of several strided convolutional layers followed by global pooling and fully connected layers, producing a compact quality descriptor that summarizes the degradation characteristics of the input image. The estimated quality vector is injected into the backbone through multiple Source Quality Adapters (SQA) inserted in the deep feature extraction stages of HAT. Each SQA modulates intermediate feature maps using channel-wise scaling and bias parameters derived from the quality representation, allowing the network to dynamically adjust feature responses according to the predicted degradation level.
In addition to global quality variations, infrared remote sensing images may contain spatially localized artifacts. To model these local degradations, they introduce an Local Quality-Aware Module (LQAM). The LQAM extracts artifact-aware features using a downsampling pathway that provides a larger receptive field for capturing contextual degradation patterns. The resulting artifact representation is fused with the backbone features to guide the reconstruction process in regions affected by degradations. Similar to the global branch, the fused features are integrated into the HAT backbone through a residual connection to ensure stable training.
By jointly modeling global degradation characteristics and local artifact patterns, the proposed QAHAT improves the robustness of the process and produces more reliable reconstructions for infrared remote sensing images.
\noindent\textbf{Implementation Details.}
{\textit{Datasets.}}In addition to the training data provided by the challenge, they incorporate the publicly available thermal infrared remote sensing dataset SatVideoIRSDT \cite{li2025probing} as supplementary training data. Since SatVideoIRSDT is a video dataset, they randomly sample one frame from each video sequence to construct an auxiliary thermal infrared image dataset. The sampled frames are then combined with the official competition training data to form the final training set.
{\textit{Trainning strategy.}} The proposed model is trained on image patches of size $256 \times 256$. They adopt the Adam optimizer with an initial learning rate of $5\times10^{-5}$ and momentum parameters $\beta_1 = 0.9$ and $\beta_2 = 0.99$. The learning rate is updated using a MultiStepLR scheduler, where the learning rate is reduced by a factor of 0.5 at 20k and 40k iterations. The model is trained for 200k iterations in total. An exponential moving average (EMA) with a decay factor of 0.999 is maintained to stabilize the training process. Following the evaluation protocol of the challenge, the training objective is designed to align with the official metric. The loss function is defined as $\mathcal{L} = -\text{PSNR}(I_{\text{sr}}, I_{\text{gt}}) - 20 \cdot \text{SSIM}(I_{\text{sr}}, I_{\text{gt}})$. The backbone network is initialized using pretrained weights of the HAT-L model, while the newly introduced modules are randomly initialized and jointly optimized during training.
% Team 3
\subsection{XJRes}
\noindent\textbf{Description.}
The proposed method combines two complementary super-resolution models, namely the Progressive Focused Transformer (PFT \cite{Long_2025_CVPR}) and the Hybrid Attention Transformer (HAT \cite{chen2023activating}). Given a low-resolution input image $I_{LR}$, the image is processed by four parallel branches. The first two branches adopt the PFT \cite{Long_2025_CVPR} architecture, while the last two branches employ the HAT \cite{chen2023activating} architecture to generate super-resolved results. The outputs from these four branches are then fused through a weighted averaging strategy to obtain the final high-resolution image. This design enables the framework to simultaneously exploit the progressive attention focusing capability of PFT \cite{Long_2025_CVPR} and the hybrid attention representation ability of HAT \cite{chen2023activating}, thereby enhancing the reconstruction performance.
The first two branches adopt the Progressive Focused Transformer (PFT \cite{Long_2025_CVPR}) architecture for image super-resolution. Note that these two PFT \cite{Long_2025_CVPR} branches share the same network architecture but are trained independently with different objective functions to capture complementary features. As illustrated in Fig.~\ref{fig:PFT}, the network progressively extracts image features and then reconstructs the high-resolution output.
\begin{figure*}[ht]
\centering
\includegraphics[width=.7\textwidth]{figures/team03-PFT.png}
\caption{Overall architecture of the Progressive Focused Transformer (PFT).}
\label{fig:PFT}
\end{figure*}
\begin{itemize}
\item \textbf{Feature Encoding:}
Given the low-resolution input image $I_{LR}$, a convolutional layer is first applied to transform the input into a high-dimensional feature representation $F_{0}$. This stage extracts basic structural and texture information for subsequent feature learning.
\item \textbf{Progressive Attention Representation Learning:}
The core of this branch consists of multiple Progressive Focused Attention (PFA) blocks. Each block contains several Progressive Focused Attention Layers (PFAL), where attention maps are propagated across layers to progressively refine the focus on important tokens. Through attention inheritance and sparse selection, the PFA mechanism enhances highly relevant features while suppressing irrelevant tokens, enabling efficient feature aggregation.
\item \textbf{Image Reconstruction:}
After deep feature extraction, the refined features are passed through convolutional layers and an upsampling module to generate a super-resolved image $I_{SR}^{PFT}$.
\end{itemize}
The remaining two branches are based on the Hybrid Attention Transformer (HAT \cite{chen2023activating}). Similarly, these two HAT branches share the same network architecture but are trained independently with different objective functions. The model integrates both channel attention and window-based self-attention to improve feature representation.
\begin{itemize}
\item \textbf{Shallow Feature Extraction:}
The input image $I_{LR}$ is first processed by a $3\times3$ convolutional layer to obtain shallow features $F_{0}$, mapping the image into a higher-dimensional feature space.
\item \textbf{Deep Feature Extraction:}
This stage contains several Residual Hybrid Attention Groups (RHAG), each consisting of multiple Hybrid Attention Blocks (HAB) and an Overlapping Cross-Attention Block (OCAB). The HAB combines window-based self-attention and channel attention to capture both local textures and global dependencies, while the OCAB enhances cross-window interactions for more effective feature aggregation.
\item \textbf{Image Reconstruction:}
Finally, a convolution layer followed by a pixel-shuffle \cite{shi2016real} operation upsamples the deep features to produce the super-resolved output $I_{SR}^{HAT}$.
\end{itemize}
After obtaining the outputs from the four branches, the final super-resolved image is generated by a weighted fusion strategy combined with a self-ensemble technique during inference, which aggregates predictions from geometrically transformed inputs~\cite{timofte2016seven}. Let $I_{SR}^{(i)}$ denote the super-resolved output of the $i$-th branch. The final result is computed as the weighted average of the four outputs:
\begin{equation}
I_{SR} = 0.25\, I_{SR}^{(1)} + 0.25\, I_{SR}^{(2)} + 0.25\, I_{SR}^{(3)} + 0.25\, I_{SR}^{(4)}.
\end{equation}
where the first two branches correspond to the PFT model and the remaining two branches correspond to the HAT model. Since all weights are equal, the fusion operation is equivalent to averaging the outputs of the four branches.
\noindent\textbf{Implementation Details.}
\begin{itemize}[leftmargin=*,noitemsep]
\item \textbf{Data:} 1,019 official HR/LR pairs, no extra data
\item \textbf{Loss:} PFT branches: RBSFormer \cite{li2024rbsformer} \& $L_1$; HAT branches: RBSFormer \cite{li2024rbsformer} \& CharbonnierL1 + SSIM
\item \textbf{Training:} lr=$2 \times 10^{-4}$ (Cosine Annealing), 200ep, bs=1, FP32
\item \textbf{Optim:} Adam \cite{kingma2014adam}
\item \textbf{HW:} RTX 4090 GPUs (PyTorch)
\end{itemize}
% Team 10
\subsection{FengFans}
\noindent\textbf{Description.}
Their solution for the NTIRE 2026 Remote Sensing Infrared Image Super-Resolution ($\times$4) challenge is based on a \emph{weighted ensemble} of two HAT-L (Hybrid Attention Transformer -- Large)~\cite{chen2023activating} models combined with 8-fold geometric Test-Time Augmentation~(TTA)~\cite{timofte2016seven}. Although both models share the identical HAT-L architecture (40.8\,M parameters each), they are trained with complementary optimization strategies: one emphasizes \emph{structural fidelity} via an SSIM-aware loss, while the other targets \emph{pixel-level accuracy} with a pure L1 loss and substantially longer training. The resulting predictions are diverse enough that their weighted average consistently outperforms either individual model. Figure~\ref{fig:pipeline} depicts the full inference pipeline.
%--- Pipeline figure (full width) ---
\begin{figure*}[t]
\centering
\begin{tikzpicture}[
node distance=0.55cm and 0.7cm,
block/.style={rectangle, draw, rounded corners=3pt,
minimum height=1cm, minimum width=2cm,
align=center, font=\small},
modelblock/.style={block, fill=blue!10, line width=0.6pt},
ttablock/.style={block, fill=orange!12, line width=0.6pt},
ioblock/.style={block, fill=green!10, line width=0.6pt},
ensblock/.style={block, fill=red!10, line width=0.6pt},
arrow/.style={-{Stealth[length=2.5mm]}, thick, color=gray!70},
label/.style={font=\scriptsize\itshape, text=blue!60},
]
% --- Nodes ---
\node[ioblock] (lr) {LR Image\\[-1pt]{\scriptsize$H{\times}W{\times}3$}};
\node[ttablock, right=1cm of lr] (tta) {8-fold\\[-1pt]Geometric\\[-1pt]TTA};
\node[modelblock, above right=0.6cm and 1.2cm of tta] (m1) {\textbf{HAT-L}\\[-1pt]Model\,1 (S1)\\[-1pt]{\scriptsize 40.8\,M}};
\node[modelblock, below right=0.6cm and 1.2cm of tta] (m2) {\textbf{HAT-L}\\[-1pt]Model\,2 (BSR)\\[-1pt]{\scriptsize 40.8\,M}};
\node[ttablock, right=1cm of m1] (inv1) {Inverse\\[-1pt]TTA \& Avg};
\node[ttablock, right=1cm of m2] (inv2) {Inverse\\[-1pt]TTA \& Avg};
\node[ensblock, right=0.8cm of $(inv1)!0.5!(inv2)$] (ens) {\textbf{Weighted}\\[-1pt]\textbf{Ensemble}\\[-1pt]{\scriptsize$0.45{:}0.55$}};
\node[ioblock, right=1cm of ens] (sr) {SR Image\\[-1pt]{\scriptsize$4H{\times}4W{\times}3$}};
% --- Arrows ---
\draw[arrow] (lr) -- (tta);
\draw[arrow] (tta) |- (m1);
\draw[arrow] (tta) |- (m2);
\draw[arrow] (m1) -- (inv1);
\draw[arrow] (m2) -- (inv2);
\draw[arrow] (inv1) -| (ens);
\draw[arrow] (inv2) -| (ens);
\draw[arrow] (ens) -- (sr);
% --- Training-strategy labels ---
\node[label, above=0.08cm of m1] {L1\,+\,SSIM\,loss,\; lr\,=\,$2{\times}10^{-5}$,\; 30K\,iter};
\node[label, below=0.08cm of m2] {L1\,loss,\; lr\,=\,$2{\times}10^{-4}$,\; 100K\,iter,\; basicsr};
\end{tikzpicture}
\caption{\textbf{Inference pipeline of their solution.} A low-resolution infrared image is augmented with 8 geometric transforms (4~rotations\,$\times$\,2~flips). Each augmented copy is independently super-resolved by two HAT-L models trained with different strategies. The per-model outputs are inverse-transformed and averaged, then the two model predictions are fused with learned weights (0.45\,:\,0.55) to produce the final $\times$4 SR output.}
\label{fig:pipeline}
\end{figure*}
They adopt HAT-L~\cite{chen2025hat}, a state-of-the-art hybrid attention transformer for image super-resolution. HAT augments standard window-based self-attention with two complementary mechanisms:
\begin{enumerate}[leftmargin=*,nosep]
\item \textbf{Overlapping cross-attention (OCA):} adjacent windows share key--value regions with a configurable overlap ratio, enabling information exchange across window boundaries without the quadratic cost of global attention.
\item \textbf{Channel attention block (CAB):} a squeeze-and-excitation style module integrated within each transformer block recalibrates channel-wise feature responses, improving representational capacity.
\end{enumerate}
\noindent The ``Large'' variant stacks 12 Residual Hybrid Attention Groups (RHAGs), each containing 6 Hybrid Attention Blocks (HABs). Table~\ref{tab:arch} lists the full configuration.
\begin{table}[t]
\centering
\small
\caption{HAT-L network configuration.}
\label{tab:arch}
\setlength{\tabcolsep}{4pt}
\begin{tabular}{@{}lc@{}}
\toprule
\textbf{Hyperparameter} & \textbf{Value} \\
\midrule
Input / output channels & 3 \\
Embedding dimension & 180 \\
\# Residual Groups (RHAG) & 12 \\
\# HABs per RHAG & 6 \\
\# Attention heads & 6 \\
Window size & $16{\times}16$ \\
Overlap ratio (OCA) & 0.5 \\
MLP expansion ratio & 2 \\
Channel compress ratio & 3 \\
Squeeze factor (CAB) & 30 \\
Conv scale & 0.01 \\
Upsampler & PixelShuffle ($\times$4) \\
Image value range & $[0,\,1]$ \\
\midrule
\# Parameters & 40.8\,M \\
\bottomrule
\end{tabular}
\end{table}
Although the competition images are single-channel infrared data, they represent them as 3-channel RGB by replicating the gray channel. This allows us to directly leverage pretrained HAT-L weights without any architectural modification. The official evaluation converts both the SR output and the ground truth to a single luminance channel via $Y = 0.299R + 0.587G + 0.114B$ before computing PSNR and SSIM.
Pretraining: Both models are initialized from the official HAT-L checkpoint that was first pretrained on ImageNet for image classification and then trained for $\times$4 super-resolution on the DF2K dataset (DIV2K\,+\,Flickr2K, $\approx$3{,}450 high-resolution images). This two-stage pretraining endows the backbone with strong low-level feature representations for natural images.
They fine-tune on the competition's 1{,}019 paired HR--LR infrared training images. Two models are trained with \emph{deliberately different} hyperparameters to maximize ensemble diversity. Table~\ref{tab:training} compares the two configurations.
\begin{table}[t]
\centering
\small
\caption{Training configurations of the two models.}
\label{tab:training}
\setlength{\tabcolsep}{3pt}
\begin{tabular}{@{}lcc@{}}
\toprule
& \textbf{Model\,1 (S1)} & \textbf{Model\,2 (BSR)} \\
\midrule
Loss & L1 + 0.5\,$\mathcal{L}_{\text{SSIM}}$ & L1 \\
Optimizer & AdamW & Adam \\
Initial LR & $2{\times}10^{-5}$ & $2{\times}10^{-4}$ \\
LR schedule & Cosine & MultiStep \\
& & {\scriptsize(50/80/90/95K)} \\
Warmup & 1{,}000 iter & None \\
Total iterations & 30{,}000 & 100{,}000 \\
Patch size & $256{\times}256$ & $256{\times}256$ \\
Batch size & 4 & 4 \\
EMA decay & 0.999 & 0.999 \\
Weight decay & 0 & 0 \\
Gradient clip & 1.0 & -- \\
Random seed & 42 & 42 \\
Framework & Custom & basicsr \\
\bottomrule
\end{tabular}
\end{table}
The competition scoring formula $\text{Score} = \text{PSNR} + 20 \times \text{SSIM}$ amplifies SSIM by a factor of 20 relative to PSNR. Concretely, an SSIM improvement of 0.01 contributes the same as a 0.2\,dB PSNR gain. They therefore incorporate a differentiable SSIM loss term ($\mathcal{L}_{\text{SSIM}} = 1 - \text{SSIM}$) alongside L1 to encourage the model to preserve structural patterns---particularly important for infrared imagery where thermal edge boundaries and fine textures carry critical information. The low learning rate ($2{\times}10^{-5}$) with cosine annealing prevents catastrophic forgetting of the pretrained features.
A 10$\times$ higher initial learning rate ($2{\times}10^{-4}$) combined with a stepwise decay schedule enables more aggressive adaptation to the infrared domain. The substantially longer training (100K iterations, \emph{vs.}\ 30K for S1) allows the model to thoroughly learn infrared-specific data statistics. Using pure L1 loss produces different gradient dynamics than the SSIM-augmented loss, yielding a model with complementary error patterns that benefits the ensemble.
Data Augmentation: Both models share the same augmentation pipeline:
\begin{itemize}[leftmargin=*,nosep]
\item Random horizontal flip ($p = 0.5$)
\item Random vertical flip ($p = 0.5$)
\item Random rotation from $\{90^{\circ}, 180^{\circ}, 270^{\circ}\}$
\end{itemize}
They intentionally omit color-space augmentations (jitter, channel shuffle) and advanced mixing strategies (MixUp, CutMix), because the single-channel infrared images have fundamentally different intensity statistics from natural RGB photographs.
Test-Time Augmentation (TTA)~\cite{timofte2016seven}: For each input LR image, they apply all 8 geometric transforms from the dihedral group $D_4$ (4 rotations $\times$ 2 flips). Each transformed copy is super-resolved, inverse-transformed back to the original orientation, and the 8 outputs are averaged:
\begin{equation}
\hat{I}_{m} = \frac{1}{8}\sum_{k=1}^{8} T_k^{-1}\!\bigl(f_m\!\bigl(T_k(I_{\text{LR}})\bigr)\bigr),
\end{equation}
where $f_m$ is model $m$ and $T_k$ is the $k$-th transform. TTA is their single largest source of test-time improvement (+2.54 points on the test set).
Weighted Model Ensemble: The final SR output fuses the two per-model predictions with optimized weights:
\begin{equation}
\hat{I}_{\text{SR}} = \alpha\,\hat{I}_{1} + (1-\alpha)\,\hat{I}_{2},\quad \alpha = 0.45.
\end{equation}
The weight $\alpha$ was selected through a systematic grid search over $[0.30, 0.60]$, evaluating each configuration on the test leaderboard. Table~\ref{tab:weights} reports the sensitivity.
\begin{table}[t]
\centering
\small
\caption{Ensemble weight sensitivity ($\alpha$ = S1 weight). Score~=~PSNR + 20\,$\times$\,SSIM on the test set.}
\label{tab:weights}
\setlength{\tabcolsep}{5pt}
\begin{tabular}{@{}cccc@{}}
\toprule
$\alpha$ (S1) & PSNR & SSIM & Score \\
\midrule
0.40 & 35.82 & 0.9205 & 54.228 \\
0.42 & 35.81 & 0.9207 & 54.228 \\
0.43 & 35.81 & 0.9207 & 54.228 \\
\textbf{0.45} & \textbf{35.81} & \textbf{0.9207} & \textbf{54.229} \\
0.50 & 35.81 & 0.9208 & 54.222 \\
0.55 & 35.80 & 0.9211 & 54.219 \\
0.60 & 35.78 & 0.9213 & 54.208 \\
\bottomrule
\end{tabular}
\end{table}
\noindent The optimal weight slightly favors BSR100K ($1-\alpha = 0.55$), consistent with its stronger pixel-level accuracy from longer training. Notably, the score is robust within $\alpha \in [0.40, 0.50]$, varying by only 0.007 across this range.
\noindent\textbf{Implementation Details.}
\begin{itemize}[leftmargin=*,nosep]
\item \textbf{No mixed precision:} They discovered that HAT-L produces NaN outputs when using fp16 autocast (likely due to overflow in the attention softmax with 16$\times$16 windows). All training and inference therefore use fp32.
\item \textbf{Reflect padding:} Input images are padded to the nearest multiple of the window size (16) using reflection padding before inference, then the output is cropped to the exact target resolution ($4H \times 4W$).
\item \textbf{No tiling:} All test images have LR dimensions $\leq 320 \times 256$, which comfortably fit in GPU memory without tile-based processing.
\end{itemize}
\vspace{-2.mm}
\section{Methods of the Remaining Teams}
\vspace{-2.mm}
All the teams presented innovative ideas and thorough experiments for the competition. However, due to space limitations, a more in-depth discussion can be found in Sec.~A of the supplementary materials, which contains detailed descriptions of the methods and implementation details for the remaining teams that participated in the challenge. While these teams have not been discussed in the main report, their approaches are still highlighted, offering insight into their unique strategies and technical implementations.
\section*{Acknowledgments}
% other acknowledgments and the following:
This work is supported by the National Natural Science Foundation of China (62501386, 625B2116, 625B1025), CCF-Tencent Rhino-Bird Open Research Fund.
This work is also sponsored by Al Hundred Schools Program and is carried out using the Ascend AI technology stack.
This work was partially supported by the Humboldt Foundation. We thank the NTIRE 2026 sponsors: OPPO, Kuaishou, and the University of Wurzburg (Computer Vision Lab).
%%%%%%%%% REFERENCES
{\small
\bibliographystyle{ieeenat_fullname}
\bibliography{main}
}
\end{document}
%
% --- inline annotations
%
\newcommand{\red}[1]{{\color{red}#1}}
\newcommand{\todo}[1]{{\color{red}#1}}
\newcommand{\TODO}[1]{\textbf{\color{red}[TODO: #1]}}
% --- disable by uncommenting
% \renewcommand{\TODO}[1]{}
% \renewcommand{\todo}[1]{#1}
\usepackage{adjustbox}
\usepackage{multirow}
\usepackage{tabularx}
\usepackage{makecell}
\usepackage[accsupp]{axessibility} % Improves PDF readability for those with disabilities.