Deep multi-frame face super-resolution

Extracted source text · arXiv 1709.03196

% \documentclass[10pt,twocolumn,letterpaper]{article}
% \usepackage[utf8]{inputenc}
% \bibliographystyle{plain}
% \usepackage[english]{babel}
 
% \usepackage{biblatex}
% \addbibresource{refs.bib}
% \usepackage{biblatex}
% \usepackage{times}
% \usepackage{epsfig}
% \usepackage{graphicx}
% \usepackage{amsmath}
% \usepackage{amssymb}

% \usepackage{placeins}
% \usepackage{ulem}


% \usepackage[utf8]{inputenc} % allow utf-8 input
% \usepackage[T1]{fontenc}    % use 8-bit T1 fonts
% \usepackage{hyperref}       % hyperlinks
% \usepackage{url}            % simple URL typesetting
% \usepackage{placeins}
% \usepackage{booktabs}       % professional-quality tables
% \usepackage{amsfonts}       % blackboard math symbols
% \usepackage{nicefrac}       % compact symbols for 1/2, etc.
% \usepackage{microtype}      % microtypography
% \usepackage{graphicx}
% \usepackage{wrapfig,lipsum,booktabs}
% \usepackage[font=footnotesize,labelfont=bf]{caption}
% \usepackage[font=footnotesize,labelfont=bf]{subcaption}
% \usepackage{hyperref}
% \usepackage{amsmath}
% \usepackage{mathtools,xparse}
% \usepackage{authblk}
% \usepackage{float}
% \floatstyle{plaintop}
% \restylefloat{table}
% \usepackage{wrapfig}


\documentclass[10pt,twocolumn,letterpaper]{article}


%\usepackage{times}
\usepackage{epsfig}
\usepackage{graphicx}
\usepackage{amsmath}
\usepackage{amssymb}
\usepackage{placeins}
\usepackage{wrapfig}
\usepackage[normalem]{ulem}
\usepackage{biblatex}



% \newcommand{\fig}[1]{Figure~\ref{fig:#1}}
% \newcommand{\sect}[1]{Section~\ref{sect:#1}}
% \newcommand{\tab}[1]{Table~\ref{tab:#1}}
% \newcommand{\alg}[1]{Algorithm~\ref{alg:#1}}
% \newcommand{\eq}[1]{(\ref{eq:#1})}
\addbibresource{refs.bib}

\title{Deep multi-frame face super-resolution}
\author{Evgeniya Ustinova, Victor Lempitsky}

\begin{document}

\maketitle


\begin{abstract}
Face verification and recognition problems have seen rapid progress in recent years, however recognition from small size images remains a challenging task that is inherently intertwined with the task of face super-resolution. Tackling this problem using multiple frames is an attractive idea, yet requires solving the alignment problem that is also challenging for low-resolution faces. Here we present a holistic system for multi-frame recognition, alignment, and superresolution of faces. Our neural network architecture restores the central frame of each input sequence additionally taking into account a number of adjacent frames and making use of sub-pixel movements. We present our results using the popular dataset for video face recognition (YouTube Faces). We show a notable improvement of identification score compared to several baselines including the one based on single-image super-resolution.
\end{abstract}


\input{intro}
\input{related}
\input{method}
\input{experiments}
\input{conclusion}



\medskip
 
\printbibliography

\end{document}

\section{Introduction} Face recognition systems have seen a great progress over the last several years with super-human recognition accuracy attainable in many scenarios. However, the accuracy of recognition degrades very significantly when dealing with very low resolution faces. In such conditions, the tasks of recognition and increasing the effective resolution (\textit{super-resolution}) become intertwined and necessitate joint solution. Indeed, developing  super-resolution techniques without regard for recognition often leads to face \textit{hallucination}, i.e.\ a process that creates plausibly looking faces lacking personal specifics. On the other hand, super-resolution has been known to benefit from recognition for a long time \cite{baker2002limits}.

\begin{figure}[t]
%\begin{wrapfigure}{i}{0.5\textwidth}
\includegraphics[width=\columnwidth]{images/ytube/teaser.png}
\caption{Results of different super-resolution convolutional networks on samples from the Youtube Faces (YTF) dataset. From left to right: ground truth, bicubic upsampling,  single-frame superresolution, super-resolution from 25 frames without alignment (ours), super-resolution from 25 frames with warping subnetwork (ours).}
\label{fig:teaser}
%\vspace{10pt}
\end{figure}



While single-image super-resolution has recently drawn considerable attention \cite{ZhuLLT16, TuzelTH16}, super-resolution over large magnification factors can benefit significantly from information accumulated over multiple images, e.g.\ using adjacent frames in a surveillance stream or a video. Traditionally, multi-frame super-resolution has required rigid or non-rigid alignment with sub-pixel accuracy \cite{capel2003computer}. 
At the same time, faces have complex and deformable shapes leading to complex two-dimensional motion patterns which makes motion estimation hard to accomplish at sub-pixel precision. Generally, such precise alignment cannot be accomplished using low-level cues alone, and therefore requires high-level understanding/recognition of face geometry.



Motivated by all these observations, we present a system that performs multi-frame super-resolution by tackling all three inter-related problems, namely super-resolution, non-rigid alignment, and recognition, jointly and simultaneously. The tasks are implemented as modules of a deep neural network architecture that is trained in an end-to-end fashion on a dataset of realistic face videos \cite{WolfHM11}. The forward pass in our network involves pairwise alignment of pairs of frames performed in parallel with feature extraction, while the super-resolution is accomplished by a subsequent reconstruction module that takes warped features of the multiple frames into account. The learning process is driven by a combination of loss functions that includes the recognition-related loss ensuring that the super-resolution process reconstructs person-specific traits. 




%Here, we propose and evaluate a deep system that embraces all the aforementioned features: super-resolution, caring for recognition, multiple frames usage, motion recovering and avoiding hallucination. The system is trained end-to-end. \emph{Face Warping} sub-network is responsible for predicting the motion compensation transformation to align pairs of frames in a video-sequence to match one reference frame. The predicted transforms are applied to deep features of the frames in the input sequence, computed with \emph{Frame Feature extractors}. \emph{Combining} sub-network accepts all the transformed frames features and reconstructs the central frame in the sequence. 
Overall, while individual components of our system have been proposed in previous works, to the best of our knowledge, our work is the first that builds a systems that combines face super-resolution, recognition and alignment in a holistic manner. 
We evaluate the proposed architecture on the hold-out part of the YouTube Faces (YTF) dataset (\cite{WolfHM11}). We demonstrate good face verification  performance for the restored images using standard protocols adopted for the YTF dataset. We also show benefits of using multiple frames along with \emph{Face Warping} sub-network over the single-image approach. 
 We additionally compare our approach with  state-of-the-art face hallucination method \cite{ZhuLLT16} and find our method to perform better on the YouTube Faces dataset.

In the remainder of this work, we review the most related approaches in \ref{sec:related} describe the components of the proposed system in \ref{sec:video} and \ref{sec:loss} demonstrate the super-resolution results in \ref{sec:exps} and conclude with a short summary in \ref{sec:summary}. 

\section{Related work}
\label{sec:related}

\subsection{Face super-resolution approaches}

Initially, super-resolution problem has been formulated for low-resolution image sequence that can be used to produced one image of higher resolution. Under this approach, reconstruction constraints are used to make sure that resulting high-resolution image is consistent with the input sequence. 
Maximum a posteriori (MAP) framework has been used in \cite{HardieBA97, SchultzS96, baker2002limits} to take into account such reconstruction constraints along with priors on the high-resolution image.

Precise image registration has been shown to be very important for multi-image \cite{HardieBA97, IraniP91, SchultzS96} and super-resolution methods but is rarely achievable for real  low-resolution data, especially for images depicting non-rigid objects such as faces. In the case of multi-image super-resolution, approximate low-parametric registration could be used instead. For single-image super-resolution, such registration with canonical pose can also be used in order to use stronger face-specific priors \cite{LiuSF07}.


Having assumed ideal image registration, Baker \emph{et al.} \cite{baker2002limits} demonstrate the effect of introducing additional recognition-based prior. The authors include it into the task formulation as additional constraints based on particular examples from  training set chosen by similarity to the regions of the input image.  Later, more advanced techniques for modeling such face-specific constraints were introduced in \cite{LiuSF07} for single-image face super-resolution. The authors decomposed such constraints to \emph{global} and \emph{local} constraints. A similar idea was also adopted in \cite{TuzelTH16} to build a ConvNet architecture for single-image face super-resolution.


%TODO : maybe elaborate on this.
%correspondence between low res and high-res patches 
%dictionary learning: faces \cite{YangWLCH12, TianT16}, direct patch correspondence :  \cite{MaZQ10}, methods are also very dependent on alignment, general and CNN :  \cite{DongLHT16} 

\subsection{Deep learning for face super-resolution}

Several recent deep learning approached \cite{TuzelTH16,ZhuLLT16} focus on single-image face super-resolution problem.
Tuzel \emph{et al.} \cite{TuzelTH16} suggested the end-to-end learning scheme to obtain high quality results even in the case of 8x downsampling. The architecture includes two parts corresponding to global and local modeling of the face features. In the \emph{global} network, the fully-connected layers are used to capture the global face structure, while the \emph{local} part consists of convolution layers that are used to model local face features. Additionally, authors apply adversarial learning to achieve more realistic results. 
Below, we use the \textit{Perceptual loss} for the similar goal.

Zhu \emph{et al.}~\cite{ZhuLLT16}  proposed a cascaded scheme that includes iterative high-resolution image refinement and pose estimation from these refined images. This approach is motivated by the fact that face super-resolution and face pose estimation tasks are related, and it is easier to increase image resolution knowing the pose of the face and vice versa. Special gated architecture is introduced to effectively combine high-frequency and low-frequency information and make use of face pose estimated at previous scale levels.
All the aforementioned methods only consider single-frame face super-resolution/restoration. To the best of our knowledge, none of the recent works on deep face super-resolution consider multi-frame scenario.


\subsection{Restoration and recognition}
%\cite{Hennings-YeomansBK08, ZhangYZNH11}
%The idea of combining the two tasks of face image restoration and face recognition has been investigated in several works


Initially, recognition was incorporated into face super-resolution in the form of face-specific priors \cite{baker2002limits, LiuSF07}. Several works considered an explicit combination of face recognition and face restoration tasks: \cite{Hennings-YeomansBK08, ZhangYZNH11}.
The proposed approaches perform recognition using a limited number of gallery images. In parallel, they reconstruct the input image and classify it based on labels of the most relevant examples found in the train set. Here we work in a different setting using a feed-forward deep neural network to produce the restored high-resolution image without using the gallery set at test time.

\subsection{Deep learning for video-based super-resolution}
As mentioned earlier, video data bring more useful information compared to isolated frames and can be used to enhance the restoration algorithms. Naturally, most recent deep learning approaches, which focus on video super-resolution \cite{LiaoTLMJ15, SongDQ16, TaoGLWJ17}, use motion estimation to align a number of subsequent frames to make use of sub-pixel motion and reveal more object details. Liao~\emph{et al.}~\cite{LiaoTLMJ15} use different optical flow methods to generate super-resolution "drafts". Such drafts can then be further combined into the final reconstruction using a number of convolutional layers. Kappeler~\emph{et al.}~\cite{KappelerYDK16} also experiment with different variants of video-based super-resolution architecture incorporating neighbouring frames alignment. 

%here it is interesting to check if Warping Subnet even changes during training => it would be possible to say that we benefit from end-to-end learring in this case.
Our idea is to adopt similar approach based on video-data and frame alignment for human faces. Importantly, we aim not only at enhancing image quality but also at preserving face identities and therefore improving face verification quality for the restored images.
 
   





%\begin{figure*}
%\begin{center}

%\includegraphics[width=\textwidth]{images/method/vgg_loss.pdf}

%\caption{General scheme of learning super-resolution with perceptual loss. Along with L2 loss, the \textit{Perceptual loss} \cite{JohnsonAF16} is used, that is the loss computed for high-level features extracted from pre-trained CNN. The weights of the pre-trained CNN are fixed during training. See \ref{sec:vgg_loss} for the details.}

%\label{fig:vgg_loss}

%\end{center}

%\end{figure*}



\begin{figure*}
%\begin{center}

\includegraphics[width=\textwidth]{images/method/superres_designations.pdf}

\caption{The general scheme of our video-based super-resolution convolutional network. \emph{Feature Extractor} modules (red) compute features for every frame in the input sequence, which are then warped by the \emph{Face Warping} sub-network (blue). The transformed feature maps are fed into the \emph{Reconstruction} sub-network (purple) that produces the central frame reconstruction. Spatial transformer modules \cite{JaderbergSZK15} with thin plate spline transformer are used in the \emph{Face Warping} sub-network.}

\label{fig:video}

%\end{center}

\end{figure*}

\section{Multi-frame face super-resolution}
%scheme
\label{sec:video}
Here we describe the proposed multi-frame face super-resolution convolutional neural network. Our architecture consists of three main learnable modules:
\begin{enumerate}
\item\emph{Feature Extractor} sub-network that computes features for every frame in the input sequence, \item\emph{Face Warping} sub-network that aligns input frames with the central frame,  
\item\emph{Reconstruction} sub-network that accepts warped features of input frames and perform reconstruction of the central frame in the sequence.
\end{enumerate}
The modules are combined as follows (\ref{fig:video}). \emph{Feature Extractor} outputs features for every frame in the input sequence. The feature maps are then warped by the \emph{Face Warping} sub-network. The transformed feature maps are fed into the \emph{Reconstruction} sub-network that produces the central frame reconstruction. Another option was to warp all the faces to match one standard pose, but as central frame warping may introduce additional distortions and loss of visual information, we only perform pairwise alignment between the central frame and other frames in the input sequence. 
%TODO can we actually perform warping??

In more detail, our goal is to restore the central frame $s_{0}$ of the input low-resolution sequence $s = [s_{-k}, ..., s_{0}, ..., s_{k}]$ of length $2k+1$. Here we work with RGB-images: $s_{i}\subseteq \mathbb{R}^{3\times h \times w}$, $i\subseteq [-k,..,k]$. We then start by processing each input frame $s_{i}$ with the feature extractor sub-networks $F_{i}$:
\begin{equation}
 f_{i} = F_{i}(\theta_{s_{i}}; F_{i}), 
 f_{i}\subseteq \mathbb{R}^{D\times {h}' \times {w}'}
\end{equation}
where $D$ is the number of output feature maps of size ${h}'\times{w}'$. Here all the feature extractors $F_{i}$ share parameters $\theta_{F_{i}}$, except for the feature extractor for the central frame $F_{0}$: $\theta_{F_{i}} == \theta_{F_{adj}}$, $F_{i} == F_{adj}$, where $i\subseteq [-k,..., -1, 1, ..., k]$. This is done for simplicity, and to avoid excessive memory consumption for long video-sequences.

To align all the adjacent frames $s_{i}$,  $i\subseteq [-k,..., -1, 1, ..., k]$, with the central frame $ s_{0}$, we incorporate the \emph{Face Warping} sub-network that consists of the learnable warping predictor $P(s_{0}, s_{i};\theta_{P})$ and the warping module $M(p_{i}, f_{i})$ that accepts transform parameters computed by $P$ and feature maps $F_{i}$. $M$ performs warping using differentiable sampling introduced in \cite{JaderbergSZK15}.

The warping predictor $P$ accepts frame pairs and outputs transform parameters $p_{i}$  that are used to warp each frame $s_{i}$, $i\neq0$, in the input sequence: 
\begin{equation}
    p_{i} = P(s_{0}, s_{i};\theta_{P}),
\end{equation}
where $i\subseteq [-k,..., -1, 1, ..., k]$.

Feature maps $f_{i}$ are transformed using warping parameters $p_{i}$ in differentiable manner \cite{JaderbergSZK15}: 
\begin{equation}
    f_{i}^{M}= M(p_{i}, f_{i}) = S(\mathcal{T}_{p_{i}}(G)), 
\end{equation}
where $i\subseteq[-k,..., -1, 1, ..., k]$, $\mathcal{T}$ is a predefined transform applied to the regular grid $G$ \cite{JaderbergSZK15}. Here we use Thin Plate Spline transform that is suitable for modeling non-rigid deformations inherent to face images. Therefore, $p_{i}\subseteq  \mathbb{R}^{2C\times 1 }$, where $C$ is a number of anchor points used for warping.

All the warped feature maps $f_{i}^M$ along with central frame feature map $f_{0}$ are then stacked together:
\begin{equation}
    f_{stacked}^{M} = [f_{-k}^{M}, ...,f_{0}, ..., f_{k}^{M}],
\end{equation}
 $f_{stacked}^{M} \subseteq  \mathbb{R}^{(2k+1)D\times {h}' \times {w}'}$.
 The resulting features $f_{stacked}^{M}$ are fed into \emph{Reconstruction} sub-network $R$, resulting in restored image $s_{N}^{R}$:
 \begin{equation}
 s_{0}^{R}=R(f_{stacked}^{M}; \theta_{R})
\end{equation}

The described architecture is learned in a supervised manner, using the loss function calculated for the ground truth image $s_{0}^{G}$ and the restored image $s_{0}^{R}$. The loss function is discussed in details in the section \ref{sec:loss}.



\section{Perceptual Loss for face super-resolution}

\label{sec:loss}
Perceptual losses have already been used for general super-resolution \cite{JohnsonAF16} and face frontalization \cite{cole2017face}. The idea is to compare high-level features for the ground truth image and the restored image in addition to pixel-level data. Here we use pre-trained VGG-face \cite{ParkhiVZ15} model (weights are fixed during training) to extract such features. The motivation behind such approach is that, first, less blurry results can be achieved \cite{JohnsonAF16}. Second, we use the pre-trained verification CNN for feature extraction, so there is a hope that our super-resolution neural network will be able to focus on facial features that are important for face identification. 
%The general scheme of the corresponding CNN 
%architecture (similar to \cite{JohnsonAF16}) is shown in Figure \ref{fig:vgg_loss}. 

%In general case there may be several perceptual loss terms that are added to form the final loss:
Our neural network described in the section \ref{sec:video} in learned using the following objective that includes pixel-level term along with sum of a number of feature-level terms:
\begin{equation}
\label{eq:loss}
\begin{aligned}
    L_{\theta_{F_{0}}, \theta_{F_{adj}}, \theta_{P}, \theta_{R}}(s_{-k}, ..., s_{0}, ..., s_{k}, s^{G}) = \\ \left \| s_{0}^{G} - s_{0}^{R}\right \|^{2}_{2} + \sum_{l \subseteq {layers}}  {\lambda_l \left \| s_{0,l}^{G} - s_{0,l}^{R}\right \|^{2}_{2}}
\end{aligned}
\end{equation}
where $s_{0}^{G}$ and $s_{0}^{R}$ are ground truth image and reconstruction for the frame $s_{0}$, $s_{0, l}^{G}$  and $s_{0, l}^{R}$ the features extracted by the layer $l$ of the ground truth image  $s_{0}^{G}$ and the restored image  $s_{0}^{R}$ accordingly, $\lambda_l$ is a fixed weight assigned to the corresponding loss components. Unlike \cite{cole2017face}, we use mid-level features extracted using VGG-face model as we observed that this leads to better results than using last fully connected layer of VGG-face.
\section{Experiments}

\label{sec:exps}
\subsection{Datasets}

In this work two popular face verification datasets were used. We use Labeled Faces in the Wild (LFW) to evaluate the \textit{baseline architecture}, which closely follows \cite{TuzelTH16} but is trained using \emph{Perceptual loss} (see section \ref{sec:loss} for details). Our multi-frame architecture described in section~\ref{sec:video} is evaluated using YouTube Faces dataset. The ablation study on the same dataset include evaluation of different architecture variants described in section~\ref{sec:arch}.

Labeled Faces in the Wild (LFW) \cite{KaramZ15} contains 13,233 images with 5,749 identities. The standard evaluation procedure for LFW includes similarity estimation for the given set of image pairs. All pairs are split into ten subsets non-overlapping in terms of identities. We use standard test subset $1$ to evaluate our super-resolution methods. Identities that are not included into test subset $1$ are thus used for training. To evaluate the recognition quality, we use the Equal Error Rate (EER) (i.e.\ the error rate at the ROC operating point where the false positive and false negative rates are equal). To get EER values, we first  compute descriptors for the face images using pre-trained face recognition model \cite{ParkhiVZ15}.
%TODO : how many persons in train/test

%EER does not depend on the similarity threshold that separates similarity values for 'positive' and 'negative' pairs of images. 

To evaluate our video-based super-resolution method, we use the YouTube Faces (YTF) dataset \cite{WolfHM11}. It contains 3,425 videos of 1,595
people collected from YouTube, with an average of 2 videos per identity. Similarly to LFW, EER is used to evaluate recognition quality for the YTF dataset. The only difference is that the similarity value is estimated for each pair of videos. To do this, we calculate the mean similarity for all pairs of frames of the two tracks. As this is time-consuming operation, we take only first $100$ frames in each video (the first $20$ frames were used for comparison with \cite{ZhuLLT16}). %The number of the frames used for the evaluation is less because we only take those frames that at least have $12$ neighboring subsequent frames before and after them. This is done to compare results for different variants of the video-based super-resolution method.

We also use PSNR (for luminance channel) and Euclidean distance metrics for comparing different variants of model described in \ref{sec:video}. We use $623$ images from the YTF dataset to compare PSNR and Euclidean distance between features of ground truth and reconstructed images extracted using VGG face model layers \emph{pool3}, \emph{pool4} and \emph{fc7}.

All experiments were performed by considering the downsampled versions of images from the described datasets as inputs. Unless specified otherwise, we give results are for $\times$8 magnification factor as it is a very challenging setting, which still allows to see meaningful variations between methods (much higher magnification factors result in all methods performing equally bad, and much lower magnification factors result in all methods performing equally well).

\subsection{Architectures}

\label{sec:arch}
The following architectures were used in our experiments:
\begin{enumerate}
    \item The single-image architecture from \cite{TuzelTH16} denoted \texttt{f$1$} ( \emph{8$\times$GN} and  \emph{8 layer LN} were used for \emph{Local} and \emph{Global} modules of the architecture).
    \item The multi-frame architecture similar to described in Section~\ref{sec:video} but without \emph{Face Warping} subnetwork. This architecture stacks features for all frames  without alignment and then processes the stack by the \emph{Reconstruction} subnetwork. We experiment with two variants of this architecture \texttt{f$5$} and \texttt{f$25$} that accept sequences of length $5$ and $25$ accordingly.
    \item The full multi-frame architecture described in Section~\ref{sec:video} is also implemented in two variants \texttt{f$5$warp} and \texttt{f$25$warp} that accept sequences of length $5$ and $25$ accordingly.
\end{enumerate} 
The single-image architecture \cite{TuzelTH16} is evaluated for the LFW dataset and several modes of using \emph{Perceptual} loss are compared in the section \ref{sec:perceptual}.
The proposed multi-frame architecture (section \ref{sec:video}) is evaluated on the YTF dataset.
Further details of the architectures are discussed below.



\subsection{Training the model}

The \emph{feature extractor} sub-network is implemented similar to \emph{8$\times$GN} in \emph{Global} module in \cite{TuzelTH16}. It includes two parallel streams. The first stream performs upsampling using one deconvolution layer, while the second stream consists of four fully connected layers. The first three fully connected layers have $256$ neurons, while the last one has the size $128\times128$.

The \emph{face warping} sub-network accepts pairs of images. Initially, the two images are processed separately using  two sub-networks consisting of three convolution layers with $20$ filters of sizes $3\times3$, $3\times3$ and $1\times1$ accordingly. The outputs of these two streams are concatenated and passed to the next five convolution layers with $100$ filters of size $3\times3$ each.
Then three fully connected layers with $256$ neurons are applied. The final fully connected layer then outputs shifts for coordinate pairs of $64$ control points. The warping is performed using thin plate spline with $64$ control points located in the nodes of the regular grid \cite{JaderbergSZK15}.

The \emph{reconstruction} sub-network is implemented similarly to \emph{Local} module in \cite{TuzelTH16}. It consists of eight convolution layers:
\vspace{5mm}
\begin{tabular}{c |c c c c c c c c }
\hline
  \#conv & 1& 2& 3 & 4 & 5&6  & 7 &8 \\
  \#filters & $16$ & $32$&$64$&$64$&$64$&$32$&$16$&$3$  \\
  filter size &$5$& $7$& $7$& $7$& $7$& $7$& $5$& $5$ \\
\hline
\end{tabular}

ReLU (rectified linear unit) activation functions are used for all the layers except the last convolution layer in the \emph{Reconstruction} sub-network. The latter uses the sigmoid activation.

The architecture is trained using \ref{eq:loss} and the ADAM optimizer~\cite{KingmaB14} for ~1,500 epochs with learning rate fixed to $1e-4$. Batch size is set to $10$. Pre-trained VGG-16 face model from \cite{ParkhiVZ15} is used for calculating deep features within loss \ref{eq:loss}.

The \emph{face warping} sub-network is pre-trained in unsupervised manner using pairs of images. The L2 loss for the warped and reference images is used for training.

For the LFW dataset, we used $\lambda_{pool3}$, $\lambda_{pool4}$ and $\lambda_{fc7}$ set to $10^3$ for the loss \ref{eq:loss}. For the YTF dataset, the value of $10^5$ was used because the quality of ground-truth images in YTF is much worse than for LFW and therefore pixel-level loss is less useful for the training on YTF. Increasing values of $\lambda_{pool3}$ and $\lambda_{pool4}$ also affects the color of resulting images, as deep features are more color-independent (c.f.~\ref{fig:ytube}, row $7$, where the green background became grey in the reconstruction). 





\subsection{Perceptual Loss effects}
\label{sec:perceptual}


First, we experimented with training the baseline single-image super-resolution ConvNet (the architecture from \cite{TuzelTH16}) using the Perceptual loss in addition to the pixel-level loss. Here we show some of the results that demonstrate the effect of using deep features extracted from different layers of the pre-trained VGG-face model and choose the most beneficial variant.

As mentioned above, we evaluate the models using the split 1 of the LFW dataset. All images were resized to $128\times128$ pixels, blurred (Gaussian kenel, $\sigma=2.4$) and downsampled to $16\times16$ pixels for training and testing.

%It turned out that using fully-connected layers of the pre-trained VGG-face model leads to the decreasing image quality. See Figure \ref{fig:fc7} for results of learning with perceptual loss using \emph{fc7} layer of the VGG-face model additionally to the pixel-level L2 loss. 

The most visually plausible results were achieved by using the \emph{pool3} and \emph{pool4} layers for learning along pith pixel-level data. The results on LFW hold-out set were compared with bicubic interpolation as well as with the variant learned with pixel-level loss only. The comparison in Figure \ref{fig:layers} shows clear improvement of the system that uses pixel-level loss over the baselines. 

We also observed that using perceptual loss improved the recognition score. Recognition scores ($100\%$-EER) for these cases are compared in  \ref{tab:lfw_score}. At the same time, as expected, best results in terms of PSNR (peak signal-to-noise ratio) were achieved with pixel-level loss. %TODO : insert values

%Additionally, we have compared the results for down-sampling factor $4$ (input images were of size $32\times32$), but there was no difference in either visual quality or recognition score between the results \emph{pixel} and \emph{pixel} $+$ \emph{pool3} $+$ \emph{pool4} modes.




\begin{table*}
\centering
\begin{tabular}{ c | c c c c c }
  & gt & bicubic & \emph{pixel}  & \emph{pixel} + \emph{pool3} + \emph{pool4} & \emph{pixel} + \emph{fc7}  \\
\hline
train & -      & -    & 85.56 & 86.19 & 90.74\\
test  & 95.33 & 73.01 & 83.02 & \bf{85.02} & 84.33\\


\end{tabular}
\caption{100\% - EER (Equal error rate) values for the standard split $1$ of the FLW dataset. The scores for bicubic upsamling and ground truth images are also included. \emph{pixel} - the results achieved using pixel-level loss only. Best results were achieved using pixel-level loss along with \emph{Perceptual} loss for layers \emph{pool3} and \emph{pool4} of the pre-trained VGG-face model.}
\label{tab:lfw_score}
\end{table*}



% \begin{figure*}
% \begin{center}

% \includegraphics[width=\textwidth]{images/lfw/fc7.png}

% \caption{The results achieved by training the super-resolution network using additional perceptual loss term that compares reconstruction and ground truth images representations extracted from the \emph{fc7} layer of the pre-trained VGG-face model. No image quality improvement is observed, on the contrary, images become less realistic with the increase of perceptual loss weight. }

% \label{fig:fc7}

% \end{center}

% \end{figure*}



\begin{figure}[t]



\includegraphics[width=\columnwidth]{images/lfw/layers_short.png}

\caption{The results achieved using additional \emph{Perceptual} loss terms for layers \emph{pool3} and \emph{pool4} compared with result for pixel-level loss and bicubic interpolation. We can see the clear improvement when using layers \emph{pool3} and \emph{pool4} along with pixel-level data.}

\label{fig:layers}



\vspace{10pt}
\end{figure}

\subsection{Experiments with video-data}

We have performed experiments on video-based face super-resolution using different variants of face super-resolution network described in \ref{sec:video}. All images were fist resized to $128\times128$ pixels, blurred with the Gaussian kernel ($\sigma = 2.4 $), and downsampled to the size $16\times16$. 
Here we use previously chosen perceptual loss training mode \emph{pixel} + \emph{pool3} + \emph{pool4} that uses pixel-level differences along with differences of features at \emph{pool3} and \emph{pool4} layers to compute the final loss value. The weight equal to $10^5$ was used for both Perceptual loss components  \emph{pool3} and \emph{pool4}.


In \ref{tab:ytube_score} $100\%-$EER(Equal Error Rate) value for single-image super-resolution is compared to video-based results using different number of adjacent frames with and without frame alignment (warping). Values for ground truth images (without distortions) and bicubic upsampling are also included. Note, that ground truth performance is less than reported in \cite{ParkhiVZ15} for several reasons: we use only one scale $256\times256$ and only one crop (central) to calculate face image descriptor. Moreover, all ground truth images were resized to $128\times128$ pixels to make fair comparison with our super-resolution method that outputs images of this size. 

The best-performing method was \texttt{f$25$warp} that uses 25 frames (one central and $24$ neighboring ones) and frame warping. Using several frames is generally better than using only one frame (c.f.~super-resolution results comparison in \ref{fig:ytube}). In \ref{tab:ytube_score} we can also see that the architecture \texttt{f$25$warp} gives reconstruction that are the closest to ground-truth when comparing images using L2 distance between their VGG deep features. As expected, the architecture \texttt{f$25$warp} gives the best PSNR value. In general, we can see uniform improvement in all used metrics for architectures that use longer sequences in comparison to architectures that use less frames. Analogously, there is improvement for architectures that include \emph{Face Warping} module (\texttt{f$25$warp} and \texttt{f$5$warp}) in comparison to architectures without \emph{Face Warping} module (\texttt{f$25$} and \texttt{f$5$}).

\subsection{User study for multi-frame face super-resolution}
\label{sec:ustudy}


We also carried out a used study in order to compare human perception of images produced by architectures \texttt{f$1$}, \texttt{f$25$} and \texttt{f$25$warp}. 
We thus compared the following three pairs of architectures: \texttt{f$25$} vs \texttt{f$25$warp}, \texttt{f$1$} vs \texttt{f$25$warp}, \texttt{f$1$} vs \texttt{f$25$}. The comparison interface presented five result pairs (for each of the three pairs of methods) from the YTF dataset to each user. Within the pair, the order was randomized. Between the pair, we showed a full-resolution frame from the same sequence (different from the central frame). The users were asked to pick one of the two reconstruction that (a) resemble the reference image more and (b) has better overall quality. The users were asked to prioritize resemblance over visual quality. Finally, if the two images seemed to the user absolutely on par both in terms of resemblance and quality, the user were allowed to click on the middle (reference) frame to indicate this. We however asked the users to abstain from this as much as possible. Overall $42$ users took part in the study.

%Second criterion (less important) was the overall image quality. In addition to two images that can be chosen, users could also answer "none", meaning that it is hard to decide which of the images is better.

The results of the user study (\ref{fig:ustudy}) showed that it is easy to tell the difference between the results of  \texttt{f$25$} vs \texttt{f$25$warp}  and \texttt{f$1$} vs \texttt{f$25$warp}. It appeared to be challenging to differ \texttt{f$1$} vs \texttt{f$25$} methods. These observations indicate that \emph{Face Warping} module is essential for obtaining better results. Using more frames without warping thus did not bring advantage over single-frame super-resolution.

\begin{figure}[t]

\begin{center}
    

\includegraphics[width=\columnwidth]{images/ytube/ustudy.png}
\end{center}
\caption{Results of user study for the three pairs of architectures evaluated in this works. See details in section \ref{sec:ustudy}}

\label{fig:ustudy}



\vspace{10pt}
\end{figure}




\subsection{Comparison to state of the art}

Here we compare our method with one of the latest single-image super-resolution methods \cite{ZhuLLT16}. As we use different format of input images than in \cite{ZhuLLT16} (for example, we use tighter crops for faces), we evaluate \cite{ZhuLLT16} on the YTF dataset using less magnification factor than we use in this work. For our methods we use inputs of size $16\time16$, while using $32\times32$ for \cite{ZhuLLT16}. We use the code published for \cite{ZhuLLT16} for the evaluation and therefore ensure that all the inputs are preprocessed as appropriate for \cite{ZhuLLT16} (including face detector for cropping the ground truth images from initial frames). As in \cite{ZhuLLT16}, the downsampled images were created without applying gaussian blur beforehands, we perform the comparison on such images after retraining our architecture for such regime. 

We observed that our method performs better than \cite{ZhuLLT16} in terms of $100$\%-EER metric: 85.14 (ours) vs 82.32 (\cite{ZhuLLT16}). Also, we can see that $100$\%-EER value for \cite{ZhuLLT16} is very close to the $100$\%-EER value for \texttt{f$1$} architecture that we use as a single-image baseline in this work (see Table \ref{tab:ytube_score}).
%TODO maybe insert L2 varues, but we need to change the code in \cite{ZhuLLT16} so that it wouldnt rotate the images.


\begin{table*}
\centering
\begin{tabular}{c | c c c c c c c c}
 metric & gt & bicubic & \texttt{f$1$} & \texttt{f$5$} &  \texttt{f$25$} & \texttt{f$5$warp} &  \texttt{f$25$warp}  \\
\hline
$100$\%-EER & 85.60 & 78.80 & 82.40 & 83.20 & 83.60 & 84.39 & \bf{85.20}\\
PSNR      && & 27.64 & 28.22 & 28.28 &  \bf{29.17} & 29.12 \\
L2, \emph{pool3} &&& 0.6512 & 0.6199 & 0.6295 & 0.5568 &  \bf{0.5542} \\
L2, \emph{pool4} &&& 0.7110 & 0.6814 & 0.6918 & 0.6126 &  \bf{0.6074} \\
L2, \emph{fc7} &&& 0.4828 & 0.4478 & 0.4583 & 0.3811 &  \bf{0.3695} \\




\end{tabular}
\caption{Different metrics for several architectures evaluated in this work (see section \ref{sec:arch}). First row (face verification metric): 100\%-EER(Equal error rate), second row: PSNR - peak signal to noise ratio. Rows $3$-$5$ show mean Euclidean distances between deep features of ground truth and reconstructed images extracted using VGG-face layers \emph{pool3}, \emph{pool4}, \emph{fc7} (after normalization). Such metrics are strongly correlated with recognition. The best performing architecture is \texttt{f$25$warp} that accepts sequences of length $25$ and includes \emph{Face Warping} sub-network. See section \ref{sec:video} for details.}
\label{tab:ytube_score}
\end{table*}


\begin{figure*}
\begin{center}

\includegraphics[width=0.75\textwidth]{images/ytube/ytube.png}

\caption{Results of different super-resolution CNNs for some of the images in the YTF dataset. Ground truth images and bicubic upsampling results are in the first two columns. See sections \ref{sec:arch} and \ref{sec:video} for details.}

\label{fig:ytube}

\end{center}

\end{figure*}
\section{Summary}
\label{sec:summary}
In this work we present a deep neural network for multi-frame face super-resolution that performs alignment, reconstruction and recognition in holistic manner and learns respective modules in the end-to-end fashion. We evaluate different variants of the proposed architecture including single-image baseline. In the experiments on YouTube Faces dataset, we demonstrate the advantages of having the alignment module in the system. In the presence of alignment, we observe the improvement both in visual quality (confirmed by the user study) and in the face recognition accuracy over the single frame baselines and the single frame system \cite{ZhuLLT16}. 

% $ biblatex auxiliary file $
% $ biblatex bbl format version 2.8 $
% Do not modify the above lines!
%
% This is an auxiliary file used by the 'biblatex' package.
% This file may safely be deleted. It will be recreated by
% biber as required.
%
\begingroup
\makeatletter
\@ifundefined{ver@biblatex.sty}
  {\@latex@error
     {Missing 'biblatex' package}
     {The bibliography requires the 'biblatex' package.}
      \aftergroup\endinput}
  {}
\endgroup


\refsection{0}
  \sortlist[entry]{nty/global/}
    \entry{baker2002limits}{article}{}
      \name{author}{2}{}{%
        {{hash=d6d2aa95037c71f331914a63990512a5}{%
           family={Baker},
           familyi={B\bibinitperiod},
           given={Simon},
           giveni={S\bibinitperiod}}}%
        {{hash=45496c6a7530cfbfb4f3218a2602b77e}{%
           family={Kanade},
           familyi={K\bibinitperiod},
           given={Takeo},
           giveni={T\bibinitperiod}}}%
      }
      \strng{namehash}{6324053902ca4c0c0585124adb8f5ff3}
      \strng{fullhash}{6324053902ca4c0c0585124adb8f5ff3}
      \strng{authornamehash}{6324053902ca4c0c0585124adb8f5ff3}
      \strng{authorfullhash}{6324053902ca4c0c0585124adb8f5ff3}
      \field{sortinit}{B}
      \field{sortinithash}{5f6fa000f686ee5b41be67ba6ff7962d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{IEEE Transactions on Pattern Analysis and Machine Intelligence}
      \field{number}{9}
      \field{title}{Limits on super-resolution and how to break them}
      \field{volume}{24}
      \field{year}{2002}
      \field{pages}{1167\bibrangedash 1183}
      \range{pages}{17}
    \endentry
    \entry{capel2003computer}{article}{}
      \name{author}{2}{}{%
        {{hash=747efd873121bfcc5d2bcd1d416c4fd4}{%
           family={Capel},
           familyi={C\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=c72fc39e94030f67717052309266a44d}{%
           family={Zisserman},
           familyi={Z\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {IEEE}%
      }
      \strng{namehash}{c997ffc8eab7998f3106607dec6e9db0}
      \strng{fullhash}{c997ffc8eab7998f3106607dec6e9db0}
      \strng{authornamehash}{c997ffc8eab7998f3106607dec6e9db0}
      \strng{authorfullhash}{c997ffc8eab7998f3106607dec6e9db0}
      \field{sortinit}{C}
      \field{sortinithash}{095692fd22cc3c74d7fe223d02314dbd}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{IEEE Signal Processing Magazine}
      \field{number}{3}
      \field{title}{Computer vision applied to super resolution}
      \field{volume}{20}
      \field{year}{2003}
      \field{pages}{75\bibrangedash 86}
      \range{pages}{12}
    \endentry
    \entry{cole2017face}{article}{}
      \name{author}{6}{}{%
        {{hash=4610b77ac6a69d89eb9d500ec257c413}{%
           family={Cole},
           familyi={C\bibinitperiod},
           given={Forrester},
           giveni={F\bibinitperiod}}}%
        {{hash=f3526e17acd434580ad3b7008598d010}{%
           family={Belanger},
           familyi={B\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=6e4c62612fa904e2c1c6c00006ccc142}{%
           family={Krishnan},
           familyi={K\bibinitperiod},
           given={Dilip},
           giveni={D\bibinitperiod}}}%
        {{hash=587a236ad49e1dae23ab208779b1923b}{%
           family={Sarna},
           familyi={S\bibinitperiod},
           given={Aaron},
           giveni={A\bibinitperiod}}}%
        {{hash=d15faccf8e8953482473f549d8886b48}{%
           family={Mosseri},
           familyi={M\bibinitperiod},
           given={Inbar},
           giveni={I\bibinitperiod}}}%
        {{hash=1cb62370bf6cfdce79fded9069c80e84}{%
           family={Freeman},
           familyi={F\bibinitperiod},
           given={William\bibnamedelima T},
           giveni={W\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
      }
      \strng{namehash}{4ad90731da8c4eee3f366ea617a71004}
      \strng{fullhash}{3b5e7140f999afb0c3f78930f4c89134}
      \strng{authornamehash}{4ad90731da8c4eee3f366ea617a71004}
      \strng{authorfullhash}{3b5e7140f999afb0c3f78930f4c89134}
      \field{sortinit}{C}
      \field{sortinithash}{095692fd22cc3c74d7fe223d02314dbd}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{arXiv preprint arXiv:1701.04851}
      \field{title}{Face Synthesis from Facial Identity Features}
      \field{year}{2017}
    \endentry
    \entry{HardieBA97}{article}{}
      \name{author}{3}{}{%
        {{hash=d57d574c93a4fd018a18b360d870aaca}{%
           family={Hardie},
           familyi={H\bibinitperiod},
           given={Russell\bibnamedelima C.},
           giveni={R\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
        {{hash=3b322ddafc231934f02c746a880e98b0}{%
           family={Barnard},
           familyi={B\bibinitperiod},
           given={Kenneth\bibnamedelima J.},
           giveni={K\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=b2e1f5d72267259c03b1ba12010b3c42}{%
           family={Armstrong},
           familyi={A\bibinitperiod},
           given={Ernest\bibnamedelima E.},
           giveni={E\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
      }
      \strng{namehash}{19e8a12781a93c7b16746559f5a6d88c}
      \strng{fullhash}{19e8a12781a93c7b16746559f5a6d88c}
      \strng{authornamehash}{19e8a12781a93c7b16746559f5a6d88c}
      \strng{authorfullhash}{19e8a12781a93c7b16746559f5a6d88c}
      \field{sortinit}{H}
      \field{sortinithash}{2f664b453ec75da1fe3804ca92633405}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{{IEEE} Trans. Image Processing}
      \field{number}{12}
      \field{title}{Joint {MAP} registration and high-resolution image estimation using a sequence of undersampled images}
      \field{volume}{6}
      \field{year}{1997}
      \field{pages}{1621\bibrangedash 1633}
      \range{pages}{13}
      \verb{doi}
      \verb 10.1109/83.650116
      \endverb
      \verb{url}
      \verb https://doi.org/10.1109/83.650116
      \endverb
    \endentry
    \entry{Hennings-YeomansBK08}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=92a1c1f728ea0e3ac04b25db31e1b5cd}{%
           family={Hennings{-}Yeomans},
           familyi={H\bibinitperiod},
           given={Pablo\bibnamedelima H.},
           giveni={P\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=d6d2aa95037c71f331914a63990512a5}{%
           family={Baker},
           familyi={B\bibinitperiod},
           given={Simon},
           giveni={S\bibinitperiod}}}%
        {{hash=d006d6cd10ec98b8e3f06f86c0293de5}{%
           family={Kumar},
           familyi={K\bibinitperiod},
           given={B.\bibnamedelimi V.\bibnamedelimi K.\bibnamedelimi Vijaya},
           giveni={B\bibinitperiod\bibinitdelim V\bibinitperiod\bibinitdelim K\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
      }
      \strng{namehash}{fda97f6124b5afa03c4a4fe41d99857a}
      \strng{fullhash}{fda97f6124b5afa03c4a4fe41d99857a}
      \strng{authornamehash}{fda97f6124b5afa03c4a4fe41d99857a}
      \strng{authorfullhash}{fda97f6124b5afa03c4a4fe41d99857a}
      \field{sortinit}{H}
      \field{sortinithash}{2f664b453ec75da1fe3804ca92633405}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition}
      \field{title}{Simultaneous super-resolution and feature extraction for recognition of low-resolution faces}
      \field{year}{2008}
    \endentry
    \entry{IraniP91}{article}{}
      \name{author}{2}{}{%
        {{hash=1de8853d596bc22d3525b68a85d6938b}{%
           family={Irani},
           familyi={I\bibinitperiod},
           given={Michal},
           giveni={M\bibinitperiod}}}%
        {{hash=d3baf3d5a8851ec2b9b0e59fd76595d4}{%
           family={Peleg},
           familyi={P\bibinitperiod},
           given={Shmuel},
           giveni={S\bibinitperiod}}}%
      }
      \strng{namehash}{627f3c93648a1f66bb56686d96621255}
      \strng{fullhash}{627f3c93648a1f66bb56686d96621255}
      \strng{authornamehash}{627f3c93648a1f66bb56686d96621255}
      \strng{authorfullhash}{627f3c93648a1f66bb56686d96621255}
      \field{sortinit}{I}
      \field{sortinithash}{a3dcedd53b04d1adfd5ac303ecd5e6fa}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{{CVGIP:} Graphical Model and Image Processing}
      \field{number}{3}
      \field{title}{Improving resolution by image registration}
      \field{volume}{53}
      \field{year}{1991}
      \field{pages}{231\bibrangedash 239}
      \range{pages}{9}
      \verb{doi}
      \verb 10.1016/1049-9652(91)90045-L
      \endverb
      \verb{url}
      \verb https://doi.org/10.1016/1049-9652(91)90045-L
      \endverb
    \endentry
    \entry{JaderbergSZK15}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=7dc1446dea7ff50b2b02fb83780cc9c6}{%
           family={Jaderberg},
           familyi={J\bibinitperiod},
           given={Max},
           giveni={M\bibinitperiod}}}%
        {{hash=9d16b7284df92c9adaee86c37ab992df}{%
           family={Simonyan},
           familyi={S\bibinitperiod},
           given={Karen},
           giveni={K\bibinitperiod}}}%
        {{hash=c72fc39e94030f67717052309266a44d}{%
           family={Zisserman},
           familyi={Z\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=481308b301166b521c74fde6566e97e6}{%
           family={Kavukcuoglu},
           familyi={K\bibinitperiod},
           given={Koray},
           giveni={K\bibinitperiod}}}%
      }
      \strng{namehash}{6373e6f74e9bf37ec2dc2f2504c49358}
      \strng{fullhash}{85b8fc272dd220a33e8e918f7e76618e}
      \strng{authornamehash}{6373e6f74e9bf37ec2dc2f2504c49358}
      \strng{authorfullhash}{85b8fc272dd220a33e8e918f7e76618e}
      \field{sortinit}{J}
      \field{sortinithash}{c86bd6cced82a15683b396c2169909ef}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Advances in Neural Information Processing Systems}
      \field{title}{Spatial Transformer Networks}
      \field{year}{2015}
      \field{pages}{2017\bibrangedash 2025}
      \range{pages}{9}
    \endentry
    \entry{JohnsonAF16}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=90edc587e1d523d4e173b1fe6e733445}{%
           family={Johnson},
           familyi={J\bibinitperiod},
           given={Justin},
           giveni={J\bibinitperiod}}}%
        {{hash=a8f4774fb7f40d7bca42099c3ffcc3f8}{%
           family={Alahi},
           familyi={A\bibinitperiod},
           given={Alexandre},
           giveni={A\bibinitperiod}}}%
        {{hash=6d435fb14e3815e88798e11fe46f4617}{%
           family={Fei{-}Fei},
           familyi={F\bibinitperiod},
           given={Li},
           giveni={L\bibinitperiod}}}%
      }
      \strng{namehash}{5b1345a5a09688d3e799b57889129718}
      \strng{fullhash}{5b1345a5a09688d3e799b57889129718}
      \strng{authornamehash}{5b1345a5a09688d3e799b57889129718}
      \strng{authorfullhash}{5b1345a5a09688d3e799b57889129718}
      \field{sortinit}{J}
      \field{sortinithash}{c86bd6cced82a15683b396c2169909ef}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the European Conference on Computer Vision}
      \field{title}{Perceptual Losses for Real-Time Style Transfer and Super-Resolution}
      \field{year}{2016}
      \field{pages}{694\bibrangedash 711}
      \range{pages}{18}
    \endentry
    \entry{KappelerYDK16}{article}{}
      \name{author}{4}{}{%
        {{hash=7c9cde93c89c0acc2e5ee7b6df2f4390}{%
           family={Kappeler},
           familyi={K\bibinitperiod},
           given={Armin},
           giveni={A\bibinitperiod}}}%
        {{hash=3f3b884496a3e49929f608dd52dc71d3}{%
           family={Yoo},
           familyi={Y\bibinitperiod},
           given={Seunghwan},
           giveni={S\bibinitperiod}}}%
        {{hash=bfbbf76b8d9d20804551902a98c8d608}{%
           family={Dai},
           familyi={D\bibinitperiod},
           given={Qiqin},
           giveni={Q\bibinitperiod}}}%
        {{hash=a563844f70f456474b85442d0aed9e36}{%
           family={Katsaggelos},
           familyi={K\bibinitperiod},
           given={Aggelos\bibnamedelima K.},
           giveni={A\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
      }
      \strng{namehash}{e087e750928e32b59bf8fa20e674ff8a}
      \strng{fullhash}{b0233969a64bb379dcb5390e711fb7d5}
      \strng{authornamehash}{e087e750928e32b59bf8fa20e674ff8a}
      \strng{authorfullhash}{b0233969a64bb379dcb5390e711fb7d5}
      \field{sortinit}{K}
      \field{sortinithash}{4c244ceae61406cdc0cc2ce1cb1ff703}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{{IEEE} Trans. Computational Imaging}
      \field{number}{2}
      \field{title}{Video Super-Resolution With Convolutional Neural Networks}
      \field{volume}{2}
      \field{year}{2016}
      \field{pages}{109\bibrangedash 122}
      \range{pages}{14}
    \endentry
    \entry{KaramZ15}{inproceedings}{}
      \name{author}{2}{}{%
        {{hash=e191b50efcb19919318df4be6fa3f37a}{%
           family={Karam},
           familyi={K\bibinitperiod},
           given={Lina\bibnamedelima J.},
           giveni={L\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=a9a717c243735fe7dcd2d7ad8d919965}{%
           family={Zhu},
           familyi={Z\bibinitperiod},
           given={Tong},
           giveni={T\bibinitperiod}}}%
      }
      \strng{namehash}{a9990679fc715548c92971d7dfb5c463}
      \strng{fullhash}{a9990679fc715548c92971d7dfb5c463}
      \strng{authornamehash}{a9990679fc715548c92971d7dfb5c463}
      \strng{authorfullhash}{a9990679fc715548c92971d7dfb5c463}
      \field{sortinit}{K}
      \field{sortinithash}{4c244ceae61406cdc0cc2ce1cb1ff703}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Human Vision and Electronic Imaging XX, San Francisco, California, USA, February 9-12, 2015}
      \field{title}{Quality labeled faces in the wild {(QLFW):} a database for studying face recognition in real-world environments}
    \endentry
    \entry{KingmaB14}{article}{}
      \name{author}{2}{}{%
        {{hash=1e072d74f4ac1094c9c26e1b592cea4a}{%
           family={Kingma},
           familyi={K\bibinitperiod},
           given={Diederik\bibnamedelima P.},
           giveni={D\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
        {{hash=8aa66e8231cc2fdbe67aa4f18ca970c6}{%
           family={Ba},
           familyi={B\bibinitperiod},
           given={Jimmy},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{c1670936fba733d1cb2d4c23bce95c6e}
      \strng{fullhash}{c1670936fba733d1cb2d4c23bce95c6e}
      \strng{authornamehash}{c1670936fba733d1cb2d4c23bce95c6e}
      \strng{authorfullhash}{c1670936fba733d1cb2d4c23bce95c6e}
      \field{sortinit}{K}
      \field{sortinithash}{4c244ceae61406cdc0cc2ce1cb1ff703}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{CoRR}
      \field{title}{Adam: {A} Method for Stochastic Optimization}
      \field{volume}{abs/1412.6980}
      \field{year}{2014}
      \verb{url}
      \verb http://arxiv.org/abs/1412.6980
      \endverb
    \endentry
    \entry{LiaoTLMJ15}{inproceedings}{}
      \name{author}{5}{}{%
        {{hash=29e06af1da90bf92f1d6c73ba097d1c1}{%
           family={Liao},
           familyi={L\bibinitperiod},
           given={Renjie},
           giveni={R\bibinitperiod}}}%
        {{hash=d27274155c2516b93b5a50576669f3f9}{%
           family={Tao},
           familyi={T\bibinitperiod},
           given={Xin},
           giveni={X\bibinitperiod}}}%
        {{hash=c9eecc0bd747b07f6a529fc3deb40c9f}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Ruiyu},
           giveni={R\bibinitperiod}}}%
        {{hash=9e5c94d143b311d2d9e28ba7dd5a4634}{%
           family={Ma},
           familyi={M\bibinitperiod},
           given={Ziyang},
           giveni={Z\bibinitperiod}}}%
        {{hash=c919379669a576a7dc662e44abbbcd6c}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Jiaya},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{189685262f4261c82d50e9fad08ed1b1}
      \strng{fullhash}{16d34a8fb4c671077569be43d1eea09b}
      \strng{authornamehash}{189685262f4261c82d50e9fad08ed1b1}
      \strng{authorfullhash}{16d34a8fb4c671077569be43d1eea09b}
      \field{sortinit}{L}
      \field{sortinithash}{7bba64db83423e3c29ad597f3b682cf3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the International Conference on Computer Vision}
      \field{title}{Video Super-Resolution via Deep Draft-Ensemble Learning}
      \field{year}{2015}
      \field{pages}{531\bibrangedash 539}
      \range{pages}{9}
    \endentry
    \entry{LiuSF07}{article}{}
      \name{author}{3}{}{%
        {{hash=17bf470b120f24c48675bbcb261cab37}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Ce},
           giveni={C\bibinitperiod}}}%
        {{hash=ca4553d24ab82a1bf49685098172191d}{%
           family={Shum},
           familyi={S\bibinitperiod},
           given={Heung{-}Yeung},
           giveni={H\bibinitperiod}}}%
        {{hash=d141cc377b58d4e4a58a4983e3052073}{%
           family={Freeman},
           familyi={F\bibinitperiod},
           given={William\bibnamedelima T.},
           giveni={W\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
      }
      \strng{namehash}{f52a84405a12d6915f547e2782c93b5f}
      \strng{fullhash}{f52a84405a12d6915f547e2782c93b5f}
      \strng{authornamehash}{f52a84405a12d6915f547e2782c93b5f}
      \strng{authorfullhash}{f52a84405a12d6915f547e2782c93b5f}
      \field{sortinit}{L}
      \field{sortinithash}{7bba64db83423e3c29ad597f3b682cf3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{International Journal of Computer Vision}
      \field{number}{1}
      \field{title}{Face Hallucination: Theory and Practice}
      \field{volume}{75}
      \field{year}{2007}
      \field{pages}{115\bibrangedash 134}
      \range{pages}{20}
      \verb{doi}
      \verb 10.1007/s11263-006-0029-5
      \endverb
      \verb{url}
      \verb https://doi.org/10.1007/s11263-006-0029-5
      \endverb
    \endentry
    \entry{ParkhiVZ15}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=3d7ebeea7f2b18a1490038683a6a2c16}{%
           family={Parkhi},
           familyi={P\bibinitperiod},
           given={Omkar\bibnamedelima M.},
           giveni={O\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=85ab53268da1006b51b453d57d3566f2}{%
           family={Vedaldi},
           familyi={V\bibinitperiod},
           given={Andrea},
           giveni={A\bibinitperiod}}}%
        {{hash=c72fc39e94030f67717052309266a44d}{%
           family={Zisserman},
           familyi={Z\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
      }
      \strng{namehash}{ea910c3ddba5378bea18ce7a29c00ae6}
      \strng{fullhash}{ea910c3ddba5378bea18ce7a29c00ae6}
      \strng{authornamehash}{ea910c3ddba5378bea18ce7a29c00ae6}
      \strng{authorfullhash}{ea910c3ddba5378bea18ce7a29c00ae6}
      \field{sortinit}{P}
      \field{sortinithash}{24100cef455d7974167575052c29146e}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the British Machine Vision Conference}
      \field{title}{Deep Face Recognition}
      \field{year}{2015}
      \field{pages}{41.1\bibrangedash 41.12}
      \range{pages}{-1}
    \endentry
    \entry{SchultzS96}{article}{}
      \name{author}{2}{}{%
        {{hash=7ecb0cb4c7d6f3510022a212003d6bea}{%
           family={Schultz},
           familyi={S\bibinitperiod},
           given={Richard\bibnamedelima R.},
           giveni={R\bibinitperiod\bibinitdelim R\bibinitperiod}}}%
        {{hash=af443dce335077d6b18c74d00eb22cac}{%
           family={Stevenson},
           familyi={S\bibinitperiod},
           given={Robert\bibnamedelima L.},
           giveni={R\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
      }
      \strng{namehash}{78eef22290ac83eda0dd10518ce1048f}
      \strng{fullhash}{78eef22290ac83eda0dd10518ce1048f}
      \strng{authornamehash}{78eef22290ac83eda0dd10518ce1048f}
      \strng{authorfullhash}{78eef22290ac83eda0dd10518ce1048f}
      \field{sortinit}{S}
      \field{sortinithash}{3c1547c63380458f8ca90e40ed14b83e}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{{IEEE} Trans. Image Processing}
      \field{number}{6}
      \field{title}{Extraction of high-resolution frames from video sequences}
      \field{volume}{5}
      \field{year}{1996}
      \field{pages}{996\bibrangedash 1011}
      \range{pages}{16}
      \verb{doi}
      \verb 10.1109/83.503915
      \endverb
      \verb{url}
      \verb https://doi.org/10.1109/83.503915
      \endverb
    \endentry
    \entry{SongDQ16}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=2f872efaee126300360c45aef8d2d4fb}{%
           family={Song},
           familyi={S\bibinitperiod},
           given={Xibin},
           giveni={X\bibinitperiod}}}%
        {{hash=46e3a90300a599dc3588c3ceb79df78b}{%
           family={Dai},
           familyi={D\bibinitperiod},
           given={Yuchao},
           giveni={Y\bibinitperiod}}}%
        {{hash=3fc8dbdd972a17942c54b5e65069e9cf}{%
           family={Qin},
           familyi={Q\bibinitperiod},
           given={Xueying},
           giveni={X\bibinitperiod}}}%
      }
      \strng{namehash}{f14aa5127fc17cbeaa0b1ab57c2ea6fb}
      \strng{fullhash}{f14aa5127fc17cbeaa0b1ab57c2ea6fb}
      \strng{authornamehash}{f14aa5127fc17cbeaa0b1ab57c2ea6fb}
      \strng{authorfullhash}{f14aa5127fc17cbeaa0b1ab57c2ea6fb}
      \field{sortinit}{S}
      \field{sortinithash}{3c1547c63380458f8ca90e40ed14b83e}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the Asian Conference on Computer Vision}
      \field{title}{Deep Depth Super-Resolution: Learning Depth Super-Resolution Using Deep Convolutional Neural Network}
      \field{year}{2016}
      \field{pages}{360\bibrangedash 376}
      \range{pages}{17}
    \endentry
    \entry{TaoGLWJ17}{article}{}
      \name{author}{5}{}{%
        {{hash=d27274155c2516b93b5a50576669f3f9}{%
           family={Tao},
           familyi={T\bibinitperiod},
           given={Xin},
           giveni={X\bibinitperiod}}}%
        {{hash=564558292d036085f5aca384abfe4859}{%
           family={Gao},
           familyi={G\bibinitperiod},
           given={Hongyun},
           giveni={H\bibinitperiod}}}%
        {{hash=29e06af1da90bf92f1d6c73ba097d1c1}{%
           family={Liao},
           familyi={L\bibinitperiod},
           given={Renjie},
           giveni={R\bibinitperiod}}}%
        {{hash=22895eda8b037b0434291a8911f78d18}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Jue},
           giveni={J\bibinitperiod}}}%
        {{hash=c919379669a576a7dc662e44abbbcd6c}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Jiaya},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{d8104eaa706fecf6a51382d75c16b7e5}
      \strng{fullhash}{73f9d1213adc89f7b388473675449bd4}
      \strng{authornamehash}{d8104eaa706fecf6a51382d75c16b7e5}
      \strng{authorfullhash}{73f9d1213adc89f7b388473675449bd4}
      \field{sortinit}{T}
      \field{sortinithash}{2e5c2f51f7fa2d957f3206819bf86dc3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{CoRR}
      \field{title}{Detail-revealing Deep Video Super-resolution}
      \field{volume}{abs/1704.02738}
      \field{year}{2017}
    \endentry
    \entry{TuzelTH16}{article}{}
      \name{author}{3}{}{%
        {{hash=10d293771217ccb6a5e06d825710814f}{%
           family={Tuzel},
           familyi={T\bibinitperiod},
           given={Oncel},
           giveni={O\bibinitperiod}}}%
        {{hash=09dc53d8d7802adec2e3f72431545ca9}{%
           family={Taguchi},
           familyi={T\bibinitperiod},
           given={Yuichi},
           giveni={Y\bibinitperiod}}}%
        {{hash=6510c5347b233a5213b409d6036d6183}{%
           family={Hershey},
           familyi={H\bibinitperiod},
           given={John\bibnamedelima R.},
           giveni={J\bibinitperiod\bibinitdelim R\bibinitperiod}}}%
      }
      \strng{namehash}{81ec74af9567f9373adfe5f76f500a58}
      \strng{fullhash}{81ec74af9567f9373adfe5f76f500a58}
      \strng{authornamehash}{81ec74af9567f9373adfe5f76f500a58}
      \strng{authorfullhash}{81ec74af9567f9373adfe5f76f500a58}
      \field{sortinit}{T}
      \field{sortinithash}{2e5c2f51f7fa2d957f3206819bf86dc3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{CoRR}
      \field{title}{Global-Local Face Upsampling Network}
      \field{volume}{abs/1603.07235}
      \field{year}{2016}
    \endentry
    \entry{WolfHM11}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=f70d0dee88ad32fb0faf165ab5d0e9ab}{%
           family={Wolf},
           familyi={W\bibinitperiod},
           given={Lior},
           giveni={L\bibinitperiod}}}%
        {{hash=46a03ab511e1b24870696b8a70022509}{%
           family={Hassner},
           familyi={H\bibinitperiod},
           given={Tal},
           giveni={T\bibinitperiod}}}%
        {{hash=707f0588e3d770cab23eae52e6a2a85e}{%
           family={Maoz},
           familyi={M\bibinitperiod},
           given={Itay},
           giveni={I\bibinitperiod}}}%
      }
      \strng{namehash}{c06a3c78da845ece928be9485ad6622b}
      \strng{fullhash}{c06a3c78da845ece928be9485ad6622b}
      \strng{authornamehash}{c06a3c78da845ece928be9485ad6622b}
      \strng{authorfullhash}{c06a3c78da845ece928be9485ad6622b}
      \field{sortinit}{W}
      \field{sortinithash}{6d25b3eefe5aa2147d1f339686808918}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition}
      \field{title}{Face recognition in unconstrained videos with matched background similarity}
      \field{year}{2011}
      \field{pages}{529\bibrangedash 534}
      \range{pages}{6}
    \endentry
    \entry{ZhangYZNH11}{inproceedings}{}
      \name{author}{5}{}{%
        {{hash=0b700ede8c64b558ca32569fc772ee11}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Haichao},
           giveni={H\bibinitperiod}}}%
        {{hash=638fef88cfdc77389b0c27ebae4bd0e5}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Jianchao},
           giveni={J\bibinitperiod}}}%
        {{hash=571ef82b45c89300cf183470a54910e0}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Yanning},
           giveni={Y\bibinitperiod}}}%
        {{hash=441f03f67b16fec7ea4ea0b675a0dfb8}{%
           family={Nasrabadi},
           familyi={N\bibinitperiod},
           given={Nasser\bibnamedelima M.},
           giveni={N\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=498037761b9ebb9c140d2808e0a0f39c}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Thomas\bibnamedelima S.},
           giveni={T\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
      }
      \strng{namehash}{1e3c311ebd39df97bd895642d7874b8a}
      \strng{fullhash}{a6c9738a5cdba2bdf884fae4f29c39d9}
      \strng{authornamehash}{1e3c311ebd39df97bd895642d7874b8a}
      \strng{authorfullhash}{a6c9738a5cdba2bdf884fae4f29c39d9}
      \field{sortinit}{Z}
      \field{sortinithash}{35589aa085e881766b72503e53fd4c97}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the International Conference on Computer Vision}
      \field{title}{Close the loop: Joint blind image restoration and recognition with sparse representation prior}
      \field{year}{2011}
      \field{pages}{770\bibrangedash 777}
      \range{pages}{8}
    \endentry
    \entry{ZhuLLT16}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=e4691a9df5a64d515558045aa54e044b}{%
           family={Zhu},
           familyi={Z\bibinitperiod},
           given={Shizhan},
           giveni={S\bibinitperiod}}}%
        {{hash=4e3d90436e049535489bca0f6aa12973}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Sifei},
           giveni={S\bibinitperiod}}}%
        {{hash=2d5156563537138d4e0e4a8aaa64df3e}{%
           family={Loy},
           familyi={L\bibinitperiod},
           given={Chen\bibnamedelima Change},
           giveni={C\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
        {{hash=7e09524e32e7b51c169850f848787677}{%
           family={Tang},
           familyi={T\bibinitperiod},
           given={Xiaoou},
           giveni={X\bibinitperiod}}}%
      }
      \strng{namehash}{07feaa8727ebda875a4c881c85dbca9a}
      \strng{fullhash}{3cac7bcac45ab53ef06b24562fe72762}
      \strng{authornamehash}{07feaa8727ebda875a4c881c85dbca9a}
      \strng{authorfullhash}{3cac7bcac45ab53ef06b24562fe72762}
      \field{sortinit}{Z}
      \field{sortinithash}{35589aa085e881766b72503e53fd4c97}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the European Conference on Computer Vision}
      \field{title}{Deep Cascaded Bi-Network for Face Hallucination}
      \field{year}{2016}
      \field{pages}{614\bibrangedash 630}
      \range{pages}{17}
    \endentry
  \endsortlist
\endrefsection
\endinput


% $ biblatex auxiliary file $
% $ biblatex bbl format version 2.8 $
% Do not modify the above lines!
%
% This is an auxiliary file used by the 'biblatex' package.
% This file may safely be deleted. It will be recreated by
% biber as required.
%
\begingroup
\makeatletter
\@ifundefined{ver@biblatex.sty}
  {\@latex@error
     {Missing 'biblatex' package}
     {The bibliography requires the 'biblatex' package.}
      \aftergroup\endinput}
  {}
\endgroup


\refsection{0}
  \sortlist[entry]{nty/global/}
    \entry{baker2002limits}{article}{}
      \name{author}{2}{}{%
        {{hash=d6d2aa95037c71f331914a63990512a5}{%
           family={Baker},
           familyi={B\bibinitperiod},
           given={Simon},
           giveni={S\bibinitperiod}}}%
        {{hash=45496c6a7530cfbfb4f3218a2602b77e}{%
           family={Kanade},
           familyi={K\bibinitperiod},
           given={Takeo},
           giveni={T\bibinitperiod}}}%
      }
      \strng{namehash}{6324053902ca4c0c0585124adb8f5ff3}
      \strng{fullhash}{6324053902ca4c0c0585124adb8f5ff3}
      \strng{authornamehash}{6324053902ca4c0c0585124adb8f5ff3}
      \strng{authorfullhash}{6324053902ca4c0c0585124adb8f5ff3}
      \field{sortinit}{B}
      \field{sortinithash}{5f6fa000f686ee5b41be67ba6ff7962d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{IEEE Transactions on Pattern Analysis and Machine Intelligence}
      \field{number}{9}
      \field{title}{Limits on super-resolution and how to break them}
      \field{volume}{24}
      \field{year}{2002}
      \field{pages}{1167\bibrangedash 1183}
      \range{pages}{17}
    \endentry
    \entry{capel2003computer}{article}{}
      \name{author}{2}{}{%
        {{hash=747efd873121bfcc5d2bcd1d416c4fd4}{%
           family={Capel},
           familyi={C\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=c72fc39e94030f67717052309266a44d}{%
           family={Zisserman},
           familyi={Z\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {IEEE}%
      }
      \strng{namehash}{c997ffc8eab7998f3106607dec6e9db0}
      \strng{fullhash}{c997ffc8eab7998f3106607dec6e9db0}
      \strng{authornamehash}{c997ffc8eab7998f3106607dec6e9db0}
      \strng{authorfullhash}{c997ffc8eab7998f3106607dec6e9db0}
      \field{sortinit}{C}
      \field{sortinithash}{095692fd22cc3c74d7fe223d02314dbd}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{IEEE Signal Processing Magazine}
      \field{number}{3}
      \field{title}{Computer vision applied to super resolution}
      \field{volume}{20}
      \field{year}{2003}
      \field{pages}{75\bibrangedash 86}
      \range{pages}{12}
    \endentry
    \entry{cole2017face}{article}{}
      \name{author}{6}{}{%
        {{hash=4610b77ac6a69d89eb9d500ec257c413}{%
           family={Cole},
           familyi={C\bibinitperiod},
           given={Forrester},
           giveni={F\bibinitperiod}}}%
        {{hash=f3526e17acd434580ad3b7008598d010}{%
           family={Belanger},
           familyi={B\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=6e4c62612fa904e2c1c6c00006ccc142}{%
           family={Krishnan},
           familyi={K\bibinitperiod},
           given={Dilip},
           giveni={D\bibinitperiod}}}%
        {{hash=587a236ad49e1dae23ab208779b1923b}{%
           family={Sarna},
           familyi={S\bibinitperiod},
           given={Aaron},
           giveni={A\bibinitperiod}}}%
        {{hash=d15faccf8e8953482473f549d8886b48}{%
           family={Mosseri},
           familyi={M\bibinitperiod},
           given={Inbar},
           giveni={I\bibinitperiod}}}%
        {{hash=1cb62370bf6cfdce79fded9069c80e84}{%
           family={Freeman},
           familyi={F\bibinitperiod},
           given={William\bibnamedelima T},
           giveni={W\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
      }
      \strng{namehash}{4ad90731da8c4eee3f366ea617a71004}
      \strng{fullhash}{3b5e7140f999afb0c3f78930f4c89134}
      \strng{authornamehash}{4ad90731da8c4eee3f366ea617a71004}
      \strng{authorfullhash}{3b5e7140f999afb0c3f78930f4c89134}
      \field{sortinit}{C}
      \field{sortinithash}{095692fd22cc3c74d7fe223d02314dbd}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{arXiv preprint arXiv:1701.04851}
      \field{title}{Face Synthesis from Facial Identity Features}
      \field{year}{2017}
    \endentry
    \entry{HardieBA97}{article}{}
      \name{author}{3}{}{%
        {{hash=d57d574c93a4fd018a18b360d870aaca}{%
           family={Hardie},
           familyi={H\bibinitperiod},
           given={Russell\bibnamedelima C.},
           giveni={R\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
        {{hash=3b322ddafc231934f02c746a880e98b0}{%
           family={Barnard},
           familyi={B\bibinitperiod},
           given={Kenneth\bibnamedelima J.},
           giveni={K\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=b2e1f5d72267259c03b1ba12010b3c42}{%
           family={Armstrong},
           familyi={A\bibinitperiod},
           given={Ernest\bibnamedelima E.},
           giveni={E\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
      }
      \strng{namehash}{19e8a12781a93c7b16746559f5a6d88c}
      \strng{fullhash}{19e8a12781a93c7b16746559f5a6d88c}
      \strng{authornamehash}{19e8a12781a93c7b16746559f5a6d88c}
      \strng{authorfullhash}{19e8a12781a93c7b16746559f5a6d88c}
      \field{sortinit}{H}
      \field{sortinithash}{2f664b453ec75da1fe3804ca92633405}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{{IEEE} Trans. Image Processing}
      \field{number}{12}
      \field{title}{Joint {MAP} registration and high-resolution image estimation using a sequence of undersampled images}
      \field{volume}{6}
      \field{year}{1997}
      \field{pages}{1621\bibrangedash 1633}
      \range{pages}{13}
      \verb{doi}
      \verb 10.1109/83.650116
      \endverb
      \verb{url}
      \verb https://doi.org/10.1109/83.650116
      \endverb
    \endentry
    \entry{Hennings-YeomansBK08}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=92a1c1f728ea0e3ac04b25db31e1b5cd}{%
           family={Hennings{-}Yeomans},
           familyi={H\bibinitperiod},
           given={Pablo\bibnamedelima H.},
           giveni={P\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=d6d2aa95037c71f331914a63990512a5}{%
           family={Baker},
           familyi={B\bibinitperiod},
           given={Simon},
           giveni={S\bibinitperiod}}}%
        {{hash=d006d6cd10ec98b8e3f06f86c0293de5}{%
           family={Kumar},
           familyi={K\bibinitperiod},
           given={B.\bibnamedelimi V.\bibnamedelimi K.\bibnamedelimi Vijaya},
           giveni={B\bibinitperiod\bibinitdelim V\bibinitperiod\bibinitdelim K\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
      }
      \strng{namehash}{fda97f6124b5afa03c4a4fe41d99857a}
      \strng{fullhash}{fda97f6124b5afa03c4a4fe41d99857a}
      \strng{authornamehash}{fda97f6124b5afa03c4a4fe41d99857a}
      \strng{authorfullhash}{fda97f6124b5afa03c4a4fe41d99857a}
      \field{sortinit}{H}
      \field{sortinithash}{2f664b453ec75da1fe3804ca92633405}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition}
      \field{title}{Simultaneous super-resolution and feature extraction for recognition of low-resolution faces}
      \field{year}{2008}
    \endentry
    \entry{IraniP91}{article}{}
      \name{author}{2}{}{%
        {{hash=1de8853d596bc22d3525b68a85d6938b}{%
           family={Irani},
           familyi={I\bibinitperiod},
           given={Michal},
           giveni={M\bibinitperiod}}}%
        {{hash=d3baf3d5a8851ec2b9b0e59fd76595d4}{%
           family={Peleg},
           familyi={P\bibinitperiod},
           given={Shmuel},
           giveni={S\bibinitperiod}}}%
      }
      \strng{namehash}{627f3c93648a1f66bb56686d96621255}
      \strng{fullhash}{627f3c93648a1f66bb56686d96621255}
      \strng{authornamehash}{627f3c93648a1f66bb56686d96621255}
      \strng{authorfullhash}{627f3c93648a1f66bb56686d96621255}
      \field{sortinit}{I}
      \field{sortinithash}{a3dcedd53b04d1adfd5ac303ecd5e6fa}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{{CVGIP:} Graphical Model and Image Processing}
      \field{number}{3}
      \field{title}{Improving resolution by image registration}
      \field{volume}{53}
      \field{year}{1991}
      \field{pages}{231\bibrangedash 239}
      \range{pages}{9}
      \verb{doi}
      \verb 10.1016/1049-9652(91)90045-L
      \endverb
      \verb{url}
      \verb https://doi.org/10.1016/1049-9652(91)90045-L
      \endverb
    \endentry
    \entry{JaderbergSZK15}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=7dc1446dea7ff50b2b02fb83780cc9c6}{%
           family={Jaderberg},
           familyi={J\bibinitperiod},
           given={Max},
           giveni={M\bibinitperiod}}}%
        {{hash=9d16b7284df92c9adaee86c37ab992df}{%
           family={Simonyan},
           familyi={S\bibinitperiod},
           given={Karen},
           giveni={K\bibinitperiod}}}%
        {{hash=c72fc39e94030f67717052309266a44d}{%
           family={Zisserman},
           familyi={Z\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=481308b301166b521c74fde6566e97e6}{%
           family={Kavukcuoglu},
           familyi={K\bibinitperiod},
           given={Koray},
           giveni={K\bibinitperiod}}}%
      }
      \strng{namehash}{6373e6f74e9bf37ec2dc2f2504c49358}
      \strng{fullhash}{85b8fc272dd220a33e8e918f7e76618e}
      \strng{authornamehash}{6373e6f74e9bf37ec2dc2f2504c49358}
      \strng{authorfullhash}{85b8fc272dd220a33e8e918f7e76618e}
      \field{sortinit}{J}
      \field{sortinithash}{c86bd6cced82a15683b396c2169909ef}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Advances in Neural Information Processing Systems}
      \field{title}{Spatial Transformer Networks}
      \field{year}{2015}
      \field{pages}{2017\bibrangedash 2025}
      \range{pages}{9}
    \endentry
    \entry{JohnsonAF16}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=90edc587e1d523d4e173b1fe6e733445}{%
           family={Johnson},
           familyi={J\bibinitperiod},
           given={Justin},
           giveni={J\bibinitperiod}}}%
        {{hash=a8f4774fb7f40d7bca42099c3ffcc3f8}{%
           family={Alahi},
           familyi={A\bibinitperiod},
           given={Alexandre},
           giveni={A\bibinitperiod}}}%
        {{hash=6d435fb14e3815e88798e11fe46f4617}{%
           family={Fei{-}Fei},
           familyi={F\bibinitperiod},
           given={Li},
           giveni={L\bibinitperiod}}}%
      }
      \strng{namehash}{5b1345a5a09688d3e799b57889129718}
      \strng{fullhash}{5b1345a5a09688d3e799b57889129718}
      \strng{authornamehash}{5b1345a5a09688d3e799b57889129718}
      \strng{authorfullhash}{5b1345a5a09688d3e799b57889129718}
      \field{sortinit}{J}
      \field{sortinithash}{c86bd6cced82a15683b396c2169909ef}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the European Conference on Computer Vision}
      \field{title}{Perceptual Losses for Real-Time Style Transfer and Super-Resolution}
      \field{year}{2016}
      \field{pages}{694\bibrangedash 711}
      \range{pages}{18}
    \endentry
    \entry{KappelerYDK16}{article}{}
      \name{author}{4}{}{%
        {{hash=7c9cde93c89c0acc2e5ee7b6df2f4390}{%
           family={Kappeler},
           familyi={K\bibinitperiod},
           given={Armin},
           giveni={A\bibinitperiod}}}%
        {{hash=3f3b884496a3e49929f608dd52dc71d3}{%
           family={Yoo},
           familyi={Y\bibinitperiod},
           given={Seunghwan},
           giveni={S\bibinitperiod}}}%
        {{hash=bfbbf76b8d9d20804551902a98c8d608}{%
           family={Dai},
           familyi={D\bibinitperiod},
           given={Qiqin},
           giveni={Q\bibinitperiod}}}%
        {{hash=a563844f70f456474b85442d0aed9e36}{%
           family={Katsaggelos},
           familyi={K\bibinitperiod},
           given={Aggelos\bibnamedelima K.},
           giveni={A\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
      }
      \strng{namehash}{e087e750928e32b59bf8fa20e674ff8a}
      \strng{fullhash}{b0233969a64bb379dcb5390e711fb7d5}
      \strng{authornamehash}{e087e750928e32b59bf8fa20e674ff8a}
      \strng{authorfullhash}{b0233969a64bb379dcb5390e711fb7d5}
      \field{sortinit}{K}
      \field{sortinithash}{4c244ceae61406cdc0cc2ce1cb1ff703}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{{IEEE} Trans. Computational Imaging}
      \field{number}{2}
      \field{title}{Video Super-Resolution With Convolutional Neural Networks}
      \field{volume}{2}
      \field{year}{2016}
      \field{pages}{109\bibrangedash 122}
      \range{pages}{14}
    \endentry
    \entry{KaramZ15}{inproceedings}{}
      \name{author}{2}{}{%
        {{hash=e191b50efcb19919318df4be6fa3f37a}{%
           family={Karam},
           familyi={K\bibinitperiod},
           given={Lina\bibnamedelima J.},
           giveni={L\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=a9a717c243735fe7dcd2d7ad8d919965}{%
           family={Zhu},
           familyi={Z\bibinitperiod},
           given={Tong},
           giveni={T\bibinitperiod}}}%
      }
      \strng{namehash}{a9990679fc715548c92971d7dfb5c463}
      \strng{fullhash}{a9990679fc715548c92971d7dfb5c463}
      \strng{authornamehash}{a9990679fc715548c92971d7dfb5c463}
      \strng{authorfullhash}{a9990679fc715548c92971d7dfb5c463}
      \field{sortinit}{K}
      \field{sortinithash}{4c244ceae61406cdc0cc2ce1cb1ff703}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Human Vision and Electronic Imaging XX, San Francisco, California, USA, February 9-12, 2015}
      \field{title}{Quality labeled faces in the wild {(QLFW):} a database for studying face recognition in real-world environments}
    \endentry
    \entry{KingmaB14}{article}{}
      \name{author}{2}{}{%
        {{hash=1e072d74f4ac1094c9c26e1b592cea4a}{%
           family={Kingma},
           familyi={K\bibinitperiod},
           given={Diederik\bibnamedelima P.},
           giveni={D\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
        {{hash=8aa66e8231cc2fdbe67aa4f18ca970c6}{%
           family={Ba},
           familyi={B\bibinitperiod},
           given={Jimmy},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{c1670936fba733d1cb2d4c23bce95c6e}
      \strng{fullhash}{c1670936fba733d1cb2d4c23bce95c6e}
      \strng{authornamehash}{c1670936fba733d1cb2d4c23bce95c6e}
      \strng{authorfullhash}{c1670936fba733d1cb2d4c23bce95c6e}
      \field{sortinit}{K}
      \field{sortinithash}{4c244ceae61406cdc0cc2ce1cb1ff703}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{CoRR}
      \field{title}{Adam: {A} Method for Stochastic Optimization}
      \field{volume}{abs/1412.6980}
      \field{year}{2014}
      \verb{url}
      \verb http://arxiv.org/abs/1412.6980
      \endverb
    \endentry
    \entry{LiaoTLMJ15}{inproceedings}{}
      \name{author}{5}{}{%
        {{hash=29e06af1da90bf92f1d6c73ba097d1c1}{%
           family={Liao},
           familyi={L\bibinitperiod},
           given={Renjie},
           giveni={R\bibinitperiod}}}%
        {{hash=d27274155c2516b93b5a50576669f3f9}{%
           family={Tao},
           familyi={T\bibinitperiod},
           given={Xin},
           giveni={X\bibinitperiod}}}%
        {{hash=c9eecc0bd747b07f6a529fc3deb40c9f}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Ruiyu},
           giveni={R\bibinitperiod}}}%
        {{hash=9e5c94d143b311d2d9e28ba7dd5a4634}{%
           family={Ma},
           familyi={M\bibinitperiod},
           given={Ziyang},
           giveni={Z\bibinitperiod}}}%
        {{hash=c919379669a576a7dc662e44abbbcd6c}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Jiaya},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{189685262f4261c82d50e9fad08ed1b1}
      \strng{fullhash}{16d34a8fb4c671077569be43d1eea09b}
      \strng{authornamehash}{189685262f4261c82d50e9fad08ed1b1}
      \strng{authorfullhash}{16d34a8fb4c671077569be43d1eea09b}
      \field{sortinit}{L}
      \field{sortinithash}{7bba64db83423e3c29ad597f3b682cf3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the International Conference on Computer Vision}
      \field{title}{Video Super-Resolution via Deep Draft-Ensemble Learning}
      \field{year}{2015}
      \field{pages}{531\bibrangedash 539}
      \range{pages}{9}
    \endentry
    \entry{LiuSF07}{article}{}
      \name{author}{3}{}{%
        {{hash=17bf470b120f24c48675bbcb261cab37}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Ce},
           giveni={C\bibinitperiod}}}%
        {{hash=ca4553d24ab82a1bf49685098172191d}{%
           family={Shum},
           familyi={S\bibinitperiod},
           given={Heung{-}Yeung},
           giveni={H\bibinitperiod}}}%
        {{hash=d141cc377b58d4e4a58a4983e3052073}{%
           family={Freeman},
           familyi={F\bibinitperiod},
           given={William\bibnamedelima T.},
           giveni={W\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
      }
      \strng{namehash}{f52a84405a12d6915f547e2782c93b5f}
      \strng{fullhash}{f52a84405a12d6915f547e2782c93b5f}
      \strng{authornamehash}{f52a84405a12d6915f547e2782c93b5f}
      \strng{authorfullhash}{f52a84405a12d6915f547e2782c93b5f}
      \field{sortinit}{L}
      \field{sortinithash}{7bba64db83423e3c29ad597f3b682cf3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{International Journal of Computer Vision}
      \field{number}{1}
      \field{title}{Face Hallucination: Theory and Practice}
      \field{volume}{75}
      \field{year}{2007}
      \field{pages}{115\bibrangedash 134}
      \range{pages}{20}
      \verb{doi}
      \verb 10.1007/s11263-006-0029-5
      \endverb
      \verb{url}
      \verb https://doi.org/10.1007/s11263-006-0029-5
      \endverb
    \endentry
    \entry{ParkhiVZ15}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=3d7ebeea7f2b18a1490038683a6a2c16}{%
           family={Parkhi},
           familyi={P\bibinitperiod},
           given={Omkar\bibnamedelima M.},
           giveni={O\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=85ab53268da1006b51b453d57d3566f2}{%
           family={Vedaldi},
           familyi={V\bibinitperiod},
           given={Andrea},
           giveni={A\bibinitperiod}}}%
        {{hash=c72fc39e94030f67717052309266a44d}{%
           family={Zisserman},
           familyi={Z\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
      }
      \strng{namehash}{ea910c3ddba5378bea18ce7a29c00ae6}
      \strng{fullhash}{ea910c3ddba5378bea18ce7a29c00ae6}
      \strng{authornamehash}{ea910c3ddba5378bea18ce7a29c00ae6}
      \strng{authorfullhash}{ea910c3ddba5378bea18ce7a29c00ae6}
      \field{sortinit}{P}
      \field{sortinithash}{24100cef455d7974167575052c29146e}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the British Machine Vision Conference}
      \field{title}{Deep Face Recognition}
      \field{year}{2015}
      \field{pages}{41.1\bibrangedash 41.12}
      \range{pages}{-1}
    \endentry
    \entry{SchultzS96}{article}{}
      \name{author}{2}{}{%
        {{hash=7ecb0cb4c7d6f3510022a212003d6bea}{%
           family={Schultz},
           familyi={S\bibinitperiod},
           given={Richard\bibnamedelima R.},
           giveni={R\bibinitperiod\bibinitdelim R\bibinitperiod}}}%
        {{hash=af443dce335077d6b18c74d00eb22cac}{%
           family={Stevenson},
           familyi={S\bibinitperiod},
           given={Robert\bibnamedelima L.},
           giveni={R\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
      }
      \strng{namehash}{78eef22290ac83eda0dd10518ce1048f}
      \strng{fullhash}{78eef22290ac83eda0dd10518ce1048f}
      \strng{authornamehash}{78eef22290ac83eda0dd10518ce1048f}
      \strng{authorfullhash}{78eef22290ac83eda0dd10518ce1048f}
      \field{sortinit}{S}
      \field{sortinithash}{3c1547c63380458f8ca90e40ed14b83e}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{{IEEE} Trans. Image Processing}
      \field{number}{6}
      \field{title}{Extraction of high-resolution frames from video sequences}
      \field{volume}{5}
      \field{year}{1996}
      \field{pages}{996\bibrangedash 1011}
      \range{pages}{16}
      \verb{doi}
      \verb 10.1109/83.503915
      \endverb
      \verb{url}
      \verb https://doi.org/10.1109/83.503915
      \endverb
    \endentry
    \entry{SongDQ16}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=2f872efaee126300360c45aef8d2d4fb}{%
           family={Song},
           familyi={S\bibinitperiod},
           given={Xibin},
           giveni={X\bibinitperiod}}}%
        {{hash=46e3a90300a599dc3588c3ceb79df78b}{%
           family={Dai},
           familyi={D\bibinitperiod},
           given={Yuchao},
           giveni={Y\bibinitperiod}}}%
        {{hash=3fc8dbdd972a17942c54b5e65069e9cf}{%
           family={Qin},
           familyi={Q\bibinitperiod},
           given={Xueying},
           giveni={X\bibinitperiod}}}%
      }
      \strng{namehash}{f14aa5127fc17cbeaa0b1ab57c2ea6fb}
      \strng{fullhash}{f14aa5127fc17cbeaa0b1ab57c2ea6fb}
      \strng{authornamehash}{f14aa5127fc17cbeaa0b1ab57c2ea6fb}
      \strng{authorfullhash}{f14aa5127fc17cbeaa0b1ab57c2ea6fb}
      \field{sortinit}{S}
      \field{sortinithash}{3c1547c63380458f8ca90e40ed14b83e}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the Asian Conference on Computer Vision}
      \field{title}{Deep Depth Super-Resolution: Learning Depth Super-Resolution Using Deep Convolutional Neural Network}
      \field{year}{2016}
      \field{pages}{360\bibrangedash 376}
      \range{pages}{17}
    \endentry
    \entry{TaoGLWJ17}{article}{}
      \name{author}{5}{}{%
        {{hash=d27274155c2516b93b5a50576669f3f9}{%
           family={Tao},
           familyi={T\bibinitperiod},
           given={Xin},
           giveni={X\bibinitperiod}}}%
        {{hash=564558292d036085f5aca384abfe4859}{%
           family={Gao},
           familyi={G\bibinitperiod},
           given={Hongyun},
           giveni={H\bibinitperiod}}}%
        {{hash=29e06af1da90bf92f1d6c73ba097d1c1}{%
           family={Liao},
           familyi={L\bibinitperiod},
           given={Renjie},
           giveni={R\bibinitperiod}}}%
        {{hash=22895eda8b037b0434291a8911f78d18}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Jue},
           giveni={J\bibinitperiod}}}%
        {{hash=c919379669a576a7dc662e44abbbcd6c}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Jiaya},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{d8104eaa706fecf6a51382d75c16b7e5}
      \strng{fullhash}{73f9d1213adc89f7b388473675449bd4}
      \strng{authornamehash}{d8104eaa706fecf6a51382d75c16b7e5}
      \strng{authorfullhash}{73f9d1213adc89f7b388473675449bd4}
      \field{sortinit}{T}
      \field{sortinithash}{2e5c2f51f7fa2d957f3206819bf86dc3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{CoRR}
      \field{title}{Detail-revealing Deep Video Super-resolution}
      \field{volume}{abs/1704.02738}
      \field{year}{2017}
    \endentry
    \entry{TuzelTH16}{article}{}
      \name{author}{3}{}{%
        {{hash=10d293771217ccb6a5e06d825710814f}{%
           family={Tuzel},
           familyi={T\bibinitperiod},
           given={Oncel},
           giveni={O\bibinitperiod}}}%
        {{hash=09dc53d8d7802adec2e3f72431545ca9}{%
           family={Taguchi},
           familyi={T\bibinitperiod},
           given={Yuichi},
           giveni={Y\bibinitperiod}}}%
        {{hash=6510c5347b233a5213b409d6036d6183}{%
           family={Hershey},
           familyi={H\bibinitperiod},
           given={John\bibnamedelima R.},
           giveni={J\bibinitperiod\bibinitdelim R\bibinitperiod}}}%
      }
      \strng{namehash}{81ec74af9567f9373adfe5f76f500a58}
      \strng{fullhash}{81ec74af9567f9373adfe5f76f500a58}
      \strng{authornamehash}{81ec74af9567f9373adfe5f76f500a58}
      \strng{authorfullhash}{81ec74af9567f9373adfe5f76f500a58}
      \field{sortinit}{T}
      \field{sortinithash}{2e5c2f51f7fa2d957f3206819bf86dc3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{journaltitle}{CoRR}
      \field{title}{Global-Local Face Upsampling Network}
      \field{volume}{abs/1603.07235}
      \field{year}{2016}
    \endentry
    \entry{WolfHM11}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=f70d0dee88ad32fb0faf165ab5d0e9ab}{%
           family={Wolf},
           familyi={W\bibinitperiod},
           given={Lior},
           giveni={L\bibinitperiod}}}%
        {{hash=46a03ab511e1b24870696b8a70022509}{%
           family={Hassner},
           familyi={H\bibinitperiod},
           given={Tal},
           giveni={T\bibinitperiod}}}%
        {{hash=707f0588e3d770cab23eae52e6a2a85e}{%
           family={Maoz},
           familyi={M\bibinitperiod},
           given={Itay},
           giveni={I\bibinitperiod}}}%
      }
      \strng{namehash}{c06a3c78da845ece928be9485ad6622b}
      \strng{fullhash}{c06a3c78da845ece928be9485ad6622b}
      \strng{authornamehash}{c06a3c78da845ece928be9485ad6622b}
      \strng{authorfullhash}{c06a3c78da845ece928be9485ad6622b}
      \field{sortinit}{W}
      \field{sortinithash}{6d25b3eefe5aa2147d1f339686808918}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition}
      \field{title}{Face recognition in unconstrained videos with matched background similarity}
      \field{year}{2011}
      \field{pages}{529\bibrangedash 534}
      \range{pages}{6}
    \endentry
    \entry{ZhangYZNH11}{inproceedings}{}
      \name{author}{5}{}{%
        {{hash=0b700ede8c64b558ca32569fc772ee11}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Haichao},
           giveni={H\bibinitperiod}}}%
        {{hash=638fef88cfdc77389b0c27ebae4bd0e5}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Jianchao},
           giveni={J\bibinitperiod}}}%
        {{hash=571ef82b45c89300cf183470a54910e0}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Yanning},
           giveni={Y\bibinitperiod}}}%
        {{hash=441f03f67b16fec7ea4ea0b675a0dfb8}{%
           family={Nasrabadi},
           familyi={N\bibinitperiod},
           given={Nasser\bibnamedelima M.},
           giveni={N\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=498037761b9ebb9c140d2808e0a0f39c}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Thomas\bibnamedelima S.},
           giveni={T\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
      }
      \strng{namehash}{1e3c311ebd39df97bd895642d7874b8a}
      \strng{fullhash}{a6c9738a5cdba2bdf884fae4f29c39d9}
      \strng{authornamehash}{1e3c311ebd39df97bd895642d7874b8a}
      \strng{authorfullhash}{a6c9738a5cdba2bdf884fae4f29c39d9}
      \field{sortinit}{Z}
      \field{sortinithash}{35589aa085e881766b72503e53fd4c97}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the International Conference on Computer Vision}
      \field{title}{Close the loop: Joint blind image restoration and recognition with sparse representation prior}
      \field{year}{2011}
      \field{pages}{770\bibrangedash 777}
      \range{pages}{8}
    \endentry
    \entry{ZhuLLT16}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=e4691a9df5a64d515558045aa54e044b}{%
           family={Zhu},
           familyi={Z\bibinitperiod},
           given={Shizhan},
           giveni={S\bibinitperiod}}}%
        {{hash=4e3d90436e049535489bca0f6aa12973}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Sifei},
           giveni={S\bibinitperiod}}}%
        {{hash=2d5156563537138d4e0e4a8aaa64df3e}{%
           family={Loy},
           familyi={L\bibinitperiod},
           given={Chen\bibnamedelima Change},
           giveni={C\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
        {{hash=7e09524e32e7b51c169850f848787677}{%
           family={Tang},
           familyi={T\bibinitperiod},
           given={Xiaoou},
           giveni={X\bibinitperiod}}}%
      }
      \strng{namehash}{07feaa8727ebda875a4c881c85dbca9a}
      \strng{fullhash}{3cac7bcac45ab53ef06b24562fe72762}
      \strng{authornamehash}{07feaa8727ebda875a4c881c85dbca9a}
      \strng{authorfullhash}{3cac7bcac45ab53ef06b24562fe72762}
      \field{sortinit}{Z}
      \field{sortinithash}{35589aa085e881766b72503e53fd4c97}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{booktitle}{Proceedings of the European Conference on Computer Vision}
      \field{title}{Deep Cascaded Bi-Network for Face Hallucination}
      \field{year}{2016}
      \field{pages}{614\bibrangedash 630}
      \range{pages}{17}
    \endentry
  \endsortlist
\endrefsection
\endinput