Data Encoding For Healthcare Data Democratisation and Information Leakage Prevention
Extracted source text · arXiv 2305.03710
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% %%
%% Please do not use \input{...} to include other tex files. %%
%% Submit your LaTeX manuscript as one .tex document. %%
%% %%
%% All additional figures and files should be attached %%
%% separately and not embedded in the \TeX\ document itself. %%
%% %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%%\documentclass[referee,sn-basic]{sn-jnl}% referee option is meant for double line spacing
%%=======================================================%%
%% to print line numbers in the margin use lineno option %%
%%=======================================================%%
%%\documentclass[lineno,sn-basic]{sn-jnl}% Basic Springer Nature Reference Style/Chemistry Reference Style
%%======================================================%%
%% to compile with pdflatex/xelatex use pdflatex option %%
%%======================================================%%
%%\documentclass[pdflatex,sn-basic]{sn-jnl}% Basic Springer Nature Reference Style/Chemistry Reference Style
%%\documentclass[sn-basic]{sn-jnl}% Basic Springer Nature Reference Style/Chemistry Reference Style
% \documentclass[pdflatex,sn-mathphys]{sn-jnl}% Math and Physical Sciences Reference Style
%%\documentclass[sn-aps]{sn-jnl}% American Physical Society (APS) Reference Style
%%\documentclass[sn-vancouver]{sn-jnl}% Vancouver Reference Style
%%\documentclass[sn-apa]{sn-jnl}% APA Reference Style
%%\documentclass[sn-chicago]{sn-jnl}% Chicago-based Humanities Reference Style
\documentclass[sn-mathphys]{sn-jnl}% Standard Nature Portfolio Reference Style
%%\documentclass[default]{sn-jnl}% Default
%%\documentclass[default,iicol]{sn-jnl}% Default with double column layout
%%%% Standard Packages
%%<additional latex packages if required can be included here>
%%%%
%%%%%=============================================================================%%%%
%%%% Remarks: This template is provided to aid authors with the preparation
%%%% of original research articles intended for submission to journals published
%%%% by Springer Nature. The guidance has been prepared in partnership with
%%%% production teams to conform to Springer Nature technical requirements.
%%%% Editorial and presentation requirements differ among journal portfolios and
%%%% research disciplines. You may find sections in this template are irrelevant
%%%% to your work and are empowered to omit any such section if allowed by the
%%%% journal you intend to submit to. The submission guidelines and policies
%%%% of the journal take precedence. A detailed User Manual is available in the
%%%% template package for technical guidance.
%%%%%=============================================================================%%%%
\jyear{2022}%
%% as per the requirement new theorem styles can be included as shown below
\theoremstyle{thmstyleone}%
\newtheorem{theorem}{Theorem}% meant for continuous numbers
%%\newtheorem{theorem}{Theorem}[section]% meant for sectionwise numbers
%% optional argument [theorem] produces theorem numbering sequence instead of independent numbers for Proposition
\newtheorem{proposition}[theorem]{Proposition}%
%%\newtheorem{proposition}{Proposition}% to get separate numbers for theorem and proposition etc.
\theoremstyle{thmstyletwo}%
\newtheorem{example}{Example}%
\newtheorem{remark}{Remark}%
\theoremstyle{thmstylethree}%
\newtheorem{definition}{Definition}%
\raggedbottom
%%\unnumbered% uncomment this for unnumbered level heads
%\usepackage{floatrow}
\usepackage{graphicx}
\usepackage{subcaption}
\usepackage{physics}
\begin{document}
\title[Encoding For Healthcare Data Democratisation]{Data Encoding For Healthcare Data Democratisation and Information Leakage Prevention}
%%=============================================================%%
%% Prefix -> \pfx{Dr}
%% GivenName -> \fnm{Joergen W.}
%% Particle -> \spfx{van der} -> surname prefix
%% FamilyName -> \sur{Ploeg}
%% Suffix -> \sfx{IV}
%% NatureName -> \tanm{Poet Laureate} -> Title after name
%% Degrees -> \dgr{MSc, PhD}
%% \author*[1,2]{\pfx{Dr} \fnm{Joergen W.} \spfx{van der} \sur{Ploeg} \sfx{IV} \tanm{Poet Laureate}
%% \dgr{MSc, PhD}}\email{iauthor@gmail.com}
%%=============================================================%%
\author*[1]{\fnm{Anshul} \sur{Thakur}}\email{anshul.thakur@eng.ox.ac.uk}
\author[1]{\fnm{Tingting} \sur{Zhu}}\email{tingting.zhu@eng.ox.ac.uk}
\equalcont{These authors contributed equally to this work.}
\author[2]{\fnm{Vinayak} \sur{Abrol}}\email{abrol@iiid.ac.in}
\equalcont{These authors contributed equally to this work.}
\author[1]{\fnm{Jacob} \sur{Armstrong}}\email{jacob.armstrong@eng.ox.ac.uk}
\author*[1]{\fnm{Yujiang} \sur{Wang}}\email{yujiang.wang@eng.ox.ac.uk}
\author[1]{\fnm{David A.} \sur{Clifton}}\email{david.clifton@eng.ox.ac.uk}
\affil*[1]{\orgdiv{Department of Engineering Science}, \orgname{University of Oxford}, \orgaddress{ \postcode{OX3 7DQ}, \state{Oxfordshire}, \country{United Kingdom}}}
\affil[2]{\orgdiv{Infosys Centre for AI}, \orgname{IIIT Delhi}, \orgaddress{\country{India}}}
%%==================================%%
%% sample for unstructured abstract %%
%%==================================%%
\abstract{
The lack of data democratization and information leakage from trained models hinder the development and acceptance of robust deep learning-based healthcare solutions. This paper argues that irreversible data encoding can provide an effective solution to achieve data democratization without violating the privacy constraints imposed on healthcare data and clinical models. An ideal encoding framework transforms the data into a new space where it is imperceptible to a manual or computational inspection. However, encoded data should preserve the semantics of the original data such that deep learning models can be trained effectively. This paper hypothesizes the characteristics of the desired encoding framework and then exploits random projections and random quantum encoding to realize this framework for dense and longitudinal or time-series data. Experimental evaluation highlights that models trained on encoded time-series data effectively uphold the information bottleneck principle and hence, exhibit lesser information leakage from trained models.
}
\keywords{Healthcare data encoding, Data democratization, Information Leakage}
\maketitle
\section{Introduction}
\label{sec:sec1}
In recent years, deep learning has demonstrated remarkable success in a wide variety of fields \cite{Goodfellow}, and it is expected to have a significant impact on healthcare as well \cite{hinton}. Many attempts have been made to achieve this breakthrough in healthcare informatics, which often deals with noisy, heterogeneous, and non-standardized electronic health records (EHRs) \cite{7801947}. However, most clinical deep learning tools are either not robust enough or have not been tested in real-world scenarios \cite{challenges,jama_rev}. Deep learning solutions, approved by regulatory bodies, are less common in healthcare informatics, which shows that deep learning hasn't had the same level of success as in other fields such as speech and image processing \cite{aisu2022regulatory}. Along with well-known explainability challenges in deep learning models \cite{sapoval2022current}, the lack of \emph{data democratization} \cite{lewis2020data} and \emph{latent information leakage} (information leakage from trained models) \cite{liu2020privacy,mireshghallah2020privacy} can also be regarded as a major hindrance in the development and acceptance of robust clinical deep learning solutions. In the current context, data democratization and information leakage can be described as:
\begin{itemize}
\setlength{\itemsep}{0.5\baselineskip}
\item \textbf{\emph{Data democratization :}} It involves making digital healthcare data available to a wider cohort of the AI researchers. Achieving healthcare data democratization can result in global clinical models that are trained on data sampled from multiple geographical locations instead of being limited to a single site. These models are expected to be robust to population-specific distribution shifts and to exhibit better generalization. The wider access to healthcare data might also facilitate algorithmic contributions tailored for healthcare applications through a broader AI research base. However, healthcare data is ``sensitive'' and is rightly protected by data privacy laws making data democratization difficult \cite{vokinger_stekhoven_krauthammer_2020,thakur2021dynamic}.
\item \textbf{\emph{Latent Information Leakage:}} Deep learning models are known for their higher complexity and ability to learn the non-targeted latent information about the underlying population \cite{mireshghallah2020privacy}. This latent information often acts as an inductive bias to improve the predictive performance of the model. However, the latent information can be sensitive or help in inferring the information such as age, sex, and chronic or acute medical conditions of the patients. The revelation of this sensitive patient information can be considered a privacy violation.
\end{itemize}
Hence, data democratization and prevention of latent information leakage are two of the important factors required to develop better clinical deep learning solutions that are secure and widely acceptable.
\vspace{0.1cm}
Data democratization can be equated with the irreversible de-identification of healthcare data so that no patient can be linked to an electronic health record (EHR). A ``truly'' de-identified dataset cannot be considered sensitive or private, so sharing it publicly would not result in a violation of any data privacy laws \cite{el2015anonymising}. However, researchers have not developed a truly irreversible de-identification mechanism, and there is always a risk of re-identification \cite{el2015anonymising,henriksen2016re,vokinger_stekhoven_krauthammer_2020}. It is a common practice to anonymize healthcare data, but the resulting data might not always be considered to be completely de-identified. In general, the notion of anonymity or de-identification is closely related to the amount of computational effort and time required to re-identify a patient from the data. An EHR can be considered non-anonymous (even after the anonymization process) if the efforts to re-identify the patient are considered reasonable. The ``reasonable efforts'' are subjective and should often change with advancements in technology \cite{vokinger_stekhoven_krauthammer_2020}. As a result, simple data anonymization is not enough to achieve ``true'' de-identification and data democratization. Hence, there is a requirement for information processing mechanisms that could mask private information while retaining the data semantics to enable data sharing or democratization.
\vspace{0.1cm}
Aside from data democratization, trained clinical deep learning models also raise privacy concerns. These models have been shown to learn bio-markers of diabetic retinopathy, anemia, and chronic kidney disease from fundus images \cite{zhang2021deep}. Apart from that, deep learning models can also predict gender, sex, ethnicity, and smoking status from a fundus image \cite{poplin2018prediction}. Hence, it is quite possible that a model trained for predicting diabetic retinopathy from fundus images can learn a feature representation that may reveal non-targeted patient characteristics and sensitive information regarding the ailment of a patient suffering from chronic kidney disease and anemia. In the same way, a model trained for mortality prediction based on the first 48 hours of hospitalization in the intensive care unit (ICU) can provide information on the patient's acute as well as chronic conditions that may or may not be related to the current ICU stay or mortality prediction (see Results). The extensive feature extraction in deep learning models results in better performance for the targeted task and the discovery of new \emph{non-targeted} or \emph{passive} digital bio-markers for various diseases, thereby improving healthcare provision. This disclosure of non-targeted information, however, violates the privacy of the patients and poses an ethical dilemma.
% Moreover, patients may have permitted their medical information or data to be used for a very specific purpose. For example, researchers may have received consent to study only eye diseases using patients' fundus images. Using these fundus images to extract and reveal latent kidney disease information may violate data utilization agreements.
\vspace{0.1cm}
Deep learning models can be seen as a combination of feature extraction layers mapping an input example to a compressed, semantic representation or embedding and the last classification layer mapping the embedding to the model output or predictions (Fig.~\ref{fig:intro}D). According to the information bottleneck (IB) principle, an ideal model should minimize mutual information between input and embedding while maximizing it between embedding and the model output \cite{pan2021disentangled,tishby2000information}. In other words, the embedding extracted by the model should only contain task-specific information and must strip spurious or non-task-related information that might be present in the input. To avoid latent information leakage, clinical deep learning models should be designed or trained to follow the IB principle and must only extract the ``relevant'' information from the input patient data.
\begin{figure}[t]
\centering
\includegraphics[scale=0.34]{figs/INTRO-1.pdf}
\caption{\textbf{A.}~Conceptual rendition of a multi-variate time-series as a collection of multiple $1$-d signals.~\textbf{B.} Illustration of the process of encoding one of the 1-d signals within a time-series using the proposed encoding framework.~\textbf{C.}~Illustration of a quantum circuit that is composed of four wires, unitary rotation gates, and controlled-NOT (CNOT) gates. ~\textbf{D.} Illustration of the setup used for evaluating the latent information leakage from the trained mortality prediction models. Penultimate layer embedding from the trained mortality prediction models is given as input to a linear or dense layer dealing with either gender or patient disorders predictions.}
\label{fig:intro}
\end{figure}
\vspace{0.1cm}
This paper argues that encoding healthcare data can achieve both data democratization and latent information leakage prevention simultaneously. To accomplish this, we envision an encoding framework transforming pre-processed and anonymized longitudinal health records or multi-variate time-series data into a new space. This encoding framework should meet the following requirements:
\begin{itemize}
\setlength{\itemsep}{0.5\baselineskip}
\item \textbf{\emph{One-way transformation:}} The recovery of the original data from its encoded version should either be impossible or extremely computationally challenging.
\item \textbf{\emph{Imperceptibility of the encoded data:}} The encoded data should be a highly convoluted version of the original data. It should not be possible to infer any information about the original data just by performing a simple manual or computational analysis of its encoded version. Feature scaling or normalization, for example, cannot be considered a viable method of encoding information.
\item \textbf{\emph{Semantic preservation:}} The encoding framework must preserve the semantic characteristics of the original data to a large extent so that deep learning models can be trained effectively over the encoded data. In theory, the performance of models based on original data and encoded data should be the same.
\end{itemize}
The realization of this envisioned framework will enable the sharing of encoded healthcare data without violating privacy constraints. Ideally, encoded data is imperceptible, and the encoding process is practically irreversible. Therefore, it is very unlikely that any sensitive patient information can be derived from encoded data by either a manual or computational inspection. Nevertheless, there is an obvious trade-off between the imperceptibility and semantic preservation requirements of the envisioned encoding framework. A better semantic preservation results in lesser imperceptibility and vice versa. As a result, the encoded data can be seen as a ``deformed'' version of the original data, and much higher computational effort is required to extract its semantic characteristics. This nature of encoded data results in inherent regularization during model training and indirectly enforces the IB principle (see Results) to prevent latent information leakage.
This paper exploits \emph{random projections} \cite{bingham2001random,vempala2005random} and \emph{random quantum circuits} \cite{yang2021decentralizing,henderson2020quanvolutional} as information processing tools to achieve the desired encoding framework for the multivariate time-series data. Both random quantum circuits and random projections can deform or project the data to a space where it becomes imperceptible. By exploiting random projections or random quantum circuits, the proposed encoding framework performs piece-wise or segment-wise temporal encoding of each feature or each $1$-d signal of a multivariate time series (Figure \ref{fig:intro}B). Since there is no interference among features or signals of the original time series, the resulting encoded time series retains its semantic characteristics. However, random transformations deform each segment of a signal to make them incomprehensible. Due to the fact that the original data, encoding method, transformation matrix (used for random projections), and random quantum circuit will not be made public, it is extremely difficult to reverse the encoding process. Hence, data democratization can be achieved by sharing this encoded data among deep learning researchers. Additionally, higher model complexity is required to extract the relevant semantic information from the deformed or encoded data resulting in regularisation and thus enforcing the IB principle.
\begin{table}[t]
\centering
\caption{Characteristics of MIMIC-III, PhysioNet, and eICU datasets.}
\label{tab:data}
\resizebox{.95\textwidth}{!}{
\begin{tabular}{c||c||c||c||c||c}
\specialrule{.15em}{.12em}{.12em}
\textbf{Dataset} & \textbf{\begin{tabular}[c]{@{}c@{}}\#ICU \\ Stays\end{tabular}} & \textbf{\begin{tabular}[c]{@{}c@{}}\# Positive\\ Cases\end{tabular}} & \textbf{\begin{tabular}[c]{@{}c@{}} Feature \\ Dimensions\end{tabular}} & \textbf{Time-steps} & \textbf{\begin{tabular}[c]{@{}c@{}}\# Train, Validation \\ and Held-out\\ Examples\end{tabular}} \\ \specialrule{.15em}{.12em}{.12em}
MIMIC-III & 21,156 & 2,799 & 60 & 48 & 14698, 3222, 3236 \\ \specialrule{.1em}{.05em}{.05em}
PhysioNet & 8,000 & 1,122 & 44 & 48 & 5120, 1280, 1600 \\ \specialrule{.1em}{.05em}{.05em}
eICU & 122,588 & 57,434 & 284 & 12 & 68648, 17163, 36777 \\ \specialrule{.15em}{.12em}{.12em}
\end{tabular}}
\end{table}
\section{Results}
\label{sec:res}
\subsection{Designed experiments for the performance evaluation}
The proposed encoding framework is evaluated using publicly available datasets: \textbf{1.)} \emph{PhysioNet 2012 challenge} \cite{silva2012predicting}, \textbf{2.)} \emph{MIMIC-III} \cite{johnson2016mimic,harutyunyan2019multitask} and \textbf{3.)} \emph{eICU-CRD} \cite{pollard2018eicu, tang2020democratizing}. Both \emph{PhysioNet} and \emph{MIMIC-III} deal with in-hospital mortality prediction based on the first 48 hours of ICU stay. Similarly, \emph{eICU-CRD} is used for the task of acute respiratory failure (ARF) prediction based on the first 12 hours of ICU stay. Each ICU stay is represented by a time series with $48$ and $12$ time steps (separated by $1$ hour) for mortality and ARF prediction, respectively. Each step is represented by a $44$, $60$, and $284$-dimensional feature vector in PhysioNet, MIMIC-III, and eICU datasets, respectively. Table \ref{tab:data} documents the total number of ICU stays or examples available in each dataset. In addition to the clinical features and task labels, meta-data about the patients corresponding to ICU stays are also available. This includes gender information in all datasets as well as chronic, acute, and mixed conditions afflicting the patients in MIMIC-III and information about the ethnicity of the
patients in eICU. More details about the clinical features representing time series in all datasets can be found in the supplementary document. The following experiments are designed to evaluate different aspects of the proposed framework:
\begin{itemize}
\setlength{\itemsep}{0.5\baselineskip}
\item On the original as well as on the encoded data, we train $5$ different neural networks on each dataset and compare their relative performances. These models include long short-term memory (LSTM) \cite{yu2019review}, temporal $1$-D convolutions \cite{bai2018empirical}, multi-resolution temporal convolutions \cite{martinez2020lipreading}, transformer \cite{vaswani2017attention}, and vision transformer \cite{dosovitskiy2020image}. More details can be found in Section \ref{sec:methods}.
% \newpage
\item To assess the latent information leakage from the trained models, a single dense layer mapping the penultimate layer embedding to the patient information is used. For the MIMIC-III dataset, gender and $25$ ``latent'' or non-targeted patient disorders (acute, chronic, and mixed) are predicted from the penultimate layer embedding of the trained mortality prediction models. For PhysioNet, we only predict gender as the latent information.
\begin{figure}[H]
\centering
\begin{subfigure}{.495\textwidth}
\centering
\includegraphics[scale=0.245]{mimic/main_strip.pdf}
\caption{Models'~performance on MIMIC-III.}
\end{subfigure}
\begin{subfigure}{.495\textwidth}
\centering
\includegraphics[scale=0.27]{mimic/main_auroc.pdf}
\vspace{1.75mm}
\caption{Aggregate MIMIC-III performance.}
\end{subfigure}
\begin{subfigure}{.495\textwidth}
\centering
\includegraphics[scale=0.245]{physio/results_strip.pdf}
\caption{Models'~performance on PhysioNet.}
\end{subfigure}
\begin{subfigure}{.495\textwidth}
\centering
\includegraphics[scale=0.27]{physio/results_auroc.pdf}
\vspace{1.75mm}
\caption{Aggregate PhysioNet performance.}
\end{subfigure}
\begin{subfigure}{.495\textwidth}
\centering
\includegraphics[scale=0.245]{EICU/main_strip.pdf}
\caption{Models'~performance on eICU.}
\end{subfigure}
\begin{subfigure}{.495\textwidth}
\centering
\includegraphics[scale=0.27]{EICU/main_auroc.pdf}
\vspace{1.75mm}
\caption{Aggregate eICU performance.}
\end{subfigure}
\caption[short]{Performance of LSTM, vision transformer (ViT), transformer, temporal convolutional network (TCN) and multi-branch temporal convolutional network (Multi-TCN) on \textbf{(a)} MIMIC-III, \textbf{(c)} PhysioNet and \textbf{(e)} eICU, respectively. Performance as a function of encoding methods across different models on \textbf{(b)} MIMIC-III, \textbf{(d)} PhysioNet and \textbf{(f)} eICU, respectively.}
\label{fig:res1}
\end{figure}
\noindent Similarly, we predict the gender and ethnicity of patients from the trained ARF prediction models.
\end{itemize}
Since we are employing only a single linear layer to map embedding to either sex, ethnicity, or patient disorders (Fig.~\ref{fig:intro}D), no further feature transformations are employed. The performance of this latent information prediction depends entirely on the nature of embedding. More details about this experimental setup can be found in Section \ref{sec:methods}.
\vspace{-0.25cm}
\subsection{Performance on the encoded time-series data}
The performance of different models on the encoded and the original datasets is depicted in Fig.~\ref{fig:res1}. An analysis of this figure highlights the following:
\begin{itemize}
\itemsep 1em
\item Across all datasets, the performance of models trained and evaluated on the original data is superior to that of the models dealing with the encoded time-series data. Across all models on MIMIC-III, random quantum encoding and random projection-based encoding resulted in an average relative performance drop of $3.52\;(\pm1.25)\%$ and $15.29\;(\pm2.51)\%$, respectively. The average relative performance drop of $5.13\;(\pm1.94)\%$ and $22.44\;(\pm4.75)\%$ are observed in PhysioNet dataset. Similarly, a drop of $2.13\;(\pm1.59)\%$ and $12.45\;(\pm2.29)\%$ was observed for the eICU dataset. This drop is expected as data encoding deforms the time series to preserve patient information.
\item Despite the performance drop exhibited by models trained on the encoded data, these models (especially models trained on the quantum encoded data) seem to be effective in performing the target task. This shows that the encoding framework, either using random projection or random quantum encoding, can retain essential semantic characteristics in the \emph{deformed} encoded data.
\item The performance of random quantum encoding is significantly better than random projections across all models and datasets. This shows that quantum encoding can preserve the semantic characteristics to a greater extent while deforming the data using random quantum operations.
\end{itemize}
\subsection{Latent information leakage from the trained models}
\subsubsection*{Patients' gender and ethnicity prediction}
The performance for the task of predicting a patient's gender from the trained mortality and ARF prediction models is depicted in Fig.~\ref{fig:res2}. According to the analysis of Fig.~\ref{fig:res2}, we can effectively predict patients' gender from the trained models on original or non-encoded data. The behavior is common across all datasets and all models regardless of their modeling capacity. Similarly, the analysis of Fig.~\ref{fig:ethn} illustrates that we can identify the patients' gender from the ARF models trained on the original time-series data. Although gender and ethnicity are not sensitive information, these results highlight that trained models can indeed reveal the latent non-targeted patient characteristics.
\begin{figure}[H]
\centering
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.26]{mimic/sex_strip.pdf}
\includegraphics[scale=0.26]{mimic/sex_AUROC.pdf}
\caption{Gender prediction from the embedding of MIMIC-III models.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.26]{physio/sex_strip.pdf}
\includegraphics[scale=0.26]{physio/sex_auroc.pdf}
\caption{Gender prediction from the embedding of PhysioNet models .}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.26]{EICU/sex_strip.pdf}
\includegraphics[scale=0.26]{EICU/sex_AUROC.pdf}
\caption{Gender prediction from the embedding of eICU models.}
\end{subfigure}
\caption[short]{Model-specific and aggregated (across all models) performance for the task of patients' gender prediction using the penultimate embedding generated from different models trained on \textbf{(a)} MIMIC-III and \textbf{(b)} PhysioNet and \textbf{(c)} eICU datasets, respectively.}
\label{fig:res2}
\end{figure}
\begin{figure}[H]
\centering
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.21]{EICU/Black_strip.pdf}
\includegraphics[scale=0.21]{EICU/Black_AUROC.pdf}
\caption{Predicting if a patient is African-American.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.21]{EICU/Asian_strip.pdf}
\includegraphics[scale=0.21]{EICU/Asian_AUROC.pdf}
\caption{Predicting if a patient is Asian.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.21]{EICU/White_strip.pdf}
\includegraphics[scale=0.21]{EICU/White_AUROC.pdf}
\caption{Predicting if a patient is Caucasian.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.21]{EICU/Hispanic_strip.pdf}
\includegraphics[scale=0.21]{EICU/Hispanic_AUROC.pdf}
\caption{Predicting if a patient is Hispanic.}
\end{subfigure}
\caption[short]{Model-specific and aggregated (across all models) performance for the task of predicting patients' ethnicity from the trained \emph{acute respiratory failure} prediction models.}
\label{fig:ethn}
\end{figure}
\begin{figure}[H]
\centering
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.25]{mimic/latent_pheno_strip.pdf}
\includegraphics[scale=0.25]{mimic/latent_pheno_auroc.pdf}
\caption{Average performance for the prediction of all $25$ patient disorders.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[trim={0 0.65cm 0 0},clip,scale=0.26]{mimic/chronic_results_LSTM.pdf}
% \includegraphics[scale=0.26]{mimic/acute_results_LSTM.pdf}
\caption{Latent prediction of chronic disorders from LSTM-based MIMIC-III models.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[trim={0 0.65cm 0 0},clip,scale=0.26]{mimic/acute_results_LSTM.pdf}
%\includegraphics[scale=0.26]{mimic/acute_results_LSTM.pdf}
\caption{Latent prediction of acute disorders from LSTM-based MIMIC-III models.}
\end{subfigure}
\caption[short]{Performance for the task of latent patient disorder prediction using the penultimate embedding generated from MIMIC-III mortality prediction models. The chronic and acute disorders shown in (b) and (c) are subsets of $25$ different conditions considered in this work. A single model predicts the presence/absence of all $25$ disorders.}
\label{fig:disorder}
\end{figure}
\subsubsection*{Latent disorder prediction}
Fig.~\ref{fig:disorder} (a) illustrates the performance of predicting the patient disorders from the trained MIMIC-III models in a latent manner. The analysis of this figure highlights that all models trained on the original data generate representations or embedding that reveal information regarding the patients' disorders. Across all models trained on original data, a macro AUROC of approx. $0.7$ is observed for the latent disorder prediction. It should be noted that the macro AUROC obtained by different models within this experiment is comparable to the performance achieved by the targeted patient phenotype prediction models (see Fig.~S1 of the supplementary report). This shows that mortality prediction models are susceptible to leaking the patients' private medical information.
\begin{figure}[t]
\centering
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.33,trim={0 1.25cm 0 0},clip]{figs/Odds_ratios_chronic.pdf}
\caption{Odds ratios between occurrences of chronic disorders and mortality.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.33,trim={0 1.25cm 0 0},clip]{figs/Odds_ratios_Acute.pdf}
\caption{Odds ratios between occurrences of acute disorders and mortality.}
\end{subfigure}
\caption[short]{Odds ratios comparing occurrences of \textbf{(a)} chronic and \textbf{(b)} acute disorders against the \emph{outcome} i.e.~mortality in MIMIC-III dataset.}
\label{fig:odds}
\end{figure}
Fig.~\ref{fig:disorder} (b) and (c) depict the performance of predicting the chronic and acute disorders (a subset of 25 disorders) from the trained LSTM mortality prediction models. Similar behavior is observed for all the other models considered in this study (see supplementary document Fig.~S2). The analysis of the figures shows that these models learn the characteristics that help infer or predict non-targeted patient disorders. We can predict both chronic and acute disorders that may or may not be correlated with the mortality prediction. According to the odds ratios \cite{bland2000odds} for acute and chronic disorders (Fig.~\ref{fig:odds} (a) and (b)), most acute conditions exhibit a higher risk of mortality (odds ratio $>>1$), while most chronic conditions are weakly associated with the mortality ($\approx1$).
This shows that some conditions, such as \emph{shock} and \emph{acute renal failure}, are directly associated while others, such as chronic \emph{lipid metabolism disorder} and chronic \emph{renal disease}, are not associated with mortality in the MIMIC-III patients corresponding to the ICU stays. Irrespective of odds ratios or the association between disorders and mortality, we can identify patients ailing from these ailments with an average AUROC of $>0.7$.
\subsection{Encoded data minimizes information leakage}
The analysis of Fig.~\ref{fig:res2}, \ref{fig:ethn}, and \ref{fig:disorder} further highlights that the models trained on the encoded data exhibit lesser latent information leakage than the models trained on the original data. On average, MIMIC-III models trained on data encoded using quantum circuits and random projections (rather than original data) exhibited a relative drop of $20.11\;(\pm 2.45)\%$ and $23.52\;(\pm 3.98)\%$ in performance for the latent gender prediction task. The PhysioNet models also exhibited relative drops of $22.66\;(\pm 5.45)\%$ and $28.21\;(\pm 8.98)\%$ for the data encoded using the quantum circuit and the random projections, respectively. Similar behavior is observed for the eICU models where quantum encoding and random projection-based encoding resulted in a relative drop of $23.1\;(\pm 4.25)\%$ and $31.11\;(\pm 7.6)\%$ in the performance of gender prediction task. The encoding data also resulted in a drop in the performance of the ethnicity prediction tasks. A similar trend is observed for the patient disorder prediction from MIMIC-III models. Quantum encoding and random projections resulted in a relative drop of $12.5\;(\pm 3.79)\%$ and $18.75\;(\pm 5.45)\%$ in the average macro AUROC score.
\vspace{0.1cm}
As discussed in Section \ref{sec:sec1}, models that follow the IB principle exhibit lesser information leakage. The drop in latent information leakage from models trained on the encoded data can be attributed to the lower mutual information (MI) between the model input (i.e.~original or encoded) time series and the penultimate layer embedding generated from the trained models. To uphold this claim, we estimated MI from the LSTMs trained using the original and the encoded data. For the feasibility of MI estimation, we used the average and vectorized form of the input time series to compute MI. Fig.~\ref{fig:MI} illustrates the distribution of estimated MI between the input and the penultimate embedding. It is clear from this figure that the utilization of encoded data minimizes the MI between the model input and the learned representation. As a result, it can be inferred that training models with the encoded data inherently enforce the IB principle in the training process. Hence, the learned embedding only retains the information required to predict mortality while stripping away the non-essential or non-targeted patient information.
\vspace{0.1cm}
The above analysis shows that random projections-based encoding provides maximum prevention against latent information leakage. However, if we analyze Fig.~\ref{fig:res2} along with Fig.~\ref{fig:res1}, it is also evident that random projection-based encoding results in a larger drop in the performance of the targeted task. On the other hand, random quantum encoding provides more balance between the performance of the targeted task and the prevention of information leakage.
\begin{figure}[H]
\centering
\begin{subfigure}{.5\textwidth}
\centering
\includegraphics[scale=0.45]{figs/MI/MI_Means.pdf}
\caption{\centering On MIMIC-III; MI using\hspace{\textwidth} averaged time-series}
\end{subfigure}%
\begin{subfigure}{.5\textwidth}
\centering
\includegraphics[scale=0.45]{figs/MI/MI_Vect.pdf}
\caption{\centering On MIMIC-III; MI using\hspace{\textwidth} unraveled time-series}
\end{subfigure}
\begin{subfigure}{.5\textwidth}
\centering
\includegraphics[scale=0.449]{figs/MI/MI_Mean_Physio.pdf}
\caption{\centering On PhysioNet, MI using\hspace{\textwidth} averaged time-series}
\end{subfigure}%
\begin{subfigure}{.5\textwidth}
\centering
\includegraphics[scale=0.45]{figs/MI/MI_Vect_Physio.pdf}\caption{\centering On PhysioNet; MI using\hspace{\textwidth} unraveled time-series}
\end{subfigure}
\caption[short]{Kernel density estimation plots illustrating the estimated mutual information (MI) between embedding obtained from the trained LSTM models and the input time-series in MIMIC-III (\emph{first row}) and PhysioNet (\emph{second row}) as a function of the encoding methods. To facilitate the MI estimation, the input time series is either vectorized or averaged across time dimensional before computing MI with the embedding.}
\label{fig:MI}
\end{figure}
\begin{figure}[H]
\centering
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.45]{figs/heat_map_negative.pdf}
\caption{Three negative examples from MIMIC-III.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.45]{figs/heat_map_positive.pdf}
\caption{Three positive examples from MIMIC-III.}
\end{subfigure}
\caption[short]{Heat maps illustrating the differences in magnitude and trends of the original and encoded time-series examples. Each row represents an input time series and its encoded versions.}
\label{fig:heat}
\end{figure}
\begin{figure}[t]
\centering
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.3]{figs/dist/ALT_layer2.pdf}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.3]{figs/dist/ALP_layer2.pdf}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.3]{figs/dist/BUN_layer2.pdf}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.3]{figs/dist/CHOLESTROL_layer2.pdf}
\end{subfigure}
\caption[short]{Difference in average trends and the average magnitude of the original and encoded signals or features. These signals are obtained by averaging $50$ time series representing patients exhibiting mortality in the PhysioNet dataset.}
\label{fig:res5}
\end{figure}
\subsection{Visual inspection of the encoded data}
The difference between the original and the encoded examples from the MIMIC-III dataset is illustrated in Fig.~\ref{fig:heat}. The analysis of this figure makes it clear that both temporal trends and distribution of features in the original and the encoded time-series examples are noticeably different. To further analyze the impact of the encoding process on the time-series data, $50$ original and encoded examples from the positive (mortality) class of the PhysioNet dataset were randomly selected and averaged to obtain the original and encoded ``summary'' time series. Fig.~\ref{fig:res5} depicts the behavior of four randomly chosen features from these summarised time series. Again, the distribution of magnitude as well as temporal trends of the encoded features is different from the original time-series features. By mere visual inspection, it is near impossible to perceive any information from the encoded data (both quantum encoding and random projections). Similar behavior is observed for the other features. Hence, the encoding process provides an additional layer of privacy over the de-identified data and pushes the community a step closer to achieving data democratization.
\subsection{Data encoding and explainability}
Encoded data is expected to retain the semantic characteristics of the original data to a large extent such that models trained on original and encoded data exhibit similar behavior. Along with similar performance, the features relevant for predictions in models trained on both the original and the encoded data should largely be the same. While encoded data does retain semantic characteristics, there is a noticeable performance drop due to data encoding (Fig.~\ref{fig:res1}). This shows that the behavior of models trained on encoded data could be different.
Shapely additive explanations (SHAP) \cite{NIPS2017_8a20a862} are employed on the LSTM models, trained using the original and encoded PhysioNet and MIMIC-III datasets, to study the impact of data encoding on the feature relevance. Fig.~\ref{fig:shap} illustrates the top $10$ relevant features identified by SHAP in each PhysioNet model. The analysis of this figure highlights that there is a huge overlap between the sets of relevant features identified for the ``original'' and the ``quantum encoded'' models. Moreover, \emph{Glascow comma score} and \emph{blood urea nitrogen} are regarded as the most relevant features in both models. Although there is some overlap between the relevant features of the original and the ``random projection-based encoded'' models, the overall behavior seems to be very different. Similar behavior is observed for the MIMIC-III models (see Fig.~S3 of the supplementary document). Hence, it can be argued that random quantum encoding has been successful in retaining semantic characteristics such that the resultant models exhibit similar behavior to the original models up to an acceptable level.
\begin{figure}[t]
\centering
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.28]{figs/SHAP/Org_physio.pdf}
\caption{SHAP analysis of LSTM trained on PhysioNet dataset.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.28]{figs/SHAP/Quantum_physio.pdf}
\caption{SHAP analysis of LSTM trained on quantum encoded PhysioNet dataset.}
\end{subfigure}
\begin{subfigure}{\textwidth}
\centering
\includegraphics[scale=0.28]{figs/SHAP/RP_physio.pdf}
\caption{SHAP analysis of LSTM trained on PhysioNet data encoded by random projections.}
\end{subfigure}
\caption[short]{A comparison of SHAP-based feature importance in LSTM models trained on (a) original, (b) quantum encoded, and (c) randomly projected versions of the PhysioNet dataset.}
\label{fig:shap}
\end{figure}
\section{Discussion}
\label{sec:dis}
This study proposes to encode the healthcare data to achieve data democratization and prevent information leakage. The \emph{irreversible} and \emph{semantic preserving} encoding process outlined in this paper allows getting an imperceptible and deformed form of healthcare data that can be shared among researchers without violating privacy constraints. Moreover, the inherent regularisation imposed on neural network training due to deformity of the training data induces the \emph{information bottleneck} (IB) principle and results in models that are less susceptible to latent information leakage (Fig.~\ref{fig:MI}).
This paper explores random projections and random quantum operations to piece-wise encode the 1-d signals in a time series as highlighted in Section \ref{sec:methods} and Fig.~\ref{fig:intro}. Compared to the original time-series signals, the resultant encoded signals exhibit different feature distributions and follow \emph{somewhat} imperceptible trends (Fig.~\ref{fig:res5}). Models trained on the encoded data perform well, highlighting that the semantics are effectively preserved (Fig.~\ref{fig:res1}). Concomitantly, the information leakage from these models is significantly lesser than models trained on the original data (Fig.~\ref{fig:res2}, \ref{fig:ethn} and \ref{fig:disorder}). Thus, as desired, the proposed encoding framework results in encoded data that is visually imperceptible, effective for deep learning and minimizes information leakage from the trained deep models. The encoding transformation is near irreversible if the attacker does not have access to the random Gaussian matrix or random quantum circuit. To learn this transformation computationally or with deep neural networks, both encoded and original data must be available, which is clearly not the case.
Based on the performance comparison between models trained on data encoded using random projections and random quantum circuits (Fig.~\ref{fig:res1} and \ref{fig:res2}), it is evident that random quantum encoding balances the deformation of data and preservation of the semantic characteristics, which results in better models. Apart from the better performance of quantum encoding, retrieving the original data from its encoded version is theoretically harder as outputs of the quantum circuit or the state of qubits are observed by projecting them on a pre-defined basis state \cite{keyl2002fundamentals}. These measurements become the encoded signals, and estimating the qubit state from this measurement can be ambiguous as multiple qubit states could map to the same measurement. Even if the measurement weren't an issue, one would have to estimate the structure of quantum circuits (number of layers, number of gates, and nature of gates) as well as the parameters of rotation gates to reverse the encoding process possibly. In contrast, we only need to estimate the transformation matrix ($4 \times 4$) to reverse the random projections. It will be sufficient to have access to even one pair of original and encoded data to estimate this transformation matrix accurately.
\vspace{0.1cm}
The encoding of data is also able to facilitate collaboration among multiple research entities without infringing upon the privacy of the patients. All data collection sites can potentially share their data among themselves so that every site can access the ``global'' data. As discussed in Section \ref{sec:sec1}, the models trained on this global data are expected to be more generic and better at handling the population-specific distribution shifts. However, the random nature of encoding at each site will impede this cross-site collaboration. This problem can be solved by agreeing beforehand on the nature of data transformation, such as quantum circuit structure and rotation gate parameters. Thus, encoded data from each site will be in the same transformation space, allowing deep learning models to be trained effectively. Similar to cross-site collaboration, federated learning also allows a central server to collaborate with multiple sites for training a global model without data sharing \cite{rieke2020future}. However, the structure of models is entirely decided by the server, and sites do not have any independence. Each site is expected to perform similar operations using its local data. On the other hand, data encoding allows the researchers at each site to access the global data and work independently on any deep learning algorithm.
\vspace{0.1cm}
As an alternative to data encoding, generative models such as generative adversarial networks have been used to generate the data points that do not represent any real patients and theoretically can be shared publicly \cite{chen2021synthetic,jordon2020synthetic}. However, generative models capture the input distribution of the data points, and it is always possible to sample data points that are extremely similar to the input points or real patients. Similar to the subjectivity around the de-identification process (as discussed in Section 1), a sampled example that is similar to real patient data may or may not be considered as a fabricated data point. Moreover, generative modeling requires extensive computational resources and a ``large amount'' of data to fabricate the data points effectively. On the other hand, the proposed encoding approach is an information-processing framework and does not require any training.
\vspace{0.1cm}
In hindsight, the proposed encoding framework suffers from two major drawbacks:
\begin{itemize}
\itemsep 1em
\item The proposed framework was designed to encode the data for deep learning models that are known for their higher modeling capabilities. The deformations in the encoded data make it difficult for traditional machine-learning models with limited capabilities to process the encoded data effectively. Similarly, the summary statistics of the encoded and the original data are poles apart (by design). As a result, traditional statistical or epidemiological analyses are not feasible. Hence, the use cases of the encoded data are only limited to deep learning models.
\item Both random projections and random quantum encoding don't provide any explicit mechanism to control the degree of deformation in the encoded data or to maintain a balance between the imperceptibility of the encoded data and retaining the semantic information. The performance drop in models trained on the encoded data can be attributed to a lack of this balancing mechanism that could have induced only the minimum required deformation to make the data imperceptible and prevent information leakage.
\end{itemize}
In the future, we will work towards coming up with non-linear or sub-linear data transformations that could either automatically balance the deformation and semantic retention trade-off or provides a hyper-parameter to control the degree of deformation in the encoded data. Using such data transformations in the proposed encoding framework will improve the performance of the target tasks while enabling data democratization and preventing information leakage.
\section{Methods}
\label{sec:methods}
\subsection{Proposed encoding framework}
A uniformly sampled multivariate time series is a collection of multiple 1-d signals representing features measured over time. Suppose $\mathbf{X} \in \mathbb{R}^{F \times T}$ is a time-series consisting of $F$ 1-d signals of length $T$, and $\mathbf{x} \in \mathbb{R}^T$ or $\mathbf{x}=\left[\mathbf{x}_1,\mathbf{x}_2, \mathbf{x}_3, \ldots \mathbf{x}_T\right]$ is one of the $F$ signals. The proposed framework transforms the time-series $\mathbf{X}$ by performing piece-wise encoding of every 1-d signal in $\mathbf{X}$. The framework divides the signal $\mathbf{x}$ into segments or chunks of length $n$ as
$\hat{\mathbf{x}}=\left[\mathbf{x}
_{1:n},\mathbf{x}_{n+1:2n}
,\ldots \mathbf{x}_{(T-n+1):T}\right]$ and applies transformation operation $f()$ on every segment:
\begin{equation} \label{eq1}
\mathbf{e}_j=f(\hat{\mathbf{x}}_j) \;\;\;\forall\;\hat{\mathbf{x}}_j \in \hat{\mathbf{x}},
\end{equation}
\noindent where $\mathbf{e}_j \in \mathbb{R}^n$ is encoded version of $j$th segment of $\mathbf{x}$. Note that the dimensions of transformed/encoded and input segments are the same, and a segment length of $n=4$ has been used across all experiments. Each encoded segment of length $n$ is temporally concatenated to obtain the encoded version, $\mathbf{e} \in \mathbb{R}^T$, of the signal $\mathbf{x}$ as:
$\mathbf{e}=\left[\mathbf{e}_1, \mathbf{e}_2, \mathbf{e}_3 \ldots \mathbf{e}_{(T/n)} \right]$. Similarly, transformation or encoding operation is applied on all $F$ 1-d signals to transform $\mathbf{X}$ into the encoded time-series $\mathbf{E} \in \mathbb{R}^{F \times T}$. In this paper, we have used random projection and random quantum encoding as data transformation operation $f()$ in the proposed framework. Both these mechanisms are discussed below.
\subsubsection{Random projection}
Random projection is a method of projecting the input data into a random subspace using a random projection matrix whose columns are of unit length \cite{bingham2001random,vempala2005random}. It is mainly used for dimensionality reduction, and it approximately preserves the similarity among data points in the projected subspace as outlined by Johnson–Lindenstrauss lemma \cite{larsen2017optimality}. In this work, we are not interested in dimensionality reduction and are mainly concerned with projecting the input into a random subspace to make the data imperceptible. To attain this goal, we use a projection matrix $\mathbf{R} \in \mathbb{R}^{n \times n}$ whose entries are randomly sampled from Gaussian distribution $\mathcal{N}(0,1/n)$. This projection matrix can be used to encode the $j$th segment $\hat{\mathbf{x}}_j \in \mathbb{R}^{n \times 1}$ of signal $\mathbf{x}$ as:
\begin{equation}
\mathbf{e}_j= \mathbf{R}\hat{\mathbf{x}}_j,
\end{equation}
where $\mathbf{e}_j \in \mathbb{R}^{n \times 1}$ is the encoded version of the input segment. As discussed above, we have used a segment length of $n=4$, so the projection matrix of $4 \times 4$ is used for data encoding.
\subsubsection{Random quantum encoding}
The term random quantum encoding refers to a process of data transformation through the use of a quantum circuit containing multiple gates with random parameters \cite{yang2021decentralizing}. The Quantum circuit used in this study is shown in Fig.~\ref{fig:intro}(c). This circuit is composed of the following components \cite{kaye2006introduction}:
\begin{itemize}
\setlength\itemsep{1em}
\item \emph{Qubits or wires:} The circuit consists of four wires to represent four quantum bits or qubits. A qubit is a quantum system having a resting state $\ket{0}$ and an excited state $\ket{1}$. These states are mutually orthogonal and any qubit state $\ket{\psi}$ can be represented as a superposition of $\ket{0}$ and $\ket{1}$ as: $\ket{\psi}=a\ket{0}+b\ket{1}$, where $a$ and $b$ are complex numbers that must satisfy $\lvert a \rvert^2 + \lvert b \rvert^2=1$. $\lvert a\rvert^2$ and $\lvert b\rvert^2$ represent the probability of $\ket{\psi}$ being in $\ket{0}$ and $\ket{1}$, respectively. Initially, all four qubits are in a resting state. The number of wires or qubits is dictated by the length of the input segmented signal i.e.~$n=4$.
\item \emph{Rotation gates (RX)}: These gates rotate the qubit around x-axis by $\phi_k$ (radians) on its Bloch sphere projection, where $k$ is the index of RX gate in the circuit. This rotation operator with $\phi_k$ randomly chosen parameters can be defined as:
\begin{equation}
RX(\phi_k)=\begin{bmatrix}
\textrm{cos}\frac{\phi_k}{2} &-\iota \textrm{sin} \frac{\phi_k}{2}\\
-\iota\textrm{sin}\frac{\phi_k}{2} &\textrm{cos}\frac{\phi_k}{2}
\end{bmatrix}
\end{equation}
The resultant qubit state $\ket{\psi'}$ after applying $k$th RX gate to qubit $\ket{\psi}$ is given as:
\begin{equation}
\ket{\psi'}=\begin{bmatrix}
\textrm{cos}\frac{\phi_k}{2} &-\iota \textrm{sin} \frac{\phi_k}{2}\\
-\iota\textrm{sin}\frac{\phi_k}{2} &\textrm{cos}\frac{\phi_k}{2}
\end{bmatrix} \begin{bmatrix}
a \\
b
\end{bmatrix}
\end{equation}
\item \emph{Controlled-NOT (CNOT) gates}: A CNOT gate is used to entangle the two qubits and has no parameters. First qubit is considered as control and the second qubit is flipped if the control is $\ket{1}$. As we can see, CNOT deals with 2-qubit quantum system whose basis states are $\{\ket{00},\ket{01}, \ket{10},\ket{11}\}$. An input to CNOT gate is a linear superimposition of these basis states: $\ket{\psi}=a\ket{00}+b\ket{01}+c\ket{10}+d\ket{11}$, where $a,b,c$ and $d$ are the complex coefficients. Hence, CNOT operation can be defined as:
\begin{equation}
\textsc{cnot}(\ket{\psi})=a\ket{00}+b\ket{01}+d\ket{10}+c\ket{11}.
\end{equation}
\end{itemize}
\noindent\textbf{Encoding using quantum circuit:} The whole quantum encoding process can be divided into three steps:
\begin{itemize}
\setlength\itemsep{1em}
\item \emph{Encoding input segment on wires:} The first step is to infuse or project the input segment $\hat{\mathbf{x}}_j$ on wires of the circuit. Each element ($\hat{\mathbf{x}}_{j_n}$) of the input segment $\hat{\mathbf{x}}_j$ corresponds to $n$th wire or qubit. To encode the information from $\hat{\mathbf{x}}_{j_n}$ to $n$th qubit, we rotate this qubit by $\hat{\mathbf{x}}_{j_n}$ radians around $y$-axis on its Bloch sphere projection. This rotation operator is described as:
\begin{equation}
RY(\phi_n)=\begin{bmatrix}
\textrm{cos}\frac{\phi_n}{2} &-\textrm{sin} \frac{\phi_k}{2}\\
\textrm{sin}\frac{\phi_n}{2} &\textrm{cos}\frac{\phi_k}{2}
\end{bmatrix},
\end{equation}
where $\phi_n$ is $\pi \hat{\mathbf{x}}^j_{n}$. The process of applying this operator is similar to RX gates (Equation 4).
\item \emph{Processing qubits by quantum circuit:} After preparing the qubits as encoded versions of the input segment, these qubits are processed by the quantum circuit (Fig.~\ref{fig:intro}C) described above.
\item \emph{Measuring the outputs:} This operation is used to register the state of a qubit after applying all the quantum operations. In this work, we use the expectation of the Pauli-Z operator ($\mathbf{Z}$) to measure the output state of a qubit $\ket{\psi}$. We know that $\mathbf{Z}$ can be defined as \cite{kaye2006introduction}:
\begin{equation}
\mathbf{Z} = \begin{bmatrix}
1 &0\\
0 &-1
\end{bmatrix},
\end{equation}
where $\ket{0}\bra{0}-\ket{1}\bra{1}$ is the spectral decomposition form of $\mathbf{Z}$. Then, the expected value of Pauli-Z operator for $\ket{\psi}$ can be determined as:
\begin{equation}
\bra{\psi} \mathbf{Z} \ket{\psi}= \bra{\psi}\ket{0} \bra{0}\ket{\psi} - \bra{\psi}\ket{1} \bra{1}\ket{\psi}=\lvert \bra{0}\ket{\psi} \rvert^2 - \lvert \bra{1}\ket{\psi} \rvert^2.
\end{equation}
Here $\lvert \bra{0}\ket{\psi} \rvert^2$ and $\lvert \bra{1}\ket{\psi} \rvert^2$ represents the probabilities of $\ket{\psi}$ being in states $\ket{0}$ and $\ket{1}$, respectively. Note that $\bra{a}\ket{b}$ represents the inner product between $\ket{a}$ and $\ket{b}$ in Hilbert space. For $n$th wire or qubit, the measured value ($e_{j_n}$) is regarded as the encoded version of the corresponding element $\hat{\mathbf{x}}_{j_n}$ of the input segment $\hat{\mathbf{x}}_j$. By considering all $n$ qubit measurements, we obtain an encoded version ($\mathbf{e}_j=[e_{j_1}, e_{j_2}, \ldots e_{j_n}]$) of the input segment $\hat{\mathbf{x}}_j$. The encoded signal $\mathbf{e}$ is obtained by temporally concatenating all the encoded segments $\mathbf{e}_j$.
\end{itemize}
\subsection{Models}
Following neural network architectures have been used for the prediction tasks:
\begin{itemize}
\item \emph{Long short-term memory (LSTM) based model:} This model has also been used in \cite{thakur2021dynamic} for mortality prediction. It consists of an LSTM with 256 recurrent units followed by a linear layer with 1 node and sigmoid activation for binary prediction.
\item \emph{Temporal convolution neural networks} \cite{bai2018empirical,martinez2020lipreading}: These models exploit 1-d convolution operations for modeling input time series. In this work, we have used temporal convolutional networks having four temporal blocks followed by a linear layer with $1$ node and sigmoid activation that maps the $64$ dimensional embedding to an output score. Each temporal block consists of two 1-d convolution layers having $64$ filters of size $9$. Also, each convolution layer is followed by a 1-d batch normalization layer, parametric ReLU activation, and a dropout layer with a dropout probability of $0.75$. We have also used a multi-branch temporal convolutional network (\emph{Multi-TCN}) consisting of two multi-branch temporal blocks followed by a linear layer with 1 node and sigmoid activation. Each multi-branch temporal block consists of three branches that process the same input in parallel. Each branch consists of two 1-d convolutional layers having 32 filters where each convolutional layer is followed by batch normalization and parametric ReLU activation. The kernel size of the filters in first, second and third branches is of $5,7$ and $9$, respectively. The last layer of the block is a 1-d conv layer with 96 filters of size 1 that acts as an aggregator and selects the relevant features from all three branches.
\item \emph{Transformer and Vision Transformer:} A transformer \cite{vaswani2017attention} consists of an encoder and a decoder, each formulated by stacking multiple self-attention layers that can capture the global dependencies in the input signals. We employ a transformer encoder having $1$ attention layer with sixteen $256$-dimensional heads followed by two linear layers having $16$ and $F$ nodes. We get an output of shape $T \times F$, where $T$ are the time steps and $F$ is the feature dimensions of the input time series. This encoder output is temporally pooled and given as input to a two-layered MLP classifier having 128 and 1 node to obtain the binary prediction. Vision transformer (ViT) \cite{dosovitskiy2020image} is another prevalent variant of transformer that is explicitly designed for images. In this work, we also exploit a vision transformer for modeling time series. The architecture is almost identical to the previously described transformer. In ViT, a learnable $F$-dimensional token is appended to the input time series and is given as input to the MLP classifier (instead of temporally pooled representation as done in classical transformer).
\end{itemize}
As discussed earlier, we have used single-layer models having either $1$ node for latent binary prediction tasks or $25$ nodes followed by sigmoid activation for latent disorder prediction from the mortality prediction models.
\subsection{Training mortality prediction models}
Irrespective of the data encoding strategy or model architectures, all prediction models are trained using the same parameter setting. Binary cross-entropy is used as the loss function. Adam optimizer with a fixed learning rate of $0.001$ and a batch size of $64$ are used for training the models. Each model is trained to provide the best performance on the validation examples, and the best-performing model configuration is used for evaluating the test or held-out dataset.
\subsection{Training latent information prediction models}
For training information leakage or latent prediction models, we again followed the same train, validation, and test split that is available for the prediction tasks. For estimating the information leakage from a trained model, we obtained the penultimate layer embedding for all examples. These embedding are used as input representation for training and evaluating the latent information prediction models i.e. gender, ethnicity and disorder prediction models. Binary cross-entropy loss, Adam optimizer with a fixed learning rate of $0.001$ and a batch size of $256$ are used for training the models.
\subsection{Implementation details}
All the experiments are performed using Python. PyTorch is used as a deep learning library. Quantum operations have been simulated using PennyLane \cite{bergholm2018pennylane}. Mutual information for the IB analysis (Fig.~\ref{fig:MI}) has been estimated using \cite{noshad2019scalable}.
\backmatter
\section*{Declarations}
\subsection*{Funding}
This work was supported in part by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC), and in part by an InnoHK Project at the Hong Kong Centre for Cerebro-cardiovascular Health Engineering (COCHE). AT is supported by an EPSRC Healthcare Technologies Challenge Award (EP/N020774/1). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, the Department of Health, InnoHK – ITC, or the University of Oxford.
\subsection*{Conflict of interest} Nothing to disclose.
\subsection*{Ethical approval} Not required.
\subsection*{Data availability} All datasets used in this study are publicly available.
\subsection*{Code availability} The code repository is publicly available at \url{github.com/AnshThakur/Quantum-Encoding}.
\subsection*{Authors' Contribution} AT and DAC were responsible for developing the idea of data encoding for data democratization. AT and VA implemented the proposed encoding framework including random projections and random quantum encoding. AT and TZ studied the latent information leakage from the clinical models. AT, JA, and YW designed the experiments and evaluated the impact of data encoding. AT, VA, TZ, and DAC were responsible for drafting the manuscript.
\bibliography{sn-bibliography}
\end{document}
% \begin{figure}[t]
% \centering
% \begin{subfigure}{\textwidth}
% \centering
% \includegraphics[scale=0.26]{mimic/latent_pheno_strip.pdf}
% % \hfill
% \includegraphics[scale=0.26]{mimic/latent_pheno_auroc.pdf}
% \caption{Patient disorder prediction from the embedding of MIMIC-III mortality prediction models.}
% \end{subfigure}%
% \begin{subfigure}{\textwidth}
% \centering
% \includegraphics[scale=0.26]{EICU/Eth_ROC/Black_strip.pdf}
% % \hfill
% \includegraphics[scale=0.26]{EICU/Eth_ROC/Black_AUROC.pdf}
% \caption{Gender prediction from the embedding of eICU models.}
% \end{subfigure}
% \caption[short]{Model-specific and aggregated (across all models) performance for the task of (a) patients' disorders prediction using the penultimate embedding generated from different models trained on \textbf{(a)} MIMIC-III and \textbf{(b)} PhysioNet and \textbf{(c)} eICU datasets, respectively.}
% \label{fig:res2}
% \end{figure}
%% BioMed_Central_Bib_Style_v1.01
\begin{thebibliography}{42}
% BibTex style file: bmc-mathphys.bst (version 2.1), 2014-07-24
\ifx \bisbn \undefined \def \bisbn #1{ISBN #1}\fi
\ifx \binits \undefined \def \binits#1{#1}\fi
\ifx \bauthor \undefined \def \bauthor#1{#1}\fi
\ifx \batitle \undefined \def \batitle#1{#1}\fi
\ifx \bjtitle \undefined \def \bjtitle#1{#1}\fi
\ifx \bvolume \undefined \def \bvolume#1{\textbf{#1}}\fi
\ifx \byear \undefined \def \byear#1{#1}\fi
\ifx \bissue \undefined \def \bissue#1{#1}\fi
\ifx \bfpage \undefined \def \bfpage#1{#1}\fi
\ifx \blpage \undefined \def \blpage #1{#1}\fi
\ifx \burl \undefined \def \burl#1{\textsf{#1}}\fi
\ifx \doiurl \undefined \def \doiurl#1{\url{https://doi.org/#1}}\fi
\ifx \betal \undefined \def \betal{\textit{et al.}}\fi
\ifx \binstitute \undefined \def \binstitute#1{#1}\fi
\ifx \binstitutionaled \undefined \def \binstitutionaled#1{#1}\fi
\ifx \bctitle \undefined \def \bctitle#1{#1}\fi
\ifx \beditor \undefined \def \beditor#1{#1}\fi
\ifx \bpublisher \undefined \def \bpublisher#1{#1}\fi
\ifx \bbtitle \undefined \def \bbtitle#1{#1}\fi
\ifx \bedition \undefined \def \bedition#1{#1}\fi
\ifx \bseriesno \undefined \def \bseriesno#1{#1}\fi
\ifx \blocation \undefined \def \blocation#1{#1}\fi
\ifx \bsertitle \undefined \def \bsertitle#1{#1}\fi
\ifx \bsnm \undefined \def \bsnm#1{#1}\fi
\ifx \bsuffix \undefined \def \bsuffix#1{#1}\fi
\ifx \bparticle \undefined \def \bparticle#1{#1}\fi
\ifx \barticle \undefined \def \barticle#1{#1}\fi
\bibcommenthead
\ifx \bconfdate \undefined \def \bconfdate #1{#1}\fi
\ifx \botherref \undefined \def \botherref #1{#1}\fi
\ifx \url \undefined \def \url#1{\textsf{#1}}\fi
\ifx \bchapter \undefined \def \bchapter#1{#1}\fi
\ifx \bbook \undefined \def \bbook#1{#1}\fi
\ifx \bcomment \undefined \def \bcomment#1{#1}\fi
\ifx \oauthor \undefined \def \oauthor#1{#1}\fi
\ifx \citeauthoryear \undefined \def \citeauthoryear#1{#1}\fi
\ifx \endbibitem \undefined \def \endbibitem {}\fi
\ifx \bconflocation \undefined \def \bconflocation#1{#1}\fi
\ifx \arxivurl \undefined \def \arxivurl#1{\textsf{#1}}\fi
\csname PreBibitemsHook\endcsname
%%% 1
\bibitem{Goodfellow}
\begin{bbook}
\bauthor{\bsnm{Goodfellow}, \binits{I.}},
\bauthor{\bsnm{Bengio}, \binits{Y.}},
\bauthor{\bsnm{Courville}, \binits{A.}}:
\bbtitle{Deep Learning}.
\bpublisher{MIT Press}, \blocation{???}
(\byear{2016}).
\bcomment{\url{http://www.deeplearningbook.org}}
\end{bbook}
\endbibitem
%%% 2
\bibitem{hinton}
\begin{barticle}
\bauthor{\bsnm{Hinton}, \binits{G.}}:
\batitle{{Deep Learning—A Technology With the Potential to Transform Health
Care}}.
\bjtitle{JAMA}
\bvolume{320}(\bissue{11}),
\bfpage{1101}--\blpage{1102}
(\byear{2018})
\end{barticle}
\endbibitem
%%% 3
\bibitem{7801947}
\begin{barticle}
\bauthor{\bsnm{{Ravì}}, \binits{D.}},
\bauthor{\bsnm{{Wong}}, \binits{C.}},
\bauthor{\bsnm{{Deligianni}}, \binits{F.}},
\bauthor{\bsnm{{Berthelot}}, \binits{M.}},
\bauthor{\bsnm{{Andreu-Perez}}, \binits{J.}},
\bauthor{\bsnm{{Lo}}, \binits{B.}},
\bauthor{\bsnm{{Yang}}, \binits{G.}}:
\batitle{Deep learning for health informatics}.
\bjtitle{IEEE Journal of Biomedical and Health Informatics}
\bvolume{21}(\bissue{1}),
\bfpage{4}--\blpage{21}
(\byear{2017})
\end{barticle}
\endbibitem
%%% 4
\bibitem{challenges}
\begin{barticle}
\bauthor{\bsnm{Xiao}, \binits{C.}},
\bauthor{\bsnm{Choi}, \binits{E.}},
\bauthor{\bsnm{Sun}, \binits{J.}}:
\batitle{{Opportunities and challenges in developing deep learning models using
electronic health records data: a systematic review}}.
\bjtitle{Journal of the American Medical Informatics Association}
\bvolume{25}(\bissue{10}),
\bfpage{1419}--\blpage{1428}
(\byear{2018})
\end{barticle}
\endbibitem
%%% 5
\bibitem{jama_rev}
\begin{barticle}
\bauthor{\bsnm{Wang}, \binits{F.}},
\bauthor{\bsnm{Casalino}, \binits{L.P.}},
\bauthor{\bsnm{Khullar}, \binits{D.}}:
\batitle{{Deep Learning in Medicine—Promise, Progress, and Challenges}}.
\bjtitle{JAMA Internal Medicine}
\bvolume{179}(\bissue{3}),
\bfpage{293}--\blpage{294}
(\byear{2019})
\end{barticle}
\endbibitem
%%% 6
\bibitem{aisu2022regulatory}
\begin{barticle}
\bauthor{\bsnm{Aisu}, \binits{N.}},
\bauthor{\bsnm{Miyake}, \binits{M.}},
\bauthor{\bsnm{Takeshita}, \binits{K.}},
\bauthor{\bsnm{Akiyama}, \binits{M.}},
\bauthor{\bsnm{Kawasaki}, \binits{R.}},
\bauthor{\bsnm{Kashiwagi}, \binits{K.}},
\bauthor{\bsnm{Sakamoto}, \binits{T.}},
\bauthor{\bsnm{Oshika}, \binits{T.}},
\bauthor{\bsnm{Tsujikawa}, \binits{A.}}:
\batitle{Regulatory-approved deep learning/machine learning-based medical
devices in japan as of 2020: A systematic review}.
\bjtitle{PLOS Digital Health}
\bvolume{1}(\bissue{1}),
\bfpage{0000001}
(\byear{2022})
\end{barticle}
\endbibitem
%%% 7
\bibitem{sapoval2022current}
\begin{barticle}
\bauthor{\bsnm{Sapoval}, \binits{N.}},
\bauthor{\bsnm{Aghazadeh}, \binits{A.}},
\bauthor{\bsnm{Nute}, \binits{M.G.}},
\bauthor{\bsnm{Antunes}, \binits{D.A.}},
\bauthor{\bsnm{Balaji}, \binits{A.}},
\bauthor{\bsnm{Baraniuk}, \binits{R.}},
\bauthor{\bsnm{Barberan}, \binits{C.}},
\bauthor{\bsnm{Dannenfelser}, \binits{R.}},
\bauthor{\bsnm{Dun}, \binits{C.}},
\bauthor{\bsnm{Edrisi}, \binits{M.}}, \betal:
\batitle{Current progress and open challenges for applying deep learning across
the biosciences}.
\bjtitle{Nature Communications}
\bvolume{13}(\bissue{1}),
\bfpage{1}--\blpage{12}
(\byear{2022})
\end{barticle}
\endbibitem
%%% 8
\bibitem{lewis2020data}
\begin{bchapter}
\bauthor{\bsnm{Lewis}, \binits{K.}},
\bauthor{\bsnm{Pham}, \binits{C.}},
\bauthor{\bsnm{Batarseh}, \binits{F.A.}}:
\bctitle{Data openness and democratization in healthcare: An evaluation of
hospital ranking methods}.
In: \beditor{\bsnm{Batarseh}, \binits{F.A.}},
\beditor{\bsnm{Yang}, \binits{R.}} (eds.)
\bbtitle{Data Democracy},
pp. \bfpage{109}--\blpage{126}.
\bpublisher{Elsevier}, \blocation{???}
(\byear{2020})
\end{bchapter}
\endbibitem
%%% 9
\bibitem{liu2020privacy}
\begin{barticle}
\bauthor{\bsnm{Liu}, \binits{X.}},
\bauthor{\bsnm{Xie}, \binits{L.}},
\bauthor{\bsnm{Wang}, \binits{Y.}},
\bauthor{\bsnm{Zou}, \binits{J.}},
\bauthor{\bsnm{Xiong}, \binits{J.}},
\bauthor{\bsnm{Ying}, \binits{Z.}},
\bauthor{\bsnm{Vasilakos}, \binits{A.V.}}:
\batitle{Privacy and security issues in deep learning: A survey}.
\bjtitle{IEEE Access}
\bvolume{9},
\bfpage{4566}--\blpage{4593}
(\byear{2020})
\end{barticle}
\endbibitem
%%% 10
\bibitem{mireshghallah2020privacy}
\begin{botherref}
\oauthor{\bsnm{Mireshghallah}, \binits{F.}},
\oauthor{\bsnm{Taram}, \binits{M.}},
\oauthor{\bsnm{Vepakomma}, \binits{P.}},
\oauthor{\bsnm{Singh}, \binits{A.}},
\oauthor{\bsnm{Raskar}, \binits{R.}},
\oauthor{\bsnm{Esmaeilzadeh}, \binits{H.}}:
Privacy in deep learning: A survey.
arXiv preprint arXiv:2004.12254
(2020)
\end{botherref}
\endbibitem
%%% 11
\bibitem{vokinger_stekhoven_krauthammer_2020}
\begin{barticle}
\bauthor{\bsnm{Vokinger}, \binits{K.N.}},
\bauthor{\bsnm{Stekhoven}, \binits{D.J.}},
\bauthor{\bsnm{Krauthammer}, \binits{M.}}:
\batitle{Lost in anonymization — a data anonymization reference
classification merging legal and technical considerations}.
\bjtitle{Journal of Law, Medicine \& Ethics}
\bvolume{48}(\bissue{1}),
\bfpage{228}--\blpage{231}
(\byear{2020}).
\doiurl{10.1177/1073110520917025}
\end{barticle}
\endbibitem
%%% 12
\bibitem{thakur2021dynamic}
\begin{barticle}
\bauthor{\bsnm{Thakur}, \binits{A.}},
\bauthor{\bsnm{Sharma}, \binits{P.}},
\bauthor{\bsnm{Clifton}, \binits{D.A.}}:
\batitle{Dynamic neural graphs based federated reptile for semi-supervised
multi-tasking in healthcare applications}.
\bjtitle{IEEE Journal of Biomedical and Health Informatics}
\bvolume{26}(\bissue{4}),
\bfpage{1761}--\blpage{1772}
(\byear{2021})
\end{barticle}
\endbibitem
%%% 13
\bibitem{el2015anonymising}
\begin{barticle}
\bauthor{\bsnm{El~Emam}, \binits{K.}},
\bauthor{\bsnm{Rodgers}, \binits{S.}},
\bauthor{\bsnm{Malin}, \binits{B.}}:
\batitle{Anonymising and sharing individual patient data.}
\bjtitle{BMJ (Clinical Research ed.)}
\bvolume{350},
\bfpage{1139}--\blpage{1139}
(\byear{2015})
\end{barticle}
\endbibitem
%%% 14
\bibitem{henriksen2016re}
\begin{barticle}
\bauthor{\bsnm{Henriksen-Bulmer}, \binits{J.}},
\bauthor{\bsnm{Jeary}, \binits{S.}}:
\batitle{Re-identification attacks—a systematic literature review}.
\bjtitle{International Journal of Information Management}
\bvolume{36}(\bissue{6}),
\bfpage{1184}--\blpage{1192}
(\byear{2016})
\end{barticle}
\endbibitem
%%% 15
\bibitem{zhang2021deep}
\begin{barticle}
\bauthor{\bsnm{Zhang}, \binits{K.}},
\bauthor{\bsnm{Liu}, \binits{X.}},
\bauthor{\bsnm{Xu}, \binits{J.}},
\bauthor{\bsnm{Yuan}, \binits{J.}},
\bauthor{\bsnm{Cai}, \binits{W.}},
\bauthor{\bsnm{Chen}, \binits{T.}},
\bauthor{\bsnm{Wang}, \binits{K.}},
\bauthor{\bsnm{Gao}, \binits{Y.}},
\bauthor{\bsnm{Nie}, \binits{S.}},
\bauthor{\bsnm{Xu}, \binits{X.}}, \betal:
\batitle{Deep-learning models for the detection and incidence prediction of
chronic kidney disease and type 2 diabetes from retinal fundus images}.
\bjtitle{Nature Biomedical Engineering}
\bvolume{5}(\bissue{6}),
\bfpage{533}--\blpage{545}
(\byear{2021})
\end{barticle}
\endbibitem
%%% 16
\bibitem{poplin2018prediction}
\begin{barticle}
\bauthor{\bsnm{Poplin}, \binits{R.}},
\bauthor{\bsnm{Varadarajan}, \binits{A.V.}},
\bauthor{\bsnm{Blumer}, \binits{K.}},
\bauthor{\bsnm{Liu}, \binits{Y.}},
\bauthor{\bsnm{McConnell}, \binits{M.V.}},
\bauthor{\bsnm{Corrado}, \binits{G.S.}},
\bauthor{\bsnm{Peng}, \binits{L.}},
\bauthor{\bsnm{Webster}, \binits{D.R.}}:
\batitle{Prediction of cardiovascular risk factors from retinal fundus
photographs via deep learning}.
\bjtitle{Nature Biomedical Engineering}
\bvolume{2}(\bissue{3}),
\bfpage{158}--\blpage{164}
(\byear{2018})
\end{barticle}
\endbibitem
%%% 17
\bibitem{pan2021disentangled}
\begin{bchapter}
\bauthor{\bsnm{Pan}, \binits{Z.}},
\bauthor{\bsnm{Niu}, \binits{L.}},
\bauthor{\bsnm{Zhang}, \binits{J.}},
\bauthor{\bsnm{Zhang}, \binits{L.}}:
\bctitle{Disentangled information bottleneck}.
In: \bbtitle{Proceedings of the AAAI Conference on Artificial Intelligence},
vol. \bseriesno{35},
pp. \bfpage{9285}--\blpage{9293}
(\byear{2021})
\end{bchapter}
\endbibitem
%%% 18
\bibitem{tishby2000information}
\begin{botherref}
\oauthor{\bsnm{Tishby}, \binits{N.}},
\oauthor{\bsnm{Pereira}, \binits{F.C.}},
\oauthor{\bsnm{Bialek}, \binits{W.}}:
The information bottleneck method.
arXiv preprint physics/0004057
(2000)
\end{botherref}
\endbibitem
%%% 19
\bibitem{bingham2001random}
\begin{bchapter}
\bauthor{\bsnm{Bingham}, \binits{E.}},
\bauthor{\bsnm{Mannila}, \binits{H.}}:
\bctitle{Random projection in dimensionality reduction: applications to image
and text data}.
In: \bbtitle{International Conference on Knowledge Discovery and Data Mining},
pp. \bfpage{245}--\blpage{250}
(\byear{2001}).
\bcomment{PMLR}
\end{bchapter}
\endbibitem
%%% 20
\bibitem{vempala2005random}
\begin{bbook}
\bauthor{\bsnm{Vempala}, \binits{S.S.}}:
\bbtitle{The Random Projection Method}
vol. \bseriesno{65}.
\bpublisher{American Mathematical Soc.}, \blocation{???}
(\byear{2005})
\end{bbook}
\endbibitem
%%% 21
\bibitem{yang2021decentralizing}
\begin{bchapter}
\bauthor{\bsnm{Yang}, \binits{C.-H.H.}},
\bauthor{\bsnm{Qi}, \binits{J.}},
\bauthor{\bsnm{Chen}, \binits{S.Y.-C.}},
\bauthor{\bsnm{Chen}, \binits{P.-Y.}},
\bauthor{\bsnm{Siniscalchi}, \binits{S.M.}},
\bauthor{\bsnm{Ma}, \binits{X.}},
\bauthor{\bsnm{Lee}, \binits{C.-H.}}:
\bctitle{Decentralizing feature extraction with quantum convolutional neural
network for automatic speech recognition}.
In: \bbtitle{Proceedings of IEEE International Conference on Acoustics, Speech
and Signal Processing (ICASSP)},
pp. \bfpage{6523}--\blpage{6527}
(\byear{2021})
\end{bchapter}
\endbibitem
%%% 22
\bibitem{henderson2020quanvolutional}
\begin{barticle}
\bauthor{\bsnm{Henderson}, \binits{M.}},
\bauthor{\bsnm{Shakya}, \binits{S.}},
\bauthor{\bsnm{Pradhan}, \binits{S.}},
\bauthor{\bsnm{Cook}, \binits{T.}}:
\batitle{Quanvolutional neural networks: powering image recognition with
quantum circuits}.
\bjtitle{Quantum Machine Intelligence}
\bvolume{2}(\bissue{1}),
\bfpage{1}--\blpage{9}
(\byear{2020})
\end{barticle}
\endbibitem
%%% 23
\bibitem{silva2012predicting}
\begin{bchapter}
\bauthor{\bsnm{Silva}, \binits{I.}},
\bauthor{\bsnm{Moody}, \binits{G.}},
\bauthor{\bsnm{Scott}, \binits{D.J.}},
\bauthor{\bsnm{Celi}, \binits{L.A.}},
\bauthor{\bsnm{Mark}, \binits{R.G.}}:
\bctitle{Predicting in-hospital mortality of icu patients: The
physionet/computing in cardiology challenge 2012}.
In: \bbtitle{Computing in Cardiology},
pp. \bfpage{245}--\blpage{248}
(\byear{2012}).
\bcomment{IEEE}
\end{bchapter}
\endbibitem
%%% 24
\bibitem{johnson2016mimic}
\begin{barticle}
\bauthor{\bsnm{Johnson}, \binits{A.E.}},
\bauthor{\bsnm{Pollard}, \binits{T.J.}},
\bauthor{\bsnm{Shen}, \binits{L.}},
\bauthor{\bsnm{Lehman}, \binits{L.-w.H.}},
\bauthor{\bsnm{Feng}, \binits{M.}},
\bauthor{\bsnm{Ghassemi}, \binits{M.}},
\bauthor{\bsnm{Moody}, \binits{B.}},
\bauthor{\bsnm{Szolovits}, \binits{P.}},
\bauthor{\bsnm{Anthony~Celi}, \binits{L.}},
\bauthor{\bsnm{Mark}, \binits{R.G.}}:
\batitle{Mimic-iii, a freely accessible critical care database}.
\bjtitle{Scientific data}
\bvolume{3}(\bissue{1}),
\bfpage{1}--\blpage{9}
(\byear{2016})
\end{barticle}
\endbibitem
%%% 25
\bibitem{harutyunyan2019multitask}
\begin{barticle}
\bauthor{\bsnm{Harutyunyan}, \binits{H.}},
\bauthor{\bsnm{Khachatrian}, \binits{H.}},
\bauthor{\bsnm{Kale}, \binits{D.C.}},
\bauthor{\bsnm{Ver~Steeg}, \binits{G.}},
\bauthor{\bsnm{Galstyan}, \binits{A.}}:
\batitle{Multitask learning and benchmarking with clinical time series data}.
\bjtitle{Scientific data}
\bvolume{6}(\bissue{1}),
\bfpage{1}--\blpage{18}
(\byear{2019})
\end{barticle}
\endbibitem
%%% 26
\bibitem{pollard2018eicu}
\begin{barticle}
\bauthor{\bsnm{Pollard}, \binits{T.J.}},
\bauthor{\bsnm{Johnson}, \binits{A.E.}},
\bauthor{\bsnm{Raffa}, \binits{J.D.}},
\bauthor{\bsnm{Celi}, \binits{L.A.}},
\bauthor{\bsnm{Mark}, \binits{R.G.}},
\bauthor{\bsnm{Badawi}, \binits{O.}}:
\batitle{The eicu collaborative research database, a freely available
multi-center database for critical care research}.
\bjtitle{Scientific data}
\bvolume{5}(\bissue{1}),
\bfpage{1}--\blpage{13}
(\byear{2018})
\end{barticle}
\endbibitem
%%% 27
\bibitem{tang2020democratizing}
\begin{barticle}
\bauthor{\bsnm{Tang}, \binits{S.}},
\bauthor{\bsnm{Davarmanesh}, \binits{P.}},
\bauthor{\bsnm{Song}, \binits{Y.}},
\bauthor{\bsnm{Koutra}, \binits{D.}},
\bauthor{\bsnm{Sjoding}, \binits{M.W.}},
\bauthor{\bsnm{Wiens}, \binits{J.}}:
\batitle{Democratizing ehr analyses with fiddle: a flexible data-driven
preprocessing pipeline for structured clinical data}.
\bjtitle{Journal of the American Medical Informatics Association}
\bvolume{27}(\bissue{12}),
\bfpage{1921}--\blpage{1934}
(\byear{2020})
\end{barticle}
\endbibitem
%%% 28
\bibitem{yu2019review}
\begin{barticle}
\bauthor{\bsnm{Yu}, \binits{Y.}},
\bauthor{\bsnm{Si}, \binits{X.}},
\bauthor{\bsnm{Hu}, \binits{C.}},
\bauthor{\bsnm{Zhang}, \binits{J.}}:
\batitle{A review of recurrent neural networks: Lstm cells and network
architectures}.
\bjtitle{Neural computation}
\bvolume{31}(\bissue{7}),
\bfpage{1235}--\blpage{1270}
(\byear{2019})
\end{barticle}
\endbibitem
%%% 29
\bibitem{bai2018empirical}
\begin{botherref}
\oauthor{\bsnm{Bai}, \binits{S.}},
\oauthor{\bsnm{Kolter}, \binits{J.Z.}},
\oauthor{\bsnm{Koltun}, \binits{V.}}:
An empirical evaluation of generic convolutional and recurrent networks for
sequence modeling.
arXiv preprint arXiv:1803.01271
(2018)
\end{botherref}
\endbibitem
%%% 30
\bibitem{martinez2020lipreading}
\begin{bchapter}
\bauthor{\bsnm{Martinez}, \binits{B.}},
\bauthor{\bsnm{Ma}, \binits{P.}},
\bauthor{\bsnm{Petridis}, \binits{S.}},
\bauthor{\bsnm{Pantic}, \binits{M.}}:
\bctitle{Lipreading using temporal convolutional networks}.
In: \bbtitle{IEEE International Conference on Acoustics, Speech and Signal
Processing (ICASSP)},
pp. \bfpage{6319}--\blpage{6323}
(\byear{2020})
\end{bchapter}
\endbibitem
%%% 31
\bibitem{vaswani2017attention}
\begin{botherref}
\oauthor{\bsnm{Vaswani}, \binits{A.}},
\oauthor{\bsnm{Shazeer}, \binits{N.}},
\oauthor{\bsnm{Parmar}, \binits{N.}},
\oauthor{\bsnm{Uszkoreit}, \binits{J.}},
\oauthor{\bsnm{Jones}, \binits{L.}},
\oauthor{\bsnm{Gomez}, \binits{A.N.}},
\oauthor{\bsnm{Kaiser}, \binits{{\L}.}},
\oauthor{\bsnm{Polosukhin}, \binits{I.}}:
Attention is all you need.
Advances in neural information processing systems
\textbf{30}
(2017)
\end{botherref}
\endbibitem
%%% 32
\bibitem{dosovitskiy2020image}
\begin{bchapter}
\bauthor{\bsnm{Dosovitskiy}, \binits{A.}},
\bauthor{\bsnm{Beyer}, \binits{L.}},
\bauthor{\bsnm{Kolesnikov}, \binits{A.}},
\bauthor{\bsnm{Weissenborn}, \binits{D.}},
\bauthor{\bsnm{Zhai}, \binits{X.}},
\bauthor{\bsnm{Unterthiner}, \binits{T.}},
\bauthor{\bsnm{Dehghani}, \binits{M.}},
\bauthor{\bsnm{Minderer}, \binits{M.}},
\bauthor{\bsnm{Heigold}, \binits{G.}},
\bauthor{\bsnm{Gelly}, \binits{S.}}, \betal:
\bctitle{An image is worth 16x16 words: Transformers for image recognition at
scale}.
In: \bbtitle{International Conference on Learning Representations}
(\byear{2020})
\end{bchapter}
\endbibitem
%%% 33
\bibitem{bland2000odds}
\begin{barticle}
\bauthor{\bsnm{Bland}, \binits{J.M.}},
\bauthor{\bsnm{Altman}, \binits{D.G.}}:
\batitle{The odds ratio}.
\bjtitle{Bmj}
\bvolume{320}(\bissue{7247}),
\bfpage{1468}
(\byear{2000})
\end{barticle}
\endbibitem
%%% 34
\bibitem{NIPS2017_8a20a862}
\begin{bchapter}
\bauthor{\bsnm{Lundberg}, \binits{S.M.}},
\bauthor{\bsnm{Lee}, \binits{S.-I.}}:
\bctitle{A unified approach to interpreting model predictions}.
In: \bbtitle{Proceedings of Advances in Neural Information Processing Systems},
vol. \bseriesno{30}
(\byear{2017})
\end{bchapter}
\endbibitem
%%% 35
\bibitem{keyl2002fundamentals}
\begin{barticle}
\bauthor{\bsnm{Keyl}, \binits{M.}}:
\batitle{Fundamentals of quantum information theory}.
\bjtitle{Physics reports}
\bvolume{369}(\bissue{5}),
\bfpage{431}--\blpage{548}
(\byear{2002})
\end{barticle}
\endbibitem
%%% 36
\bibitem{rieke2020future}
\begin{barticle}
\bauthor{\bsnm{Rieke}, \binits{N.}},
\bauthor{\bsnm{Hancox}, \binits{J.}},
\bauthor{\bsnm{Li}, \binits{W.}},
\bauthor{\bsnm{Milletari}, \binits{F.}},
\bauthor{\bsnm{Roth}, \binits{H.R.}},
\bauthor{\bsnm{Albarqouni}, \binits{S.}},
\bauthor{\bsnm{Bakas}, \binits{S.}},
\bauthor{\bsnm{Galtier}, \binits{M.N.}},
\bauthor{\bsnm{Landman}, \binits{B.A.}},
\bauthor{\bsnm{Maier-Hein}, \binits{K.}}, \betal:
\batitle{The future of digital health with federated learning}.
\bjtitle{NPJ digital medicine}
\bvolume{3}(\bissue{1}),
\bfpage{1}--\blpage{7}
(\byear{2020})
\end{barticle}
\endbibitem
%%% 37
\bibitem{chen2021synthetic}
\begin{barticle}
\bauthor{\bsnm{Chen}, \binits{R.J.}},
\bauthor{\bsnm{Lu}, \binits{M.Y.}},
\bauthor{\bsnm{Chen}, \binits{T.Y.}},
\bauthor{\bsnm{Williamson}, \binits{D.F.}},
\bauthor{\bsnm{Mahmood}, \binits{F.}}:
\batitle{Synthetic data in machine learning for medicine and healthcare}.
\bjtitle{Nature Biomedical Engineering}
\bvolume{5}(\bissue{6}),
\bfpage{493}--\blpage{497}
(\byear{2021})
\end{barticle}
\endbibitem
%%% 38
\bibitem{jordon2020synthetic}
\begin{botherref}
\oauthor{\bsnm{Jordon}, \binits{J.}},
\oauthor{\bsnm{Wilson}, \binits{A.}},
\oauthor{\bparticle{van~der} \bsnm{Schaar}, \binits{M.}}:
Synthetic data: Opening the data floodgates to enable faster, more directed
development of machine learning methods.
arXiv preprint arXiv:2012.04580
(2020)
\end{botherref}
\endbibitem
%%% 39
\bibitem{larsen2017optimality}
\begin{bchapter}
\bauthor{\bsnm{Larsen}, \binits{K.G.}},
\bauthor{\bsnm{Nelson}, \binits{J.}}:
\bctitle{Optimality of the johnson-lindenstrauss lemma}.
In: \bbtitle{Proceedings of IEEE Annual Symposium on Foundations of Computer
Science (FOCS)},
pp. \bfpage{633}--\blpage{638}
(\byear{2017}).
\bcomment{IEEE}
\end{bchapter}
\endbibitem
%%% 40
\bibitem{kaye2006introduction}
\begin{bbook}
\bauthor{\bsnm{Kaye}, \binits{P.}},
\bauthor{\bsnm{Laflamme}, \binits{R.}},
\bauthor{\bsnm{Mosca}, \binits{M.}}:
\bbtitle{An Introduction to Quantum Computing}.
\bpublisher{OUP Oxford}, \blocation{???}
(\byear{2006})
\end{bbook}
\endbibitem
%%% 41
\bibitem{bergholm2018pennylane}
\begin{botherref}
\oauthor{\bsnm{Bergholm}, \binits{V.}},
\oauthor{\bsnm{Izaac}, \binits{J.}},
\oauthor{\bsnm{Schuld}, \binits{M.}},
\oauthor{\bsnm{Gogolin}, \binits{C.}},
\oauthor{\bsnm{Alam}, \binits{M.S.}},
\oauthor{\bsnm{Ahmed}, \binits{S.}},
\oauthor{\bsnm{Arrazola}, \binits{J.M.}},
\oauthor{\bsnm{Blank}, \binits{C.}},
\oauthor{\bsnm{Delgado}, \binits{A.}},
\oauthor{\bsnm{Jahangiri}, \binits{S.}}, et al.:
Pennylane: Automatic differentiation of hybrid quantum-classical computations.
arXiv preprint arXiv:1811.04968
(2018)
\end{botherref}
\endbibitem
%%% 42
\bibitem{noshad2019scalable}
\begin{bchapter}
\bauthor{\bsnm{Noshad}, \binits{M.}},
\bauthor{\bsnm{Zeng}, \binits{Y.}},
\bauthor{\bsnm{Hero}, \binits{A.O.}}:
\bctitle{Scalable mutual information estimation using dependence graphs}.
In: \bbtitle{IEEE International Conference on Acoustics, Speech and Signal
Processing (ICASSP)},
pp. \bfpage{2962}--\blpage{2966}
(\byear{2019}).
\bcomment{IEEE}
\end{bchapter}
\endbibitem
\end{thebibliography}
%% BioMed_Central_Bib_Style_v1.01
\begin{thebibliography}{2}
% BibTex style file: bmc-mathphys.bst (version 2.1), 2014-07-24
\ifx \bisbn \undefined \def \bisbn #1{ISBN #1}\fi
\ifx \binits \undefined \def \binits#1{#1}\fi
\ifx \bauthor \undefined \def \bauthor#1{#1}\fi
\ifx \batitle \undefined \def \batitle#1{#1}\fi
\ifx \bjtitle \undefined \def \bjtitle#1{#1}\fi
\ifx \bvolume \undefined \def \bvolume#1{\textbf{#1}}\fi
\ifx \byear \undefined \def \byear#1{#1}\fi
\ifx \bissue \undefined \def \bissue#1{#1}\fi
\ifx \bfpage \undefined \def \bfpage#1{#1}\fi
\ifx \blpage \undefined \def \blpage #1{#1}\fi
\ifx \burl \undefined \def \burl#1{\textsf{#1}}\fi
\ifx \doiurl \undefined \def \doiurl#1{\url{https://doi.org/#1}}\fi
\ifx \betal \undefined \def \betal{\textit{et al.}}\fi
\ifx \binstitute \undefined \def \binstitute#1{#1}\fi
\ifx \binstitutionaled \undefined \def \binstitutionaled#1{#1}\fi
\ifx \bctitle \undefined \def \bctitle#1{#1}\fi
\ifx \beditor \undefined \def \beditor#1{#1}\fi
\ifx \bpublisher \undefined \def \bpublisher#1{#1}\fi
\ifx \bbtitle \undefined \def \bbtitle#1{#1}\fi
\ifx \bedition \undefined \def \bedition#1{#1}\fi
\ifx \bseriesno \undefined \def \bseriesno#1{#1}\fi
\ifx \blocation \undefined \def \blocation#1{#1}\fi
\ifx \bsertitle \undefined \def \bsertitle#1{#1}\fi
\ifx \bsnm \undefined \def \bsnm#1{#1}\fi
\ifx \bsuffix \undefined \def \bsuffix#1{#1}\fi
\ifx \bparticle \undefined \def \bparticle#1{#1}\fi
\ifx \barticle \undefined \def \barticle#1{#1}\fi
\bibcommenthead
\ifx \bconfdate \undefined \def \bconfdate #1{#1}\fi
\ifx \botherref \undefined \def \botherref #1{#1}\fi
\ifx \url \undefined \def \url#1{\textsf{#1}}\fi
\ifx \bchapter \undefined \def \bchapter#1{#1}\fi
\ifx \bbook \undefined \def \bbook#1{#1}\fi
\ifx \bcomment \undefined \def \bcomment#1{#1}\fi
\ifx \oauthor \undefined \def \oauthor#1{#1}\fi
\ifx \citeauthoryear \undefined \def \citeauthoryear#1{#1}\fi
\ifx \endbibitem \undefined \def \endbibitem {}\fi
\ifx \bconflocation \undefined \def \bconflocation#1{#1}\fi
\ifx \arxivurl \undefined \def \arxivurl#1{\textsf{#1}}\fi
\csname PreBibitemsHook\endcsname
%%% 1
\bibitem{harutyunyan2019multitask}
\begin{barticle}
\bauthor{\bsnm{Harutyunyan}, \binits{H.}},
\bauthor{\bsnm{Khachatrian}, \binits{H.}},
\bauthor{\bsnm{Kale}, \binits{D.C.}},
\bauthor{\bsnm{Ver~Steeg}, \binits{G.}},
\bauthor{\bsnm{Galstyan}, \binits{A.}}:
\batitle{Multitask learning and benchmarking with clinical time series data}.
\bjtitle{Scientific data}
\bvolume{6}(\bissue{1}),
\bfpage{1}--\blpage{18}
(\byear{2019})
\end{barticle}
\endbibitem
%%% 2
\bibitem{tang2020democratizing}
\begin{barticle}
\bauthor{\bsnm{Tang}, \binits{S.}},
\bauthor{\bsnm{Davarmanesh}, \binits{P.}},
\bauthor{\bsnm{Song}, \binits{Y.}},
\bauthor{\bsnm{Koutra}, \binits{D.}},
\bauthor{\bsnm{Sjoding}, \binits{M.W.}},
\bauthor{\bsnm{Wiens}, \binits{J.}}:
\batitle{Democratizing ehr analyses with fiddle: a flexible data-driven
preprocessing pipeline for structured clinical data}.
\bjtitle{Journal of the American Medical Informatics Association}
\bvolume{27}(\bissue{12}),
\bfpage{1921}--\blpage{1934}
(\byear{2020})
\end{barticle}
\endbibitem
\end{thebibliography}