Deep Learning with Persistent Homology for Orbital Angular Momentum (OAM) Decoding
Extracted source text · arXiv 1911.06858
\documentclass[conference]{IEEEtran}
\IEEEoverridecommandlockouts
\usepackage{cite}
\usepackage{amsmath,amssymb,amsfonts}
\usepackage{algorithmic}
\usepackage{graphicx}
\usepackage{textcomp}
\usepackage{amssymb}
\usepackage{xcolor}
\usepackage[utf8]{inputenc}
\usepackage[english]{babel}
\usepackage[utf8]{inputenc}
\usepackage[english]{babel}
\usepackage{amsthm}
\newtheorem{theorem}{Theorem}
\usepackage{multirow}
\usepackage{booktabs}
\begin{document}
\title{Deep Learning with Persistent Homology for Orbital Angular Momentum (OAM) Decoding}
\author{Soheil Rostami, Walid Saad, and Choong Seon Hong
\\
\thanks{S. Rostami is with Huawei Technologies Oy (Finland) Co. Ltd, Helsinki, Finland. E-mail: soheil.rostami1@huawei.com.}
\thanks{W. Saad is with the Bradley Department of Electrical and Computer Engineering, Virginia Tech, USA. E-mail: walids@vt.edu.}
\thanks{C. S. Hong is with Department of Computer Science and Engineering, Kyung Hee University, South Korea. E-mail: cshong@khu.ac.kr.}
\thanks{This research was supported by the U.S. National Science Foundation under Grant CNS-1909372.}\vspace{-55cm}}
\maketitle
\vspace{-55cm}
\begin{abstract}
Orbital angular momentum (OAM)-encoding has recently emerged as an effective approach for increasing the channel capacity of free-space optical communications. In this paper, OAM-based {decoding} is formulated as a supervised classification problem. To maintain lower error rate in presence of severe {atmospheric turbulence}, a new approach that combines effective machine learning tools from persistent homology and convolutional neural networks (CNNs) is proposed {to decode the OAM modes}. A Gaussian kernel with learnable parameters is proposed in order to connect persistent homology to CNN, allowing the system to extract and distinguish robust and unique topological features for the OAM modes.
{Simulation results show that the proposed approach achieves up to $20\%$ gains in classification accuracy rate over state-of-the-art of method based on only CNNs. These results essentially show that geometric and topological features play a pivotal role in the OAM mode classification problem.}
\end{abstract}
\begin{IEEEkeywords}
OAM, convolutional neural networks, persistent homology, free-space optical communication.
\end{IEEEkeywords}
\section{Introduction}
Free-space optical (FSO) communication is an effective approach for fixed point-to-point communication, such as backhaul connectivity and fiber backup over distances up to several kilometers \cite{Khalighi_survey}. {In order to increase the transmission capacity of FSO communication, space division multiplexing can be exploited. In particular, the use of the orbital angular momentum (OAM) of a light beam has been recently proposed to realize space division multiplexing in FSO communication systems \cite{wang2012terabit}. {OAM is expected to play a major role in many emerging communication systems \cite{6G}.}
}
Theoretically, Laguerre-Gaussian (LG) beams can carry an infinite values of OAM modes, by encoding a bit-tuple of information as superposition of OAM modes \cite{wang2012terabit}. {Therefore, the transmission capacity can be increased with orders-of-magnitude by allowing beams with different modes to be multiplexed together and transmitted over the same communication link.} However, in FSO communications, the high sensitivity of the spatial structure of a light beam to atmospheric conditions such as turbulence can cause cross-talk among adjacent OAM modes. This, in turn, makes it challenging to perform error-free OAM mode detection particularly when a large number of OAM modes are used \cite{wang2012terabit}.%, \cite{Anguita:08}.
Conventionally, an optical solution based on coherent detection, known as conjugate-mode sorting method is applied for OAM detection as done in \cite{mair2001entanglement}. % and \cite{gibson2004free}.
For the coherent detection of OAM modes, both the transmitter and receiver can use spatial light modulators (SLMs). In \cite{mair2001entanglement}, a first proof-of-concept experiment, based on coherent detection, is developed to utilize OAM modes by {defining an unlimited dimensional discrete Hilbert space}. %Furthermore, the authors in \cite{mair2001entanglement}, proposed an experimental approach in order to investigate the impact of hologram misalignment. %Additionally, the work in \cite{gibson2004free} showed that coherent detection is robust to eavesdropping without need for any encryption methods.
%Furthermore, coherent detection requires precise optical alignment and its performance is very poor in presence of noise \cite{Knutson}.
Recently, neural network approaches have been adopted in \cite{Knutson} and \cite{Doster:17} in order to enhance OAM decoding by relying only on an intensity image of the unique multiplexing patterns. The authors in \cite{Knutson} proposed a deep neural network approach capable of simultaneously differentiating $110$ OAM modes with classification error rate of less than $30$\%. % while allowing superposition of a relatively large number of OAM modes.
Meanwhile, the authors in \cite{Doster:17}, used convolutional neural networks (CNN) to differentiate $32$ OAM modes with over $99$\% accuracy under high levels of turbulence. The work in \cite{Doster:17} also showed that this new method is robust to various environmental parameters. However, the performance of the solutions proposed in \cite{Knutson} and \cite{Doster:17} degrades significantly for large number of OAM modes and high levels of turbulence, thus motivating the need for new, turbulence-robust solutions. % We will use work in \cite{Doster:17} as a reference OAM receiver for comparison purposes.
{Recently, OAM communications has attracted significant attention in the wireless communication literature. For instance, in \cite{cheng2018orbital}, the authors study the problem of enhancing spectrum efficiency for multi-user access with different OAM modes for two-tier wireless networks. Meanwhile, in \cite{8712525}, the authors conducted important experiments to characterize the OAM
phase properties for long-distance transmission.}
The main contribution of this paper is a novel framework that exploits the powerful machine learning tools of \emph{persistent homology} \cite{zomorodian_2005} to enhance OAM mode detection, in presence of turbulence. In particular, the proposed approach combines a persistent homology-based input layer to a CNN-based OAM decoder. This input layer allows inference of topological and geometrical information rather than the intensity images, for OAM mode detection. Our results show that exploiting topological features is more effective than phase fronts, applied in intensity images. In particular, {simulation results show that the proposed approach outperforms CNN, in terms of the classification accuracy rate, by $10$\% in presence of severe atmospheric turbulence and a large number of OAM modes.}
%The rest of this paper is organized as follows. In Section \ref{sec:system_model}, we present the system model. Section \ref{sec:Solution} describes the proposed framework. Section \ref{ref:sim} evaluates the performance of proposed method based on simulations. Finally, conclusions are drawn in the Section \ref{conc}. \textcolor{blue}{For reader's convenience, the most relevant variables used throughout the paper are listed in
\section{System Model}
\label{sec:system_model}
We consider an OAM communication system composed of a single transmitter and receiver pair. % as shown in Fig. \ref{fig:block}.
The transmitter communicates one out of $M$ possible $n$-bit length messages $s \in\mathcal{M}$, where $M=2^n$. To transmit each message, $n$ different OAM modes $\{c_1,...,c_n\}$ are superpositioned\footnote{The throughput of the FSO communication link is linearly dependent on $n$, and hence it is beneficial to increase $n$ as much as possible to achieve higher throughput for a given error rate.}, and the corresponding transmitted beam $\boldsymbol{x}\in \mathbb{C}^n $ is sent over the channel. Hence, the transmitter can be seen as a mapping function, $\mathfrak{T}: \mathcal{M} \mapsto \mathbb{C}^n$. At the receiver, the received beam $\boldsymbol{y}\in \mathbb{C}^n $ is a noisy and distorted version of the transmitted beam. The receiver must produce an estimate $\hat{s}$ of the original message $s$, and, hence, the receiver can be seen as a mapping function, $\mathfrak{R}:\mathbb{C}^n \mapsto \mathcal{M}$. Both $\boldsymbol{x}$ and $\boldsymbol{y}$ are vectors with each element corresponding, respectively, to the intensity level of the transmitted or received beam's pixel. The length of $\boldsymbol{x}$ and $\boldsymbol{y}$ equals to the number of pixels per beam $p$, which depends on the pixel size of a charge-coupled device {image sensor}.
The considered OAM communication system must reduce the message error rate ($P_e=\text{Pr} {(\hat{s}\neq s)}$) {for a high number of OAM modes} and severe turbulence levels. {Moreover, some OAM modes are more robust to atmospheric turbulence, and, thus, the $n$ OAM modes that are used for
encoding a message can be selected in such a way to have the least sensitivity to the channel conditions.} Here, we assume that the set of OAM modes, i.e. $\{c_1,...,c_n\}$ is fixed.
{A CNN learning technique can be used for OAM decoding with the objective of minimizing the message error rate. Such a neural network can be modeled as a function composition chain of functions, $f(\boldsymbol{y}) = {a}_L\circ {q}_L \circ {a}_{L-1} \circ {q}_{L-1} \circ \dots\circ {a}_{1} \circ {q}_1(\boldsymbol{y})$; where ${a}_j$ and ${q}_j$ are convolutional (conv1,...,convL) and pooling (pool1,...,poolL) functions, respectively; and % function and ${q}_j(\boldsymbol{y}) = {\boldsymbol{\omega}_j}^T\boldsymbol{y} + \boldsymbol{\beta}_j$ is a linear function %which applies a set of $p$-length weight vectors, ${\boldsymbol{\omega}_j}$ and biases ${\boldsymbol{\beta}_j}$, to an input vector, where
$L$ is the number of layers in the network. %The convolutional (conv) layers are composed of learned convolutional filters and pooling operators followed by a non-linear activation function.
The convolution filters apply convolution operations to the input, and then pooling applies a moving window to choose the maximum value over a local region.
%The filters are convoluted with the input and then a pooling operation occurs which takes the maximum over a local region. %The pooling operator serves to reduce computation and build translational invariance. % Finally, a non-linear activation function, e.g., rectified linear unit (ReLU), is applied. % After a series of convolution-pooling-ReLU layers, the notion of spatial information is abandoned and all input neurons become connected to all output neurons in a series of fully connected layers.
%After a series of convolution-pooling-ReLU layers, the notion of spatial information is abandoned and all input neurons become connected to all output neurons in a series of fully connected layers
The final layer (based on softmax activation) of the network represents the $M$ messages. Once trained, during the testing
phase, the CNN yields a set of probabilities $\{f_{1},...,f_{m},...,f_{M}\}$, where $f_{m}$ is essentially the probability that the CNN's input message is classified as message $m$.} %The network we have chosen to utilize is known as Alexnet [7] and is composed of 5 convolution-pooling-ReLU layers and 3 fully connected layers, see Figure 1 for the network topology.%phase, the CNN yields set of probabilities $f_{i|m}$, where $i\in \mathcal{M}$. $f_{i|m}$ is essentially the probability that input message $m$ is classified as message $i$. %The network we have chosen to utilize is known as Alexnet [7] and is composed of 5 convolution-pooling-ReLU layers and 3 fully connected layers, see Figure 1 for the network topology.
Message $i$ is detected as the received message if {$f_{m}<f_{i}$ for all $m\in \mathcal{M}$ and $m\neq i$.}
%\begin{figure}[t]
%\centering
%\includegraphics[scale=.38]{block.JPG}
%\caption{At the transmitter side, LG beams carrying superposition of different OAM
%modes are generated. At the receiver side, the received LG beams are captured by a CCD image sensor. We use a CNN-based classifier to directly recognize the received LG beams. }
%\label{fig:block}
%\end{figure}
Although CNN can be effective for improving OAM reception as shown in \cite{Doster:17}, relying solely on CNN for the purpose of OAM detection can fail if the number of OAM modes is large. In particular, CNN performs its decoding by relying solely on the intensity profiles while ignoring the topological structure of each OAM mode. However, in practice, each OAM mode, also known as a topological charge, possesses a unique twisted structure. Such topological structures contain more discriminate features than intensity profiles. Hence, in order to enhance the effectiveness of OAM decoding, it is desirable to design new learning techniques that can exploit such topological structures, which has not been done in prior works \cite{Knutson, Doster:17}. In this context, persistent homology has recently emerged as a powerful tool for addressing the problem of topological feature detection and shape recognition. By means of persistent homology, a shape is represented with a family of simplicial complexes, indexed by a proximity parameter \cite{zomorodian_2005}. This converts different shapes into global topological objects. The output of persistent homology is in the form of a parameterized version of a Betti number, and can be illustrated by a persistence diagram \cite{zomorodian_2005}. Depending on the combination of OAM modes used in the transmitted beam, the received beam will exhibit a unique topological structure which differentiates it from other feasible combinations of OAM modes. Therefore, persistent homology can be used to extract such features which can, in turn, be exploited by the CNN to classify the received message. {Table \ref{tab:vari} summarizes our notations.}
\begin{table}[!t]
\centering
\renewcommand{\arraystretch}{1.2}
\caption{{Summary of main notations.}}
\label{tab:vari}
\begin{tabular}{ccccc}
\cline{1-2}
\multicolumn{1}{|c|} {\begin{tabular}[c]{@{}l@{}}\textbf{Variable}\end{tabular}} & \multicolumn{1}{c|}{\textbf{Definition} } & & & \\ \cline{1-2}
\multicolumn{1}{|c|}{ $\boldsymbol{\mu_i}=[\mu_{i,1},\mu_{i,2}]^T$ } & \multicolumn{1}{c|}{{Location parameters of Gaussian Kernel}} & & & \\ \cline{1-2}
\multicolumn{1}{|c|}{ $\sigma_i$} & \multicolumn{1}{c|}{{Standard deviation of Gaussian Kernel}} & & & \\ \cline{1-2}
\multicolumn{1}{|c|}{ $\nu$ } & \multicolumn{1}{c|}{{\begin{tabular}[c]{@{}c@{}}Parameter to control the effect of the\\ persistence and computational complexity\end{tabular}}}
& & & \\ \cline{1-2}
\multicolumn{1}{|c|}{ $\mathcal{B}$ } & \multicolumn{1}{c|}{
{\begin{tabular}[c]{@{}c@{}}Persistence diagram (can be \\ visualized as multisets of intervals) \end{tabular}}}
& & & \\ \cline{1-2} \multicolumn{1}{|c|}{ $|.|$ } & \multicolumn{1}{c|}{{Cardinality of a set}}
& & & \\ \cline{1-2}
\multicolumn{1}{l}{} & \multicolumn{1}{l}{} & & &
\end{tabular}
\vspace{-8 mm}
\end{table}
Due to space limitation, the mathematical intricacies of persistent homology are not provided in detail; we refer the reader to \cite{zomorodian_2005} for algebraic-topological aspects of persistent homology. Next, we propose a novel framework that employs persistent homology as an input layer for CNN in order to probe topological features of OAM modes and enhance the OAM receiver performance.
\section{Proposed Framework}
\label{sec:Solution}
The utilization of unique topological structures of OAM modes is promising to enhance OAM mode detection {because the {topological features} are independent of any particular coordinate. % (but dependent on pairwise distances).
As result, no optical alignment process is needed.} Furthermore, the topological features of OAM beams are deformation invariant, i.e. their topology does not change if the shape is stretched or compressed, due to atmospheric turbulence. Also, topological analysis of OAM beams enhances robustness to noise, enabling long distance communication.
Due to the superposition of $n$-orthogonal topological charges, each transmitted beam $\boldsymbol{x}$ and hence corresponding received beam $\boldsymbol{y}$ will exhibit a unique topological structure. {In this regard, persistent homology will allow us to replace each point of an OAM topological structure with a solid sphere and, then, record the topological features of the union of these solid spheres as a function of their radius.} When the radius increases, new components can be created, or existing components can merge together, or can be eliminated. %(e.g., a loop getting filled in).
The $0^{th}$ order topological feature captures the connected components, the $1^{st}$ order topological feature captures regions forming a loop structure, and $2^{nd}$ order topological feature captures regions forming a void structure. {The radius at which the $j^{th}$ component, referred to as $p_j$, is created is called its \emph{birth time} $b_j$ and the radius at which component $p_j$ is eliminated, or merged with another component that has an earlier birth time, is called its \emph{death time} $d_j$}. {For our OAM system, persistent homology detects the connected components ($0^{th}$ order), loops ($1^{st}$ order), and voids ($2^{nd}$ order) of the received beam. Meanwhile, the corresponding $(b_j,d_j)$-tuples measure how persistent the received beam's topological features are. In other words, the difference $(d_j - b_j)$ is known as the \emph{lifetime} of the topological feature and measures its robustness and prominence.}
\begin{figure}[t]
\centering
\includegraphics[scale=.8]{oamoverview.eps}
\caption{The overall functionality of the proposed method used by an OAM receiver to classify OAM modes, both projector and CNN are trained as a single neural network. }
\label{fig:overall}\vspace{-7 mm}
\end{figure}
{The persistence diagram %is a collection of all $(b_j,d_j)$ points, and
can be visualized as multisets of intervals $\mathcal{B} =\{ {p}_j=(b_j,d_j):0<b_j<d_j,j=1,...,|\mathcal{B}| \} $. We define a \emph{persistent homology} as a mapping function ${\mathfrak{H}}$, which maps the received beam $\boldsymbol{y}$ to its corresponding persistence diagram $\mathcal{B}$, i.e. $\boldsymbol{y}\overset{\mathfrak{H}}{\mapsto} \mathcal{B}$.}
The persistence diagram $\mathcal{B}$ does not possess a Hilbert space structure due to its unusual structure as multisets. As result, machine learning algorithms (e.g. CNN) operating on a Hilbert space cannot be applied to persistence diagrams. However, a persistence diagram can embed the set of persistence diagrams into a Hilbert space by applying \textit{kernels} to map the topological features into machine learning compatible representation \cite{Kusano}. %,7299106}.
However, such kernels are pre-defined and fixed, and therefore agnostic to the learning stage of the supervised classification. For our case, we propose a modified version of a Gaussian kernel with learnable parameters. In particular, the parameters of our kernel are tuned using back-propagation. %method same time that CNN is training. By doing this way, the manual parameter configuration per set of OAM modes is not needed any more.
For the CNN of our OAM decoder, we introduce a persistent homology-based input layer that is defined by projecting any {component} ${p}_j$ with respect to a collection of kernels. Therefore, each component ${p}_j$, %$\forall j\in\{1,...,|\mathcal{B}|\}$
is transformed to a single value ${z}_j$ (i.e. ${p}_j\overset{G_{\sigma_i,\boldsymbol\mu_i}}{\mapsto} {z}_j$) as follows,
$G_{\sigma_i,\boldsymbol\mu_i}({p}_j)=e^{-\frac{\lVert p_j-\boldsymbol{\mu_i} \rVert}{2{{\sigma_i}^2}}}$, where
$\boldsymbol{\mu_i}=[\mu_{i,1},\mu_{i,2}]^T$ is a location parameter and $\sigma_i>0$ is standard deviation. Both are learned using a backpropagation learning method during the training stage.
Due to fact that components close to the diagonal of persistence diagram are mainly noise,
we can remove these components in our analysis, i.e. $z_j=0$ if $d_j-b_j< \nu$ where $\nu$ is a constant. Consequently, not only the contribution of noise is discounted but also {computational complexity is reduced.}
The persistence diagram $\mathcal{B}$ per kernel is projected into a single value $v_i=\sum_{j=1}^{|\mathcal{B}|} G_{\sigma_i,\boldsymbol\mu_i}({p}_j)$.
%\begin{equation}
%v_i=\sum_{j=1}^{|\mathcal{B}|} G_{\sigma_i,\boldsymbol\mu_i}({p}_j).
% \end{equation}
\noindent By projecting $\mathcal{B}$ with respect to $N$ kernels with different parameters, the {\emph{topological feature vector} $\boldsymbol{v}$ of the received OAM beam $\boldsymbol{y}$ can be constructed, i.e. ${z}_j\overset{\mathfrak{v}}{\mapsto} \boldsymbol{v}$, where $\boldsymbol{v}=[v_1,...,v_{N}]^T$.}
%\begin{equation}
%\boldsymbol{v}=[v_1,...,v_{N}]^T.
%\end{equation}
The end-to-end operation of the framework is shown in Fig. \ref{fig:overall}. First, $\mathcal{B}$ is computed using any standard persistent homology algorithm (e.g. \cite{zomorodian_2005}) over the received OAM beam $\boldsymbol{y}$, and then $\mathcal{B}$ is projected to $\boldsymbol{v}$ which itself is an input layer for the CNN. Therefore, the overall function of the resulting neural network can be written as follows,
\begin{equation}
f(\boldsymbol{y}) = {a}_L\circ {q}_L \circ {a}_{L-1} \circ {q}_{L-1} \circ \dots\circ {a}_{1} \circ {q}_1\circ \mathfrak{v} \circ \mathfrak{H} (\boldsymbol{y}),
\end{equation}
\noindent {where ${\sigma_i}$ and $\boldsymbol{\mu}_i$ (for all $i\in\{1,...,N\}$) and corresponding parameters of $L$ layers are learned during training.} % and ${\boldsymbol{\omega}_j}$ and ${\boldsymbol{\beta}_j}$ (for all $j\in\{1,..,L\}$) are learned during training.} %, similar to ${\boldsymbol{\omega}_j}$ and biases ${\boldsymbol{\beta}_j}$ for all $j\in\{1,..,L\}$.
{An example of a computer-generated phase diagram
without turbulence for superposition of an OAM mode set $\{1,2,3,4\}$ is shown in Fig. \ref{fig:figo}. The caption of each sub-image is the encoded 4 bit-length message and
the modes that are active (set of integers in brackets). For instance, $0101 [1,3]$ means that for four-bit message $0101$, OAM modes $1$ and $3$ are superpositioned and transmitted.}
Now, based on Fig. \ref{fig:figo}, we can illustrate the reasons why the proposed approach, that combines persistent homology and CNN, is more effective than CNN alone, for OAM communications. In this regard, the received beam of OAM communication has a unique “twisted” structure %; in other words, there are some unique circular shapes per each OAM mode
(e.g. see Fig. \ref{fig:figo}). The persistent homology acts as a topological feature selector which can automatically choose those topological OAM features that contribute the most to the output. However, without persistent homology, the trained CNN model will rely on the irrelevant features and noise, which can then reduce the accuracy of the OAM decoder.
%Additionally, CNN fits a template for each mode to the received beam to determine which mode one is in. The problem with this approach is that there are an infinite variety of different possible shapes, a large number of which occur in received beam (especially when OAM modes increase). The immense variety possible among shapes per mode suggests that CNN enumerates all the possible shapes, overfits and create templates for each, but rather find a flexible way of representing all shapes.
Furthermore, by using persistent homology, each received OAM beam can be properly categorized to its unique topological structures through topological feature vector $\boldsymbol{v}$. Last but not least, the proposed method reduces training time and algorithm complexity by removing the irrelevant features and the components that most likely are linked to noise.
\begin{figure}
\centering
\includegraphics[width=0.37 \textwidth]{o.eps}
\caption{{The transmitted OAM beam when $M=16$. }}
\label{fig:figo}\vspace{-4 mm}
\end{figure}
In order to intuitively explain how the proposed method outperforms conventional CNN, the persistence diagram, phase front and topological structure of a pair of $8$-bit length OAM messages both in transmit and receive are provided in Fig. \ref{fig:fig11}. In particular, two OAM beams corresponding to the $82^{nd}$ and $91^{st}$ messages are chosen. The main reason for choosing the pair as example is that, CNN frequently misclassifies $82^{nd}$ message with $91^{st}$. In contrast, our proposed method classifies this particular example correctly most of time. It is clear that for both received messages, their persistence diagrams, especially the $2^{nd}$ order topological features (shown in black) do not vary much compared to the phase diagrams. As result, the CNN which relies on phase diagrams, will misclassify the received OAM beam. Significant features of 3D topological shape (shown in blue) are far from the diagonal in the persistence diagram, {and their corresponding points in the diagram do not change significantly. Furthermore, Fig. \ref{fig:fig11} e) illustrates the output layer (the probabilistic values between $0$ and $1$) resulting from the proposed framework and conventional CNN, when the transmit message's index is $82$. Clearly, in the proposed framework, $f_{82}$ is much higher than other $f_m$ for all $1 \leq m \leq 128$ and $m\neq 82$. However, in case of conventional CNN, $f_{91}$ is higher than other $f_m$ for all $1 \leq m \leq 128$ and $m\neq 91$, and thus the CNN misclassifies the $82^{nd}$ message as the $91^{st}$.}
\begin{figure}[!t]
\centering
\includegraphics[width=0.455 \textwidth]{three_in_one.eps}
\caption{ The OAM decoding of $M=128$; due to importance, the $1^{st}$ and $2^{nd}$ order topological feature are shown with black and red, respectively; a) the $82^{nd}$ message is shown at the transmit side ($\boldsymbol{x}$); b) the $82^{ed}$ message is shown at the receive side ($\boldsymbol{y}$); c) the $91^{st}$ message is shown at the transmit side ($\boldsymbol{x}$); d) the $91^{st}$ message is shown at the receive side ($\boldsymbol{y}$); e) $f_m$ is illustrated for both proposed method PH+CNN and CNN. }
\label{fig:fig11}\vspace{-5 mm}
\end{figure}
% {An important aspect of the persistence diagram is its stability with respect to perturbations of topological components. In fact, stability guarantees that a persistence diagram is reliable in presence of noise, and can be effectively used for classification purposes \cite{Kusano}. The authors in \cite{Kusano, 7299106} prove that kernels are stables, and hence, the proposed kernel is stable too. %multi-scale kernel is stable w.r.t. the $1$-Wasserstein distance. The multi-scale kernel is a generic family of kernels and the proposed kernel is a specific member of such family, and hence, the proposed kernel is stable too.}
{Our
network is based on Alexnet \cite{alexa} and is composed of 5 conv-pooling layers (explained in Section \ref{sec:system_model})
and 3 fully connected (fc) layers. The detailed network architectures of the proposed method (PH, conv1, pool1,..., conv5, pool5, fc1, fc2, fc3) and baseline (conv1, pool1,..., conv5, pool5, fc1, fc2, fc3) are shown in Table \ref{table:nonlin}. In order to remove the dependency of the algorithm's running time on hardware, the floating-point instruction (FLOP) counts are calculated. The FLOP
counts of backward propagation layers are listed in Table \ref{table:nonlin}, from which we can see that processing overhead of computing persistent homology (PH) is much lower than the rest of the convolutional layers. Also, Table \ref{table:rtr} shows that the running time and FLOP counts of the proposed method (including persistent homology plus Alexnet-based CNN) are just 0.3\% and 0.5\% higher than the baseline (Alexnet) when both are running on GTX1080, respectively. }
\begin{table}[!t]
\scriptsize
\caption{{Parameter analysis of layers used in the proposed method (PH+CNN) and baseline (CNN: conv1, pool1,..., conv5, pool5, fc1, fc2, fc3) when $N=1000$.}} % title of Table
\centering % used for centering table
\begin{tabular}{c|c|c c c c c} % centered columns (4 columns)
\hline\hline %inserts double horizontal lines
Proposed method &Baseline &Layer & Kernel & Parameters & FLOPs \\ [0.5ex] % inserts table
%heading
\hline % inserts single horizontal
PH&- &PH & $1\times 1$ & 3 K & 1 G \\
\hline
& &conv1 & $11\times 11$ & 35 K & 40 G \\
& &pool1 & $3\times 3$ & 0 & 1 G \\
& &conv2 & $5\times 5$ & 615 K & 120 G \\
& &pool2 & $3\times 3$ & 0 & 1 G\\
CNN& CNN&conv3 & $3\times 3$ & 885 K & 40 G \\
& &conv4 & $3\times 3$ & 1.33 M & 60 G \\
& &conv5 & $3\times 3$ & 885 K & 60 G \\
& &pool5 & $3\times 3$ & 0 & 1 G \\
& &fc6 & $1\times 1$ & 38 M & 10 G \\
& &fc7 & $1\times 1$ & 17 M & 5 G \\
& &fc8 & $1\times 1$ & 4 M & 2 G \\
%5 & 45 & 300 & 556 \\ [1ex]
\hline %inserts single line
\end{tabular}
\label{table:nonlin}\vspace{-5 mm} % is used to refer this table in the text
\end{table}
\begin{table}[!t]
\scriptsize
\caption{{Overall FLOP counts, number of parameter and running time of proposed method (PH+CNN) and baseline (CNN) when $N=1000$.}} % title of Table
\centering % used for centering table
\begin{tabular}{c c c c c} % centered columns (4 columns)
\hline\hline %inserts double horizontal lines
Method & Parameters & FLOPs & Running Time \\ [0.5ex] % inserts table
%heading
\hline % inserts single horizontal
PH+CNN & 62.753 M & 341 G & 42.1 ms\\
CNN & 62.75 M & 340 G& 42 ms\\
%5 & 45 & 300 & 556 \\ [1ex]
\hline %inserts single line
\end{tabular}\vspace{-3 mm}
\label{table:rtr} % is used to refer this table in the text
\end{table}
\section{Simulation results and Analysis}
\label{ref:sim}
In this section, we demonstrate the performance of the proposed method in terms of accuracy {($\text{Pr} {(\hat{s}= s)}=1-P_e$)}, {and we compare it with the CNN-based method (Alexnet) of \cite{Doster:17}.} For the purpose of training and testing the framework, the first-$n$-adjacent OAM modes, %\footnote{Selection of adjacent modes is not the best practice, due to the negative impact of crosstalk of adjacent modes. Future work can consider the design of an autoencoder to select OAM modes with highest discriminative features.}%; same time selecting the OAM modes with larger spaces requires the inclusion of modes with higher mode number, which adversely increases the beam diameter and thus interfering with more turbulence field.}
($n \in\{6,...,16\}$) are generated and superpositioned, numerically.
%Additionally, we have numerically generated $1000$ images for each OAM message. %Both the noiseless and distorted beams are generated by modified version of the “basic paraxial optics toolkit” in MATLAB \cite{bworld}.
Additionally, the effect of varying the turbulence level and the message length (which is equal to the number of OAM modes) on the accuracy rate $(1-P_e)$ are investigated. Turbulence causes a random phase along the propagation path of the beam \cite{Andrews}, and the turbulence level, denoted by $T$, can be quantified as the ratio between linear dimension of the SLM and the Fried’s parameter \cite{Andrews}. %, \cite{Doster:17}. %For the computing persistent homology, “R package TDA” \cite{Fasy2014IntroductionTT} is used.
We compare the performance of the proposed method, called “PH+CNN”, with
those achieved by the CNN in \cite{Doster:17}, and we call it “CNN”.
%\textcolor{blue}{%ose LeNet-5, a typical CNN designed for handwritten and machine-printed character recognition [27], to recognize the OAM pattern in our work. The architecture of LeNet-5 used in the OAMSK decoder is shown in Fig. 2. The input is a 32 × 32 pixel image. We set three convolution layers and two subsampling layers. In convolution layers 1 and 3, the units are organized into 6 and 16 feature maps, respectively. Each unit in each feature map is connected to a 5 × 5 neighborhood in the upper layer. The units in subsampling layers 2 and 4 take an input from a non-overlapping 2 × 2 region and compute the corresponding maximum. Layer 5 is a convolutional layer with 120 feature maps. Layer 6 and the output layer are the fully connected layer ith a SoftMax classifier, whose feature map number corresponds to the classifying types...For example, e found that the testing times, which determine the communication
%}
{Our dataset is generated numerically by using the “basic paraxial optics toolkit” in MATLAB \cite{bworld}, and it
consists of a balanced group size (per OAM) of $10000$ phase diagrams that contains a variable amount of turbulence.
To train the CNN, we split the
data collected into two separate sets a training set ($85\%$) and testing set ($15\%$) of the overall dataset. The training and testing sets are completely independent of one another and do not share any
turbulence realizations. The training and testing set for the PH+CNN use the same turbulence realizations as those used for the CNN.} {In our simulations, the most meaningful results were found by empirically setting $\nu$ to $0.1$. Therefore, all results are reported for $\nu=0.1$. By adjusting $\nu$, we can control and discount the effect of the points with low persistence and computational complexity (explained in Section \ref{sec:Solution}).} Furthermore, for computing persistent homology, the “R package TDA” \cite{Fasy2014IntroductionTT} is used.
{Fig. \ref{fig:fig2} shows the accuracy of decoding for different turbulence levels and bit lengths of CNN and PH+CNN. Fig. \ref{fig:fig2} shows that, PH+CNN outperforms CNN for different turbulence levels and bit lengths. Fig. \ref{fig:fig2} shows that the performance of both methods degrades rapidly with increasing turbulence level and bit length. However, for higher turbulence levels, the performance of PH+CNN is much better than CNN while they perform similarly at low turbulence levels. It can be seen that for a severe turbulence level of $21$, for a message with $16$-bit length, PH+CNN yields up to $20$\% better accuracy than CNN. This demonstrates that the PH+CNN method can allow a larger message size or OAM number and can increase the capacity further even for high turbulence levels.} % The bit-error-rate also follows similarly the message-error-rate with almost tenth of message error rate, however, due to space limitation, the bit-error-rate results are not provided for our analysis.
%\begin{figure}
%\centering
% \includegraphics[width=0.39 \textwidth]{turbu.pdf}
% \caption{The decoding accuracy rate of the PH+CNN and CNN for different turbulence levels ($n=12$ bits).}
% \label{fig:fig1}
%\end{figure}
%\begin{figure}
%\centering
% \includegraphics[width=0.39\textwidth]{bitlength.pdf}
% \caption{The decoding accuracy rate of the PH+CNN and CNN for different bit lengths ($T=10$).}
% \label{fig:fig2}
%\end{figure}
\begin{figure}
\centering
\includegraphics[width=0.36\textwidth]{drawing.eps}
\caption{{Decoding accuracy of CNN (top) and PH+CNN (bottom) as a function of bit lengths and turbulence levels.}}
\label{fig:fig2}\vspace{-3 mm}
\end{figure}
\section{Conclusions}
\label{conc}
In this paper, we have proposed a new approach that combines persistent homology and CNN to decode OAM modes. We have shown that, after training the proposed method on set of each superpositioned OAM mode, a high accuracy, rate even with large number of OAM modes, in presence of severe {atmospheric turbulence} can be achieved. Numerical results have shown a substantial increase in the number of simultaneously-discriminated OAM modes under turbulence channel with better accuracy than CNN. Future work can consider the design of an autoencoder to select OAM modes with highest discriminative topological features as the messages, for given channel conditions, data rates and error rate requirements, adaptively.
\bibliographystyle{IEEEtran}
\bibliography{IEEEabrv,Master}
\end{document}
% Generated by IEEEtran.bst, version: 1.14 (2015/08/26)
\begin{thebibliography}{10}
\providecommand{\url}[1]{#1}
\csname url@samestyle\endcsname
\providecommand{\newblock}{\relax}
\providecommand{\bibinfo}[2]{#2}
\providecommand{\BIBentrySTDinterwordspacing}{\spaceskip=0pt\relax}
\providecommand{\BIBentryALTinterwordstretchfactor}{4}
\providecommand{\BIBentryALTinterwordspacing}{\spaceskip=\fontdimen2\font plus
\BIBentryALTinterwordstretchfactor\fontdimen3\font minus
\fontdimen4\font\relax}
\providecommand{\BIBforeignlanguage}[2]{{%
\expandafter\ifx\csname l@#1\endcsname\relax
\typeout{** WARNING: IEEEtran.bst: No hyphenation pattern has been}%
\typeout{** loaded for the language `#1'. Using the pattern for}%
\typeout{** the default language instead.}%
\else
\language=\csname l@#1\endcsname
\fi
#2}}
\providecommand{\BIBdecl}{\relax}
\BIBdecl
\bibitem{Khalighi_survey}
M.~A. {Khalighi} and M.~{Uysal}, ``Survey on free space optical communication:
A communication theory perspective,'' \emph{IEEE Communications Surveys \&
Tutorials}, vol.~16, no.~4, pp. 2231--2258, Fourth Quarter 2014.
\bibitem{wang2012terabit}
J.~Wang, J.-Y. Yang, I.~M. Fazal, N.~Ahmed, Y.~Yan, H.~Huang, Y.~Ren, Y.~Yue,
S.~Dolinar, M.~Tur, and A.~E. Willner, ``Terabit free-space data transmission
employing orbital angular momentum multiplexing,'' \emph{Nature Photonics},
vol.~6, no.~7, p. 488, June 2012.
\bibitem{6G}
W.~Saad, M.~Bennis, and M.~Chen, ``A vision of 6{G} wireless systems:
applications, trends, technologies, and open research problems,'' \emph{IEEE
Network}, to appear, 2019.
\bibitem{mair2001entanglement}
A.~Mair, A.~Vaziri, G.~Weihs, and A.~Zeilinger, ``Entanglement of the orbital
angular momentum states of photons,'' \emph{Nature}, vol. 412, no. 6844, p.
313, July 2001.
\bibitem{Knutson}
E.~M. Knutson, S.~Lohani, O.~Danaci, S.~D. Huver, and R.~T. Glasser, ``Deep
learning as a tool to distinguish between high orbital angular momentum
optical modes,'' in \emph{Optical Engineering + Applications}, vol. 9970, Sep
2016, p. 997013.
\bibitem{Doster:17}
T.~Doster and A.~T. Watnik, ``Machine learning approach to {OAM} beam
demultiplexing via convolutional neural networks,'' \emph{Applied Optics},
vol.~56, no.~12, pp. 3386--3396, 2017.
\bibitem{cheng2018orbital}
W.~{Cheng}, W.~{Zhang}, H.~{Jing}, S.~{Gao}, and H.~{Zhang}, ``Orbital angular
momentum for wireless communications,'' \emph{IEEE Wireless Communications},
vol.~26, no.~1, pp. 100--107, February 2019.
\bibitem{8712525}
{ Y. {Yao}, X. {Liang}, W. {Zhu}, J. {Geng} and R. {Jin}}, ``{Experiments of
Orbital Angular Momentum Phase Properties for Long-Distance Transmission},''
\emph{{IEEE Access}}, vol.~{7}, pp. {62\,689--62\,694}, {2019}.
\bibitem{zomorodian_2005}
A.~J. Zomorodian, \emph{Topology for Computing}, ser. Cambridge Monographs on
Applied and Computational Mathematics.\hskip 1em plus 0.5em minus 0.4em\relax
{Cambridge University Press}, 2005.
\bibitem{Kusano}
G.~Kusano, Y.~Hiraoka, and K.~Fukumizu, ``Persistence weighted gaussian kernel
for topological data analysis,'' in \emph{Proc. ICML'16}, NY, USA, June 2016,
pp. 2004--2013.
\bibitem{alexa}
A.~Krizhevsky, I.~Sutskever, and G.~E. Hinton, ``Imagenet classification with
deep convolutional neural networks,'' in \emph{Proc. NIPS 2012}.\hskip 1em
plus 0.5em minus 0.4em\relax Curran Associates, Inc., 2012, pp. 1097--1105.
\bibitem{Andrews}
L.~Andrews, ``An analytical model for the refractive index power spectrum and
its application to optical scintillations in the atmosphere,'' \emph{Journal
of Modern Optics}, vol.~39, no.~9, pp. 1849--1853, 1992.
\bibitem{bworld}
A.~M. Gretarsson, ``Basic paraxial optics toolkit—{MATLAB} central.''
\bibitem{Fasy2014IntroductionTT}
B.~T. Fasy, J.~Kim, F.~Lecci, and C.~Maria, ``Introduction to the {R} package
{TDA},'' \emph{arXiv preprint arXiv:1411.1830}, Nov 2014.
\end{thebibliography}