Controlling Chaotic Maps using Next-Generation Reservoir Computing
Extracted source text · arXiv 2307.03813
\documentclass[%
aip,
% jmp,
% bmf,
% sd,
% rsi,
amsmath,amssymb,
%preprint,%
reprint,%
%author-year,%
%author-numerical,%
% Conference Proceedings
]{revtex4-2}
\usepackage{graphicx}% Include figure files
\usepackage{dcolumn}% Align table columns on decimal point
\usepackage{bm}% bold math
%\usepackage[mathlines]{lineno}% Enable numbering of text and display math
%\linenumbers\relax % Commence numbering lines
\usepackage[utf8]{inputenc}
\usepackage[T1]{fontenc}
\usepackage{mathptmx}
\usepackage{etoolbox}
\usepackage[mathscr]{euscript}
\usepackage[breaklinks]{hyperref}
\hypersetup{
colorlinks,
citecolor=blue,
linkcolor=blue,
urlcolor=blue}
\usepackage[caption=false,position=top,margin=12pt,justification=raggedright,singlelinecheck=false,subrefformat=parens,labelformat=parens]{subfig}
\usepackage{subfig}
%% Apr 2021: AIP requests that the corresponding
%% email to be moved after the affiliations
\makeatletter
\def\@email#1#2{%
\endgroup
\patchcmd{\titleblock@produce}
{\frontmatter@RRAPformat}
{\frontmatter@RRAPformat{\produce@RRAP{*#1\href{mailto:#2}{#2}}}\frontmatter@RRAPformat}
{}{}
}%
\makeatother
\begin{document}
%\preprint{AIP/123-QED}
\title[Controlling Chaotic Maps using Next-Generation Reservoir Computing]{Controlling Chaotic Maps using Next-Generation Reservoir Computing}
% Force line breaks with \\
\author{Robert M. Kent}
\altaffiliation{These authors contributed equally to this work}
\affiliation{
Department of Physics, The Ohio State University, 191 W. Woodruff Ave., Columbus, OH 43210, USA%\\This line break forced with \textbackslash\textbackslash
}%
\email{kent.321@buckeyemail.osu.edu}
%\altaffiliation[Also at ]{Physics Department, XYZ University.}%Lines break automatically or can be forced with \\
\author{Wendson A. S. Barbosa}%
\altaffiliation{These authors contributed equally to this work}
\affiliation{
Department of Physics, The Ohio State University, 191 W. Woodruff Ave., Columbus, OH 43210, USA%\\This line break forced with \textbackslash\textbackslash
}%
\author{Daniel J. Gauthier}
%\homepage{http://www.Second.institution.edu/~Charlie.Author.}
\affiliation{
Department of Physics, The Ohio State University, 191 W. Woodruff Ave., Columbus, OH 43210, USA}
\affiliation{ResCon Technologies, LLC, 1275 Kinnear Rd., Suite 238, Columbus, OH 43212 USA
}%
\date{\today}% It is always \today, today,
% but any date may be explicitly specified
\begin{abstract}
In this work, we combine nonlinear system control techniques with next-generation reservoir computing, a best-in-class machine learning approach for predicting the behavior of dynamical systems. We demonstrate the performance of the controller in a series of control tasks for the chaotic H\'{e}non map, including controlling the system between unstable fixed-points, stabilizing the system to higher order periodic orbits, and to an arbitrary desired state. We show that our controller succeeds in these tasks, requires only 10 data points for training, can control the system to a desired trajectory in a single iteration, and is robust to noise and modeling error.
\end{abstract}
\maketitle
\begin{quotation}
Developing effective control strategies for dynamical systems that display complex behaviors such as chaos poses significant challenges. Traditional control algorithms typically only work in a local linear neighborhood of a desired behavior or require an accurate system model, for example. Recent advances by the machine learning community provide new opportunities for controlling complex systems by using only measured data to identify an accurate model. Recent advances include control algorithms that use artificial neural networks and model predictive control. While these are promising approaches, they can be computationally expensive and their complexity imposes limitations on hardware implementation. In this study, we present an approach for controlling dynamical systems that harnesses the power of a novel machine learning method called next-generation reservoir computing. We show that our method can learn the underlying physics governing the dynamics using only a few data points to learn the model and use it to control the system between unstable fixed-points or arbitrary desired states even in the presence of noise and model error, thus displaying robustness.
\end{quotation}
\section{\label{sec:Intro} Introduction}
Controlling dynamical systems is a problem of wide importance as it encompasses various domains including robotics, aerospace, industrial processes, and biological systems. The goal is to design an algorithm that forces the system, known as a \textit{plant}, to follow a prescribed trajectory in phase space that is robust against noise and other external influences. Controlling a system requires, at a minimum, the existence of an accessible system parameter that modifies the dynamics. The accessible parameter is adjusted based on a control algorithm, of which there are two general classes: open-loop algorithms where the adjustment is made independent of the state of the system; and closed-loop controllers that adjust the control signal based on real-time measurement of the state of the system. We focus here on closed-loop controllers, an example of which is illustrated in the bottom panel of Fig.~\ref{fig:Storyboard}.
\begin{figure*}[htb]
\centering
%
\subfloat{%
\includegraphics[width=\linewidth]{Fig1.eps}%
}
\caption{Learning and controlling a dynamical system (plant) using next-generation reservoir computing. (top) The NG-RC is trained to predict $x_{i+1}$, the next step of one of the plant's observable variable. (bottom) The controller is designed based on the NG-RC model estimation for the evolution of the observable variable to be controlled. Then, it applies a control signal $u_i$ to the plant, which is driven towards a desired state $x_{des,i+1}$.}
\label{fig:Storyboard}
\end{figure*}
A particularly challenging control problem is when the system's dynamics are have nonlinear interactions that give rise to complex behaviors such as chaos. Typically, controlling nonlinear systems requires an accurate mathematical model of the system if control is desired over the entire phase space and range of operating parameters.\cite{Slotine1991}
The study of controlling chaotic dynamical systems was transformed in the 1990's by the realization that the unstable periodic orbits and other unstable sets that are the skeleton of the chaotic attractor can be used as the basis of a control algorithm.\cite{Ott_Grebogi_Yorke1990} Here, only the local linear dynamics of the system in the vicinity of a periodic orbit are required, and hence linear control methods\cite{Ogata} can be used. The system naturally visits the periodic orbits and control is only applied when there is a close approach, hence only small adjustments to the accessible system parameter are required. Many variations on this theme have been developed and applied to a wide variety of engineered and natural systems.\cite{Gauthier2003}
There is a resurgence in research on nonlinear control that can stabilize arbitrary states by bringing together traditional nonlinear control methods and modern machine learning (ML) tools that are used to learn a data-driven model of the system. Examples include model predictive control,\cite{Camacho2013,Wu2020} control using artificial neural networks,\cite{Zong2009,Gokce2013} and evolutionary algorithms, \cite{Matousek2019,Matousek2021,Senkerik2011,Zelinka2009,Matousek2014} among others. However, these methods require large sets of data for creating the model (called \textit{training data}) and they require high-complexity model evaluation, which limits their use for controlling high-speed systems or deployment on low-power microcontrollers (known as edge computing devices).
A promising ML algorithm for controlling dynamical systems that may offer a solution to these bottlenecks is reservoir computing.\cite{Jaeger_Haas2004,Maass2002} It is a best-in-class method for identifying data-driven models of dynamical systems and has already been applied successfully to a few problems.\cite{Waegeman2012,Waegeman2013,Canaday2021,Haluszczynski2021} Combining reservoir computing with time delays can reduce the model size, \cite{KurthsDelayRC2023} but there is a need to further reduce the algorithm complexity. Next-generation reservoir computing\cite{NGRC} is mathematically equivalent to traditional reservoir computing but requires less training data, is less computationally expensive, and has fewer hyperparameters to optimize. The next-generation reservoir computing paradigm presents state-of-the-art prediction for low- \cite{NGRC} and high-dimensional\cite{NGRC-L96} chaotic dynamical systems, but its use has not yet been explored in dynamical systems control.
The primary goal of this paper is to demonstrate how reservoir computers, including the next-generation reservoir computer (NG-RC), can be placed in the framework of control algorithms developed by Sarangapani.\cite{Sarangapani2006} This general class of control algorithms can be applied to discrete dynamical systems using what is called a self-tuning regulator and can also be applied to continuous-time systems that are sampled discretely. Sarangapani considers control of discrete maps using a trained artificial neural network that is a linear sum of nonlinear functionals of the input data and additive control perturbations, known as the discrete Brunovsky canonical form of the estimated system. Note that the underlying map does not need to be of this form, only the learned model.
Sarangapani's framework is a suitable starting point because the output of a reservoir computer is a linear sum of nonlinear functionals of the input data. Importantly, Sarangapani proves, using Lyapunov stability analysis, that any discrete system in Brunovsky form can be controlled robustly as long as the ML model error and system noise are bounded. To illustrate this approach with a pedagogical example, we show how an NG-RC can be used to control the H\'{e}non map\cite{Henon1976} by using it to stabilize unstable periodic orbits and to also guide the system to arbitrary dynamical states. We show that control is robust in the presence of noise and modeling error, the NG-RC can be trained to faithfully reproduce the behavior of the H\'{e}non map using only a few training data points, and the learned model can be evaluated by performing a small number of computations.
The control scheme concept is illustrated in Fig. \ref{fig:Storyboard}, which has two distinct phases. In the first phase, the NG-RC is trained to predict the next step of the system's observable variable to be controlled, taken to be a single variable $x$ in this illustration. The NG-RC predicts $x_{i+1}$ having as input the system's observable variables, taken as ${\bf{X_i}}=\{x_i,y_i\}$ for this illustration, which are measured through a sensor connected to the plant (dynamical system). An external perturbation $u_i$ at the current time step $t_i$, also taken as a scalar in this illustration, is applied directly to the plant. The input data (blue circles) to the NG-RC are used to create a feature vector $\mathbb{O}_{total}$ that includes $u_i$, a constant $c$, and linear ($\mathbb{O}_{lin,i}$) and nonlinear ($\mathbb{O}_{nonlin,i}$) terms derived from ${\bf{X}}_i$.
The NG-RC is trained by using a random perturbation sequence $u_i$ (length $M_{train}$), which teaches the algorithm the underlying dynamics of the discrete-time system and its response to perturbations. The NG-RC is trained so that its output is equal to the measured accessible variable, in a least-square sense, given by $x$. This optimization procedure identifies ${\bf{\hat W}}$ that minimizes the difference between the true $x_{i+1}$ and the predicted variable $\hat x_{i+1}$ (see Appendix \ref{app:OptimizingAlpha}).
In the control phase, a controller is used to generate the signal $u_i$ that is applied to the plant. The control signal is designed to drive the plant to the next state $x_{i+1}$ towards the desired state $x_{des,i+1}$ on step in the future. The controller includes information of $x_{des,i+1}$, ${\bf{X_i}}$ and NG-RC prediction of the uncontrolled system ${\bf{\hat W}}_{\bf{X}}{\mathbb{O}}_{{\bf{X}},i}$.
The rest of the paper is organized as follows. In Sec. \ref{sec:Control}, we describe the general formulation for a dynamical system whose evolution is described by a discrete map, followed by the ML-based control law formalism used in this work. In Sec. \ref{sec:NGRC}, we introduce the theoretical background of the NG-RC and describe how well it suits the proposed control algorithm. In Sec. \ref{sec:HenonMap}, we describe the dynamical system used as plant for our proposed control method, which details on implementation is shown in Sec. \ref{ControllingHenonMap}. Section \ref{sec:Results} is dedicated to the results. Here, we use our method to control the H\'{e}non map to three different desired states. We show that our algorithm can correctly learn the system in the presence of noise, thus showing to be a robust controller. Last, we close the manuscript with discussions, conclusions and future directions in Sec. \ref{sec:Discussions}.
\section{\label{sec:Control} Controlling Discrete Dynamical Systems Using Machine Learning}
In this section, we describe Sarangapani's \cite{Sarangapani2006} nonlinear control framework for discrete-time systems. First, we describe the general formulation for a multi-input multi-output (MIMO) dynamical system subject to disturbances, whose evolution is described by a discrete map. Then, we formulate the control algorithm.
\subsection{Dynamical system evolution in the presence of feedback perturbations}
Controlling a dynamical system relies on designing a control perturbation ${\bf{u}}$ applied to an accessible system parameter that drives the system to a desired behavior. The system's evolution is described in general by the map
%
\begin{eqnarray}
{\bf{\mathscr{X}}}_{i+1}&=&{{\bf{\mathscr{F}}}}\left({\bf{\mathscr{X}}}_{i},{\bf{u}}_i\right),
\label{eq:Xreal}
\end{eqnarray}
%
where the system variables ${\bf{\mathscr{X}}}_i\in \mathbb{R}^{d_s}$ represent the system state at time $t_i$, $d_s$ is the system's phase-space dimension, ${\bf{\mathscr{F}}}(\cdot)$ is a nonlinear function, generally unknown, that maps (${\bf{\mathscr{X}}}_i,{\bf{u}}_i$) to ${\bf{\mathscr{X}}}_{i+1}$. In real-world systems, it can be difficult to measure all components of ${\bf{\mathscr{X}}}_i$ because some may not be accessible or it is impractical to measure all components if the system is high dimensional. Thus, the observed dynamics are a projection of the real dynamics in the state-space formed by the set of accessible observations ${\bf{X}}$, whose evolution is given by
%
\begin{eqnarray}
{\bf{X}}~=~\bf{\mathcal{G}}({\bf{\mathscr{X}}}),
\label{eq:X}
\end{eqnarray}
%
where ${\bf{X}}_{i} \in \mathbb{R}^{d'}$ with $d' \le d_s$ and $\bf{\mathcal{G}}$ is a possibly nonlinear function.
A second consideration is that the control perturbation ${\bf{u}}$ might be applied to a subset ${\bf{Y}} \in \mathbb{R}^{d}$ of the observed variables ${\bf{X}}$, so that ${\bf{u}}$ is a ${d}$-dimensional vector. Here, ${\bf{Y}}$ represent the variables to be controlled whose dynamics are described by
\begin{eqnarray}
{{\bf{Y}}_{i+1}} &=& {\bf{\mathcal{F}}}({\bf{X}}_i,{\bf{u}}_i),
\label{eq:Y}
\end{eqnarray}
%
where ${\bf{\mathcal{F}}}$ is a nonlinear function, generally unknown, that maps $({\bf{X}}_i,{\bf{u}}_i)$ to ${{\bf{Y}}_{i+1}}$.
The control problem addressed in this paper relies on finding the control signal ${\bf{u}}$ that minimizes ${\bf{Y}}_{i+1}-{\bf{Y}}_{des,i+1}$, where ${\bf{Y}}_{des,i+1}$ is the desired state one step in the future.
\subsection{\label{sec:ControlLaw}Control Law Design}
To simplify the problem, we recall that there is a wide class of dynamical systems where the perturbations enter linearly so that
%
\begin{eqnarray}
{\bf{\mathcal{F}}}({\bf{X}}_i,{\bf{u}}_i)&=&{\bf{F}}\left({\bf{X}}_{i}\right) + {\bf{W}}_u{\bf{u}}_i.
\label{eq:F_as_F_and_Wu}
\end{eqnarray}
%
Here, ${\bf{W}}_u \in \mathbb{R}^{d\times d}$ is a matrix whose components represent the control effectiveness and ${\bf{F}}: \mathbb{R}^{d'} \rightarrow \mathbb{R}^{d}$ is the map of the uncontrolled $d$-dimensional system. Thus, the dynamical system represented in Eq. \ref{eq:Y} can be described by
%
\begin{eqnarray}
{\bf{Y}}_{i+1}&=&{\bf{F}}\left({\bf{X}}_{i}\right) + {\bf{W}}_u{\bf{u}}_i + {\bf{d}}_i,
\label{eq:controllinearu}
\end{eqnarray}
%
where {\bf{d}} is a time-dependent disturbance that arises, for example, from noise. The goal of a ML algorithm is to learn a model $\hat{\bf{F}}$ of the underlying map $\mathbf{F}$ and $\hat{\bf{W}}_u$ for the control effectiveness. It is possible to generalize Eqs.~\ref{eq:F_as_F_and_Wu} and \ref{eq:controllinearu} to have a nonlinear functional of $\mathbf{X}_i$ multiplying $\mathbf{u}$,\cite{Sarangapani2006} but we restrict our study to the simpler case to illustrate the approach with as little complexity as possible.
To arrive at a control algorithm, consider the controller output tracking error at time $t_{i+1}$ defined as the difference between the actual and desired outputs
%
\begin{eqnarray}
{\bf{e}}_{i+1} \equiv {\bf{Y}}_{i+1} - {\bf{Y}}_{des,i+1}.
\label{eq:error}
\end{eqnarray}
%
Using this definition in Eq. \ref{eq:controllinearu}, the dynamics of the output tracking error are given by
%
\begin{eqnarray}
{\bf{e}}_{i+1} &=&{\bf{F}}({\bf{X}}_{i}) + {\bf{W}}_u{\bf{u}}_i - {\bf{Y}}_{des,i+1} + {\bf{d}}_i.
\label{eq:errorv2}
\end{eqnarray}
%
Sarangapani\cite{Sarangapani2006} demonstrates that a robust and provable stable nonlinear controller can be realized by solving for $\mathbf{u}_i$ in Eq.~\ref{eq:errorv2}, setting $\mathbf{d}_i = 0$, and replacing $\mathbf{e}_{i+1} \rightarrow \mathbf{Ke}_i$, $\mathbf{F} \rightarrow \hat{\mathbf{F}}$, and $\mathbf{W}_{\mathbf{u}} \rightarrow \hat{\mathbf{W}}_{\mathbf{u}}$. The control perturbations are then given by
%
\begin{eqnarray}
{\bf{u}}_i&=&\hat{{\bf{W}}}_u^{-1}\left[{\bf{Y}}_{des,i+1} - \hat{\bf{ F}}({\bf{X}}_{i}) + {\bf{K}} {\bf{e}}_{i} \right],
\label{eq:controlsignal}
\end{eqnarray}
%
where ${\bf{K}}$ is the closed-loop gain matrix. Using this form of ${\bf{u}}$, the tracking error dynamics becomes
%
\begin{eqnarray}
{\bf{e}}_{i+1}&=&{\bf{F}}({\bf{X}}_{i}) + {\bf{W}}_u {\hat{{\bf{W}}}_u}^{-1}\left[{\bf{Y}}_{des,i+1} - \hat{\bf{ F}}({\bf{X}}_{i}) + {\bf{K}} {\bf{e}}_i \right] \nonumber \\
&~~& -{\bf{Y}}_{des,i+1} + {\bf{d}}_ i.
\label{eq:error2}
\end{eqnarray}
%
%
Equation~\ref{eq:error2} is informative: the control perturbations attempt to cancel the nonlinear function $\mathbf{F}$ via the term $\hat{\mathbf{F}}$, referred to as feedback linearization, and simultaneously apply linear proportional feedback via the term $\mathbf{Ke}_i$. In the ideal situation where the map and control effectiveness are learned without error, \textit{i.e.,} $\hat{\bf{F}}({\bf{X}}_{i}) = {\bf{F}}({\bf{X}}_{i})$ and ${\hat{{\bf{W}}}_u} = {\bf{W}}_u $, and there is no noise, the tracking error takes the simple form
%
\begin{equation}
{\bf{e}}_{i+1} = {\bf{K}}{\bf{e}}_i.
\label{eq:error_perfect}
\end{equation}
%
The tracking error approaches zero when the Floquet multipliers of map (\ref{eq:error_perfect}) are within the unit circle. Floquet multipliers close to the unit circle give a slower decay of the tracking error, whereas values close to zero give rise to faster decay.
In the next section, we show that the NG-RC meets the criteria for such a machine-learning-based control algorithm and we describe how to construct the NG-RC, train it for control, and implement it in this control framework.
\section{\label{sec:NGRC} Next-Generation Reservoir Computing}
In this section, we show how to estimate ${\bf{F}}$ and ${\bf{W}}_u$ using a next-generation reservoir computer.\cite{NGRC} This is the training phase shown in the top panel of Fig.~\ref{fig:Storyboard}. The NG-RC is trained with supervised learning, where input data and target output are known for a number of iterations $M_{train}$ and the perturbations are generated from a normally distributed random sequence with zero mean and standard deviation $\sigma_{\textbf{u}}$.
Similar to other ML approaches, the core tasks are to design the feature vector $\mathbb{O}_{total}$, whose linear transformation expresses the ML output as
%
\begin{eqnarray}
\hat{{\bf{Y}}}_{i+1} &=& \hat{{\bf{ W}}}\mathbb{O}_{total,i},
\label{eq:MLoutput}
\end{eqnarray}
%
and optimizing the output matrix of coefficients $\hat{{\bf{W}}}$ for minimizing the difference $||\hat{{\bf{Y}}}_{i+1} - {\bf{Y}}_{i+1}||$ in a least-square sense (see Appendix \ref{app:OptimizingAlpha}) between the predicted and true variables, thus maximizing the model performance. In traditional ML methods like RCs, $\mathbb{O}_{total}$ is a functional representing the nonlinear transformation of the input data performed by an artificial neural network. In the NG-RC formalism, $\mathbb{O}_{total}$ includes the control signal and a functional composed of linear and nonlinear parts that act directly on the input data and is given by
%
\begin{eqnarray}
\mathbb{O}_{total,i}&=& {\bf{u}}_i \oplus c \oplus \mathbb{O}_{lin,i} \oplus \mathbb{O}_{nonlin,i}.
\label{eq:Feats}
\end{eqnarray}
%
Here, $\oplus$ is the concatenation operator and $c$ is a constant. The linear part is a vector with dimension $d_{lin}=d'$ and is given by
%
\begin{eqnarray}
\mathbb{O}_{lin,i}&= {\bf{X}}_i,
\label{eq:lin feat observable variables}
\end{eqnarray}
and hence includes the observable system variables in the current time step.
While there is great flexibility in selecting the functions that compose the nonlinear part $\mathbb{O}_{nonlin}$, we use the unique order-$p$ monomials formed by the components of $\mathbb{O}_{lin,i}$. This choice is motivated by the realization that an arbitrary dynamical system can be expressed by a Volterra series.\cite{Boyd1985,Gonon2022} Because the system that we control in this work has quadratic polynomial terms, we expect that the series can be truncated at quadratic order. Similar aggressive truncation of a polynomial functional representation has been used previously to obtain state-of-the-art performance for dynamical system prediction.\cite{NGRC,NGRC-L96} Thus, the final dimension of $\mathbb{O}_{nonlin}$ is given by $d_{nonlin}=d_{lin}(d_{lin}+1)/2$ and the dimension of $\mathbb{O}_{total}$ is $d_{tot} = 1 + d + d_{lin} + d_{nonlin}$.
To meet the criteria imposed by Sarangapani's control framework presented in Sec. \ref{sec:Control} that the learned model needs to be in the Brunovsky canonical form, \textit{i.e.,} a linear sum of nonlinear functionals of the input data and additive control perturbations, we rewrite the NG-RC output as
%
\begin{eqnarray}
\hat{{\bf{Y}}}_{i+1} &=& {\bf{\hat W}}_{\bf{X}}\mathbb{O}_{{\bf{X}},i} + {\bf{ \hat W}}_u{\bf{u}}_i,
\label{eq:MLoutputWxWu}
\end{eqnarray}
%
where ${\bf{ \hat W}}_u$ is the learned weight matrix for the perturbation ${\bf{u}}$ and ${\bf{\hat W}}_{\bf{X}}$ is the learned weight matrix for the set of features originated from ${\bf{X}}_i$ plus the constant, which is given by $\mathbb{O}_{{\bf{X}},i} = c \oplus \mathbb{O}_{lin,i} \oplus \mathbb{O}_{nonlin,i}$. Finally, Eq. \ref{eq:MLoutputWxWu} can be written in the format of Eq. \ref{eq:controllinearu} as
%
\begin{eqnarray}
\hat{{\bf{Y}}}_{i+1} &=& {\bf{\hat F}}({\bf{X}}_i) + {\bf{ \hat W}}_u{\bf{u}}_i + {\bf{\epsilon_i}},
\label{eq:MLoutputFxWu}
\end{eqnarray}
%
where ${\bf{\hat F}}({\bf{X}}_i) = {\bf{\hat W}}_{\bf{X}}\mathbb{O}_{{\bf{X}},i}$ is the NG-RC next step prediction of the unperturbed plant and ${\bf{\epsilon_i}}$ is the machine learning modeling error, also known as parameter estimation error.
\section{\label{sec:HenonMap}The H\'{e}non Map}
The H\'{e}non map \cite{Henon1976} is a simplified model of a continuous-time weather model that displays chaos\cite{Lorenz1963} while still displaying many of the same essential properties. It has been widely used to study chaotic behavior, such as chaos synchronization,\cite{Tutueva2022} anti-control,\cite{Han2021} image encryption,\cite{Soleymani2014,Khan2015} random number generation,\cite{Vajargah2015} and secure communication.\cite{Belkhouja2018} The map is defined by
\begin{align}
x_{i+1} &= 1 - a x_{i}^{2} + y_{i} + g u_{i} + d_{x,i} \label{eq:henon map xip1}\\
y_{i+1} &= b x_{i} + d_{y,i} \label{eq:henon map yip1},
\end{align}
where H\'{e}non chose parameters $a=1.4$, and $b=0.3$ for which the map exhibits chaotic behavior, where $g$ is the gain on the control perturbation $u_i$, and $d_{x,i}$ and $d_{y,i}$ are additive noise terms. For now, we take $u_{i} = d_{x,i} = d_{y,i} = 0$ to attain the classic equation. Throughout the rest of the paper, we use the original values of $a$ and $b$. A phase space trajectory of the H\'{e}non map can be seen in Fig. \ref{fig:attractor}.
\begin{figure}[!ht]
\centering
%
\subfloat{%
\includegraphics[scale=0.42]{Fig2.eps}
}
\caption{Phase portrait of the H\'{e}non attractor for $a=1.4$, $b=0.3$ iterated for 500 points (blue xs). Orange square represent the unstable fixed-points $P_{U1}$ and $P_{U2}$ with coordinate values $(x_{U1},y_{U1}) = (+0.63135,+0.18941)$ and $(x_{U2},y_{U2}) = (-1.13135,-0.33941)$ respectively. The red circles represent the points in the 4-period orbit $P_1,P_2,P_3,P_4$ given by $(x_1,y_1)=(0.638194,-0.21203)$, $(x_2,y_2)=(0.217762,0.191458)$, $(x_3,y_3)=(1.12507,0.0653285)$, and $(x_4,y_4) = (-0.706767,0.337521)$ respectively. The dashed black line represents the trapping region: all points within the region remain within the region and all points outside diverge to infinity.\cite{Henon1976}}
\label{fig:attractor}
\end{figure}
The H\'{e}non map has two unstable fixed-points, $P_{U1}$ and $P_{U2}$. $P_{U1}$ is inside the trapping region that bounds the attractor, while $P_{U2}$ is located outside the trapping region. Any points inside the trapping region remain inside, and any point outside will diverge to infinity (see Fig. \ref{fig:attractor}).
The unstable fixed-points can be found by solving Eq.~\ref{eq:henon map xip1} and Eq.~\ref{eq:henon map yip1} for $x_{i+1}=x_n$ and $y_{i+1}=y_n$, respectively. When the system is in one of these fixed points, it is said to be in a 1-period orbit because it repeats with every iteration of the map. Higher orbits, such as 2-period and 4-period, can be computed using a similar approach. The points in the 4-period orbit are shown in Fig. \ref{fig:attractor}.
\section{\label{ControllingHenonMap} Controlling the H\'{e}non Map}
We implement the NG-RC-based controller by applying it to the H\'enon map. Here, the control perturbation is only applied to the $x$ variable, as $x$ is more sensitive to control than $y$.\cite{Braverman2022} Because we control a single variable, we adapt our notation introduced in Sec. \ref{sec:Control} by making ${\bf{Y}}\rightarrow Y$, ${\bf{u}}\rightarrow u$, ${\bf{W}}_u \rightarrow W_u$, ${\bf{K}} \rightarrow K$, and ${\bf{Y}_{des}}\rightarrow x_{des}$, as these quantities become scalars.
As a first step towards the control algorithm implementation, we train the NG-RC to predict the dynamics of $x$ having current values for both $x$ and $y$, so that $ Y_{i+1}= x_{i+1}$ and ${\bf{X}}_i = [x_i,y_i]^T$. We choose $c=1$ and the nonlinear features to be the unique second-order monomials of $\mathbb{O}_{lin,i}$, so that $\mathbb{O}_{nonlin,i} = [x_i^2,x_i y_i,y_i^2]^T$. We limit the monomials in the feature vector to order 2 because it is appropriate for this problem as Eqs. \ref{eq:henon map xip1} and \ref{eq:henon map yip1} contain only quadratic nonlinear terms. In general, higher-order polynomials can be used when less information is known about the system, or when the dynamics are more complex. Next, after learning ${\bf{\hat W}}_{\bf{X}}$ and ${\hat W}_u$, the control signal is calculated according to the control law of Eq. \ref{eq:controlsignal}.
Our focus lies on the control task of stabilizing the 1-period orbit outside the trapping region, considering the presence of noise and modeling error. Additionally, we undertake the challenging task of stabilizing the 4-period orbit, which is a known difficult task,\cite{Matousek2021} and controlling the system to an arbitrary trajectory.
\section{\label{sec:Results}Results}
We evaluate the effectiveness of our NG-RC-based controller using a variety of metrics. First, we evaluate the accuracy of the NG-RC prediction in the presence of noise. To quantify the prediction accuracy, we determine the root mean-square error (RMSE) between $x$ and $\hat x$ given by
\begin{eqnarray}
\text{RMSE}&=& \sqrt{{\langle{(x_i-{\hat x}_i)^2}\rangle}},
\label{eq:rmse}
\end{eqnarray}
where $\langle \cdot \rangle$ means averaging over many time steps, here taken to be $M_{test}$ steps.
\subsection{\label{sec: Prediction Robustness to Noise}Prediction Robustness to Noise}
To generate the training and testing data, an initial condition $(x_0,y_0)$ is chosen randomly with a uniform distribution inside the trapping region of the H\'{e}non Map. The map is iterated forwards for a set number of steps, and a perturbation $g~u_i$ is applied at each step, $u_i$ is randomly sampled from a normal distribution with mean 0 and standard deviation 0.1, and $g$ is chosen to be 1 for simplicity. During the trajectory, the random perturbation can cause the system state to exit the trapping region and escape the attractor. In this case, a new initial condition is chosen and the current dataset is discarded. At the end of the trajectory, the dataset is split into a training and testing set, containing $M_{train}$ and $M_{test}$ data points, respectively.
For this first prediction task, we inject noise into the map through $d_{x,i}$ in Eq. \ref{eq:henon map xip1} and $d_{y,i}$ in Eq. \ref{eq:henon map yip1}. The noise is randomly sampled from a normal distribution with mean 0 and various standard deviations and $M_{train}$ is varied, while the ridge regression parameter is chosen $\alpha\in[0,1]$ to minimize the RMSE on $M_{test}=50$ (see Appendix \ref{app:OptimizingAlpha}). The resulting curves are averaged over 100 initial conditions (see Fig. \ref{fig:sweep training points and noise rmse}).
Looking at the low noise $\sigma_d = 10^{-5}$ case, the RMSE begins to quickly decrease after only 2 iterations, but reaches a critical point between iterations 7-8 where the RMSE begins to decrease much more rapidly. This is because the number of training data points is comparable to the number of learned model parameters and that the training data explores the extent of the attractor. The cases of higher noise levels initially display the same behavior, but gradually level off as the RMSE approaches the noise level. It is notable that the RMSE converges to the noise level after $M_{train}=10$. This convergence demonstrates the NG-RC's ability to accurately predict the H'{e}non map even in the presence of noise, while relying on a minimal number of data points. In all the results that follow, the NG-RC is trained with $M_{train}=10$ without noise using random conditions for each trial, and the optimal $\alpha$.
\begin{figure}[!ht]
\centering
%
\subfloat{%
\includegraphics[scale=0.47]{Fig3.eps}
}
\caption{Predicting the H\'{e}non map system. Mean RMSE for the $x$ variable prediction as function of the training data size $M_{train}$ for different noise levels (color code). The curves represent the RMSE relative to the testing dataset of 50 points. The ridge parameter that minimizes the RMSE is chosen for each curve through a grid search, and the curves are averaged over 100 trials, each of which with different training and testing data sets as well as different perturbation and noise signals. From top to bottom, the average RMSE after 10 training points is $1.09 \times 10^{-5}$,$1.06 \times 10^{-4}$,$1.04 \times 10^{-3}$,$1.02 \times 10^{-2}$, and $0.98 \times 10^{-1}$.
}
\label{fig:sweep training points and noise rmse}
\end{figure}
\subsection{Controlling without Noise}
We first investigate the task of controlling the H\'{e}non map from $P_{U1}$ to $x_{des} = x_{U2}$ to observe the effect of $K$ on the rate of convergence to the desired state. The result for this task without noise or modeling error can be seen in Fig. \ref{fig:p1_orbit_control}. For higher $K$ values, $x_i$ approaches $x_{des}$ slowly, while for lower $K$ values, it converges rapidly. In the $K = 0$ case, the relative error is $1.53 \times 10^{-14}$ after a single iteration. The low error can be attributed to Eq. \ref{eq:controlsignal} being driven solely by $x_{des,i+1}-\hat{x}_{i+1}$ when $K=0$, where $\hat{x}_{i+1}$ is a very good approximation of $x_{i+1}$ in the absence of perturbations. Furthermore, for $K=0.9$, $x_i$ approaches $x_{des}$ gradually with a relative error <1\% after 48 iterations (not shown in the plot).
With the assumption of perfect learning and no disturbances, the tracking error is $e_{i+1} = 0.9 e_{i}$ according to Eq. \ref{eq:error_perfect}, meaning the error in the next step is 90\% of the current error. Given the initial error $x_{0} - x_{U2} = 1.7627$ in Fig. \ref{fig:p1_orbit_control}, a simple iteration of Eq. \ref{eq:error_perfect} also yields 48 iterations for a $<1\%$ relative error, whose value agrees with the numerical simulation down to a precision of $1.8 \times 10^{-12}$. This agreement indicates that the assumption of perfect learning is valid, the control law is working as expected, and the NG-RC is a reliable model to learn this system.
%
Note that even though we are only controlling $x_i$, $y_i$ is also driven towards $y_{U2}= 0.3x_{U2}$ because it is coupled to $x$.
\begin{figure}[!ht]
\centering
%
\subfloat{%
\includegraphics[scale=0.33]{Fig4.eps}
}
\caption{Controlling the H\'{e}non map dynamics between the two unstable fixed points. (top) $x$, (middle) $y$ and (bottom) $u$ as function of iterations for different values of $K$ (color code). Horizontal dashed line on (top) indicates $x_{des}=x_{U2}$ and initial conditions for $x$ and $y$ are $x_{U1}$ and $y_{U1}$, respectively.}
\label{fig:p1_orbit_control}
\end{figure}
A more difficult task is to control the system to the 4-period orbit whose points are represented by the red circles in Fig. \ref{fig:attractor}. When the system is in the 4-period orbit, it follows the trajectory $P_{1} \rightarrow P_{2} \rightarrow P_{3} \rightarrow P_{4} \rightarrow P_{1}$. As before, we seek to observe the effect of $K$ on the rate of convergence to the desired state. Because we only control $x$, we set $x_{des,i} = [x_1,x_2,x_3,x_4,x_1,...]$, and start at an initial condition $(x_0,y_0) = (-1,0)$, which is far from the points in the orbit. The result can be seen in Figure \ref{fig:p4_orbit_control}. Similar to before, the larger $K$ values approach the desired values gradually, while the smaller $K$ values approach the desired values rapidly. The $K = 0.0$ case achieves a relative error of $1.8 \times 10^{-12}$ by the first iteration, and the $K = 0.9$ case achieves a relative error $<1\%$ by iteration 50 (not shown). As before, $y$ approaches those of the 4-period orbit, even though $y$ is not controlled explicitly. We conclude that even for the difficult task of controlling the system to a 4-period orbit, the control law performs as expected.
\begin{figure}[!ht]
\centering
%
\subfloat{%
\includegraphics[scale=0.34]{Fig5.eps}
}
\caption{Controlling H\'{e}non Map dynamics to a 4-period orbit. (top) $x$, (middle) $y$ and (bottom) $u$ as function of iterations for different values of $K$ (color code). Horizontal dashed lines on (top) indicate the $x_{des}$ values, which change between $P_1$, $P_2$, $P_3$ and $P_4$ every iteration step starting at $x_{des} = x_1$ at iteration 0. The initial condition is set to $(x_0,y_0) =(-1,0)$.
}
\label{fig:p4_orbit_control}
\end{figure}
To show that the control law is not limited to unstable periodic orbits, we show the control performance of an arbitrary control task, to control the system between $x=-1.5$, and $x=1.5$. Both of these points are outside of the trapping region, meaning that large control perturbations are required to keep the system from diverging to infinity. The result can be seen in Fig. \ref{fig:arbitrary_control}. As with the other control tasks, the $K=0$ trajectory reaches the desired value in one iteration with a relative error equal to $2.88 \times 10^{-5}$, and the $K=0.9$ trajectory reaches the desired value with a relative error $<1\%$ after iteration 44. Thus, we conclude that the NG-RC-based controller can control the system to an arbitrary desired state, which is not possible for many controllers.
\begin{figure}[!ht]
\centering
%
\subfloat{%
\includegraphics[scale=0.34]{Fig6.eps}
}
\caption{Controlling H\'{e}non Map dynamics between two arbitrary values $x=-1.5$ and $x=1.5$. The first desired value is $x_{des} = -1.5$. (top) $x$, (middle) $y$ and (bottom) $u$ as function of iterations for different values of $K$ (color code). Horizontal dashed lines on (top) indicate the $x_{des}$ values. The initial condition is set to $(x_0,y_0) =(0,0)$.
}
\label{fig:arbitrary_control}
\end{figure}
\subsection{Control in the Presence of Noise and Modeling Error}
To show that the NG-RC-based controller is robust to unexpected perturbations, we inject noise into the H\'{e}non map during control. The noise is injected in both $x$ and $y$ variables using $d_{x}$ and $d_{y}$ as shown in Eqs. \ref{eq:henon map xip1}-\ref{eq:henon map yip1}. The noise is sampled from a normal distribution with 0 mean. We vary the noise strength in the same way as in Sec. \ref{sec: Prediction Robustness to Noise}.
To determine the effectiveness of the NG-RC-based controller subject to noise, we repeat the task of controlling the system between the two unstable fixed points $P_{U1} \rightarrow P_{U2}$, but we choose to focus on the stability of the system after it has reached $P_{U2}$, and compare the error to the noise level. To do this, we sweep $K$ and calculate the RMSE between iterations 50 and 150 for each, and average over 100 trials. As shown in Fig. \ref{fig:sweep_K_and_noise_rmse}, the RMSE rapidly increases when $|K|$ approaches 1, indicating that the controller is unstable for $|K|>1$ for all noise levels in agreement with Sarangapani's stability analysis.\cite{Sarangapani2006}
Note that the RMSE approaches the noise level when $K \rightarrow 0$, which is what we expect from Eq. \ref{eq:error2} in the case of perfect learning as the tracking error becomes the noise. Although the modeling error of the NG-RC is very small for learning the H\'{e}non map, this might not be true for every system.
To explore this possibility, we include modeling error to our controller and perform the same $P_{U1}\rightarrow P_{U2}$ control task as in Fig. \ref{fig:sweep_K_and_noise_rmse}. The modeling error is added to the NG-RC by perturbing the learned weights after the training phase with the additive term ${\bf{\delta W}}$ so that ${\bf{\hat W}} \rightarrow {\bf{\hat W}} + {\bf{\delta W}}$. This perturbation is equivalent to the additive modeling error $\epsilon$ shown in Eq. \ref{eq:MLoutputFxWu}. Note that ${\bf{\delta W}}$ has as many components as ${\bf{\hat W}}$, each of which is randomly sampled from a 0 mean normal distribution with standard deviation $\sigma_{\bf{\delta W}}$ and held constant during the control phase. Here, we choose $\sigma_{\bf{\delta W}} = \sigma_{d}$, \textit{i.e.,} both the noise and the modeling perturbation have the same strength. As shown in Fig. \ref{fig:sweep_K_and_noise_and_modeling_rmse}, which is obtained using the same procedures used to obtain Fig. \ref{fig:sweep_K_and_noise_rmse}, the controller displays robustness to both noise and modeling error similar to when only noise is present (Fig. \ref{fig:sweep_K_and_noise_rmse}). Here, the RMSE dependence on $K$ is less smooth than in the previous case. One possible reason is that the control law is strongly based on the learned weights, which implies that the controller noise sensitivity increases with the modeling error. Also, the minimum RMSE for this case increase by a factor of $1.6$ in comparison to the case where only noise is applied, which is expected because the controller has two sources of noise. Moreover, the range of $K$ where the control is stable is preserved. These results indicate that the NG-RC-based controller is robust to random disturbances.
\begin{figure}[!ht]
\centering
%
\subfloat{%
\includegraphics[scale=0.5]{Fig7.eps}
}
\caption{Mean RMSE between $x$ and $x_{des}$ for the control task $P_{U1}\rightarrow P_{U2}$ as function of $K$ for different noise levels (color code).
}
\label{fig:sweep_K_and_noise_rmse}
\end{figure}
\begin{figure}[!ht]
\centering
%
\subfloat{%
\includegraphics[scale=0.5]{Fig8.eps}
}
\caption{Mean RMSE between $x$ and $x_{des}$ for the control task $P_{U1}\rightarrow P_{U2}$ as function of $K$, for varying noise with $\sigma_{d}=\sigma_{\delta \bf{W}}$. The minimum RMSE values from top to bottom are $1.93 \times 10^{-1}$, $1.60 \times 10^{-2}$, $1.60 \times 10^{-3}$, $1.68 \times 10^{-4}$, and $1.60 \times 10^{-5}$.}
\label{fig:sweep_K_and_noise_and_modeling_rmse}
\end{figure}
\section{\label {sec:Discussions}Discussions}
In this work, we demonstrate the effectiveness of the NG-RC for controlling the H\'{e}non map when using it in the formalism developed by Sarangapani.\cite{Sarangapani2006} Our results demonstrate several key advantages when compared to other ML-based control methods.
We highlight that the NG-RC-based controller requires significantly fewer training points when compared to other ML approaches. The NG-RC is able to learn the dynamics of the H\'{e}non map with as few as 10 data points even with injected noise, while other previously reported methods require 100$\times$ more training data to perform similar control tasks.\cite{Gokce2013,Garcia2022} Additionally, the RMSE during prediction is approximately equal to the noise level, which, for the $\sigma_{d} = 10^{-5}$ case, is 1,000$\times$ smaller than the RMSE seen in other studies without noise.\cite{Leite2021}
We demonstrate that the NG-RC-based controller excels at three challenging control tasks. High gain allows the system to reach the desired state in a single iteration, while low gain allows for a tunable rate of convergence. This is in contrast to other methods that require over ten iterations to stabilize to the desired state for similar tasks.\cite{Senkerik2011,Leite2021} Matousek\cite{Matousek2021} shows similar convergence times for the 4-period orbit task using a technique known as genetic programming, but their best solution uses delayed points and polynomials in the feature vector up to 6$^{th}$ order, which we do not require.
We demonstrate that the NG-RC-based controller is robust to noise and modeling errors, showing that it can control the system to a desired state with an error close to the noise level. Real-world systems are often subject to unpredictable disturbances, and our model showcased its ability to handle such challenges. These qualities are necessary for reliability and performance in practical applications.
An important aspect of our approach is computational efficiency. Our model requires only 7 weights to successfully control the H'{e}non map, allowing the control law to be computed at a low computational cost. Furthermore, optimizing the control is an analytical procedure that uses ridge regression (see Appendix \ref{app:OptimizingAlpha}). In contrast, other control methods, such as evolutionary algorithms, require iterative optimization to determine the weights, which can be computationally expensive. Some models require an expensive optimization before each control action, as in model predictive control. The NG-RC has the same predictive power but is paired with a much simpler approach. This indicates that the NG-RC is suitable for hardware implementation and edge computing, where real-time control is often required.
The NG-RC has very few hyperparameters to optimize compared to other ML methods, and appropriate parameter values can often be obtained based on physical insights. We demonstrate this by incorporating the dynamics of the H\'{e}non map into the design of the polynomial features to achieve an optimal control law.
Previous studies have also employed other physical principles, such as symmetry considerations, to achieve optimal predictions.\cite{Barbosa2021} Thus, information about the underlying dynamics of the target system has the potential to accelerate nonlinear controller design using NG-RC.
While our work shows the NG-RC-based controller can stabilize discrete-time maps, future work will explore the application of our controller to discretely-sampled continuous systems. The NG-RC has already been proven to excel at forecasting such systems, \cite{NGRC,NGRC-L96} and Sarangapani's work is designed specifically for such systems. Furthermore, we seek to test the performance of the NG-RC-based controller on real-world systems by implementing the controller in hardware, where we can take advantage of the simplicity of the control law and the parallelizability of the polynomial features to control systems on short timescales. Additionally, it has been shown that Tikhonov regularization can be performed iteratively,\cite{Hertz1991} allowing for the possibility of an NG-RC-based controller that can continuously adapt to changing conditions, which reflects realistic control situations.
In conclusion, the NG-RC-based controller is a powerful ML approach for controlling dynamical systems. The model can learn the physics of a system with small training dataset sizes and is robust to noise and modeling error.
\section*{Acknowledgement}
We gratefully acknowledge the financial support of the U.S. Air Force Office of Scientific Research, Contracts \#FA9550-20-1-0177 and \#FA9550-22-1-0203.
\section*{Data Availability Statement}
The data that support the findings of this study are available from the corresponding author upon reasonable request.
\appendix
\section{\label{app:OptimizingAlpha}Optimizing the NG-RC for Prediction}
To optimize $\hat{{\bf{W}}}$, we use Tikhonov regularization to minimize $||\hat{{\bf{Y}}}- {\bf{Y}}||^2 + \alpha||{\bf{W}}||^2$ over all training $M_{train}$ points. Here, $\alpha$ is the regularization parameter, also known as Ridge parameter, used to prevent over-fitting. Once the optimal $\hat{{\bf{W}}}$ is obtained in training phase, prediction is made using Eq. \ref{eq:MLoutput} for a given initial state.
\begin{thebibliography}{38}%
\makeatletter
\providecommand \@ifxundefined [1]{%
\@ifx{#1\undefined}
}%
\providecommand \@ifnum [1]{%
\ifnum #1\expandafter \@firstoftwo
\else \expandafter \@secondoftwo
\fi
}%
\providecommand \@ifx [1]{%
\ifx #1\expandafter \@firstoftwo
\else \expandafter \@secondoftwo
\fi
}%
\providecommand \natexlab [1]{#1}%
\providecommand \enquote [1]{``#1''}%
\providecommand \bibnamefont [1]{#1}%
\providecommand \bibfnamefont [1]{#1}%
\providecommand \citenamefont [1]{#1}%
\providecommand \href@noop [0]{\@secondoftwo}%
\providecommand \href [0]{\begingroup \@sanitize@url \@href}%
\providecommand \@href[1]{\@@startlink{#1}\@@href}%
\providecommand \@@href[1]{\endgroup#1\@@endlink}%
\providecommand \@sanitize@url [0]{\catcode `\\12\catcode `\$12\catcode
`\&12\catcode `\#12\catcode `\^12\catcode `\_12\catcode `\%12\relax}%
\providecommand \@@startlink[1]{}%
\providecommand \@@endlink[0]{}%
\providecommand \url [0]{\begingroup\@sanitize@url \@url }%
\providecommand \@url [1]{\endgroup\@href {#1}{\urlprefix }}%
\providecommand \urlprefix [0]{URL }%
\providecommand \Eprint [0]{\href }%
\providecommand \doibase [0]{https://doi.org/}%
\providecommand \selectlanguage [0]{\@gobble}%
\providecommand \bibinfo [0]{\@secondoftwo}%
\providecommand \bibfield [0]{\@secondoftwo}%
\providecommand \translation [1]{[#1]}%
\providecommand \BibitemOpen [0]{}%
\providecommand \bibitemStop [0]{}%
\providecommand \bibitemNoStop [0]{.\EOS\space}%
\providecommand \EOS [0]{\spacefactor3000\relax}%
\providecommand \BibitemShut [1]{\csname bibitem#1\endcsname}%
\let\auto@bib@innerbib\@empty
%</preamble>
\bibitem [{\citenamefont {Slotine}\ and\ \citenamefont
{Li}(1991)}]{Slotine1991}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {J.}~\bibnamefont
{Slotine}}\ and\ \bibinfo {author} {\bibfnamefont {W.}~\bibnamefont {Li}},\
}\href {https://books.google.com/books?id=HddxQgAACAAJ} {\emph {\bibinfo
{title} {Applied Nonlinear Control}}}\ (\bibinfo {publisher}
{Prentice-Hall},\ \bibinfo {year} {1991})\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Ott}, \citenamefont {Grebogi},\ and\ \citenamefont
{Yorke}(1990)}]{Ott_Grebogi_Yorke1990}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {E.}~\bibnamefont
{Ott}}, \bibinfo {author} {\bibfnamefont {C.}~\bibnamefont {Grebogi}},\ and\
\bibinfo {author} {\bibfnamefont {J.~A.}\ \bibnamefont {Yorke}},\ }\bibfield
{title} {\enquote {\bibinfo {title} {Controlling chaos},}\ }\href
{https://doi.org/10.1103/PhysRevLett.64.1196} {\bibfield {journal} {\bibinfo
{journal} {Phys. Rev. Lett.}\ }\textbf {\bibinfo {volume} {64}},\ \bibinfo
{pages} {1196--1199} (\bibinfo {year} {1990})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Ogata}(2010)}]{Ogata}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {K.}~\bibnamefont
{Ogata}},\ }\href@noop {} {\emph {\bibinfo {title} {Modern Control
Engineering}}}\ (\bibinfo {publisher} {Prentice Hall},\ \bibinfo {year}
{2010})\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Gauthier}(2003)}]{Gauthier2003}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {D.~J.}\ \bibnamefont
{Gauthier}},\ }\bibfield {title} {\enquote {\bibinfo {title} {{Resource
Letter: CC-1: Controlling chaos}},}\ }\href
{https://doi.org/10.1119/1.1572488} {\bibfield {journal} {\bibinfo
{journal} {Amer. J. Phys.}\ }\textbf {\bibinfo {volume} {71}},\ \bibinfo
{pages} {750--759} (\bibinfo {year} {2003})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Camacho}\ and\ \citenamefont
{Alba}(2013)}]{Camacho2013}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {E.~F.}\ \bibnamefont
{Camacho}}\ and\ \bibinfo {author} {\bibfnamefont {C.~B.}\ \bibnamefont
{Alba}},\ }\href@noop {} {\emph {\bibinfo {title} {Model predictive
control}}}\ (\bibinfo {publisher} {Springer science \& business media},\
\bibinfo {year} {2013})\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Wu}, \citenamefont {Rincon},\ and\ \citenamefont
{Christofides}(2020)}]{Wu2020}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {Z.}~\bibnamefont
{Wu}}, \bibinfo {author} {\bibfnamefont {D.}~\bibnamefont {Rincon}},\ and\
\bibinfo {author} {\bibfnamefont {P.~D.}\ \bibnamefont {Christofides}},\
}\bibfield {title} {\enquote {\bibinfo {title} {Process structure-based
recurrent neural network modeling for model predictive control of nonlinear
processes},}\ }\href
{https://doi.org/https://doi.org/10.1016/j.jprocont.2020.03.013} {\bibfield
{journal} {\bibinfo {journal} {Journal of Process Control}\ }\textbf
{\bibinfo {volume} {89}},\ \bibinfo {pages} {74--84} (\bibinfo {year}
{2020})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Zong}\ and\ \citenamefont {Geng}(2009)}]{Zong2009}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {X.-P.}\ \bibnamefont
{Zong}}\ and\ \bibinfo {author} {\bibfnamefont {J.}~\bibnamefont {Geng}},\
}\bibfield {title} {\enquote {\bibinfo {title} {Control chaotic systems
based on bp neural network with a new perturbation},}\ }in\ \href
{https://doi.org/10.1109/ICWAPR.2009.5207408} {\emph {\bibinfo {booktitle}
{2009 International Conference on Wavelet Analysis and Pattern
Recognition}}}\ (\bibinfo {year} {2009})\ pp.\ \bibinfo {pages}
{166--170}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Gokce}\ and\ \citenamefont
{Uyaroğlu}(2013)}]{Gokce2013}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {K.}~\bibnamefont
{Gokce}}\ and\ \bibinfo {author} {\bibfnamefont {Y.}~\bibnamefont
{Uyaroğlu}},\ }\bibfield {title} {\enquote {\bibinfo {title} {Controlling
the chaotic discrete-henon system using a feedforward neural network with an
adaptive learning rate},}\ }\href {https://doi.org/10.3906/elk-1109-58}
{\bibfield {journal} {\bibinfo {journal} {Turkish Journal of Electrical
Engineering and Computer Sciences}\ }\textbf {\bibinfo {volume} {21}},\
\bibinfo {pages} {793--803} (\bibinfo {year} {2013})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Matousek}\ and\ \citenamefont
{Hulka}(2019)}]{Matousek2019}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {R.}~\bibnamefont
{Matousek}}\ and\ \bibinfo {author} {\bibfnamefont {T.}~\bibnamefont
{Hulka}},\ }\bibfield {title} {\enquote {\bibinfo {title} {Stabilization of
higher periodic orbits of the chaotic logistic and hénon maps using
meta-evolutionary approaches},}\ }in\ \href
{https://doi.org/10.1109/CEC.2019.8790075} {\emph {\bibinfo {booktitle} {2019
IEEE Congress on Evolutionary Computation (CEC)}}}\ (\bibinfo {year} {2019})\
pp.\ \bibinfo {pages} {1758--1765}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Matousek}, \citenamefont {Lozi},\ and\ \citenamefont
{Hulka}(2021)}]{Matousek2021}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {R.}~\bibnamefont
{Matousek}}, \bibinfo {author} {\bibfnamefont {R.~P.}\ \bibnamefont {Lozi}},\
and\ \bibinfo {author} {\bibfnamefont {T.}~\bibnamefont {Hulka}},\ }\bibfield
{title} {\enquote {\bibinfo {title} {Stabilization of higher periodic orbits
of the lozi and hénon maps using meta-evolutionary approaches},}\ }in\ \href
{https://doi.org/10.1109/CEC45853.2021.9504798} {\emph {\bibinfo {booktitle}
{2021 IEEE Congress on Evolutionary Computation (CEC)}}}\ (\bibinfo {year}
{2021})\ pp.\ \bibinfo {pages} {572--579}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Senkerik}, \citenamefont {Oplatkova},\ and\
\citenamefont {Zelinka}(2011)}]{Senkerik2011}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {R.}~\bibnamefont
{Senkerik}}, \bibinfo {author} {\bibfnamefont {Z.}~\bibnamefont
{Oplatkova}},\ and\ \bibinfo {author} {\bibfnamefont {I.}~\bibnamefont
{Zelinka}},\ }\bibfield {title} {\enquote {\bibinfo {title} {{Investigation
on Evolutionary Chaos Controller Synthesis for Hénon Map Stabilization}},}\
}\href {https://doi.org/10.1063/1.3637785} {\bibfield {journal} {\bibinfo
{journal} {AIP Conference Proceedings}\ }\textbf {\bibinfo {volume} {1389}},\
\bibinfo {pages} {1027--1030} (\bibinfo {year} {2011})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Zelinka}, \citenamefont {Senkerik},\ and\
\citenamefont {Navratil}(2009)}]{Zelinka2009}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {I.}~\bibnamefont
{Zelinka}}, \bibinfo {author} {\bibfnamefont {R.}~\bibnamefont {Senkerik}},\
and\ \bibinfo {author} {\bibfnamefont {E.}~\bibnamefont {Navratil}},\
}\bibfield {title} {\enquote {\bibinfo {title} {Investigation on
evolutionary optimization of chaos control},}\ }\href
{https://doi.org/https://doi.org/10.1016/j.chaos.2007.07.045} {\bibfield
{journal} {\bibinfo {journal} {Chaos Solitons Fractals}\ }\textbf {\bibinfo
{volume} {40}},\ \bibinfo {pages} {111--129} (\bibinfo {year}
{2009})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Matousek}\ \emph {et~al.}(2014)\citenamefont
{Matousek}, \citenamefont {Dobrovsky}, \citenamefont {Minar},\ and\
\citenamefont {Mouralova}}]{Matousek2014}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {R.}~\bibnamefont
{Matousek}}, \bibinfo {author} {\bibfnamefont {L.}~\bibnamefont {Dobrovsky}},
\bibinfo {author} {\bibfnamefont {P.}~\bibnamefont {Minar}},\ and\ \bibinfo
{author} {\bibfnamefont {K.}~\bibnamefont {Mouralova}},\ }\bibfield {title}
{\enquote {\bibinfo {title} {A note about robust stabilization of chaotic
h{\'e}non system using grammatical evolution},}\ }in\ \href@noop {} {\emph
{\bibinfo {booktitle} {Nostradamus 2014: Prediction, Modeling and Analysis of
Complex Systems}}},\ \bibinfo {editor} {edited by\ \bibinfo {editor}
{\bibfnamefont {I.}~\bibnamefont {Zelinka}}, \bibinfo {editor} {\bibfnamefont
{P.~N.}\ \bibnamefont {Suganthan}}, \bibinfo {editor} {\bibfnamefont
{G.}~\bibnamefont {Chen}}, \bibinfo {editor} {\bibfnamefont {V.}~\bibnamefont
{Snasel}}, \bibinfo {editor} {\bibfnamefont {A.}~\bibnamefont {Abraham}},\
and\ \bibinfo {editor} {\bibfnamefont {O.}~\bibnamefont {R{\"o}ssler}}}\
(\bibinfo {publisher} {Springer International Publishing},\ \bibinfo
{address} {Cham},\ \bibinfo {year} {2014})\ pp.\ \bibinfo {pages}
{219--228}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Jaeger}\ and\ \citenamefont
{Haas}(2004)}]{Jaeger_Haas2004}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {H.}~\bibnamefont
{Jaeger}}\ and\ \bibinfo {author} {\bibfnamefont {H.}~\bibnamefont {Haas}},\
}\bibfield {title} {\enquote {\bibinfo {title} {Harnessing nonlinearity:
Predicting chaotic systems and saving energy in wireless communication},}\
}\href {https://doi.org/10.1126/science.1091277} {\bibfield {journal}
{\bibinfo {journal} {Science}\ }\textbf {\bibinfo {volume} {304}},\ \bibinfo
{pages} {78--80} (\bibinfo {year} {2004})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Maass}, \citenamefont {Natschläger},\ and\
\citenamefont {Markram}(2002)}]{Maass2002}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {W.}~\bibnamefont
{Maass}}, \bibinfo {author} {\bibfnamefont {T.}~\bibnamefont
{Natschläger}},\ and\ \bibinfo {author} {\bibfnamefont {H.}~\bibnamefont
{Markram}},\ }\bibfield {title} {\enquote {\bibinfo {title} {Real-time
computing without stable states: A new framework for neural computation based
on perturbations},}\ }\href {https://doi.org/10.1162/089976602760407955}
{\bibfield {journal} {\bibinfo {journal} {Neural Computation}\ }\textbf
{\bibinfo {volume} {14}},\ \bibinfo {pages} {2531--2560} (\bibinfo {year}
{2002})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Waegeman}, \citenamefont {wyffels},\ and\
\citenamefont {Schrauwen}(2012)}]{Waegeman2012}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {T.}~\bibnamefont
{Waegeman}}, \bibinfo {author} {\bibfnamefont {F.}~\bibnamefont {wyffels}},\
and\ \bibinfo {author} {\bibfnamefont {B.}~\bibnamefont {Schrauwen}},\
}\bibfield {title} {\enquote {\bibinfo {title} {Feedback control by online
learning an inverse model},}\ }\href
{https://doi.org/10.1109/TNNLS.2012.2208655} {\bibfield {journal} {\bibinfo
{journal} {IEEE Trans. Neural Netw. Learn. Syst.}\ }\textbf {\bibinfo
{volume} {23}},\ \bibinfo {pages} {1637--1648} (\bibinfo {year}
{2012})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Waegeman}, \citenamefont {Hermans},\ and\
\citenamefont {Schrauwen}(2013)}]{Waegeman2013}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {T.}~\bibnamefont
{Waegeman}}, \bibinfo {author} {\bibfnamefont {M.}~\bibnamefont {Hermans}},\
and\ \bibinfo {author} {\bibfnamefont {B.}~\bibnamefont {Schrauwen}},\
}\bibfield {title} {\enquote {\bibinfo {title} {{MACOP} modular architecture
with control primitives},}\ }\href {https://doi.org/10.3389/fncom.2013.00099}
{\bibfield {journal} {\bibinfo {journal} {Frontiers in Computational
Neuroscience}\ }\textbf {\bibinfo {volume} {7}} (\bibinfo {year}
{2013})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Canaday}, \citenamefont {Pomerance},\ and\
\citenamefont {Gauthier}(2021)}]{Canaday2021}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {D.}~\bibnamefont
{Canaday}}, \bibinfo {author} {\bibfnamefont {A.}~\bibnamefont {Pomerance}},\
and\ \bibinfo {author} {\bibfnamefont {D.~J.}\ \bibnamefont {Gauthier}},\
}\bibfield {title} {\enquote {\bibinfo {title} {Model-free control of
dynamical systems with deep reservoir computing},}\ }\href
{https://doi.org/10.1088/2632-072X/ac24f3} {\bibfield {journal} {\bibinfo
{journal} {Journal of Physics: Complexity}\ }\textbf {\bibinfo {volume}
{2}},\ \bibinfo {pages} {035025} (\bibinfo {year} {2021})}\BibitemShut
{NoStop}%
\bibitem [{\citenamefont {Haluszczynski}\ and\ \citenamefont
{R{\"a}th}(2021)}]{Haluszczynski2021}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {A.}~\bibnamefont
{Haluszczynski}}\ and\ \bibinfo {author} {\bibfnamefont {C.}~\bibnamefont
{R{\"a}th}},\ }\bibfield {title} {\enquote {\bibinfo {title} {Controlling
nonlinear dynamical systems into arbitrary states using machine learning},}\
}\href {https://doi.org/10.1038/s41598-021-92244-6} {\bibfield {journal}
{\bibinfo {journal} {Scientific Reports}\ }\textbf {\bibinfo {volume}
{11}},\ \bibinfo {pages} {12991} (\bibinfo {year} {2021})}\BibitemShut
{NoStop}%
\bibitem [{\citenamefont {Duan}\ \emph {et~al.}(2023)\citenamefont {Duan},
\citenamefont {Ying}, \citenamefont {Leng}, \citenamefont {Kurths},
\citenamefont {Lin},\ and\ \citenamefont {Ma}}]{KurthsDelayRC2023}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {X.-Y.}\ \bibnamefont
{Duan}}, \bibinfo {author} {\bibfnamefont {X.}~\bibnamefont {Ying}}, \bibinfo
{author} {\bibfnamefont {S.-Y.}\ \bibnamefont {Leng}}, \bibinfo {author}
{\bibfnamefont {J.}~\bibnamefont {Kurths}}, \bibinfo {author} {\bibfnamefont
{W.}~\bibnamefont {Lin}},\ and\ \bibinfo {author} {\bibfnamefont {H.-F.}\
\bibnamefont {Ma}},\ }\bibfield {title} {\enquote {\bibinfo {title}
{Embedding theory of reservoir computing and reducing reservoir network using
time delays},}\ }\href {https://doi.org/10.1103/PhysRevResearch.5.L022041}
{\bibfield {journal} {\bibinfo {journal} {Phys. Rev. Res.}\ }\textbf
{\bibinfo {volume} {5}},\ \bibinfo {pages} {L022041} (\bibinfo {year}
{2023})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Gauthier}\ \emph {et~al.}(2021)\citenamefont
{Gauthier}, \citenamefont {Bollt}, \citenamefont {Griffith},\ and\
\citenamefont {Barbosa}}]{NGRC}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {D.~J.}\ \bibnamefont
{Gauthier}}, \bibinfo {author} {\bibfnamefont {E.}~\bibnamefont {Bollt}},
\bibinfo {author} {\bibfnamefont {A.}~\bibnamefont {Griffith}},\ and\
\bibinfo {author} {\bibfnamefont {W.~A.~S.}\ \bibnamefont {Barbosa}},\
}\bibfield {title} {\enquote {\bibinfo {title} {Next generation reservoir
computing},}\ }\href {https://doi.org/10.1038/s41467-021-25801-2} {\bibfield
{journal} {\bibinfo {journal} {Nat. Commun.}\ }\textbf {\bibinfo {volume}
{12}},\ \bibinfo {pages} {5564} (\bibinfo {year} {2021})}\BibitemShut
{NoStop}%
\bibitem [{\citenamefont {Barbosa}\ and\ \citenamefont
{Gauthier}(2022)}]{NGRC-L96}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {W.~A.~S.}\
\bibnamefont {Barbosa}}\ and\ \bibinfo {author} {\bibfnamefont {D.~J.}\
\bibnamefont {Gauthier}},\ }\bibfield {title} {\enquote {\bibinfo {title}
{{Learning spatiotemporal chaos using next-generation reservoir
computing}},}\ }\href {https://doi.org/10.1063/5.0098707} {\bibfield
{journal} {\bibinfo {journal} {Chaos}\ }\textbf {\bibinfo {volume} {32}},\
\bibinfo {pages} {093137} (\bibinfo {year} {2022})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Sarangapani}(2006)}]{Sarangapani2006}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {J.}~\bibnamefont
{Sarangapani}},\ }\href@noop {} {\emph {\bibinfo {title} {Neural network
control of nonlinear discrete-time systems}}}\ (\bibinfo {publisher} {CRC
Press, Taylor \& Francis},\ \bibinfo {address} {Boca Raton},\ \bibinfo {year}
{2006})\BibitemShut {NoStop}%
\bibitem [{\citenamefont {H{\'e}non}(1976)}]{Henon1976}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {M.}~\bibnamefont
{H{\'e}non}},\ }\bibfield {title} {\enquote {\bibinfo {title} {A
two-dimensional mapping with a strange attractor},}\ }\href
{https://doi.org/10.1007/BF01608556} {\bibfield {journal} {\bibinfo
{journal} {Comm. Math. Phys.}\ }\textbf {\bibinfo {volume} {50}},\ \bibinfo
{pages} {69--77} (\bibinfo {year} {1976})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Boyd}\ and\ \citenamefont {Chua}(1985)}]{Boyd1985}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {S.}~\bibnamefont
{Boyd}}\ and\ \bibinfo {author} {\bibfnamefont {L.}~\bibnamefont {Chua}},\
}\bibfield {title} {\enquote {\bibinfo {title} {Fading memory and the
problem of approximating nonlinear operators with volterra series},}\ }\href
{https://doi.org/10.1109/TCS.1985.1085649} {\bibfield {journal} {\bibinfo
{journal} {IEEE Transactions on Circuits and Systems}\ }\textbf {\bibinfo
{volume} {32}},\ \bibinfo {pages} {1150--1161} (\bibinfo {year}
{1985})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Gonon}, \citenamefont {Grigoryeva},\ and\
\citenamefont {Ortega}(2022)}]{Gonon2022}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {L.}~\bibnamefont
{Gonon}}, \bibinfo {author} {\bibfnamefont {L.}~\bibnamefont {Grigoryeva}},\
and\ \bibinfo {author} {\bibfnamefont {J.-P.}\ \bibnamefont {Ortega}},\
}\bibfield {title} {\enquote {\bibinfo {title} {Reservoir kernels and
{V}olterra series},}\ }\href {https://arxiv.org/abs/2212.14641} {\bibfield
{journal} {\bibinfo {journal} {arXiv:2212.14641}\ } (\bibinfo {year}
{2022})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Lorenz}(1963)}]{Lorenz1963}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {E.~N.}\ \bibnamefont
{Lorenz}},\ }\bibfield {title} {\enquote {\bibinfo {title} {Deterministic
nonperiodic flow},}\ }\href
{https://doi.org/https://doi.org/10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2}
{\bibfield {journal} {\bibinfo {journal} {J. Atmos. Sci.}\ }\textbf
{\bibinfo {volume} {20}},\ \bibinfo {pages} {130 -- 141} (\bibinfo {year}
{1963})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Tutueva}\ \emph {et~al.}(2022)\citenamefont
{Tutueva}, \citenamefont {Moysis}, \citenamefont {Rybin}, \citenamefont
{Kopets}, \citenamefont {Volos},\ and\ \citenamefont
{Butusov}}]{Tutueva2022}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {A.~V.}\ \bibnamefont
{Tutueva}}, \bibinfo {author} {\bibfnamefont {L.}~\bibnamefont {Moysis}},
\bibinfo {author} {\bibfnamefont {V.~G.}\ \bibnamefont {Rybin}}, \bibinfo
{author} {\bibfnamefont {E.~E.}\ \bibnamefont {Kopets}}, \bibinfo {author}
{\bibfnamefont {C.}~\bibnamefont {Volos}},\ and\ \bibinfo {author}
{\bibfnamefont {D.~N.}\ \bibnamefont {Butusov}},\ }\bibfield {title}
{\enquote {\bibinfo {title} {Fast synchronization of symmetric hénon maps
using adaptive symmetry control},}\ }\href
{https://doi.org/https://doi.org/10.1016/j.chaos.2021.111732} {\bibfield
{journal} {\bibinfo {journal} {Chaos Solitons Fractals}\ }\textbf {\bibinfo
{volume} {155}},\ \bibinfo {pages} {111732} (\bibinfo {year}
{2022})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Han}\ \emph {et~al.}(2021)\citenamefont {Han},
\citenamefont {Ding}, \citenamefont {Du},\ and\ \citenamefont
{Lei}}]{Han2021}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {Y.}~\bibnamefont
{Han}}, \bibinfo {author} {\bibfnamefont {J.}~\bibnamefont {Ding}}, \bibinfo
{author} {\bibfnamefont {L.}~\bibnamefont {Du}},\ and\ \bibinfo {author}
{\bibfnamefont {Y.}~\bibnamefont {Lei}},\ }\bibfield {title} {\enquote
{\bibinfo {title} {Control and anti-control of chaos based on the moving
largest lyapunov exponent using reinforcement learning},}\ }\href
{https://doi.org/https://doi.org/10.1016/j.physd.2021.133068} {\bibfield
{journal} {\bibinfo {journal} {Physica D}\ }\textbf {\bibinfo {volume}
{428}},\ \bibinfo {pages} {133068} (\bibinfo {year} {2021})}\BibitemShut
{NoStop}%
\bibitem [{\citenamefont {Soleymani}, \citenamefont {Nordin},\ and\
\citenamefont {Sundararajan}(2014)}]{Soleymani2014}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {A.}~\bibnamefont
{Soleymani}}, \bibinfo {author} {\bibfnamefont {M.~J.}\ \bibnamefont
{Nordin}},\ and\ \bibinfo {author} {\bibfnamefont {E.}~\bibnamefont
{Sundararajan}},\ }\bibfield {title} {\enquote {\bibinfo {title} {A chaotic
cryptosystem for images based on henon and arnold cat map},}\ }\href
{https://doi.org/10.1155/2014/536930} {\bibfield {journal} {\bibinfo
{journal} {The Scientific World Journal}\ }\textbf {\bibinfo {volume}
{2014}},\ \bibinfo {pages} {536930} (\bibinfo {year} {2014})}\BibitemShut
{NoStop}%
\bibitem [{\citenamefont {Khan}, \citenamefont {Ahmad},\ and\ \citenamefont
{Hwang}(2015)}]{Khan2015}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {J.}~\bibnamefont
{Khan}}, \bibinfo {author} {\bibfnamefont {J.}~\bibnamefont {Ahmad}},\ and\
\bibinfo {author} {\bibfnamefont {S.~O.}\ \bibnamefont {Hwang}},\ }\bibfield
{title} {\enquote {\bibinfo {title} {An efficient image encryption scheme
based on: Henon map, skew tent map and s-box},}\ }in\ \href
{https://doi.org/10.1109/ICMSAO.2015.7152261} {\emph {\bibinfo {booktitle}
{2015 6th International Conference on Modeling, Simulation, and Applied
Optimization (ICMSAO)}}}\ (\bibinfo {year} {2015})\ pp.\ \bibinfo {pages}
{1--6}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Vajargah}\ and\ \citenamefont
{Asghari}(2015)}]{Vajargah2015}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {B.~F.}\ \bibnamefont
{Vajargah}}\ and\ \bibinfo {author} {\bibfnamefont {R.}~\bibnamefont
{Asghari}},\ }\bibfield {title} {\enquote {\bibinfo {title} {A pseudo random
number generator based on chaotic henon map (chcg)},}\ }\href@noop {}
{\bibfield {journal} {\bibinfo {journal} {International Journal of
Mechatronics, Electrical and Computer Technology (IJMEC)}\ }\textbf {\bibinfo
{volume} {5}},\ \bibinfo {pages} {2120--2129} (\bibinfo {year}
{2015})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Belkhouja}\ \emph {et~al.}(2018)\citenamefont
{Belkhouja}, \citenamefont {Du}, \citenamefont {Mohamed}, \citenamefont
{Al-Ali},\ and\ \citenamefont {Guizani}}]{Belkhouja2018}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {T.}~\bibnamefont
{Belkhouja}}, \bibinfo {author} {\bibfnamefont {X.}~\bibnamefont {Du}},
\bibinfo {author} {\bibfnamefont {A.}~\bibnamefont {Mohamed}}, \bibinfo
{author} {\bibfnamefont {A.~K.}\ \bibnamefont {Al-Ali}},\ and\ \bibinfo
{author} {\bibfnamefont {M.}~\bibnamefont {Guizani}},\ }\bibfield {title}
{\enquote {\bibinfo {title} {Symmetric encryption relying on chaotic henon
system for secure hardware-friendly wireless communication of implantable
medical systems},}\ }\href {https://www.mdpi.com/2224-2708/7/2/21} {\bibfield
{journal} {\bibinfo {journal} {Journal of Sensor and Actuator Networks}\
}\textbf {\bibinfo {volume} {7}},\ \bibinfo {pages} {21} (\bibinfo {year}
{2018})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Braverman}\ and\ \citenamefont
{Rodkina}(2022)}]{Braverman2022}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {E.}~\bibnamefont
{Braverman}}\ and\ \bibinfo {author} {\bibfnamefont {A.}~\bibnamefont
{Rodkina}},\ }\bibfield {title} {\enquote {\bibinfo {title} {On
target-oriented control of hénon and lozi maps},}\ }\href
{https://doi.org/10.1080/10236198.2022.2088286} {\bibfield {journal}
{\bibinfo {journal} {Journal of Difference Equations and Applications}\ ,\
\bibinfo {pages} {1--24}} (\bibinfo {year} {2022})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {García}(2022)}]{Garcia2022}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {P.}~\bibnamefont
{García}},\ }\bibfield {title} {\enquote {\bibinfo {title} {A machine
learning based control of chaotic systems},}\ }\href
{https://doi.org/https://doi.org/10.1016/j.chaos.2021.111630} {\bibfield
{journal} {\bibinfo {journal} {Chaos Solitons Fractals}\ }\textbf {\bibinfo
{volume} {155}},\ \bibinfo {pages} {111630} (\bibinfo {year}
{2022})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Leite}\ \emph {et~al.}(2021)\citenamefont {Leite},
\citenamefont {Coutinho}, \citenamefont {Bessa}, \citenamefont {Camargos},
\citenamefont {Junior.},\ and\ \citenamefont {Palhares}}]{Leite2021}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {D.}~\bibnamefont
{Leite}}, \bibinfo {author} {\bibfnamefont {P.}~\bibnamefont {Coutinho}},
\bibinfo {author} {\bibfnamefont {I.}~\bibnamefont {Bessa}}, \bibinfo
{author} {\bibfnamefont {M.}~\bibnamefont {Camargos}}, \bibinfo {author}
{\bibfnamefont {L.~A. Q.~C.}\ \bibnamefont {Junior.}},\ and\ \bibinfo
{author} {\bibfnamefont {R.}~\bibnamefont {Palhares}},\ }\bibfield {title}
{\enquote {\bibinfo {title} {Incremental learning and state-space evolving
fuzzy control of nonlinear time-varying systems with unknown model},}\ }in\
\href {https://doi.org/10.2991/asum.k.210827.011} {\emph {\bibinfo
{booktitle} {Joint Proceedings of the 19th World Congress of the
International Fuzzy Systems Association (IFSA), the 12th Conference of the
European Society for Fuzzy Logic and Technology (EUSFLAT), and the 11th
International Summer School on Aggregation Operators (AGOP)}}}\ (\bibinfo
{publisher} {Atlantis Press},\ \bibinfo {year} {2021})\ pp.\ \bibinfo {pages}
{80--87}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Barbosa}\ \emph {et~al.}(2021)\citenamefont
{Barbosa}, \citenamefont {Griffith}, \citenamefont {Rowlands}, \citenamefont
{Govia}, \citenamefont {Ribeill}, \citenamefont {Nguyen}, \citenamefont
{Ohki},\ and\ \citenamefont {Gauthier}}]{Barbosa2021}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {W.~A.~S.}\
\bibnamefont {Barbosa}}, \bibinfo {author} {\bibfnamefont {A.}~\bibnamefont
{Griffith}}, \bibinfo {author} {\bibfnamefont {G.~E.}\ \bibnamefont
{Rowlands}}, \bibinfo {author} {\bibfnamefont {L.~C.~G.}\ \bibnamefont
{Govia}}, \bibinfo {author} {\bibfnamefont {G.~J.}\ \bibnamefont {Ribeill}},
\bibinfo {author} {\bibfnamefont {M.-H.}\ \bibnamefont {Nguyen}}, \bibinfo
{author} {\bibfnamefont {T.~A.}\ \bibnamefont {Ohki}},\ and\ \bibinfo
{author} {\bibfnamefont {D.~J.}\ \bibnamefont {Gauthier}},\ }\bibfield
{title} {\enquote {\bibinfo {title} {Symmetry-aware reservoir computing},}\
}\href {https://doi.org/10.1103/PhysRevE.104.045307} {\bibfield {journal}
{\bibinfo {journal} {Phys. Rev. E}\ }\textbf {\bibinfo {volume} {104}},\
\bibinfo {pages} {045307} (\bibinfo {year} {2021})}\BibitemShut {NoStop}%
\bibitem [{\citenamefont {Hertz}(1991)}]{Hertz1991}%
\BibitemOpen
\bibfield {author} {\bibinfo {author} {\bibfnamefont {D.}~\bibnamefont
{Hertz}},\ }\bibfield {title} {\enquote {\bibinfo {title} {Sequential ridge
regression},}\ }\href {https://doi.org/10.1109/7.81440} {\bibfield {journal}
{\bibinfo {journal} {IEEE Trans. on Aerospace and Electronic Systems}\
}\textbf {\bibinfo {volume} {27}},\ \bibinfo {pages} {571--574} (\bibinfo
{year} {1991})}\BibitemShut {NoStop}%
\end{thebibliography}%
\end{document}
%