On spectral clustering under non-isotropic Gaussian mixture models
Extracted source text · arXiv 2601.13930
% ===== ここは必ず \documentclass より前 =====
\PassOptionsToPackage{off}{crop}
\documentclass[preprint,ejsv2,noshowframe]{imsart} % ← , , を消した
% ===== fancyhdr：線は消すがページ番号は出す =====
\usepackage{fancyhdr}
\pagestyle{fancy}
\fancyhf{} % いったん全部消す
\fancyfoot[C]{\thepage} % ページ番号だけ中央
\renewcommand{\headrulewidth}{0pt}
\renewcommand{\footrulewidth}{0pt}
% ===== crop（版面マーク）を完全OFF =====
\makeatletter
\AtBeginDocument{%
\@ifundefined{CROP@offtrue}{}{\CROP@offtrue}%
\@ifundefined{CROP@infofalse}{}{\CROP@infofalse}%
}
\makeatother
\usepackage[authoryear,round]{natbib}
\usepackage{graphicx} % Required for inserting images
\usepackage{amsmath,amsthm,bm,xcolor}
\newcommand{\e}{\mathrm{e}}
\providecommand{\arrowvert}{\vert}
\providecommand{\Arrowvert}{\Vert}
\providecommand{\red}[1]{\textcolor{red}{#1}}
\providecommand{\blue}[1]{\textcolor{blue}{#1}}
\providecommand{\white}[1]{\textcolor{white}{#1}}
\providecommand{\green}[1]{\textcolor{green}{#1}}
\providecommand{\purple}[1]{\textcolor{purple}{#1}}
\providecommand{\skakko}[1]{\left(#1\right)}
\providecommand{\mkakko}[1]{\left\{#1\right\}}
\providecommand{\lkakko}[1]{\left[#1\right]}
\numberwithin{equation}{section}
\theoremstyle{plain}
\newtheorem{thm}{Theorem}[section]
\newtheorem{lem}[thm]{Lemma}
\newtheorem{cor}[thm]{Corollary}
\theoremstyle{definition}
\newtheorem{rem}{Remark}
%% Packages
%%\arxiv{2010.00000}
\startlocaldefs
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% %%
%% Uncomment next line to change %%
%% the type of equation numbering %%
%% %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%\numberwithin{equation}{section}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% %%
%% For Axiom, Claim, Corollary, Hypothesis, %%
%% Lemma, Theorem, Proposition %%
%% use \theoremstyle{plain} %%
%% %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% %%
%% For Assumption, Definition, Example, %%
%% Notation, Property, Remark, Fact %%
%% use \theoremstyle{definition} %%
%% %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\theoremstyle{definition}
\newtheorem{definition}[thm]{Definition}
\newtheorem*{example}{Example}
\newtheorem*{fact}{Fact}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% %%
%% For Case use \theoremstyle{remark} %%
%% %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\theoremstyle{remark}
\newtheorem{case}{Case}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% Please put your definitions here: %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\endlocaldefs
\begin{document}
\begin{frontmatter}
\title{On spectral clustering under non-isotropic Gaussian mixture models}
%\title{A sample article title with some additional note\thanksref{t1}}
\runtitle{Spectral clustering}
%\thankstext{T1}{A sample additional note to the title.}
\begin{aug}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% Only one address is permitted per author. %%
%% Only division, organization and e-mail is %%
%% included in the address. %%
%% Additional information can be included in %%
%% the Acknowledgments section if necessary. %%
%% ORCID can be inserted by command: %%
%% \orcid{0000-0000-0000-0000} %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\author[A]{\fnms{Kohei}~\snm{Kawamoto}%
\ead[label=e1]{kawamoto.kohei.532@s.kyushu-u.ac.jp}%
\orcid{0009-0001-9424-0018}}
\author[B]{\fnms{Yuichi}~\snm{Goto}%
\ead[label=e2]{yuichi.goto@math.kyushu-u.ac.jp}%
\orcid{0000-0002-7556-2572}}
\and
\author[B]{\fnms{Koji}~\snm{Tsukuda}%
\ead[label=e3]{tsukuda@math.kyushu-u.ac.jp}%
\orcid{0000-0002-3973-0460}}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% Addresses %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\address[A]{Joint Graduate School of Mathematics for Innovation, Kyushu University,
744 Motooka, Fukuoka, Fukuoka 819-0395, Japan\printead[presep={,\ }]{e1}}
\address[B]{Faculty of Mathematics, Kyushu University,
744 Motooka, Fukuoka, Fukuoka 819-0395, Japan\printead[presep={,\ }]{e2,e3}}
\runauthor{K. Kawamoto et al.}
\end{aug}
\begin{abstract}
We evaluate the misclustering probability of a spectral clustering algorithm under a Gaussian mixture model with a general covariance structure.
The algorithm partitions the data into two groups based on the sign of the first principal component score.
As a corollary of the main result, the clustering procedure is shown to be consistent in a high-dimensional regime.
\end{abstract}
% --- MSC2020 (codes) ---
\begin{keyword}[class=MSC2020]
\kwd{62H30}
\kwd{62H25}
\kwd{62H12}
\end{keyword}
% --- Keywords / phrases ---
\begin{keyword}
\kwd{clustering}
\kwd{high-dimensional regime}
\kwd{misclustering probability}
\end{keyword}
\end{frontmatter}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% Please use \tableofcontents for articles %%
%% with 50 pages and more %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%\tableofcontents
\section{Introduction}
Spectral clustering algorithm is a widely used method that applies a clustering algorithm, such as $k$-means, after dimension reduction via spectral decomposition of a certain matrix, including an adjacency matrix, a graph Laplacian derived from a similarity matrix, or a covariance matrix.
Compared with other clustering approaches, spectral clustering algorithm has the advantage of a lower computational burden.
Unlike iterative methods, spectral clustering algorithm does not require tuning parameters.
Considerable attention has been devoted to spectral clustering algorithm based on
$k$-means for more than two clusters; see, for example,
\cite{lzz21}, \citet[Section~3.1]{afw22}, \cite{zz24}, and references therein.
In contrast, for binary clustering problems, sign-based spectral clustering algorithm methods have also been extensively investigated.
\cite{cz18}, \citet[Section~3.2]{afw22}, and \citet[Section~4.7.1]{v18} considered clustering based on the sign of the first right singular vector, the leading eigenvector of the hollowed Gram matrix, and the first principal component score, respectively. These studies assume the Gaussian mixture model with isotropic innovations.
Under a heteroskedastic two-component Gaussian mixture model with independent coordinates and coordinate-wise variances, \citet{chz22} studied clustering based on the sign of the first principal component score, leveraging sharp
non-asymptotic concentration bounds for Wishart-type matrices.
More recently, \cite{kgt25} analyzed this sign-based spectral clustering procedure under an allometric extension relationship, in which the first principal directions of the two clusters are aligned with the direction of the difference between their mean vectors.
As stated, existing theoretical studies assume certain restrictions on the covariance structure such as isotropy or allometric extension model.
The leading principal component of their mixture models other than the model of \cite{chz22} aligns with the mean difference direction.
However, these model assumptions often do not fit real-world data.
In this paper, we derive a non-asymptotic bound on the misclustering probability of the spectral clustering algorithm method for a two-component Gaussian mixture model without such restrictions and, as a by-product, sufficient conditions ensuring consistency of spectral clustering in certain high-dimensional regimes.
%Although sign-based clustering and $k$-means in the two-cluster case can be closely related when the cluster centers are symmetric with respect to the origin, sign-based clustering has the advantage of lower computational burden.
\section{Model and spectral clustering algorithm}
Let $\theta$ be a Rademacher random variable that takes a value in $\{-1,1\}$ with equal probability. Denote
$\bm{g}^{(-1)}\sim \mathcal{N}_n(\bm{0}_n,\bm{\Sigma}_{-1})$ and $\bm{g}^{(1)}\sim \mathcal{N}_n(\bm{0}_n,\bm{\Sigma}_1)$ for positive-definite symmetric matrices $\bm{\Sigma}_j$ for $j=-1,1$.
We consider the $n$-dimensional two-component Gaussian mixture model for a random vector $\bm{X}$, defined as
\begin{equation}\label{eq:model}
\bm{X} = \theta\bm{\mu} + \bm{g}^{(\theta)}.
\end{equation}
We address the problem of clustering observed random vectors $\bm{X}_1,\ldots,\bm{X}_m$ that are independent and follow the same distribution as $\bm{X}$ in \eqref{eq:model} into two classes determined by the latent sign variable $\theta$.
To this end, we apply spectral clustering algorithm, which classifies each observed random vector according to the sign of $\langle \bm{\gamma}_1(\bm{S}_m), \bm{X}_i \rangle$ for $i=1,\ldots,m$, where $\bm{S}_m ={ \sum_{i=1}^m \bm {X}_i \bm{X}_i^\top/m}$. %denotes the sample covariance matrix computed from $\bm{X}_1,\ldots,\bm{X}_m$ .
Since the sign of an eigenvector is indeterminate, we assume that $\langle \bm{\gamma}_1(\bm{S}_m), \bm{\gamma}_1(\bm{\Sigma}) \rangle > 0$, where $\bm{\gamma}_1(\cdot)$ denotes the eigenvector associated with the largest eigenvalue of the matrix argument, and {$\bm{\Sigma} = (\bm{\Sigma}_{-1}+\bm{\Sigma}_1)/2$}.
With this convention, the misclassification probability of $\bm{X}_i$ is represented as
\[{\rm P}\big(\,\theta_i \,\langle \bm{\gamma}_1(\bm{S}_m), \bm{X}_i \rangle < 0\,\big)
\] for $i=1,\ldots,m$.
%the probability density function $f_{\bm{X}}(\cdot)$ of $\bm{X}$ is given by
%\[
%f_{\bm{X}}(x)\;=\; \tfrac12 f_1(x) \;+\; \tfrac12 f_2(x)\qquad (x\in\mathbb{R}^n),
%\]
%where $f_1(\cdot)$ and $f_2(\cdot)$ are the probability density functions of $\mathcal{N}_n(\bm{\mu},\bm{\Sigma}_1)$ and
%$\mathcal{N}_n(-\bm{\mu},\bm{\Sigma}_{\red{-1}})$, respectively.
\section{Main result}
Our main result evaluates the misclassification probability of spectral clustering algorithm together with a non-asymptotic error bound.
\begin{thm}\label{mthm3}
Let $c$, $C$, $K$, and $K_g$ be absolute constants independent of $m$, $n$, $\bm{\mu}$, $\bm{\Sigma}_1$, and $\bm{\Sigma}_{-1}$.
Define
\begin{align*}
\delta = & 2^{5/2} c_1 \sqrt{ \frac{n\max_{j=-1,1} \{ \lambda_1(\bm{\Sigma}_j) \}}{m\| \bm{\mu} \|_2^2}}\\
&+ \sqrt{2}\left( \frac{\lambda_1(\bm{\Sigma}_1)+\lambda_1(\bm{\Sigma}_{-1})}{\| \bm{\mu} \|_2^2} \right)
\left( CK^2 \left( \sqrt{\frac{2n}{m}} + \frac{2n}{m}\right) +1 \right),
\end{align*}
where $c_1 = 1+K_g^2/\sqrt{c}$.
Suppose that there exists $\alpha \in (0,1)$ such that
\begin{align}\label{eq:con}
\delta \leq \frac{\alpha\| \bm{\mu} \|_2}{ c_1\sqrt{n\max_{j=-1,1} \lambda_1(\bm{\Sigma}_j)} + \| \bm{\mu} \|_2}.
\end{align}
Then, for any $j=-1,1$,
it holds that
\begin{align*}\label{eq:mis_prob_PhiA_refined}
&\left|{\rm P}\!\left(j\langle \bm{\gamma}_1(\bm{S}_m),\bm{X}_i\rangle<0\,\middle|\,\theta_i=j\right)-\Phi\skakko{-\frac{\|\bm{\mu}\|_2^2}{\max_{j=-1,1}\|\bm{\Sigma}_j^{1/2}\bm{\mu}\|_2}}\right|\\
&\le \frac{\alpha\|\bm{\mu}\|_2^2}{\max_{j=-1,1}\|\bm{\Sigma}_j^{1/2}\bm{\mu}\|_2}
\,\phi\skakko{\frac{(1-\alpha)\|\bm{\mu}\|_2^2}{\max_{j=-1,1}\|\bm{\Sigma}_j^{1/2}\bm{\mu}\|_2}}+10e^{-n},
\end{align*}
where $\Phi(\cdot)$ and $\phi(\cdot)$ denote the distribution function and density function of $\mathcal{N}(0,1)$, respectively.
\end{thm}
\begin{rem}
Let us briefly explain the absolute constants $c$, $C$, $K$, and $K_g$ in Theorem~\ref{mthm3}. The constants $C$ and $K$ are universal constants that appear in the concentration/perturbation bounds used to control
$\|\bm{S}_m-\bm{\Sigma}\|_{\mathrm{op}}$ and the corresponding eigenvector deviation; in particular, they do not depend on $m$, $n$, $\bm{\mu}$, $\bm{\Sigma}_1$, or $\bm{\Sigma}_{-1}$.
The constant $K_g$ is the sub-Gaussian (Orlicz $\psi_2$) norm of a standard normal random variable. In particular, under the convention $K_g= \inf\left\{ s>0:\ E[\exp\!\left(Z^2/s^2\right)]\le 2 \right\}$ for
$Z\sim\mathcal{N}(0,1)$, we have $K_g=\sqrt{8/3}$.
Consequently, for $\bm{g}\sim\mathcal{N}_n(\bm{0}_n,\bm{I}_n)$, a standard Gaussian norm concentration inequality yields that for all $t\ge 0$,
\begin{equation}\label{eq:gauss_norm_conc}
\mathbb{P}\bigl(\bigl|\|\bm{g}\|_2-\sqrt{n}\bigr|\ge t\bigr)
\le 2\exp\!\left(-\frac{c\,t^2}{K_g^4}\right),
\end{equation}
see, for example, \citet[Ch.~3]{v18}. The constant $c$ in Theorem~\ref{mthm3} corresponds to the absolute constant in \eqref{eq:gauss_norm_conc}.
With the choice $c_1:=1+K_g^2/\sqrt{c}$, \eqref{eq:gauss_norm_conc} implies
\[
\mathbb{P}\!\left(\|\bm{g}\|_2>c_1\sqrt{n}\right)
\le 2e^{-n},
\]
which is exactly the tail bound used to control the event $\mathrm{E}_2$ in
\eqref{eq:mthm3_eva3}.
\end{rem}
\begin{rem}
When $\bm{\Sigma}_1 = \bm{\Sigma}_2$,
the quantity
$\Phi ( - {\| \bm{\mu} \|_2^2}/{\max_{j=-1,1} \| \bm{\Sigma}_j^{1/2}\bm{\mu} \|_2 } )$ in Theorem \ref{mthm3} reduces to
$\Phi ( - {\| \bm{\mu} \|_2^2}/{\| \bm{\Sigma}_j^{1/2}\bm{\mu} \|_2 } )$, whereas the oracle misclassification probability of linear discriminant analysis is given by
$\Phi (-\sqrt{\bm \mu^\top \bm \Sigma_j^{-1}\bm \mu} )$.
We have
$$
\frac{\| \bm{\mu} \|_2^2}{\left\| \bm{\Sigma}_j^{1/2}\bm{\mu} \right\|_2 }
\leq
\sqrt{\bm \mu^\top \bm \Sigma_j^{-1}\bm \mu}
\leq
\sqrt{\frac{\lambda_1(\bm{\Sigma}_j)}{\lambda_n(\bm{\Sigma}_j)}}
\frac{\| \bm{\mu} \|_2^2}{\left\| \bm{\Sigma}_j^{1/2}\bm{\mu} \right\|_2 },
$$
where $\lambda_n(\bm{\Sigma}_j)$ denotes the smallest eigenvalue of $\bm{\Sigma}_j$,
which yields
$$
\Phi\skakko{
-\sqrt{\frac{\lambda_1(\bm{\Sigma}_j)}{\lambda_n(\bm{\Sigma}_j)}}
\frac{\| \bm{\mu} \|_2^2}{\left\| \bm{\Sigma}_j^{1/2}\bm{\mu} \right\|_2 }
}
\leq
\Phi\skakko{
-
\sqrt{\bm \mu^\top \bm \Sigma_j^{-1}\bm \mu}
}
\leq
\Phi\skakko{
-
\frac{\| \bm{\mu} \|_2^2}{\left\| \bm{\Sigma}_j^{1/2}\bm{\mu} \right\|_2 }
}.
$$
Thus, our theorem provides a quantitative assessment of the gap between our bound and the oracle misclassification probability.
In the isotropic case $\bm{\Sigma}_1 = \bm{\Sigma}_2= \sigma^2 \bm{I}_n$, the spectral clustering algorithm is optimal.
On the other hand, when $\bm{\Sigma}_1 \neq \bm{\Sigma}_2$, even in an oracle setting, it is difficult to explicitly describe the optimal misclassification probability of linear discriminant analysis \citep{ab62}.
\end{rem}
Let
\[ \eta := \frac{\|\bm\mu\|_2^2}{ \max_{j=-1,1}\lambda_1(\bm\Sigma_j)} \]
that can regarded as the signal-to-noise ratio for our clustering problem.
The numerator of $\eta$ corresponds to the magnitude of separation between the two clusters, while the denominator represents the largest within-cluster variability.
Thus, $\eta$ measures the separation between the cluster means relative to the largest within-cluster dispersion,
and therefore quantifies the intrinsic difficulty of the clustering problem.
The condition \eqref{eq:con} is satisfied for large $m$ and $n$ if
\[
\frac{1}{\eta}\max\!\left\{
\dfrac{n}{\sqrt{m}},\;
n^{1/3}
\right\}\to 0.
\]
The next corollary demonstrates that spectral clustering algorithm enjoy consistency in a certain high-dimensional scenario.
Intuitively, if $\eta$ is sufficiently large, then the clustering is consistent.
\begin{cor}\label{cor:consistency}
As $n \to \infty$ with $\log m / n \to 0$, if
%\[
%\frac{1}{\eta}\,
%\max\!\left\{
%\frac{n}{m},\,
%\frac{n^2}{m\eta},\,
%\frac{n}{\eta^2},\,
%\log m
%\right\}\to 0,
%\]
\[
\frac{1}{\eta}\max\!\left\{
\frac{n}{\sqrt m},\,
n^{1/3},\,
\log m
\right\}\to 0,
\]
then the probability that all observations $\bm X_1,\dots,\bm X_m$ are correctly clustered tends to one.
Moreover, under these conditions, the misclassification probability decays at an exponential rate.
\end{cor}
\begin{rem}
Corollary \ref{cor:consistency} does not require the largest eigenvalue to be bounded.
\end{rem}
Finally, we compare the sufficient conditions for the expected number of misclustered observations to converge to zero, that is
\begin{equation}\label{eq:misc1X}
E \!\left[
\min \!\left\{
\sum_{i=1}^m 1\!\left\{ \theta_i \langle \boldsymbol{\gamma}_1(\boldsymbol{S}_m), \boldsymbol{X}_i \rangle < 0 \right\},
\sum_{i=1}^m 1\!\left\{ \theta_i \langle \boldsymbol{\gamma}_1(\boldsymbol{S}_m), \boldsymbol{X}_i \rangle > 0 \right\}
\right\}
\right] \to 0,
\end{equation}
with those in \cite{cz18} under the isotropic setting $\bm\Sigma_1 = \bm\Sigma_2 = \bm I_n$.
By Corollary~\ref{cor:consistency}, the sufficient conditions for \eqref{eq:misc1X} to hold are
%\[
%\frac{\log m}{n},\quad
%\frac{n}{\|\bm\mu\|_2^2 m},\quad
%\frac{n^2}{\|\bm\mu\|_2^4 m},\quad
%\frac{n}{\|\bm\mu\|_2^6},\quad
%\text{and}\quad
%\frac{\log m}{\|\bm\mu\|_2^2}\to 0,
%\]
\[
\frac{1}{\|\bm{\mu}\|_2}\max\!\left\{
%n^{1/2} m^{-1/2},\;
n^{1/2} m^{-1/4},\;
n^{1/6},\;
(\log m)^{1/2}
\right\}\to0
\text{ and }
\frac{\log m}{n}\to0.
\]
whereas the corresponding conditions in \cite{cz18} are
%\[
%\frac{n}{\|\bm\mu\|_2^4}\to 0
%\quad \text{and} \quad
%\frac{m}{\|\bm\mu\|_2^2}\to 0.
%\]
\[
\frac{1}{\|\bm\mu\|_2}\max\!\left\{
n^{1/4},\; m^{1/2}
\right\} \to0.
\]
When $m$ grows on the same order as the sample size $n$,
our condition is less restrictive.
In contrast, when $n \to \infty$ while $m$ remains fixed, the conditions in \cite{cz18} is less restrictive.
%\begin{rem}
%In the two-class Gaussian model with known covariance matrix $\bm{\Sigma}$, linear discriminant analysis classifies along the Bayes-optimal direction $\bm{\Sigma}^{-1} \bm{\mu}$, whereas \purple{clustering} based on the principal component analysis uses the sign of the projection onto the first eigenvector of $\bm{\Sigma}$.
%Thus the two methods coincide exactly when these two directions are collinear and the signal strength $\| \bm{\mu} \|_2$ is sufficiently large relative to the within-class variance.
%In particular, they always agree in the spherical case $\bm{\Sigma} = \sigma^2 \bm{I}$ or under the allometric extension model, where the first eigenvector of $\bm{\Sigma}$ is parallel to $\bm{\mu}$.
%\end{rem}
\section{Proofs}
\subsection{Proof of Theorem~\ref{mthm3}}
\begin{proof}[Proof of Theorem~\ref{mthm3}]
Let
\[
A:=\frac{\|\bm{\mu}\|_2^2}{\max_{j=-1,1}\|\bm{\Sigma}_j^{1/2}\bm{\mu}\|_2}\ (\ge 0)
\quad
\text{and}
\quad
p_j:={\rm P}\!\left(j\langle \bm{\gamma}_1(\bm{S}_m),\bm{X}_i\rangle<0\,\middle|\,\theta_i=j\right).
\]
From Lemma~\ref{lemk3} below, it follows that
\[
\Phi\bigl(-(1+\alpha)A\bigr)-10e^{-n}\le p_j\le \Phi\bigl(-(1-\alpha)A\bigr)+10e^{-n}.
\]
Thus, we have
\[
|p_j-\Phi(-A)|
\le \max\!\left\{\Phi(-A)-\Phi\bigl(-(1+\alpha)A\bigr),\ \Phi\bigl(-(1-\alpha)A\bigr)-\Phi(-A)\right\}+10e^{-n}.
\]
Since $\Phi'=\phi$ and $\phi(t)=\phi(-t)$ for all $t\in \mathbb{R}$, it holds that
\[
\Phi(-A)-\Phi\bigl(-(1+\alpha)A\bigr)=\int_A^{(1+\alpha)A}\phi(u)\,du\le \alpha A\,\phi(A),
\]
\[
\Phi\bigl(-(1-\alpha)A\bigr)-\Phi(-A)=\int_{(1-\alpha)A}^{A}\phi(u)\,du\le \alpha A\,\phi\bigl((1-\alpha)A\bigr).
\]
Because $\phi$ is decreasing on $(0,\infty)$ and $(1-\alpha)A\le A$, we have
$\phi(A)\le \phi((1-\alpha)A)$, so the maximum is bounded by $\alpha A\,\phi((1-\alpha)A)$.
\end{proof}
The following lemma provides an bound on the conditional misclassification probability and is key to the proof of Theorem~\ref{mthm3}.
\begin{lem}\label{lemk3}
Let $c$, $C$, and $K$ be absolute constants independent of $m$, $n$, $\bm{\mu}$, $\bm{\Sigma}_1$, and $\bm{\Sigma}_{-1}$.
The quantities $c_1$ and $\delta$ are as defined in Theorem~\ref{mthm3}.
If there exists $\alpha \in (0,1)$ such that
\begin{align}
\delta \leq \frac{\alpha\| \bm{\mu} \|_2}{ c_1\sqrt{n \lambda_1(\bm{\Sigma}_j) } + \| \bm{\mu}\|_2},
\end{align}
it holds that
\begin{align}\label{eq:mthm3_result1}
&\Phi\left( - \frac{ (1 + \alpha)\| \bm{\mu} \|_2^2}{\left\| \bm{\Sigma}_j^{1/2}\bm{\mu} \right\|_2 } \right) - 10\e^{-n}\\
&\leq
{\rm P}(j\langle \bm{\gamma}_1(\bm{S}_m), \bm{X}_i \rangle <0 \arrowvert \theta_i = j )\leq \Phi\left( - \frac{ (1 - \alpha)\| \bm{\mu} \|_2^2}{\left\| \bm{\Sigma}_j^{1/2}\bm{\mu} \right\|_2 } \right) + 10\e^{-n}
\end{align}
for $i=1,\ldots,m$ and $j=-1,1$.
\end{lem}
\begin{proof}
We prove \eqref{eq:mthm3_result1} only for $j=1$, and the case $j=-1$ follows similarly.
For notational convenience, define the events $\mathrm{A}_i$, $\mathrm{E}_1$, and $\mathrm{E}_2$ as
\begin{align*}
\mathrm{A}_i &= \left\{ \theta_i = 1 \right\} ,\quad
\mathrm{E}_1 = \left\{ \|\bm{\gamma}_1(\bm{S}_m) - \tilde{\bm{\mu}} \|_2 \leq \delta \right\}, \\
\mathrm{E}_2 &= \left\{ \left\| \bm{g}_i \right\|_2 \leq c_1\sqrt{n\lambda_1(\bm{\Sigma}_1)} \right\},
\end{align*}
where $\tilde{\bm{\mu}} = \bm{\mu}/\|\bm{\mu}\|_2$.
Then, we find that
\begin{align}
&{\rm P}\left( \left\langle \bm{\gamma}_1(\bm{S}_m), \bm{X}_i \right\rangle < 0 \middle\arrowvert \mathrm{A}_i \right)\nonumber \\
\leq&
{\rm P}\left( \left\{ \left\langle \bm{\gamma}_1(\bm{S}_m), \bm{X}_i \right\rangle < 0 \right\} \cap \mathrm{E}_1 \cap \mathrm{E}_2 \middle\arrowvert \mathrm{A}_i \right)
+ {\rm P}\left( \mathrm{E}_1^c \middle\arrowvert \mathrm{A}_i \right) + {\rm P}\left( \mathrm{E}_2^c \middle\arrowvert \mathrm{A}_i \right). \label{eq:mthm3_eva1}
\end{align}
First, we evaluate the first term on the right-hand side of \eqref{eq:mthm3_eva1}:
\begin{align}
&{\rm P} \biggl(\langle \bm{\gamma}_1(\bm{S}_{m}) , \bm{X}_i \rangle<0 \biggl\arrowvert \mathrm{A}_i\biggr) \nonumber \\*
=& {\rm P} \biggl(\langle \bm{\gamma}_1(\bm{S}_{m}) - \tilde{\bm{\mu}} + \tilde{\bm{\mu}} , \theta_i \bm{\mu} + \bm{g}_i^{(\theta_i)} \rangle<0 \biggl\arrowvert \mathrm{A}_i \biggr) \nonumber \\*
=& {\rm P}\biggl( \langle \bm{\gamma}_1(\bm{S}_{m}) - \tilde{\bm{\mu}}, \bm{\mu} \rangle + \langle \bm{\gamma}_1(\bm{S}_{m}) -\tilde{\bm{\mu}},\bm{g}_i^{(\theta_i)}\rangle +\langle \tilde{\bm{\mu}} ,\bm{\mu} \rangle \nonumber \\&\quad +\langle\tilde{\bm{\mu}},\bm{g}_i^{(\theta_i)}\rangle <0 \biggl\arrowvert \mathrm{A}_i\biggr) \nonumber \\*
\leq &
{\rm P}\biggl( - \|\bm{\gamma}_1(\bm{S}_{m}) - \tilde{\bm{\mu}}\|_2\cdot \| \bm{\mu} \|_2 + \langle\bm{\Sigma}_1^{1/2}(\bm{\gamma}_1(\bm{S}_{m})- \tilde{\bm{\mu}}),\bm{\Sigma}_1^{-1/2}\bm{g}_i^{(\theta_i)}\rangle\nonumber \\*
&\qquad + \| \bm{\mu}\|_2 + \|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2 \biggl\langle \frac{\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}}{\| \bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2 },\bm{\Sigma}_1^{-1/2}\bm{g}_i^{(\theta_i)}\biggr\rangle
< 0\biggl\arrowvert \mathrm{A}_i \biggr) \nonumber \\*
\leq &
{\rm P}\biggl(
- \|\bm{\gamma}_1(\bm{S}_{m}) - \tilde{\bm{\mu}}\|_2\cdot \| \bm{\mu} \|_2 -\|\bm{\Sigma}_1^{1/2} \|_{\mathrm{op}} \|\bm{\gamma}_1(\bm{S}_{m}) - \bm{\gamma}_1 (\bm{\Sigma}_1)\|_2 \nonumber\\
&\cdot \|\bm{\Sigma}_1^{- 1/2}\bm{g}_i^{(\theta_i)}\|_2
+ \| \bm{\mu}\|_2 + \|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2 \biggl\langle \frac{\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}}{\| \bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2 },\bm{\Sigma}_1^{-1/2}\bm{g}_i^{(\theta_i)}\biggr\rangle
< 0\biggl\arrowvert \mathrm{A}_i \biggr) \label{eq:mthm3_f1}.
\end{align}
Here, we used the following inequality
\begin{align*}
&\langle \bm{\gamma}_1(\bm{S}_{m}) - \bm{\gamma}_1 (\bm{\Sigma}_1), \bm{g}_i^{(\theta_i)} \rangle
= \langle \bm{\Sigma}_1^{1/2} (\bm{\gamma}_1(\bm{S}_{m}) - \bm{\gamma}_1 (\bm{\Sigma}_1)), \bm{\Sigma}_1^{-1/2}\bm{g}_i^{(\theta_i)}\rangle \\
&\geq -
\|\bm{\Sigma}_1^{1/2} (\bm{\gamma}_1(\bm{S}_{m}) - \bm{\gamma}_1 (\bm{\Sigma}_1))\|_2 \|\bm{\Sigma}_1^{- 1/2}\bm{g}_i^{(\theta_i)}\|_2 \\
&\geq -\|\bm{\Sigma}_1^{1/2} \|_{\mathrm{op}} \|\bm{\gamma}_1(\bm{S}_{m}) - \bm{\gamma}_1 (\bm{\Sigma}_1)\|_2 \|\bm{\Sigma}_1^{- 1/2}\bm{g}_i^{(\theta_i)}\|_2 .
\end{align*}
Set
\begin{align*}
\bm{g}_i &= \bm{\Sigma}_1^{-1/2}\bm{g}_i^{(\theta_i)} \quad\text{and}\quad
Z_i = \biggl\langle \frac{\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}}{\|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2 },\bm{g}_i \biggr\rangle .
\end{align*}
Because $\bm{g}_i \mid \mathrm{A}_i \sim \mathcal{N}_n(0,I_n)$, for any deterministic $a\in\mathbb{R}^n$ we have
$\bm{a}^\top \bm{g}_i \mid \mathrm{A}_i \sim \mathcal{N}(0,\|\bm{a}\|_2^2)$.
By taking
\[
a=\frac{\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}}{\bigl\|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\bigr\|_2},
\]
it follows that
\begin{equation*}
\|\bm{\Sigma}_1^{1/2}\tfrac{\bm{\mu}}{\| \bm{\mu} \|_2}\|_2\, Z_i \mid \mathrm{A}_i \sim \mathcal{N}\!\left(0, \bigl\|\bm{\Sigma}_1^{1/2}\tfrac{\bm{\mu}}{\| \bm{\mu} \|_2}\bigr\|_2^2\right).
\end{equation*}
Hence, the right-hand side of \eqref{eq:mthm3_f1} equals
\begin{align*}
&{\rm P}\Biggl( - \| \bm{\gamma}_1(\bm{S}_{m}) - \tilde{\bm{\mu}}\|_2 \left(\sqrt{\lambda_1(\bm{\Sigma}_1)}\| \bm{g}_i\|_2 + \|\bm{\mu} \|_2\right) + \|\bm{\mu} \|_2 \\
&\quad + \|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2 Z_i <0\biggl\arrowvert \mathrm{A}_i \Biggr)\\
=&
{\rm P}\Biggl(\|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2Z_i< \| \bm{\gamma}_1(\bm{S}_{m}) - \tilde{\bm{\mu}}\|_2 \left(\sqrt{\lambda_1(\bm{\Sigma}_1)}\| \bm{g}_i \|_2 + \| \bm{\mu} \|_2 \right) \\
&\quad - \| \bm{\mu} \|_2\biggl\arrowvert \mathrm{A}_i \Biggr).
\end{align*}
Since
$
\delta \leq {\alpha\| \bm{\mu} \|_2}/{(c_1\sqrt{n\ \lambda_1(\bm{\Sigma}_1) } + \| \bm{\mu} \|_2)}$,
it holds that
\begin{align}
&{\rm P}\Biggl( \Biggl
\{\|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2Z_i< \| \bm{\gamma}_1(\bm{S}_{m}) - \tilde{\bm{\mu}}\|_2 \left( \sqrt{\lambda_1(\bm{\Sigma}_1)}\| \bm{g}_i \|_2 + \| \bm{\mu} \|_2 \right) - \| \bm{\mu} \|_2 \Biggr\} \nonumber\\
& \quad \cap \mathrm{E}_1 \cap \mathrm{E}_2\biggl\arrowvert \mathrm{A}_i \Biggr) \nonumber\\
\leq& {\rm P}\Biggl( \Biggl\{\|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2Z_i< \delta \left(c_1\sqrt{n\lambda_1(\bm{\Sigma}_1)} + \| \bm{\mu} \|_2 \right) - \| \bm{\mu} \|_2 \Biggr\} \cap \mathrm{E}_1 \cap \mathrm{E}_2 \biggl\arrowvert \mathrm{A}_i \Biggr) \nonumber\\
\leq&
{\rm P} \Biggl(Z_i< \frac{-(1-\alpha) \| \bm{\mu} \|_2}{\|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\|_2} \biggl\arrowvert \mathrm{A}_i \Biggr) \nonumber\\
=&
{\rm P} \Biggl(Z_i< \frac{-(1-\alpha) \| \bm{\mu} \|_2^2}{\|\bm{\Sigma}_1^{1/2}\bm{\mu}\|_2} \biggl\arrowvert \mathrm{A}_i \Biggr) .\label{eq:mthm3_eva2}
\end{align}
Next, we evaluate the remaining two terms in \eqref{eq:mthm3_eva1}.
Since $c_1 = 1 + { K_g^2}/{\sqrt{c}}$ by assumption, a standard concentration bound for Gaussian norms gives
\begin{align}
{\rm P}(\|\bm{g}_i\|_2 > c_1 \sqrt{n} \arrowvert \mathrm{A}_i )
=& {\rm P}( | \| \bm{g}_i \|_2 - \sqrt{n} + \sqrt{n} | > c_1 \sqrt{n} \arrowvert \mathrm{A}_i ) \nonumber \\
\leq& {\rm P}( | \| \bm{g}_i \|_2 - \sqrt{n} | > (c_1-1) \sqrt{n} \arrowvert \mathrm{A}_i ) \nonumber \\
\leq& 2 \e^{-n}, \label{eq:mthm3_eva3}
\end{align}
see, e.g., \citet[Ch.~3]{v18}. % Vershynin
We also find that
\begin{align}
{\rm P}\left(\left\|\bm{\gamma}_1(\bm{S}_{m}) - \tilde{\bm{\mu}} \right\|_2 > \delta \biggl\arrowvert \mathrm{A}_i \right)\leq&
\frac{1}{{\rm P}\left( \mathrm{A}_i \right)}{\rm P}\left(\left\|\bm{\gamma}_1(\bm{S}_{m}) - \tilde{\bm{\mu}} \right\|_2 > \delta \right) \nonumber \\
\leq&
8\e^{-n}. \label{eq:mthm3_eva4}
\end{align}
Combining \eqref{eq:mthm3_eva1}, \eqref{eq:mthm3_eva2}, \eqref{eq:mthm3_eva3}, and \eqref{eq:mthm3_eva4} yields
\begin{equation*}
{\rm P} \biggl(\langle \bm{\gamma}_1(\bm{S}_{m}), \bm{X}_i\rangle<0 \biggl\arrowvert \mathrm{A}_i \biggr) \\
\leq {\rm P} \Biggl(Z_i< \frac{-(1-\alpha) \| \bm{\mu} \|_2^2}{\|\bm{\Sigma}_1^{1/2}\bm{\mu}\|_2} \biggl\arrowvert \mathrm{A}_i \Biggr) + 10 \e^{-n}.
\end{equation*}
Similarly, by an analogous argument, we obtain
\begin{align*}
&{\rm P}\bigl(\langle \bm{\gamma}_1(\bm{S}_{m}) , \bm{X}_i \rangle<0 \mid \mathrm{A}_i\bigr) \\
&\geq {\rm P}\Bigl(
\bigl\|\bm{\gamma}_1(\bm{S}_{m}) - \tfrac{\bm{\mu}}{\| \bm{\mu} \|_2}\bigr\|_2
\bigl(\sqrt{\lambda_1(\bm{\Sigma}_1)}\| \bm{g}_i\|_2 + \|\bm{\mu} \|_2\bigr)
+ \|\bm{\mu} \|_2
+ \bigl\|\bm{\Sigma}_1^{1/2}\tfrac{\bm{\mu}}{\| \bm{\mu} \|_2}\bigr\|_2 Z_i <0
\,\bigm|\, \mathrm{A}_i
\Bigr)\\
&\geq {\rm P}\Bigl(
\bigl\{
\bigl\|\bm{\Sigma}_1^{1/2}\tfrac{\bm{\mu}}{\| \bm{\mu} \|_2}\bigr\|_2 Z_i
< - \bigl\|\bm{\gamma}_1(\bm{S}_{m}) - \tfrac{\bm{\mu}}{\| \bm{\mu} \|_2}\bigr\|_2
\bigl( \sqrt{\lambda_1(\bm{\Sigma}_1)}\| \bm{g}_i \|_2 + \| \bm{\mu} \|_2 \bigr)
- \| \bm{\mu} \|_2
\bigr\} \\
&\qquad\qquad
\cap \mathrm{E}_1 \cap \mathrm{E}_2
\,\bigm|\, \mathrm{A}_i
\Bigr)\\
&\geq {\rm P}\Bigl(
\bigl\{
\bigl\|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\bigr\|_2 Z_i
< - \delta \bigl(c_1\sqrt{n\lambda_1(\bm{\Sigma}_1)} + \| \bm{\mu} \|_2 \bigr)
- \| \bm{\mu} \|_2
\bigr\}
\cap \mathrm{E}_1 \cap \mathrm{E}_2
\,\bigm|\, \mathrm{A}_i
\Bigr)\\
&\geq
{\rm P}\Biggl(
Z_i <
\frac{-(1+\alpha)\,\|\bm{\mu}\|_2}
{\bigl\|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\bigr\|_2}
\,\biggm|\, \mathrm{A}_i
\Biggr)
- {\rm P}(\mathrm{E}_1^c\mid \mathrm{A}_i)
- {\rm P}(\mathrm{E}_2^c\mid \mathrm{A}_i)\\
&\geq
{\rm P}\Biggl(
Z_i <
\frac{-(1+\alpha)\,\|\bm{\mu}\|_2}
{\bigl\|\bm{\Sigma}_1^{1/2}\tilde{\bm{\mu}}\bigr\|_2}
\,\biggm|\, \mathrm{A}_i
\Biggr)
-10\e^{-n}.
\end{align*}
\end{proof}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% Acknowledgements %%
%% should be provided in the %%
%% Acknowledgements section. %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% Funding information, if any, %%
%% should be provided in the %%
%% funding section. %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\begin{funding}
This study was supported in part by Japan Society for the Promotion of Science KAKENHI Grant Numbers 23K16851 (YG) and 25K07133 (KT).
\end{funding}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%% Supplementary Material, including data %%
%% sets and code, should be provided in %%
%% {supplement} environment with title %%
%% and short description. It cannot be %%
%% available exclusively as external link. %%
%% All Supplementary Material must be %%
%% available to the reader on Project %%
%% Euclid with the published article. %%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\bibliographystyle{imsart-nameyear}
\bibliography{ref}
\end{document}