A Variational Method for Conformable Fractional Equations Using Rank-One Updates

Extracted source text · arXiv 2510.03778

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
% Conformable Fractional PGD in Energy Spaces:
% Rank-One Greedy Analysis, ALS Realization, and Detailed Implementation
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\documentclass[11pt]{article}

% -------------------------------------------------
% Packages
% -------------------------------------------------
\usepackage{amsmath,amssymb,amsfonts,amsthm}
\usepackage{mathtools}
\usepackage{geometry}
  \geometry{margin=1in}
\usepackage{hyperref}
  \hypersetup{colorlinks=true, linkcolor=blue, citecolor=blue, urlcolor=blue}
\usepackage{microtype}
\usepackage{bm}
\usepackage{bbm}

% -------------------------------------------------
% Theorem environments
% -------------------------------------------------
\newtheorem{theorem}{Theorem}[section]
\newtheorem{lemma}[theorem]{Lemma}
\newtheorem{proposition}[theorem]{Proposition}
\newtheorem{corollary}[theorem]{Corollary}
\theoremstyle{definition}
\newtheorem{definition}[theorem]{Definition}
\theoremstyle{remark}
\newtheorem*{remark}{Remark}
\newtheorem*{assumption}{Assumption}

% -------------------------------------------------
% Custom commands and notation
% -------------------------------------------------
\newcommand{\norm}[1]{\left\lVert #1 \right\rVert}
\newcommand{\ip}[2]{\left\langle #1,\,#2\right\rangle}
\newcommand{\R}{\mathbb{R}}
\newcommand{\D}{\mathcal{D}}
\newcommand{\anorm}[1]{\left\lVert #1 \right\rVert_a}
\newcommand{\aform}[2]{a\!\left(#1,#2\right)}
\newcommand{\Hinner}[2]{\left\langle #1,\,#2\right\rangle_H}
\newcommand{\tensor}{\widehat{\otimes}}
\newcommand{\Mone}{\mathcal{M}_1}
\newcommand{\Ox}{\Omega_x}
\newcommand{\Oy}{\Omega_y}
\newcommand{\dx}{\,dx}
\newcommand{\dy}{\,dy}

\begin{document}

% -------------------------------------------------
% Title and Authors
% -------------------------------------------------
\begin{center}
{\LARGE\bfseries A Variational Method for Conformable Fractional Equations Using Rank-One Updates}\\[0.0ex]
\end{center}

\vspace{1ex}

\begin{center}
{\large Tejas Dhulipalla\textsuperscript{1} and Maatank Parashar\textsuperscript{1}}\\[0.5ex]
\textsuperscript{1}Center for Research in Engineering, Science, and Technology, Phoenix, Arizona, USA\\[1ex]
July 24, 2025
\end{center}

% -------------------------------------------------
% Abstract
% -------------------------------------------------
\vspace{1cm}

\begin{abstract}
We make a complete variational treatment of rank-one Proper Generalised Decomposition for separable fractional partial differential equations with conformable derivatives. The setting is Hilbertian, the energy is induced by a symmetric coercive bilinear form, and the residual is placed in the dual space. A greedy rank-one update is obtained by maximizing an energy Rayleigh quotient over the rank-one manifold, followed by an exact line search. An exact one step energy decrease identity is proved, together with geometric decay of the energy error under a weak greedy condition that measures how well the search captures the Riesz representer of the residual. The alternating least squares realization is analyzed at the level of operators, including well posedness of the alternating subproblems, a characterization of stationary points, and monotonicity of the Rayleigh quotient along the inner iteration. Discretizations based on weighted finite elements and on Gr\"unwald type schemes are described in detail, including assembly, boundary conditions, complexity, and memory. Two model problems, a stationary fractional Poisson problem and a space time fractional diffusion problem, are treated from the continuous level down to matrices. 
\end{abstract}

\vspace{1.5cm}

\setcounter{tocdepth}{2}
\tableofcontents
\bigskip
\vspace{3cm}

\section{Introduction}
The conformable derivative is linear, satisfies a product rule, and for smooth functions equals a weighted first derivative. This enables a clean variational formulation. We develop a rank-one Proper Generalised Decomposition in this setting with a precise, implementable analysis in a Hilbert energy space. The bilinear form encodes conformable derivatives in each coordinate. The solution is defined by the Riesz map, and the residual lies in the dual space. The greedy step chooses a rank-one direction that maximizes \(\langle r, w\rangle^{2}/a(w,w)\) and uses an exact one dimensional line search for the step size. A weak greedy parameter quantifies how well the search approximates the Riesz representer. The alternating least squares subproblem reduces to symmetric, coercive linear solves and increases the Rayleigh quotient until stationarity.

We fix the functional framework, construct the rank-one manifold and greedy step, prove the exact energy decrease identity, define the weak greedy parameter, and derive geometric decay under a uniform lower bound on that parameter.


\section{Energy space, operator, and residual}
Let \(\Ox,\Oy\subset\R\) be bounded intervals and let \(\alpha_x,\alpha_y\in(0,1)\). For \(f:[0,\infty)\to\R\) and \(\alpha\in(0,1)\), the conformable derivative at \(x>0\) is
\begin{equation}\label{eq:confder}
\D^\alpha f(x) := \lim_{h\to0^+}\frac{f\!\left(x+h\,x^{1-\alpha}\right)-f(x)}{h}.
\end{equation}
If \(f\) is differentiable at \(x\) then \(\D^\alpha f(x)=x^{1-\alpha} f'(x)\). This equality holds almost everywhere for absolutely continuous functions with the classical derivative \(f'\) in \(L^2\) with a weight. This identity is used when assembling discrete operators and also when deriving the form of the energy on rank-one functions.

For an interval \(\Omega\subset\R\) and \(\alpha\in(0,1)\) define
\[
\norm{v}_{H^\alpha(\Omega)}^2 := \int_\Omega \left( v^2 + \left|\D^\alpha v\right|^2 \right)\,dx.
\]
Let \(H_0^\alpha(\Omega)\) denote the closure of \(C_c^\infty(\Omega)\) in this norm. The inner product associated with \(\norm{\cdot}_{H^\alpha(\Omega)}\) is written \(\ip{\cdot}{\cdot}_{H^\alpha(\Omega)}\). Set
\[
X:=H^{\alpha_x}_0(\Ox), \qquad Y:=H^{\alpha_y}_0(\Oy), \qquad H:=X\tensor Y,
\]
where \(\tensor\) denotes the Hilbert tensor completion. For simple tensors \(p\otimes q\) and \(p'\otimes q'\) define
\[
\Hinner{p\otimes q}{p'\otimes q'} := \ip{p}{p'}_{H^{\alpha_x}(\Ox)}\,\ip{q}{q'}_{H^{\alpha_y}(\Oy)},
\]
and extend by bilinearity and completion. The operator is encoded by the symmetric bilinear form
\begin{equation}\label{eq:energyform}
\aform{u}{v} := \int_{\Ox\times\Oy}\left( \D^{\alpha_x}_x u\,\D^{\alpha_x}_x v + \D^{\alpha_y}_y u\,\D^{\alpha_y}_y v \right)\,dx\,dy.
\end{equation}
The induced energy norm is \(\anorm{u}^2:=\aform{u}{u}\). The form \eqref{eq:energyform} is continuous and coercive on \(H\) under standard assumptions. A convenient sufficient condition is the following, which holds in particular when \(\Ox\) and \(\Oy\) are bounded intervals with Dirichlet boundary conditions enforced by the choice of \(X\) and \(Y\).

\begin{assumption}[Continuity and coercivity]\label{ass:contcoer}
There exist constants \(0<\eta\le M<\infty\) such that
\[
\eta\,\norm{v}_H^2 \le \aform{v}{v} \le M\,\norm{v}_H^2 \qquad \forall v\in H.
\]
\end{assumption}

Let \(\ell\in H'\) be a bounded linear functional. The weak problem reads
\begin{equation}\label{eq:weak}
\text{find } u\in H \text{ such that } \aform{u}{v}=\ell(v) \quad \text{for all } v\in H.
\end{equation}
By the Lax Milgram theorem there is a unique solution \(u\). Define the Riesz map \(A:H\to H'\) by \(\ip{Au}{v}=\aform{u}{v}\). Then \eqref{eq:weak} is equivalent to \(Au=\ell\). Given any approximation \(u_N\in H\), define the error \(e_N:=u-u_N\in H\) and the residual \(r_N:=\ell-Au_N\in H'\). The next identity is the basic algebraic relation behind the algorithm and the analysis.

\begin{lemma}[Energy identity]\label{lem:energyidentity}
With the definitions above,
\[
\anorm{e_N}^2 = \aform{e_N}{e_N} = \ip{r_N}{e_N} = \norm{r_N}_{H'}^2.
\]
\end{lemma}

\begin{proof}
The equalities \(\aform{e_N}{e_N}=\ip{Ae_N}{e_N}\) and \(Ae_N=\ell-Au_N=r_N\) imply \(\aform{e_N}{e_N}=\ip{r_N}{e_N}\). Since \(A\) is a Riesz isomorphism associated with the energy inner product, one has \(\norm{r_N}_{H'}=\anorm{e_N}\).
\end{proof}

Two auxiliary results are recorded for later use. The first identifies the energy of a rank-one function in terms of one dimensional quantities. The second gives a weighted Poincar\'e inequality that justifies the use of \(\norm{\cdot}_{H^\alpha}\) on intervals with homogeneous boundary values.

\begin{lemma}[Energy on rank-one functions]\label{lem:rankoneenergy}
Let \(p\in X\) and \(q\in Y\). Then
\[
\aform{p\otimes q}{p\otimes q} = \left(\int_{\Ox} \left|\D^{\alpha_x}p\right|^2 \dx\right)\left(\int_{\Oy} q^2 \dy\right) + \left(\int_{\Ox} p^2 \dx\right)\left(\int_{\Oy} \left|\D^{\alpha_y}q\right|^2 \dy\right).
\]
If \(p\) and \(q\) are absolutely continuous, the same identity holds with \(\D^{\alpha_x}p=x^{1-\alpha_x}p'\) and \(\D^{\alpha_y}q=y^{1-\alpha_y}q'\).
\end{lemma}

\begin{proof}
Apply the definition \eqref{eq:energyform} to the simple tensors and use Fubini.
\end{proof}

\begin{lemma}[Weighted Poincar\'e]\label{lem:weightedPoincare}
Let \(\Omega=(0,L)\) and \(\alpha\in(0,1)\). There exists \(C_\alpha>0\) depending only on \(\alpha\) and \(L\) such that for every \(v\in H_0^\alpha(\Omega)\) that is absolutely continuous,
\[
\int_0^L v(x)^2 dx \le C_\alpha \int_0^L x^{2(1-\alpha)} \left|v'(x)\right|^2 dx.
\]
\end{lemma}

\begin{proof}
A Hardy type inequality gives the result. One may apply the substitution \(z=x^{\alpha}\) and then use the standard one dimensional Poincar\'e inequality on \((0,L^\alpha)\) together with the Jacobian factor. The density of smooth compactly supported functions in \(H_0^\alpha(\Omega)\) is used to extend the inequality to the whole space.
\end{proof}

\section{Greedy rank one update and exact energy decrease}
The search space for a single mode is the rank-one manifold
\[
\Mone := \{\, w=p\otimes q : p\in X,\ q\in Y,\ w\neq 0 \,\}.
\]
Given an iterate \(u_N\), the goal is to select a direction \(w\in\Mone\) and a scalar \(\tau\in\R\) that reduce the energy error \(\anorm{u-u_N-\tau w}\). The optimal scalar for a fixed direction is obtained by minimizing a quadratic polynomial. The optimal direction is chosen by maximizing a Rayleigh quotient. This selection is natural, it is intrinsic to the energy inner product, and it does not require any extraneous projection.

Define the Rayleigh quotient at iteration \(N\) by
\[
\mathcal{R}_N(w) := \frac{\ip{r_N}{w}^2}{\aform{w}{w}} \qquad \text{for } w\in\Mone.
\]
Select \(w_{N+1}\in\Mone\) that maximizes \(\mathcal{R}_N\) and set
\[
\tau_{N+1} := \frac{\ip{r_N}{w_{N+1}}}{\aform{w_{N+1}}{w_{N+1}}}, \qquad u_{N+1}:=u_N+\tau_{N+1} w_{N+1}.
\]
The next identity is the key algebraic fact that drives the analysis.

\begin{lemma}[Exact one step energy decrease]\label{lem:onestep}
With the update defined above,
\[
\anorm{u-u_{N+1}}^2 = \anorm{u-u_N}^2 - \frac{\ip{r_N}{w_{N+1}}^2}{\aform{w_{N+1}}{w_{N+1}}}
= \anorm{u-u_N}^2 - \max_{w\in\Mone} \mathcal{R}_N(w).
\]
\end{lemma}

\begin{proof}
Let \(e_N=u-u_N\). For any \(w\in H\) and any \(\tau\in\R\),
\[
\anorm{e_N-\tau w}^2 = \anorm{e_N}^2 - 2\tau\,\ip{r_N}{w} + \tau^2\,\aform{w}{w}.
\]
The minimum with respect to \(\tau\) is attained at \(\tau^\ast=\ip{r_N}{w}/\aform{w}{w}\) and equals \(\anorm{e_N}^2 - \ip{r_N}{w}^2/\aform{w}{w}\). Maximizing the decrease over \(w\in\Mone\) gives the second equality. Choosing \(w_{N+1}\) as a maximizer and \(\tau_{N+1}=\tau^\ast\) gives the first equality.
\end{proof}

The quality of the decrease depends on how well rank-one functions correlate with the residual in the dual norm. Introduce the parameter
\begin{equation}\label{eq:thetaN}
\theta_N := \sup_{w\in\Mone}\frac{\ip{r_N}{w}}{\norm{r_N}_{H'}\,\sqrt{\aform{w}{w}}}\in(0,1].
\end{equation}
The value \(\theta_N\) is the cosine of the angle between the residual and the cone generated by \(\Mone\), as seen through the energy inner product. If \(\Mone\) contained all of \(H\) then \(\theta_N\) would equal \(1\). The rank-one restriction reduces the value to something strictly less than \(1\) unless the residual happens to be rank one. The next assumption formalizes the inexactness of the inner search.

\begin{assumption}[Weak greedy step]\label{ass:weak}
There exists \(t\in(0,1]\) independent of \(N\) such that the selected direction \(w_{N+1}\) satisfies
\[
\frac{\ip{r_N}{w_{N+1}}^2}{\aform{w_{N+1}}{w_{N+1}}}
\ge t^2 \max_{w\in\Mone} \frac{\ip{r_N}{w}^2}{\aform{w}{w}}
= t^2\,\theta_N^2\,\norm{r_N}_{H'}^2.
\]
\end{assumption}

\begin{theorem}[Geometric energy decay]\label{thm:decay}
Under Assumption \ref{ass:contcoer} and the weak greedy Assumption \ref{ass:weak}, one has
\[
\anorm{u-u_{N+1}}^2 \le \left(1 - t^2 \theta_N^2\right)\,\anorm{u-u_N}^2.
\]
If there exists \(\theta_\ast\in(0,1]\) such that \(\theta_N\ge \theta_\ast\) for all \(N\), then
\[
\anorm{u-u_N} \le \left(1 - t^2 \theta_\ast^2\right)^{N/2}\,\anorm{u-u_0}.
\]
\end{theorem}

\begin{proof}
Combine Lemma \ref{lem:onestep} with Assumption \ref{ass:weak} and Lemma \ref{lem:energyidentity}, which yields \(\norm{r_N}_{H'}=\anorm{u-u_N}\). The uniform lower bound on \(\theta_N\) implies a fixed contraction factor, and iteration completes the proof.
\end{proof}

A lower bound for \(\theta_N\) can be obtained in a separable setting. Consider a load of the form \(f(x,y)=f_x(x)f_y(y)\) and an operator with the energy \eqref{eq:energyform}. The Riesz representer of the residual is the solution of a separable elliptic problem. The best rank-one approximation in the energy inner product captures a fixed fraction of the energy of the representer, provided the cross interactions are not dominant. A general quantitative bound requires spectral information on one dimensional operators and on the strength of the cross coupling. The detailed treatment is problem dependent. The analysis of this paper isolates the role of this bound through the single parameter \(\theta_\ast\).

\vspace{2cm}
\section{Alternating least squares realization}
The maximization of \(\mathcal{R}_N\) over \(\Mone\) can be realized by an alternating procedure that solves two symmetric coercive problems at each inner iterate. The derivation is direct. Let \(w=p\otimes q\). The residual functional acts linearly as \(\ip{r_N}{p\otimes q}=\ell(p\otimes q)-\aform{u_N}{p\otimes q}\). Define one dimensional bilinear forms
\[
a_x(p,p') := \int_{\Ox} \D^{\alpha_x} p\,\D^{\alpha_x} p' \dx, \qquad
m_x(p,p') := \int_{\Ox} p\,p' \dx,
\]
\[
a_y(q,q') := \int_{\Oy} \D^{\alpha_y} q\,\D^{\alpha_y} q' \dy, \qquad
m_y(q,q') := \int_{\Oy} q\,q' \dy.
\]
By Lemma \ref{lem:rankoneenergy},
\[
\aform{p\otimes q}{p'\otimes q'} = a_x(p,p')\,m_y(q,q') + m_x(p,p')\,a_y(q,q').
\]
Fix \(q\neq 0\) and seek \(p\) that maximizes \(\mathcal{R}_N(p\otimes q)\). The stationary condition for the squared numerator minus a Lagrange multiplier times the denominator gives the normal equation
\begin{equation}\label{eq:ALSx}
\text{find } p\in X \text{ such that } \aform{p\otimes q}{p'\otimes q} = \ip{r_N}{p'\otimes q} \quad \text{for all } p'\in X.
\end{equation}
This is a linear symmetric problem on \(X\). Explicitly,
\[
\Big( a_x(\cdot,\cdot)\,m_y(q,q) + m_x(\cdot,\cdot)\,a_y(q,q) \Big) p = b_q,
\]
where \(b_q(p'):=\ip{r_N}{p'\otimes q}\). Fix \(p\neq 0\) and update \(q\) by solving
\begin{equation}\label{eq:ALSy}
\text{find } q\in Y \text{ such that } \aform{p\otimes q}{p\otimes q'} = \ip{r_N}{p\otimes q'} \quad \text{for all } q'\in Y,
\end{equation}
that is,
\[
\Big( a_y(\cdot,\cdot)\,m_x(p,p) + m_y(\cdot,\cdot)\,a_x(p,p) \Big) q = c_p,
\]
with \(c_p(q'):=\ip{r_N}{p\otimes q'}\). The two problems \eqref{eq:ALSx} and \eqref{eq:ALSy} are alternated until a stopping criterion is met. Scaling of \(p\) and \(q\) is immaterial from the point of view of the outer algorithm because the exact line search absorbs it. For numerical stability it is advisable to renormalize the factors after each substep.

\begin{proposition}[Well posedness of ALS substeps]
If \(q\neq 0\) then the operator that defines \eqref{eq:ALSx} is symmetric and coercive on \(X\). If \(p\neq 0\) then the operator that defines \eqref{eq:ALSy} is symmetric and coercive on \(Y\). In both cases a unique solution exists.
\end{proposition}

\begin{proof}
Consider \eqref{eq:ALSx}. For any \(p\in X\),
\[
\aform{p\otimes q}{p\otimes q} = a_x(p,p)\,m_y(q,q) + m_x(p,p)\,a_y(q,q).
\]
Since \(q\neq 0\), at least one of \(m_y(q,q)\) and \(a_y(q,q)\) is strictly positive. The forms \(a_x\) and \(m_x\) are symmetric and nonnegative, and the combination above controls \(\norm{p}_X^2\) by Assumption \ref{ass:contcoer}. Symmetry is evident. The argument for \eqref{eq:ALSy} is identical with the roles of \(x\) and \(y\) exchanged.
\end{proof}

The alternating process increases the Rayleigh quotient unless a stationary point has been reached. Indeed, for fixed \(q\), the solution of \eqref{eq:ALSx} maximizes \(\mathcal{R}_N(p\otimes q)\) over \(p\in X\setminus\{0\}\). For fixed \(p\), the solution of \eqref{eq:ALSy} maximizes \(\mathcal{R}_N(p\otimes q)\) over \(q\in Y\setminus\{0\}\). Therefore the sequence of values of \(\mathcal{R}_N\) along the inner iteration is nondecreasing. Any accumulation point is a stationary point of the constrained maximization of \(\mathcal{R}_N\) over \(\Mone\) with a normalization on one of the factors. In practice a few alternating steps suffice to obtain a value of \(\mathcal{R}_N\) that is within a fixed fraction of the maximum. This behavior is reflected in the parameter \(t\) of Assumption \ref{ass:weak}.

\section{Discretization, assembly, and complexity}
Two discretization strategies are described in full detail. The first relies on the identity \(\D^\alpha v=x^{1-\alpha} v'\) for absolutely continuous functions and uses weighted finite elements. The second constructs discrete conformable derivatives by shifted Gr\"unwald approximations and derives the energy from these discrete derivatives.

In the weighted finite element construction, choose conforming bases \(\{\phi_i\}_{i=1}^{n_x}\) and \(\{\psi_j\}_{j=1}^{n_y}\) for \(X\) and \(Y\). Define one dimensional matrices
\[
(A_x)_{ij} := \int_{\Ox} x^{2(1-\alpha_x)}\,\phi_i'(x)\,\phi_j'(x) \, dx, \qquad
(M_x)_{ij} := \int_{\Ox} \phi_i(x)\,\phi_j(x) \, dx,
\]
\[
(A_y)_{ij} := \int_{\Oy} y^{2(1-\alpha_y)}\,\psi_i'(y)\,\psi_j'(y) \, dy, \qquad
(M_y)_{ij} := \int_{\Oy} \psi_i(y)\,\psi_j(y) \, dy.
\]
Let \(p\in\R^{n_x}\) and \(q\in\R^{n_y}\) denote the coefficient vectors of a rank-one mode. By Lemma \ref{lem:rankoneenergy}, the discrete energy equals
\[
\mathcal{E}(p,q) = p^\top A_x p \cdot q^\top M_y q + p^\top M_x p \cdot q^\top A_y q.
\]
Let \(F\in\R^{n_x n_y}\) represent the load \(\ell\). For a current approximation \(u_N=\sum_{k=1}^N p_k\otimes q_k\), the discrete residual applied to a test mode equals
\[
\mathcal{R}_N(p,q) = F^\top (p\otimes q) - \sum_{k=1}^N \left( p_k^\top A_x p \cdot q_k^\top M_y q + p_k^\top M_x p \cdot q_k^\top A_y q \right).
\]
The alternating equations take the form
\[
\left( A_x\, (q^\top M_y q) + M_x\, (q^\top A_y q) \right) p = b_q, \qquad
\left( A_y\, (p^\top M_x p) + M_y\, (p^\top A_x p) \right) q = c_p,
\]
where \(b_q\) and \(c_p\) are vectors obtained by contracting the residual with rank-one tests. Both matrices are symmetric positive definite for \(q\neq 0\) and \(p\neq 0\). For boundary conditions, the homogeneous Dirichlet case is enforced by the choice of basis functions that vanish on the boundary. Quadrature must resolve the weights \(x^{2(1-\alpha_x)}\) and \(y^{2(1-\alpha_y)}\), which are singular near zero if \(\alpha_x<1\) or \(\alpha_y<1\). A mild grading of the mesh or a higher quadrature order near the singularity improves accuracy.

In the Gr\"unwald construction, uniform grids on \(\Ox\) and \(\Oy\) are introduced and shifted Gr\"unwald stencils approximate \(\D^{\alpha_x}\) and \(\D^{\alpha_y}\). This produces dense Toeplitz matrices \(G_{\alpha_x}\) and \(G_{\alpha_y}\). A discrete energy can be defined by \(A_x:=G_{\alpha_x}^\top G_{\alpha_x}\) and \(A_y:=G_{\alpha_y}^\top G_{\alpha_y}\) together with standard mass matrices \(M_x\) and \(M_y\). This energy is symmetric positive definite by construction. The alternating equations in this case have the same structure as in the finite element setting. Toeplitz structure allows fast matrix vector products through circulant embeddings. When combined with Krylov methods and simple diagonal preconditioners, the cost per inner solve is near \(O(n\log n)\) for one dimensional size \(n\). The outer cost is proportional to the number of ALS sweeps times the cost of these solves. The memory cost of storing \(N\) modes is \(O(N(n_x+n_y))\), which is significantly smaller than the \(O(n_x n_y)\) memory required by a full tensor grid.

For the exact line search, the scalar \(\tau_{N+1}\) is computed by a formula and does not involve any additional solve. The decrease in the energy is exactly \(\ip{r_N}{w_{N+1}}^2/\aform{w_{N+1}}{w_{N+1}}\), which is cheaply available at the end of the inner loop. This quantity provides a robust and scale invariant stopping criterion for the outer loop. One may stop when it falls below a prescribed fraction of the current energy, for instance when
\[
\frac{\ip{r_N}{w_{N+1}}^2}{\aform{w_{N+1}}{w_{N+1}}} \le \varepsilon^2\,\aform{u_N}{u_N},
\]
with a chosen tolerance \(\varepsilon\). The inner loop can be stopped when the relative improvement of the Rayleigh quotient between two alternating passes falls below a second tolerance. Orthogonalization of the new factors against previously computed ones in the \(M_x\) and \(M_y\) inner products improves numerical stability without changing the span of the rank-one modes. Simple diagonal preconditioning of \(A_x\) by the diagonal of \(M_x\) and of \(A_y\) by the diagonal of \(M_y\) often reduces the number of Krylov iterations.

\section{Two model problems}
The first example is a stationary fractional Poisson problem on the unit square. Let \(\Ox=\Oy=(0,1)\) and \(\alpha_x=\alpha_y=\alpha\). The unknown \(u\) solves \(\aform{u}{v}=\ell(v)\) for all \(v\in H\) with \(\ell(v)=\int_{(0,1)^2} f\,v\). The method begins with \(u_0=0\). At iteration \(N\), the alternating equations produce a pair \((p_{N+1},q_{N+1})\) that maximizes the Rayleigh quotient up to the parameter \(t\), and the exact line search produces \(\tau_{N+1}\). If the source \(f\) has a dominant separable component then the parameter \(\theta_N\) in \eqref{eq:thetaN} remains bounded below and the decay factor in Theorem \ref{thm:decay} is observed in practice. The assembly can use the weighted finite element construction with the identity \(\D^\alpha v=x^{1-\alpha} v'\) or the Gr\"unwald based construction with Toeplitz matrices. In both cases the discrete energy equals a sum of two one dimensional energies coupled by mass factors. This explicit decomposition explains the effectiveness of rank-one updates.

The second example treats a space time problem where time is an additional coordinate. Let \(\Ox=(0,1)\) and \(t\in(0,T)\). The time space is \(H_t:=H^1_0(0,T)\) with inner product \(\ip{u}{v}_{H_t}=\int_0^T (\partial_t u)(\partial_t v) + u v\,dt\). The energy is
\[
\aform{u}{v} = \int_0^T\!\!\int_0^1 \left( \partial_t u\,\partial_t v + \D^\alpha_x u\,\D^\alpha_x v \right)\,dx\,dt.
\]
The unknown is sought in \(H_t\tensor X\). The alternating equations decouple into a time solve and a space solve. Discretizations use matrices \(A_t,M_t\) for time and \(A_x,M_x\) for space. The discrete energy of a rank-one mode equals \(p^\top A_t p \cdot q^\top M_x q + p^\top M_t p \cdot q^\top A_x q\). The same analysis applies. The inner ALS converges rapidly to a stationary point. The outer greedy loop exhibits geometric decay provided the parameter \(\theta_N\) has a positive lower bound, which in this setting is related to how well the space time residual aligns with separable functions.

\section{Concluding discussion}
The PGD algorithm is variational. The greedy search is defined in the energy inner product, the residual is in the dual space, and the line search is exact. The contraction in Theorem~3.2 follows from a one line identity once the Rayleigh quotient \(\langle r,w\rangle^{2}/a(w,w)\) is used. The effect of restricting to rank one is quantified by \(\theta_\ast\), which measures how well rank one functions approximate the Riesz representer of the residual. The alternating least squares realization solves two symmetric coercive subproblems and is well posed. Energy respecting discretizations yield simple matrix forms. With fast Toeplitz solvers the cost scales linearly in the number of modes and nearly linearly in the one dimensional sizes.

Extensions fit the same framework. The greedy step may add several rank one terms and then compress with a truncated singular value decomposition in the energy inner product. Parameter coordinates can be included in the tensor space to treat parametric fractional models. Nonlinear problems can be handled by local linearization inside each greedy step with the residual updated accordingly. Rayleigh quotient based indicators provide quantitative guidance for adaptivity in the one dimensional spaces. These changes preserve the exact one step decrease identity and geometric decay under a uniform weak greedy bound.

\section*{Acknowledgements}
We thank the Simons Foundation and the Cornell arXiv team for supporting open discussion.

\begin{thebibliography}{9}

\bibitem{Nouy2010}
A.~Nouy.
\newblock Proper generalized decompositions and separated representations for the numerical solution of high-dimensional stochastic problems.
\newblock \emph{Arch. Comput. Methods Eng.}, 17(4):403--434, 2010.

\bibitem{Chinesta2011}
F.~Chinesta, A.~M.~S.~D\'{\i}ez, E.~Cueto, and A.~Leygue.
\newblock PGD-based computational vademecum for efficient design, optimization and control.
\newblock \emph{Arch. Comput. Methods Eng.}, 18(4):495--512, 2011.

\bibitem{Ryan2002}
R.~A.~Ryan.
\newblock \emph{Introduction to Tensor Products of Banach Spaces}.
\newblock Springer, 2002.

\bibitem{Khalil2014}
R.~Khalil, M.~Al Horani, A.~Yousef, and M.~Sababheh.
\newblock A new definition of fractional derivative.
\newblock \emph{J. Comput. Appl. Math.}, 264:65--70, 2014.

\end{thebibliography}

\end{document}