A generalized eigenvector-eigenvalue identity from the viewpoint of exterior algebra
Extracted source text · arXiv 1912.06967
%Shmuel December 5-6, 2019
\documentclass[12pt]{amsart}
%\usepackage{showtags}
%\usepackage{showkeys}
%\usepackage[inline]{showlabels}
\usepackage{hyperref}
\usepackage{graphicx, enumerate, url}
%%\usepackage[margin=1in]{geometry}
\usepackage{amssymb, amsmath, amsthm}
%\usepackage{algorithm}
%\usepackage{algpseudocode}
\usepackage{color}
\usepackage{tikz}
%\usetikzlibrary{3d,calc}
%\usepackage{kbordermatrix, mathdots, stmaryrd}
%\usepackage{algcompatible}
%\usepackage{float}
\numberwithin{equation}{section}
%\numberwithin{algorithm}{section}
\theoremstyle{plain}
\newtheorem{theorem}{Theorem}[section]
\newtheorem{proposition}[theorem]{Proposition}
\newtheorem{lemma}[theorem]{Lemma}
\newtheorem{corollary}[theorem]{Corollary}
\newtheorem{conjecture}[theorem]{Conjecture}
\theoremstyle{definition}
\newtheorem{definition}[theorem]{Definition}
\newtheorem{example}[theorem]{Example}
\newtheorem{problem}[theorem]{Problem}
\newtheorem{question}[theorem]{Question}
\newtheorem{answer}[theorem]{Answer}
\newtheorem{assumption}[theorem]{Assumption}
\theoremstyle{remark}
\newtheorem{remark}[theorem]{Remark}
\let\O\undefined
\let\H\undefined
\let\S\undefined
\newcommand{\NN}{\mathbb{N}}
\DeclareMathOperator{\spa}{span}
\DeclareMathOperator{\O}{O}
\DeclareMathOperator{\E}{E}
\DeclareMathOperator{\tr}{tr}
\DeclareMathOperator{\diag}{diag}
\DeclareMathOperator{\rank}{rank}
\DeclareMathOperator{\sgn}{sgn}
\DeclareMathOperator{\GL}{GL}
\DeclareMathOperator{\SL}{SL}
%\DeclareMathOperator{\mathbf{V}}{V}
\DeclareMathOperator{\Id}{Id}
\DeclareMathOperator{\End}{End}
\DeclareMathOperator{\Aut}{Aut}
\DeclareMathOperator{\Seg}{Seg}
\DeclareMathOperator{\Det}{Det}
\DeclareMathOperator{\Sym}{Sym}
\DeclareMathOperator{\im}{im}
\DeclareMathOperator{\Gr}{Gr}
\DeclareMathOperator{\Graff}{Graff}
\DeclareMathOperator{\Stab}{Stab}
\DeclareMathOperator{\brank}{brank}
\DeclareMathOperator{\Hank}{Hank}
\DeclareMathOperator{\H}{H}
\DeclareMathOperator{\S}{S}
\DeclareMathOperator{\supp}{supp}
\DeclareMathOperator{\expdim}{exp.dim}
\DeclareMathOperator{\argmax}{arg\,max}
\DeclareMathOperator{\argmin}{arg\,min}
%\DeclareMathOperator{\text{im }}{range}
%\DeclareMathOperator{\null}{null}
\DeclareMathOperator{\adj}{adj}
\DeclareMathOperator{\spec}{spec}
\newcommand{\pos}{\textbf{Pos}}
\newcommand{\herm}{\textbf{Herm}}
%\newcommand{\supp}{\textbf{supp}}
%Shmuel's preamble--------------------
\newcommand{\N}{\mathbb{N}}
\newcommand{\C}{\mathbb{C}}
\newcommand{\R}{\mathbb{R}}
\newcommand{\s}{\mathbf{s}}
\newcommand{\g}{\mathbf{g}}
%\newcommand{\mathbf{x}}{\mathbf{x}}
\newcommand{\X}{\mathbf{X}}
\newcommand{\y}{\mathbf{y}}
\newcommand{\z}{\mathbf{z}}
%\newcommand{\mathbf{U}}{\mathbf{U}}
\newcommand{\W}{\mathbf{W}}
\newcommand{\cA}{\mathcal{A}}
\newcommand{\cB}{\mathcal{B}}
\newcommand{\cC}{\mathcal{C}}
\newcommand{\cH}{\mathcal{H}}
\newcommand{\cI}{\mathcal{I}}
\newcommand{\cR}{\mathcal{R}}
\newcommand{\cU}{\mathcal{U}}
\newcommand{\cV}{\mathcal{V}}
\newcommand{\cX}{\mathcal{X}}
\newcommand{\cY}{\mathcal{Y}}
\newcommand{\ba}{\mathbf{a}}
\newcommand{\bc}{\mathbf{c}}
\newcommand{\be}{\mathbf{e}}
\newcommand{\bg}{\mathbf{g}}
\newcommand{\bp}{\mathbf{p}}
\newcommand{\br}{\mathbf{r}}
\newcommand{\bw}{\mathbf{w}}
\newcommand{\bx}{\mathbf{x}}
\newcommand{\by}{\mathbf{y}}
\newcommand{\bz}{\mathbf{z}}
\newcommand{\rB}{\mathrm{B}}
\newcommand{\rC}{\mathrm{C}}
\newcommand{\rH}{\mathrm{H}}
\newcommand{\rI}{\mathrm{I}}
\newcommand{\rL}{\mathrm{L}}
\newcommand{\rS}{\mathrm{S}}
\newcommand{\0}{\mathbf{0}}
\newcommand{\1}{\mathbf{1}}
\newcommand{\trans}{^\top}
\newcommand{\lam}{\mbox{\boldmath{$\lambda$}}}
\newcommand{\bxi}{\mbox{\boldmath{$\mathbf{x}i$}}}
\newcommand{\et}{\mbox{\boldmath{$\eta$}}}
\newcommand{\bet}{\mbox{\boldmath{$\beta$}}}
%--------------------------------------
\newcommand{\red}[1]{\textcolor{red}{#1}}
\newcommand{\blue}[1]{\textcolor{blue}{#1}}
\begin{document}
\title{More on the eigenvectors-from-eigenvalues identity}
\author[M. Stawiska]{Ma{\l}gorzata~Stawiska}
\address{Mathematical Reviews, 416 Fourth Street, Ann Arbor, MI 48103-4816, USA} \email{stawiska@umich.edu}
\date{December 13, 2019}
\begin{abstract} Using the notion of a higher adjugate of a matrix, we generalize the eigenvector-eigenvalue formula surveyed in \cite{DPTZ} to arbitrary square matrices over $\mathbb{C}$ and their possibly multiple eigenvalues.
\end{abstract}
%
\maketitle
\noindent {\bf 2010 Mathematics Subject Classification.} 15A15, 15A24, 15A75
%
\noindent \emph{Keywords}: Matrices, characteristic polynomial, eigenvalues, eigenvectors, adjugates.
\maketitle
\noindent \emph{Dedication:} To the memory of Witold Kleiner (1929-2018), my linear algebra teacher.
\section{Introduction} \label{sec:intro}
Very recently the following relation between eigenvectors and eigenvalues of a Hermitian matrix (called ``the
eigenvector-eigenvalue identity'') gained attention:
\begin{theorem} (\cite{DPTZ})
If $A$ is an $n \times n$ Hermitian matrix with eigenvalues $\lambda_1(A),...,\lambda_n(A)$ and $i,j= 1,...,n$, then the $j$th component $v_{i,j}$ of a unit eigenvector $v_i$ associated to the eigenvalue $\lambda_i(A)$ is related to the eigenvalues $\lambda_1(M_j),...,\lambda_{n-1}(M_j)$ of the minor $M_j$ of $A$ formed by removing the $j$th row and column by the formula \[
|v_{i,j}|^2 \prod_{k=1;k \ne i}^n (\lambda_i(A)-\lambda_k(A)) =\prod_{k=1}^{n-1}(\lambda_i(A)-\lambda_k(M_j)).
\]
\end{theorem}
The survey paper (\cite{DPTZ}) presents several proofs and some generalizations of this identity, along with its many variants encountered in the modern literature, while also commenting on some sociology-of-science aspects of its jump in popularity. It should be pointed out that for symmetric matrices over $\mathbb{R}$ this formula was established already in 1834 by Carl Gustav Jacob Jacobi as formula 30 in his paper \cite{Jac34} (in the process of proving that every real quadratic form has an orthogonal diagonalization). In this note, dealing with one eigenvalue at a time, we prove an analogous formula for an arbitrary (not necessarily Hermitian or normal) square matrix over $\mathbb{C}$. Our approach works also for the case of an eigenvalue of multiplicity higher than one. The result is as follows:
\begin{theorem} Let $A$ be an $n \times n$ matrix over $\mathbf{C}$, $n \geq 1$, and let $\lambda$ be an eigenvalue of $A$. Assume that the geometric multiplicity $k$ of $\lambda$ equals its algebraic multiplicity, $1 \leq k \leq n-1$. Let $\mathbf{v}_1, ...,\mathbf{v}_k$ be a basis of eigenvectors for $\text{ker }(A - \lambda I)$ and let $\mathbf{w}_1,...,\mathbf{w}_k \in \text{ker } (A- \lambda I)^*$ be such that $\mathbf{w}_i(\mathbf{v}_j) =\delta_{ij}, \ i,j=1,...,k$. Then
\[
\frac{(-1)^kP^{(k)}(\lambda)}{k!}\mathbf{v}\mathbf{w}^T=\text{adj}_k(A - \lambda I),
\]
where $\mathbf{v}=\mathbf{v}_1 \wedge ...\wedge \mathbf{v}_k, \ \mathbf{w}=\mathbf{w}_1 \wedge...\wedge \mathbf{w}_k$, $P$ is the characteristic polynomial of $A$ and $\text{adj}_k(A
- \lambda I)$ is the $k$th adjugate matrix of $\red{(}A-\lambda I)$.
\end{theorem}
The analogy with the
the identity in \cite{DPTZ} for the eigenvectors of a Hermitian matrix $A$ can be easily seen: if we fix an $i \in \{1,...,n\}$ and take $\lambda=\lambda_i$, then the product of differences of eigenvalues of $A$ on the left-hand side is the derivative of the characteristic polynomial of $A$ evaluated at $\lambda=\lambda_i$. Recall that for a Hermitian matrix the left eigenvector can be chosen to be the complex conjugate of the right eigenvector: $\mathbf{w}=\overline{ \mathbf{u}}$. The expression on the right-hand side involving eigenvalues of the minor $M_j$ is the characteristic polynomial of the matrix $M_j$ evaluated at $\lambda_i$, that is, an entry of the adjugate matrix of $A-\lambda_iI$.
We use the (general) relation between the derivative of a determinant and the trace of the corresponding adjugate matrix, which is also due to Jacobi (\cite{Jac41}). Our method is first to prove the identity for $k=1$ and then use this case to prove the general one. All notions and facts used in our proof will be recalled (in some cases, proved) below. In general, we refer the reader to \cite{BGW}, \cite{DA}, \cite{DSM}, \cite[Chapter 5]{Fribook}, and \cite{Pri}.
\section{Preliminaries} \label{sec:prelim}
\subsection{Vectors, linear transformations and matrices}
Throughout, $\mathbb{K}$ will denote the field of either real or complex numbers. For finite-dimensional vector spaces $\mathbf{V},\mathbf{U}$ over $\mathbb{K}$ denote by $\rL(\mathbf{V},\mathbf{U})$ the linear space of all linear transformations $T: \mathbf{V}\to\mathbf{U}$ over $\mathbb{K}$. For $\mathbf{V}=\mathbf{U}$ let $\rL(\mathbf{V}):=\rL(\mathbf{V},\mathbf{V})$. The dual space of a vector space $\mathbf{V}$ over $\mathbb{K}$ of finite dimension $n=\dim \mathbf{V}$ is $\mathbf{V}^*:=\rL(\mathbf{V},\mathbb{K})$. Let $\mathbf{b}_1,\ldots,\mathbf{b}_n\in\mathbf{V}$ be a basis in $\mathbf{V}$. Then the dual basis $\mathbf{b}_1^*,\ldots,\mathbf{b}_n^*\in\mathbf{V}^*$ is defined by the conditions $\mathbf{b}_i^*(\mathbf{b}_j)=\delta_{ij}$ for $i,j \in \{1,\ldots,n\}$. It is easily seen that $\mathbf{V}$ is isomorphic to $\mathbb{K}^n$, the vector space of column vectors $\mathbf{x}=(x_1,\ldots,x_n)\trans$. That is, the vector $\mathbf{v}=\sum_{i=1}^n b_i\mathbf{b}_i$ corresponds to the vector $\mathbf{b}=(b_1,\ldots, b_n)\trans\in\mathbb{K}^n$. The basis $\mathbf{b}_i,i\in\{1,...,n\}$ corresponds to the standard basis $\be_i=(\delta_{i1},\ldots,\delta_{in})\trans, i \in \{1,...,n\}$. $\mathbf{V}^*$ can also be identified with $\mathbb{K}^n$, where $\mathbf{b}_i^*$ corresponds to $\be_i$ for $i\in\{1,...,n\}$. Thus $\mathbf{u}^*(\mathbf{v})$ corresponds to $\mathbf{x}\trans \y$. \\
For $T \in \rL(\mathbf{V},\mathbf{U})$ let $T^*: \mathbf{U}^*\to \mathbf{V}^*$ be its dual transformation, acting as $(T^*(\mathbf{u}^*))(\mathbf{v})=\mathbf{u}^*(T(\mathbf{v}))$ for all $\mathbf{u}^* \in \mathbf{V}^*, \mathbf{v} \in \mathbf{V}$. Let $\text{im } T:=T(\mathbf{V}) \subset \mathbf{U}$ and $\ker T:=\{\mathbf{v}\in\mathbf{V}: T(\mathbf{v})=\0\}$.
Consider $T \in \rL(\mathbf{V})$. The fundamental theorem of linear algebra says that $ \ker(T) \simeq (\operatorname {im} (T^*))^{\perp }$ and
$ \ker(T^*) \simeq (\operatorname {im} (T))^{\perp }$. Here $X^\perp :=\{ \phi \in \mathbf{V}^*: \phi(X)=0\}$ and $(X')^\perp:=\{\mathbf{v} \in \mathbf{V}: \forall \ \phi \in X' \ \phi(\mathbf{v})=0\}$ for $X \subset \mathbf{V}, \ X' \subset \mathbf{V^*}$ (the second definition reduces to the first one if we canonically identify $\mathbf{V}$ with its double dual $\mathbf{V^{**}}$). \\
We will use the following easy result:
\begin{proposition} \label{prop: bases} (see \cite{Fribook}, Problem 5.1.2(e)) Let $\mathbf{U} \subset \mathbf{V}, \ \mathbf{W} \subset \mathbf{V}^*$ be two $m$-dimensional subspaces. TFAE: (i) $\mathbf{U} \cap \mathbf{W}^\perp =\{0\}$; (ii) $\mathbf{U}^\perp \cap \mathbf{W} =\{0\}$; (iii) There exist bases $\{u_1,...,u_m\}$, $\{f_1,...,f_m\}$ in $\mathbf{U}$ and $\mathbf{W}$, respectively, such that $f_j(u_i)=\delta_{ij}, \ i,j=1,...,m$.
\end{proposition}
Assume now that $\dim\mathbf{V}=n, \dim \mathbf{U}=m$. Fix bases $\{\mathbf{b}_1,\ldots,\mathbf{b}_n\}$
and $\{\ba_1,\ldots,\ba_m\}$ in $\mathbf{V}$ and $\mathbf{U}$ respectively.
Then $\rL(\mathbf{V},\mathbf{U})$ and $\rL(\mathbf{U}^*,\mathbf{V}^*)$ are isomorphic to $\mathbb{K}^{m\times n}$ and $\mathbb{K}^{n\times m}$ respectively. Further, $T \in \rL(\mathbf{V},\mathbf{U})$ is represented by a matrix $A \in \mathbb{K}^{m\times n}$ with entries $a_{ij} \in \mathbb{K}$ as $T(\mathbf{x})=A\mathbf{x}$, and $T^*\in \rL(\mathbf{U}^*,\mathbf{V}^*)$ is represented by $A\trans$.
The vector space of $m\times n$ matrices $A=[a_{ij}]$ with entries in $\mathbb{K}$ will be
denoted by $M_{m \times n}(\mathbb{K}) \simeq \mathbb{K}^{m\times n}$. By a $k \times k$ minor of a matrix $A \in M_{m \times n}(\mathbb{K})$ we mean the determinant of a $k \times k$ submatrix obtained from $A$ by deleting $m-k$ rows and $n - k$ columns. For an $A=[a_{ij}]\in\mathbb{K}^{n\times n}$ we define the trace of $A$ as $\tr A:=\sum_{i=1}^n a_{ii}$. \\
Denote by $\rank T$ and $\text{null } T$ the dimension of $\text{im} T$ and $\ker T$ respectively. The rank-nullity theorem says that $\dim \mathbf{V}=\rank T+\text{null } T$.
Recall that for a matrix $A\in\mathbb{K}^{m\times n}$ $\rank A=r$, viewed as the rank of the linear transformation induced by $A$, is equal to the size of the largest nonzero minor of $A$. Furthermore, there exists two sets of $r$ linearly independent vectors $\mathbf{v}_1,\ldots,\mathbf{v}_r\in\mathbb{K}^n$ and $\mathbf{u}_1,\ldots,\mathbf{u}_r\in\mathbb{K}^m$ such that $A=\sum_{i=1}^r \mathbf{u}_i\mathbf{v}_i\trans$. Clearly, if $A$ has the above rank decomposition then $A=\sum_{i=1}^r (t_i^{-1}\mathbf{u}_i)(t_i\mathbf{v}_i)\trans$
for $t_1,\ldots,t_r\in\mathbb{K}\setminus\{0\}$. For $r>1$ there are other rank $r$ decomposition of $A$. \\
Assume that $A\in\mathbb{K}^{n\times n}$ has $\rank A=1$. Then the decomposition $A=\mathbf{u} \mathbf{v}\trans\ne 0$ is unique up to scaling, $A=(t^{-1}\mathbf{u})(t\mathbf{v})\trans$, $t \in \mathbb{K}\setminus \{0\}$. Further, $\tr A=\mathbf{v}\trans \mathbf{u}$. If $\tr A\ne \0$, then the dual bases of $\text{im } A$ and $\text{im } A\trans$ can be chosen as $\mathbf{u}$ and $\frac{1}{\tr A} \mathbf{v}$.
%
\subsection{Compound and adjugate matrices}
Assume that $\mathbf{V}$ is an $n$-dimensional vector space over $\mathbb{K}$. For $k \in \{1,...,n\}$ denote by $\bigwedge ^k \mathbf{V}$ the $k$-wedge product space of $\mathbf{V}$. This is a space spanned by the $k$-wedge products $\mathbf{x}_1\wedge\cdots\wedge \mathbf{x}_k, \ \mathbf{x}_1,..., \mathbf{x}_k \in \mathbf{V}$. Choose a basis $\mathbf{b}_1,\ldots,\mathbf{b}_n$ in $\mathbf{V}$. Then this basis induces the basis in $\bigwedge^k \mathbf{V}$: $\{\mathbf{b}_{i_1}\wedge\cdots\wedge\mathbf{b}_{i_k}, 1\le i_1<\cdots<i_k\le n\}$. We arrange the elements of this basis in the lexicographical order.
In $\mathbb{K}^n$ we choose the standard basis $\{\be_1,\ldots,\be_n\}$. \\
Recall that $\dim \bigwedge^k \mathbf{V}={n\choose k}$. Thus $\bigwedge ^1 \mathbf{V}=\mathbf{V}$, and $\bigwedge ^{n} \mathbf{V}$ is a one-dimensional subspace (isomorphic to $\mathbb{K}$). Assume that $\mathbf{U}$ is an $m$-dimensional vector space.
Assume that $T\in\rL(\mathbf{V},\mathbf{U})$ and $ 1 \leq k \leq \min(m,n)$. Then $T$ induces a transformation $\bigwedge^k T\in\rL(\bigwedge^k\mathbf{V},\bigwedge^k\mathbf{U})$ which acts as follows: $\bigwedge^k T(\mathbf{x}_1\wedge\cdots\wedge\mathbf{x}_k)=(T\mathbf{x}_1)\wedge\cdots\wedge(T\mathbf{x}_k)$. It is also straightforward to show that $\bigwedge^k T^*=(\bigwedge^k T)^*$. \\
For $T\in\rL(\mathbf{V})$ we have $\left(\bigwedge ^{n}T\right)\left(\mathbf{v}_{1}\wedge \dots \wedge \mathbf{v}_{n}\right)=:\det(T)\cdot \mathbf{v}_{1}\wedge \dots \wedge \mathbf{v}_{n}$. If $T$ is represented by a matrix $A$, then the scalar $\det(T)$ is the same as the determinant of $A$ (independent of the choice of a basis). \\
Suppose $\mathbf{W}$ is an $l$-dimensional vector space over $\mathbb{K}$ and let $S\in \rL(\mathbf{W},\mathbf{V})$.
The $TS\in\rL(\mathbf{W},\mathbf{U})$. Furthermore for $1 \leq k \leq \min(l,m,n)$ we have the equality $\bigwedge^k (TS)=(\bigwedge^k T)( \bigwedge^k S)$.\\
Let $\mathbf{x}_1,\ldots,\mathbf{x}_k\in\mathbb{K}^n$. Then $\mathbf{x}_1\wedge\cdots\wedge\mathbf{x}_k\in \mathbb{K}^{n\choose k}$ is a vector which is obtained as follows: Let $X=[\mathbf{x}_1\cdots\mathbf{x}_n]\in\mathbb{K}^{n\times k}$ be the matrix whose columns are $\mathbf{x}_1,\ldots,\mathbf{x}_k$. Denote by $\mathbf{c}_k(X)$ the vector whose coordinates are (determinants of) all $k\times k$ minors of $X$, arranged in the lexicographical order. Then $\mathbf{x}_1\wedge\cdots\wedge\mathbf{x}_k=\mathbf{c}_k(X)\in \mathbb{K}^{n\choose k}$. The coordinates of $\mathbf{c}_k(X)$ are the Pl\"ucker coordinates of $\mathbf{x}_1\wedge\cdots\wedge\mathbf{x}_k$ (for more information, see e.g. \cite{GKZ}). Note that if $\mathbf{x}_1,\ldots,\mathbf{x}_k$ are linearly independent, then $\mathbf{x}_1\wedge\cdots\wedge\mathbf{x}_k$ is a basis in $\bigwedge^k \textrm{span}(\mathbf{x}_1,\ldots,\mathbf{x}_k)$.
It now follows that if $T\in\rL(\mathbf{V},\mathbf{U})$ is represented by $A\in\mathbb{K}^{m\times n}$ then $\wedge ^k T$ is represented by the $k$-th compound matrix $C_k(A)\in \mathbb{K}^{{m\choose k}\times {n\choose k}}$, whose entries are the $k\times k$ minors of $A$ arranged in the lexicographical order. Assume that $S\in\rL(\W,\mathbf{V})$ is represented by $B\in \mathbb{K}^{n\times l}$. Then the above arguments show that $C_k(AB)$ represents $\bigwedge^k (TS)$, and $C_k(AB)=C_k(A)C_k(B)$.
Furthermore,
$C_k(aA)=a^kC_k(A)$, and $C_k(I_n)=I_{n\choose k}$,
where $I_n\in\mathbb{K}^{n\times n}$ is the identity matrix. It is convenient to adopt the definition $C_0(A)=1 \in \mathbb{K}$ for an arbitrary $A \ne 0$.
Recall the definition of the adjugate of $A=[a_{ij}]$, denoted by $\adj A=[b_{ij}]\in\mathbb{K}^{n\times n}$. Then $b_{ij}$ is $(-1)^{i+j}$ times the $(n-1)$st minor of $A$ obtained by deleting the $j$-th row and $i$-th column of $A$. Let $\Delta_n\in\mathbb{K}^{n\times n}$ be the matrix whose $(i,j)$ entry is $(-1)^i \delta_{i(n-j+1)}$. (Note that $\Delta_n$ is an orthogonal matrix.) It is straightforward to show that $\adj A=\Delta_n C_{n-1}(A) \Delta_n\trans$. Recall the fundamental
identity $A \adj A=(\adj A) A=(\det A)I_n$. Hence if $\det A\ne 0$ it follows that $A^{-1}=(\det A)^{-1} \adj A$. Similarly we deduce $\adj AB=(\adj B) (\adj A)$.
More generally, for $1 \leq k \leq n-1$ one can introduce the $k$-th adjugate of $A$, denoted by $\textrm{adj}_k\; A\in \mathbb{K}^{{n\choose k}\times {n\choose k}}$, as follows (cf. \cite{Ai}, \cite{PFG}, \cite{Pri}):
The entry $(\{1\le i_1<\cdots<i_k\le n\}, \{1\le j_1<\cdots<j_k\le n\})$ is $(-1)^{\sum_{l=1}^k i_l+j_l}$ times the $k$-minor of $A$ obtained from $A$ by deleting rows $i_1,\ldots,i_k$ and colums $j_1,\ldots,j_k$. It is straightforward to show that that $\textrm{adj}_k\; A=C_k(\Delta_n) C_{n-k}(A) C_k(\Delta_n)\trans$.
Note that $\adj A=\textrm{adj}_1\; A$.
We have the following identities:
\begin{eqnarray*}
C_k(A)\textrm{adj}_k\; A=(\textrm{adj}_k\; A)C_k(A)=(\det A) I_{n\choose k}.
\end{eqnarray*}
Hence
\[
C_k(A)\textrm{adj}_k\; A=(\textrm{adj}_k\; A)C_k(A)=(\det A)^k I_{n\choose k},
\]
\[
\textrm{adj}_k\; (AB)=(\textrm{adj}_k\; B) (\textrm{adj}_k\; A).
\]
Compounds and adjugates occur in the following important determinantal formula, which was proved in \cite{PFG}.
\begin{proposition}\label{prop: detsum} (Theorem 4.1, \cite{PFG}) Let $A,B \in \mathbb{K}^{n \times n}$ be arbitrary. Then
\[
\det (A+B) =\sum_{k=0}^n \tr (\text{adj}_k A \; C_k(B)).
\]
\end{proposition}
The following lemma is straightforward, but we present its proof for completeness:
\begin{lemma}\label{lemma: baskerlem} Let $A\in\mathbb{K}^{n\times n}$ and assume that $\rank A=n-k$ for some $ 1 \leq k\leq n-1$. Then for an integer $j\in \{1,..,n-1\}$ the following conditions hold:
\begin{enumerate}
\item If $j<k$, then $\textrm{adj}_j\; A=0$.
\item If $j\ge k$, then $\rank \textrm{adj}_j\; A={n-k\choose n-j}$. In particular, $\rank \textrm{adj}_k\; A=1$.
\end{enumerate}
\end{lemma}
\begin{proof}
(1) Since $\rank A=n-k$ all $n-j$ minors of $A$ are zero for $j<k$. Hence $\textrm{adj}_j\; A=0$.
\noindent
(2) As $\textrm{adj}_j\; A=C_j(\Delta_n) C_{n-j}(A) C_k(\Delta_n)\trans$ it follows that $\rank \textrm{adj}_k\; A=\rank C_{n-j}(A)$. Let $\mathbf{V}$ be the column space of $A$. Hence $\dim\mathbf{V}=n-k$.
Assume that $j\ge k$. Then the columns of $C_{n-j}(A)$ span $\bigwedge^{n-j} \mathbf{V}$, whose dimension is $n-k \choose n-j$. Hence $\rank C_{n-j}(A)={n-k\choose n-j}$.
\end{proof}
\section{Eigenvectors from eigenvalues}
Let $A\in\mathbb{K}^{n\times n}$. A vector $\mathbf{x}\ne \0$ is an eigenvector of $A\trans$ if and only if $A\trans \mathbf{x}=\lambda\mathbf{x}$ if and only if $\mathbf{x}\trans A=\lambda\mathbf{x}\trans$ for some $\lambda \in \mathbb{K}$. The scalar $\lambda$ is then called an eigenvalue of $A$. In the literature sometimes the eigenvectors of $A\trans$ are call the left eigenvectors of $A$, while the eigenvectors of $A$ are also referred to as the right eigenvectors of $A$. Note that $\lambda$ is an eigenvalue of $A$ if and only if $\rank (A -\lambda I_n )<n$.
The characteristic polynomial of $A$ is $P(\lambda)=P_A(\lambda):=\det (A -\lambda I_n ) \in \mathbb{K}[\lambda]$ (we identify the polynomial function with an underlying polynomial). From Proposition \ref{prop: detsum} and smoothness of polynomials we get the following:
\begin{corollary} \label{cor: diff} Fix an arbitrary $A \in M_{n \times n}(\mathbb{K}$. Then
(i) $P (\lambda) =\det (A -\lambda I)= \sum_{k=0}^n (-\lambda)^k\tr (\text{adj}_k A)$;\\
(ii) $P^{(j)}(\lambda)= (-1)^jj! \tr (\text{adj}_j (A-\lambda I))$, $j=1,...,n$.
\end{corollary}
Part (ii) is a useful generalization of the the well known Jacobi formula
$\det((A -\lambda I_n ))'=\tr \adj (A -\lambda I_n )$.
For $A \in \mathbb{K}^{n \times n}$ with $\mathbb{K} \in \{\mathbb{R}, \mathbb{C}\}$ the characteristic polynomial $\det (A -\lambda I_n )$ of $A$ splits in $\mathbb{C}$: $\det (A -\lambda I_n )=\prod_{i=1}^n (\lambda-\lambda_i)$, where $\lambda_i\in \mathbb{C}$ for $i=1,...,n$. If $\{\mu_1,\ldots,\mu_l\}$ is the set of distinct eigenvalues of $A$ (called the spectrum of $A$), then $\det(\lambda I_n-A)=\prod_{j=1}^l (\lambda-\mu_j)^{n_j}$ with $\sum_{j=1}^l n_j=n$. The number $n_j$ is called the algebraic multiplicity of $\mu_j$. The geometric multiplicity of $\mu_j$ is $\text{null }(A-\mu_j I)$. Recall that $1\le \text{null}(A-\mu_j I)\le n_j$. The eigenvalue $\mu_j$ is called simple, (or algebraically simple), if $n_j=1$, and geometrically simple if $\text{null }(A-\mu_j I=1$. As $\det (A -\lambda I_n )=\det (A\trans -\lambda I)$ we see that the spectrum of $A\trans$ is the same as the spectrum of $A$, and moreover the respective algebraic and geometric multiplicities of $\mu_j$ are the same for $A$ and $A\trans$.
%For simplicity of notation we assume that $\hat{\mathbb{K}}=\mathbb{K}$.
Let $\mathbf{U}(\lambda), \mathbf{V}(\lambda)\subset \mathbb{K}^n$ be the subspaces spanned by the right and the left eigenvectors of $A$ corresponding to the eigenvalue $\lambda$. From Corollary \ref{cor: diff} it follows that $\lambda$ is a simple eigenvalue if and only if $\tr \adj A(\lambda)\ne 0$.
%
Now we are ready to prove the eigenvectors-from-eigenvalues formula:
\begin{theorem} \label{thm: EEformula} Let $A$ be an $n \times n$ matrix over $\mathbf{C}$, $n \geq 1$, and let $\lambda$ be an eigenvalue of $A$. Assume that the geometric multiplicity $k$ of $\lambda$ equals its algebraic multiplicity, $1 \leq k \leq n$. Let $\mathbf{v}_1, ...,\mathbf{v}_k$ be a basis of eigenvectors for $\text{ker }(A - \lambda I)$ and let $\mathbf{w}_1,...,\mathbf{w}_k \in \text{ker } (A- \lambda I)^*$ be such that $\mathbf{w}_i(\mathbf{v}_j) =\delta_{ij}, \ i,j=1,...,k$. Then
\[
\frac{(-1)^kP^{(k)}(\lambda)}{k!}\mathbf{v}\mathbf{w}^T=\text{adj}_k(A - \lambda I),
\]
where $\mathbf{v}=\mathbf{v}_1 \wedge ...\wedge \mathbf{v}_k, \ \mathbf{w}=\mathbf{w}_1 \wedge...\wedge \mathbf{w}_k$, $P$ is the characteristic polynomial of $A$ and $\text{adj}_k(A
- \lambda I)$ is the $k$th adjugate matrix of $A-\lambda I)$.
\end{theorem}
\begin{proof}
Assume initially that $\lambda \in \mathbb{C}$ is an eigenvalue of $A$ of geometric multiplicity $1$.
By nullity-rank theorem, $\text{rank}(A-\lambda I)=n-1$, and so $\text{rank } \text{adj}(A-\lambda I)=1$. This implies that $\text{adj}(A-\lambda I)=\mathbf{v} \mathbf{u}^T$ with $\mathbf{v}, \mathbf{u} \in \mathbb{C}^n \setminus \{0\}$. Since $(A-\lambda I)(\text{adj}(A-\lambda I))=\det(A-\lambda I)I$ , we have $0\cdot I=(A-\lambda I)(\text{adj}(A-\lambda I))=((A-\lambda I)\mathbf{v})\mathbf{u}^T$. Hence $(A-\lambda I)\mathbf{v}=0$. Similarly, $\mathbf{v}\mathbf{u}^T(A-\lambda I)=0\cdot I$, so $\mathbf{u}$ is an eigenvector of $A^T$ corresponding to the eigenvalue $\lambda$. Note that $\dim \text{ker} (A-\lambda I)^T=n-(n-1)=1$. We have $\text{ker} (A -\lambda I)^T= im (A-\lambda I)$. By Proposition \ref{prop: bases}, if $\text{ker} (A -\lambda I)^T\cap \text{im} (A-\lambda I) = \{0\}$, there exists a unique $\mathbf{w} \in \mathbb{C}^n\setminus \{0\}$ such that $A^T\mathbf{w}=\lambda \mathbf{w}$, $\mathbf{w}^T\mathbf{v}=1$. We then have $c\mathbf{w}^T=\mathbf{u}^T$
with $0 \ne c$ and $c = c\mathbf{w}^T\mathbf{v}=\mathbf{u}^T\mathbf{v}= \text{tr }\text{adj}(A-\lambda I)$. Hence $\text{adj}(A-\lambda I)=\mathbf{v}\mathbf{u}^T=\text{tr }\text{adj}(A-\lambda I)\mathbf{v}\mathbf{w}^T$. By Corollary \ref{cor: diff}, $\text{tr }\text{adj}(A-\lambda I)=(-1)^nP'(\lambda)$, where $P(t)=\det (A-tI)$. Note that the condition $\text{ker} (A -\lambda I)^T\cap \text{im} (A-\lambda I) = \{0\}$ implies that there is no generalized eigenvector (for definition, see e.g. \cite{PO}, Definition 11.4) associated to $\lambda$ as an eigenvalue of $A$, and so the algebraic multiplicity of $\lambda$ is also $1$.\\
Assume now that $\lambda$ is an eigenvalue of $A$ with geometric multiplicity $k \geq 1$. We can reduce this case to the previous one, by the use of multilinear algebra, as follows: \\
Recall that $\text{rank}(\text{adj}_k(B)) = \text{rank}(C_{n-k}(B))$. Further, $\text{rank}(C_{n-k}(B))$ equals $1$ if $\text{rank}(B) = n - k$. As above, we can represent $\text{adj}_k(A - \lambda I)$ as $\text{adj}_k(A - \lambda I_n) = \mathbf{x}{\mathbf{y}}^T$, where $\mathbf{x}$ and $\mathbf{y}$ are vectors in $\mathbb{K}^{\binom {n}{r}} \setminus \{0\}$. From the relation between the compound and adjugate matrix it follows that $C_k(A - \lambda I) \mathbf{x} = 0$ and $C_k(A -\lambda I)^T \mathbf{y} = 0$. Let now $\mathbf{v}_1, ...,\mathbf{v}_k$ be a basis of eigenvectors for $\text{ker }(A - \lambda I)$. Then $\mathbf{v}_1 \wedge ...\wedge \mathbf{v}_k$ is an eigenvector for $C_k (A)$ corresponding to the eigenvalue $\lambda^k$, which has geometric multiplicity $1$ (see \cite{BGW}, \cite{DSM} about eigenvalues of compound matrices).
We can take $\mathbf{v}=\mathbf{v}_1 \wedge ...\wedge \mathbf{v}_k$ as a basis for $\text{ker} C_k(A-\lambda I)$, so $\mathbf{x}=\alpha \mathbf{v}, \ \alpha \ne 0$. Let $\mathbf{u}:=(1/\alpha)\mathbf{y}$. Then $\text{adj}_k(A-\lambda I) = \mathbf{v}{\mathbf{u}}^T$. If the algebraic multiplicity of $\lambda$ as the eigenvalue of $A$ is also $k$, there exist $\mathbf{w}_1,...,\mathbf{w}_k \in \text{ker } (A- \lambda I)^*$ such that $\mathbf{w}_i(\mathbf{v}_j) =\delta_{ij}, \ i,j=1,...,k$ Taking $\mathbf{w}=\mathbf{w}_1 \wedge...\wedge \mathbf{w}_k$ we get $\mathbf{w} \in \mathbb{K}^{\binom {n}{r}}\setminus \{0\}$ such that $C_k(A - \lambda I)^T\mathbf{w}=0$, $\mathbf{w}^T\mathbf{v}=1$. We then have $c\mathbf{w}^T=\mathbf{u}^T$
with $0 \ne c$ and $c = c\mathbf{w}^T\mathbf{v}=\mathbf{u}^T\mathbf{v}= \text{tr }\text{adj}_k(A
- \lambda I)$. Hence $\text{adj}_k(A - \lambda I)=\mathbf{v}\mathbf{u}^T=\text{tr }\text{adj}_k(A - \lambda I)\mathbf{v}\mathbf{w}^T=\frac{(-1)^kP^{(k)}(\lambda)}{j!}\mathbf{v}\mathbf{w}^T$.
\end{proof}
Note that instead of using the information on eigenvalues of compound matrices we could apply the following proposition:
\begin{proposition} \label{lemma: wedges} Let $A\in\mathbb{K}^{n\times n}$ and assume that $\rank A=n-k$ for some $ 1 \leq k\leq n-1$. Then $\textrm{adj}_k\; A=\mathbf{u}\mathbf{v}\trans,\mathbf{u},\mathbf{v}\in\mathbb{K}^{n \choose k}\setminus\{\0\}$, and $\mathbf{u}$ and $\mathbf{v}$ is are bases in $\bigwedge^k \ker A$ and $\bigwedge^k \ker A\trans$ respectively.
\end{proposition}
\begin{proof}
Let $B\in\mathbb{K}^{n\times n}$ be the diagonal matrix whose first $n-k$ diagonal entries are $1$ and the remaining diagonal entries are zero. So $\rank B=n-k$. Clearly, $\ker B$ is spanned by $\be_{n-k+1},\ldots,\be_n$. Hence $\mathbf{u}=\be_{n-k+1}\wedge\cdots\wedge\be_n$ is a basis in $\bigwedge \ker B$. As $B\trans=B$ it follows that $\mathbf{v}=\be_{n-k+1}\wedge\cdots\wedge\be_n$ is a basis in $\bigwedge \ker B\trans$. A straightforward calculation shows that $ \textrm{adj}_k\; B=\mathbf{u}\mathbf{v}\trans$. Hence the claim of the lemma holds for $B$.
If $\rank A=n-k$, then $A=PBQ$ with two invertible $P,Q\in\mathbb{K}^{n\times n}$. Hence
\begin{eqnarray*}
&&\ker A= Q^{-1}\ker B,\quad\bigwedge^k \ker A=C_k(Q^{-1}) \bigwedge^k \ker B, \\
&&\ker A\trans= (P\trans)^{-1}\ker B,\quad\bigwedge^k \ker A\trans=C_k((P\trans)^{-1}) \bigwedge^k \ker B.
\end{eqnarray*}
Next recall
\begin{eqnarray*}
\textrm{adj}_k\; A=(\textrm{adj}_k\; Q)(\textrm{adj}_k\; B)\textrm{adj}_k\; P=((\det Q\det P)^{-1} C_k(Q^{-1})\mathbf{u}\mathbf{u}\trans C_k(P^{-1}).
\end{eqnarray*}
This establishes the claim for $A$.
\end{proof}
Note also that the proof of Theorem \ref{thm: EEformula} can be adapted (with the aid of Lemma \ref{lemma: baskerlem}) to establish the following corollary, which can be useful in its own right. Unlike Theorem \ref{thm: EEformula}, this corollary does not require any assumption on the algebraic multiplicity of the eigenvalue in question.
\begin{corollary}\label{cor: multi}
(a) Let $A\in\mathbb{K}^{n\times n}$ and assume that $\lambda\in\mathbb{K}$ is an eigenvalue of $A$. Then $\lambda$ is geometrically simple if and only if $\adj (A -\lambda I_n )\ne 0$.\\
(b) More generally, let $A\in\mathbb{K}^{n\times n}$ and assume that $\lambda\in\mathbb{K}$ is an eigenvalue of $A$.
Then
\begin{enumerate}
\item the geometric multiplicity of $\lambda$ is $n$ if and only if $A=\lambda I_n$;
\item the geometric multiplicity of $\lambda$ is $k\in\{1,...,n-1\}$ if and only if $\rank \textrm{adj}_k\; (A -\lambda I_n )=1$.
\end{enumerate}
\end{corollary}
%\begin{proof}
%Assume that $\adj (A -\lambda I_n )\ne 0$. Then, by Lemma \ref{lemma: baskerlem}, $\text{rank }\adj (A -\lambda I_n )=1$, and so $\adj (A -\lambda I_n )=\mathbf{u}\mathbf{v}\trans$, where $\mathbf{u}$ and $\mathbf{v}$ are the right and the left eigenvectors of $A$ corresponding to $\lambda$. Furthermore, $\mathbf{v}\trans\mathbf{u}\ne \0$ if and only if $\lambda$ is algebraically simple.
%\end{proof}
%\begin{proof} In the first part, the condition that the geometric multiplicity of $\lambda$ equals $n$ holds if and only if $\text{rank }(A-\lambda I_n)=0$, which proves the claim.
%Assume now that the geometric multiplicity of $\lambda$ is $k \in \{1,..., n-1\}$. Then, by Lemmas \ref{lemma: baskerlem} and \ref{lemma: wedges} $\textrm{adj}_k\; (A -\lambda I_n )=\mathbf{u}\mathbf{v}\trans$, where $\mathbf{u},\mathbf{v}\in \mathbb{K}^{n\choose k}\setminus\{\0\}$. Furthermore $\mathbf{u}$ and $\mathbf{v}$ are bases in $\bigwedge^k\mathbf{U}$ and $\bigwedge^k\mathbf{V}$ respectively. Note that $\bigwedge^k\mathbf{U}=\text{ker}(C_k(A)-\lambda^k I)$ and $\bigwedge^k\mathbf{V}=\text{ker} (C_k(A)-\lambda^k I)^T$.
%Arguing as in the simple eigenvalue case we deduce that the geometric and algebraic multiplicity of $\lambda$ are equal.
%\end{proof}
We will not repeat the details.
\section{The case of normal matrices}
Recall that $A\in\C^{n\times n}$ is called normal if $A^*A=AA^*$. A normal matrix $A$ can be diagonalized by a unitary matrix $U\in\C^{n\times n}$: $C=U\Lambda U^*$, where $\Lambda$ is a diagonal matrix whose diagonal entries are the eigenvalues of $A$.
Thus if $\mathbf{x}$ is the right eigenvector of $A$ then $\bar{\mathbf{x}}$ is the left eigenvector of $A$.
Thus if $\lambda$ is an eigenvalue of algebraic multiplicity $k\in {1,...,n-1}$ we obtain the formula for $\mathbf{u}\mathbf{u}^*$ in terms of $\textrm{adj}_k\;(A -\lambda I_n )$ as in \cite{DPTZ}. \\
\textbf{Acknowledgments:} I thank Shmuel Friedland for valuable discussions on various topics in linear and multilinear algebra.
%Let $B$ be an $n \times n$ matrix, and fix $0 \leq r \leq n$. The $r$th higher adjugate of $B$ is an ${\binom {n}{r}}\times {\binom {n}{r}}$ matrix, denoted ${\text {adj}_r} B$, whose entries are indexed by size $r$ subsets $I$ and $J$ of $\{1, ..., n\}$. Let $I^c$ and $J^c$ denote the complements of $I$ and $J$, respectively. Also let $A_{I^c , J^c}$ denote the submatrix of $B$ containing those rows and columns whose indices are in $I^c$ and $J^c$, respectively. Then the $(I, J)$ entry of ${\text {adj}_r} B$ is $(-1)^{\sigma (I)+\sigma (J)}\det {B} _{J^{c},I^{c}}$, where $\sigma(I)$ and $\sigma(J)$ are the sums of the elements of $I$ and $J$, respectively.
%Suppose now $\lambda$ is an eigenvalue of $A \in M_{n \times n}$ of geometric multiplicity $1 \leq r \leq n$. With the use of multilinear algebra, this case reduces to that of $r=1$. We first prove the following:
% \begin{theorem} (NOT FROM WIKI!): If $\text{null} (A-\lambda I) =r$, then $rank(adj_r(A)) = 1$.
% \end{theorem}
% \begin{proof} Let $S$ denote the sign matrix:
% $S=\operatorname {diag} (1,-1,1,-1,\ldots ,(-1)^{n-1})$,
%and let $J$ denote the exchange matrix:
% $J={\begin{pmatrix}&&1\\&\cdots &\\1&&\end{pmatrix}}$.
%Then Jacobi's theorem states that the $r$th higher adjugate matrix is: $\operatorname {adj} _{r}(A)=JC_{n-r}(SAS)^{T}J$
\bibliographystyle{plain}
\begin{thebibliography}{MMM}
\bibitem{Ai} Aitken, A. C.: \emph{Determinants and matrices.} Edinburgh, Oliver and Boyd; New York, Interscience Publishers, 1956.. vii, 144 pp.
\bibitem{BGW} D.L. Boutin; R.F. Gleeson; R.M. Williams: \emph{Wedge Theory / Compound Matrices: Properties and Applications (Technical report).} Office of Naval Research. NAWCADPAX–96-220-TR.(1996). \url{https://apps.dtic.mil/dtic/tr/fulltext/u2/a320264.pdf}
\bibitem{DA} Luz M. DeAlba, \emph{Determinants and eigenvalues}, pages 4-1--4-11 in \cite{hand}.
\bibitem{DPTZ} Peter B. Denton, Stephen J. Parke, Terence Tao, Xining Zhang, \emph{Eigenvectors from Eigenvalues: a survey of a basic identity in linear algebra}, arXiv:1908.03795.
\bibitem{DSM} Jos\'e A. Dias da Silva and Armando Machado, \emph{Multilinear algebra}, pages 13-1--13-26 in \cite{hand}.
\bibitem{Fribook} S. Friedland, \emph{Matrices-- Algebra, Analysis and Applications}, World Scientific Publishing Co. Pte. Ltd., Hackensack, NJ, 2016. xii+582 pp. ISBN: 978-981-4667-96-8 \url{http://www2.math.uic.edu/~friedlan/bookm.pdf}
%\bibitem{Gan} F.R. Gantmacher, \emph{The Theory of Matrices}, Vol. 1, Translated by K. A. Hirsch. Chelsea Publishing Co., New York 1959 x+374 pp.
\bibitem{GKZ} I. M. Gelfand,
M. M. Kapranov, and A. V. Zelevinsky: \emph{Discriminants, resultants and multidimensional determinants},
Birkh\"auser, Boston, 1994, vii + 523 pp.,
ISBN 0 817 63660 9
\bibitem{hand} \emph{Handbook of linear algebra.}
Edited by Leslie Hogben. Associate editors: Richard Brualdi, Anne Greenbaum and Roy Mathias. Discrete Mathematics and its Applications (Boca Raton). Chapman \& Hall/CRC, Boca Raton, FL, 2007. xxx+1370 pp. ISBN: 978-1-58488-510-8; 1-58488-510-6
\bibitem{Jac34} C. G. J. Jacobi, De binis quibuslibet functionibus homogeneis secundi ordinis per substitutiones lineares in alias binas tranformandis, quae solis quadratis variabilium constant; una cum variis theorematis de transformatione et determinatione integralium multiplicium. \emph{Journal f\"ur die reine und angewandte Mathematik} 12 (1834), 1-69.
\bibitem{Jac41} C. G. J. Jacobi, De formatione et proprietatibus Determinantium.\emph{ Journal f\"ur die reine und angewandte Mathematik} 1841 (22): 285-318.
\bibitem{PO} Robert Piziak, P.L. Odell: \emph{Matrix Theory: From Generalized Inverses to Jordan Form.}
Chapman \& Hall/CRC Pure and Applied Mathematics, CRC Press, 2007, 568 pp., ISBN 1420009931, 9781420009934
\bibitem{PFG} Prells, Uwe; Friswell, Michael I.; Garvey, Seamus D.: Use of geometric algebra: compound matrices and the determinant of the sum of two matrices. \emph{Proceedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences.} 459 (2003): 273-285.
\bibitem{Pri} G. B. Price, Some Identities in the Theory of Determinants. \emph{The American Mathematical Monthly.} 54 (2 ) (1947): 75-90. doi:10.2307/2304856.
%\bibitem{Wik} Adjugate matrix, Wikipedia, https://en.wikipedia.org/wiki/Adjugate$_-$matrix
\end{thebibliography}
\end{document}