Notes - Dissertation, The polar decomposition
Flashcards
@State the polar decomposition theorem for a matrix $A \in \mathbb C^{m \times n}$.
There exists a matrix $U \in \mathbb C^{m \times n}$ and a unique Hermitian positive semi-definite matrix $H \in \mathbb C^{n \times n}$ such that
\[A = UH,\quad U^\ast U = I _ n\]and if $A$ is nonsingular, then $H$ is positive definite and $U$ is uniquely determined.
The polar decomposition of a matrix $A \in \mathbb R^{n \times n}$ is given by
\[A = UP\]
where $U$ is orthogonal and $P$ is positive semi-definite symmetric.
Can you give a geometric interpretation of such a decomposition?
It is a rotation or a reflection $U$, followed by a scaling along a set of $n$ orthogonal axes.
The polar decomposition theorem for a matrix $A \in \mathbb C^{m \times n}$ says there exists a matrix $U \in \mathbb C^{m \times n}$ and a unique Hermitian positive semi-definite matrix $H \in \mathbb C^{n \times n}$ such that
\[A = UH,\quad U^\ast U = I _ n\]
and if $A$ is nonsingular, then $H$ is positive definite and $U$ is uniquely determined.
@State a theorem describing a best approximation property for the unitary factor $U$, and describe a useful special case.
Let $A, B \in \mathbb C^{m \times n}$ and let $B^\ast A \in \mathbb C^{n \times n}$ have the polar decomposition
\[B^\ast A = UH\]then for any unitary $Z \in \mathbb C^{n \times n}$, we have
\[\vert \vert A - BU \vert \vert _ F \le \vert \vert A - BZ \vert \vert _ F \le \vert \vert A + BU \vert \vert _ F\]when $m = n$ and $B = I$, this simplifies to
\[\vert \vert A - U \vert \vert _ F \le \vert \vert A - Z \vert \vert _ F \le \vert \vert A + U \vert \vert _ F\]Hence the closest unitary matrix (as measured in the Frobenius norm) to $A$ is given by the unitary factor of the polar decomposition, and the furthest is $-U$.
Suppose we have the SVD of a matrix $A \in \mathbb C^{m \times n}$ given by
\[A = P \Sigma Q^\ast\]
where $P \in \mathbb C^{m \times m}$ and $Q \in \mathbb C^{n \times n}$ are unitary and $\Sigma = \text{diag}(\sigma _ 1, \ldots, \sigma _ n)$ where $\sigma _ 1 \ge \cdots \ge \sigma _ n \ge 0$, how may we compute the polar decomposition $A = UH$?
Partition $P = [\underbrace{P _ 1} _ {n} \mid \underbrace{P _ 2} _ {m -n}]$ where $P^\ast _ 1 = P _ 1 = I _ n$. Then $A$ has polar decomposition $A = UH$ where
\[\begin{aligned} U &= P _ 1 Q^\ast \\ H &= Q \Sigma Q^\ast \end{aligned}\]Suppose we have the polar decomposition $A = UH \in \mathbb C^{n \times n}$. How may we compute the SVD of $A$?
Find a spectral decomposition of $H = Q \Sigma Q^\ast$, then
\[A = (UQ)\Sigma Q^\ast\]Suppose we have the polar decomposition
\[A = UH \in \mathbb C^{n \times n}\]
How may we compute $H$ in terms of a matrix square root?
Suppose we have the polar decomposition
\[A = UH \in \mathbb C^{n \times n}\]
Can you state a relationship between the eigenvalues and singular values of $H$ and $A$?
Suppose we have the polar decomposition
\[A = UH \in \mathbb C^{n \times n}\]
Can you state a relationship between the condition numbers of $H$ and $A$?
Suppose we have the polar decomposition
\[A = UH \in \mathbb C^{n \times n}\]
Can you give a necessary and sufficient condition for $A$ to be normal?
The polar decomposition theorem for a matrix $A \in \mathbb C^{m \times n}$ says there exists a matrix $U \in \mathbb C^{m \times n}$ and a unique Hermitian positive semi-definite matrix $H \in \mathbb C^{n \times n}$ such that
\[A = UH,\quad U^\ast U = I _ n\]
and if $A$ is nonsingular, then $H$ is positive definite and $U$ is uniquely determined.
@State a theorem describing a best approximation property for the Hermitian polar factor $H$.
- $\frac 1 2 (A + H)$ is a best Hermitian positive semi-definite approximation to $A$ in the $2$-norm
- For any Hermitian positive semi-definite $X \in \mathbb C^{n \times n}$, we have $ \vert \vert A - H \vert \vert _ 2 \le 2 \vert \vert A - X \vert \vert _ 2$.
The polar decomposition theorem for a matrix $A \in \mathbb C^{m \times n}$ says there exists a matrix $U \in \mathbb C^{m \times n}$ and a unique Hermitian positive semi-definite matrix $H \in \mathbb C^{n \times n}$ such that
\[A = UH,\quad U^\ast U = I _ n\]
and if $A$ is nonsingular, then $H$ is positive definite and $U$ is uniquely determined.
@State a theorem giving perturbation bounds for these polar factors.
Suppose:
- $\varepsilon = \vert \vert \Delta A \vert \vert _ F / \vert \vert A \vert \vert _ F$
- $\kappa _ F(A) \epsilon < 1$
Then $A + \Delta A$ has the polar decomposition
\[A + \Delta A = (U + \Delta U)(H + \Delta H)\]where
\[\begin{aligned} &\frac{ \vert \vert \Delta H \vert \vert _ 2}{ \vert \vert H \vert \vert _ 2} \le \sqrt 2 \varepsilon + O(\varepsilon^2) \\ &\frac{ \vert \vert \Delta H \vert \vert _ 2}{ \vert \vert H \vert \vert _ 2} \le (1 + \sqrt 2) \kappa _ F(A)\varepsilon + O(\varepsilon^2) \end{aligned}\]Other notes
- Can be extended to rectangular matrices
- Taking the determinant of the decomposition gives the ordinary polar form of the determinant
- The $P$ factor is always unique even if $A$ is singular, denoted $P = (A^\ast A)^{1/2}$. If $A$ is nonsingular then uniqueness is implied just by inverting
- If the SVD of $A$ is $A = W \Sigma V^\ast$, then:
- $P = V \Sigma V^\ast$
- $U = WV^\ast$