Matrix Decomposition and Factorization

Questions requiring spectral decomposition, SVD-like factorizations, or expressing a matrix as a product of structured factors (e.g., UΛU^T, orthogonal projections from factorizations).

grandes-ecoles 2011 QIV.B.6 View
We consider four points $U_1, U_2, U_3, U_4$ in $\mathbb{R}^3$ satisfying $U_1U_2 = U_2U_3 = U_3U_4 = U_4U_1 = 1$, $U_1U_3 = a$ and $U_2U_4 = b$. We set $\Psi(M) = -\frac{1}{2}\Phi(M)$.
Conversely, if $a^2 + b^2 \leqslant 4$, give a family of points $U_1, U_2, U_3$ and $U_4$ satisfying the mutual distance constraints.
grandes-ecoles 2011 QV.A.1 View
We consider a matrix $M = (m_{ij}) \in \mathcal{S}_n(\mathbb{R})$ such that for every $(i,j) \in \llbracket 1,n\rrbracket^2$, $m_{ij} \geqslant 0$ and $m_{ii} = 0$. We assume that $\Psi(M)$ has at least one strictly negative eigenvalue.
We seek to prove that there exists a unique symmetric matrix $T_0$ with non-negative eigenvalues that minimizes $\|\Psi(M) - T\|_{\mathcal{M}_n(\mathbb{R})}$ when $T$ ranges over $\mathcal{S}_n^+(\mathbb{R})$.
a) Show that $$\forall Q \in \mathcal{O}_n(\mathbb{R}), \forall A \in \mathcal{M}_n(\mathbb{R}), \quad \|{}^t QAQ\|_{\mathcal{M}_n(\mathbb{R})} = \|A\|_{\mathcal{M}_n(\mathbb{R})}$$
b) Justify the existence of a matrix $Q_0 \in \mathcal{O}_n(\mathbb{R})$ such that the matrix ${}^t Q_0 \Psi(M) Q_0$ is diagonal.
c) Show that a necessary condition for $\|\Psi(M) - T_0\|_{\mathcal{M}_n(\mathbb{R})}$ to minimize $\|\Psi(M) - T\|_{\mathcal{M}_n(\mathbb{R})}$ when $T$ ranges over $\mathcal{S}_n^+(\mathbb{R})$ is that the matrix ${}^t Q_0 T_0 Q_0$ is diagonal.
d) Prove the existence and uniqueness of the matrix $T_0$ sought.
grandes-ecoles 2011 QV.A.2 View
We consider a matrix $M = (m_{ij}) \in \mathcal{S}_n(\mathbb{R})$ such that for every $(i,j) \in \llbracket 1,n\rrbracket^2$, $m_{ij} \geqslant 0$ and $m_{ii} = 0$. We assume that $\Psi(M)$ has at least one strictly negative eigenvalue. Let $T_0$ be the unique symmetric matrix with non-negative eigenvalues minimizing $\|\Psi(M) - T\|_{\mathcal{M}_n(\mathbb{R})}$ over $\mathcal{S}_n^+(\mathbb{R})$.
We assume in this question that $T_0$ is non-zero. We want to show that there exists a minimal integer $p \in \llbracket 1, n-1\rrbracket$ that we will specify such that we can determine vectors $U_1, U_2, \cdots, U_n$ elements of $\mathbb{R}^p$ satisfying the condition $\sum_{i=1}^n U_i = 0$ and for which the matrix $\widetilde{M} = \left(\|U_i - U_j\|^2\right)_{(i,j) \in \llbracket 1,n\rrbracket^2}$ satisfies the relation $\Psi(\widetilde{M}) = T_0$.
We use the notations of part II and denote $U = (U_1 | U_2 | \cdots | U_n)$.
a) Show that the integer $p$ satisfies $p \geqslant \operatorname{rg}(T_0)$ and that $\operatorname{rg}(T_0) \in \llbracket 1, n-1\rrbracket$.
b) Construct a matrix $U \in \mathcal{M}_{r,n}(\mathbb{R})$ such that ${}^t UU = T_0$ for $r = \operatorname{rg}(T_0)$.
Hint. Assuming that ${}^t Q_0 T_0 Q_0$ is of the form $\left(\begin{array}{ll}\Delta & \\ & 0_{n-r}\end{array}\right)$ with $\Delta \in \mathcal{M}_r(\mathbb{R})$, diagonal with non-zero values, we will seek $U$ in the form $U = \left((\Delta_1)(0)\right) \times Q_0 \in \mathcal{M}_{r,n}(\mathbb{R})$ with $\Delta_1 \in \mathcal{M}_r(\mathbb{R})$, diagonal.
c) Show that $\sum_{i=1}^n U_i = 0$ (we may study the vector $UZ$).
d) Deduce that $\Psi(\widetilde{M}) = T_0$ with $\widetilde{M} = \left(\|U_i - U_j\|^2\right)_{(i,j) \in \llbracket 1,n\rrbracket^2}$ and conclude.
grandes-ecoles 2012 QIII.A View
In this part all matrices are of format $(n, n)$, where $n$ is an integer greater than or equal to 2. We say that a real symmetric matrix is positive definite if and only if all its eigenvalues are strictly positive.
Let $A$ be a positive definite symmetric matrix.
Prove that there exists an invertible matrix $Y$ such that $A = { } ^ { t } Y Y$.
grandes-ecoles 2012 QIII.B View
In this part all matrices are of format $(n, n)$, where $n$ is an integer greater than or equal to 2. We say that a real symmetric matrix is positive definite if and only if all its eigenvalues are strictly positive.
Let $A$ be a positive definite symmetric matrix and $B$ a symmetric matrix.
Prove that there exists an invertible matrix $T$ such that: $${ } ^ { t } T A T = I _ { n } \quad \text { and } \quad { } ^ { t } T B T = D$$ where $I _ { n }$ denotes the identity matrix and $D$ a diagonal matrix.
grandes-ecoles 2013 QI.C.2 View
Let $A \in \mathrm{GL}_n(\mathbb{R})$. Deduce that there exists a unique pair $(O, S) \in \mathrm{O}(n) \times \mathcal{S}_n^{++}(\mathbb{R})$ such that $A = OS$.
grandes-ecoles 2013 QI.C.3 View
Let $A \in \mathrm{GL}_n(\mathbb{R})$. Determine the matrices $O$ and $S$ when $A = \left(\begin{array}{ccc} 3 & 0 & -1 \\ \sqrt{2}/2 & 3\sqrt{2} & -3\sqrt{2}/2 \\ -\sqrt{2}/2 & 3\sqrt{2} & 3\sqrt{2}/2 \end{array}\right)$.
grandes-ecoles 2013 QI.D.4 View
Let $A \in \mathcal{M}_n(\mathbb{R})$. Show that there exists a pair $(O, S) \in \mathrm{O}(n) \times \mathcal{S}_n^+(\mathbb{R})$ such that $A = OS$. Is such a pair unique?
grandes-ecoles 2013 QII.B.2 View
Let $A \in \mathcal{M}_n(\mathbb{R})$. Consider the system $$(*) : \left\{\begin{array}{l} {}^t A A + {}^t X X = I_n \\ {}^t A X - {}^t X A = 0_n \end{array}\right.$$
We assume in this question that the eigenvalues of ${}^t A A$ belong to the interval $[0, 1[$.
a) Justify that we can seek the solutions $X$ of $(*)$ in the form $X = UH$, with $U \in \mathrm{O}(n)$ and $H \in \mathcal{S}_n^{++}(\mathbb{R})$.
b) Determine $H$.
c) Show the existence of a solution $X \in \mathrm{GL}_n(\mathbb{R})$ of $(*)$ belonging to $\mathrm{GL}_n(\mathbb{R})$.
grandes-ecoles 2013 QIV.B.3 View
Let $f$ be a linear form on $\mathcal{M}_n(\mathbb{R})$, and let $A$ be the unique matrix in $\mathcal{M}_n(\mathbb{R})$ such that $\forall M \in \mathcal{M}_n(\mathbb{R}), f(M) = \operatorname{Tr}(AM)$. Let $\mu_1, \ldots, \mu_n$ be the $n$ positive eigenvalues of ${}^t A A$ counted with multiplicities.
Show that $M_n = \sup(\{\operatorname{Tr}(D\Omega), \Omega \in \mathrm{O}(n)\})$, where $D$ is the diagonal matrix whose diagonal elements are $\sqrt{\mu_1}, \ldots, \sqrt{\mu_n}$.
grandes-ecoles 2015 Q2a View
Let $M \in \mathcal{S}_{n}(\mathbb{R})$, we denote by $m = s^{\downarrow}(M)$ its ordered spectrum. Show that there exists an orthonormal basis $\left(v_{1}, \ldots, v_{n}\right)$ of $\mathbb{R}^{n}$ such that $$M = \sum_{i=1}^{n} m_{i} v_{i}\, {}^{t}v_{i}$$ Such a decomposition of $M$ will be called in the sequel a spectral resolution of $M$.
grandes-ecoles 2015 Q9 View
In this part, we study the case $n = 2$. For two real numbers $u$ and $v$ such that $u \geqslant v$, we denote: $$S(u, v) = \left\{M \in \mathcal{S}_{2}(\mathbb{R}) \mid s^{\downarrow}(M) = (u, v)\right\}.$$ We fix $a_{1} \geqslant a_{2}$ and $b_{1} \geqslant b_{2}$, four real numbers satisfying the relation $$a_{1} - a_{2} \geqslant b_{1} - b_{2}.$$ We seek to identify the set $$\Sigma = \left\{s^{\downarrow}(A + B) \mid A \in S\left(a_{1}, a_{2}\right),\, B \in S\left(b_{1}, b_{2}\right)\right\}.$$
Show that $\Sigma$ is included in a line segment $L$ of length $\sqrt{2}\left(b_{1} - b_{2}\right)$, and determine its endpoints. One may first study the case where $A$ and $B$ are diagonal.
grandes-ecoles 2015 Q10a View
In this part, we study the case $n = 2$. For two real numbers $u$ and $v$ such that $u \geqslant v$, we denote: $$S(u, v) = \left\{M \in \mathcal{S}_{2}(\mathbb{R}) \mid s^{\downarrow}(M) = (u, v)\right\}.$$ We fix $a_{1} \geqslant a_{2}$ and $b_{1} \geqslant b_{2}$, four real numbers satisfying the relation $a_{1} - a_{2} \geqslant b_{1} - b_{2}$, and $$\Sigma = \left\{s^{\downarrow}(A + B) \mid A \in S\left(a_{1}, a_{2}\right),\, B \in S\left(b_{1}, b_{2}\right)\right\}.$$
Show that $$\Sigma = \left\{s^{\downarrow}(A + B) \,\middle|\, A = \left(\begin{array}{cc} a_{1} & 0 \\ 0 & a_{2} \end{array}\right),\, B \in S\left(b_{1}, b_{2}\right)\right\}.$$
grandes-ecoles 2015 Q10b View
In this part, we study the case $n = 2$. For two real numbers $u$ and $v$ such that $u \geqslant v$, we denote: $$S(u, v) = \left\{M \in \mathcal{S}_{2}(\mathbb{R}) \mid s^{\downarrow}(M) = (u, v)\right\}.$$ We fix $b_{1} \geqslant b_{2}$.
Determine a continuous function defined on $[-\pi, \pi]$ whose image equals $S\left(b_{1}, b_{2}\right)$.
grandes-ecoles 2015 Q10c View
In this part, we study the case $n = 2$. For two real numbers $u$ and $v$ such that $u \geqslant v$, we denote: $$S(u, v) = \left\{M \in \mathcal{S}_{2}(\mathbb{R}) \mid s^{\downarrow}(M) = (u, v)\right\}.$$ We fix $a_{1} \geqslant a_{2}$ and $b_{1} \geqslant b_{2}$, four real numbers satisfying the relation $a_{1} - a_{2} \geqslant b_{1} - b_{2}$, and $$\Sigma = \left\{s^{\downarrow}(A + B) \mid A \in S\left(a_{1}, a_{2}\right),\, B \in S\left(b_{1}, b_{2}\right)\right\}.$$ Let $L$ be the line segment identified in question 9.
Show that $\Sigma = L$.
grandes-ecoles 2016 Q3 View
We assume $n = 2$. We identify elements $x = \binom { x _ { 1 } } { x _ { 2 } } \in \mathbb { R } ^ { 2 }$ with vectors $\vec { x } = x _ { 1 } \vec { i } + x _ { 2 } \vec { j }$ of the Euclidean plane relative to an orthonormal frame $(\Omega , \vec { i } , \vec { j })$.
Let $O$ be the matrix of a reflection relative to a line passing through $\Omega$ and directed by a vector $\vec { v } _ { + }$. Determine a vector $x \in \mathbb { R } ^ { 2 }$ strictly positive and a sign diagonal matrix $S \in M _ { 2 } ( \mathbb { R } )$ such that $O x = S x$. Hint: begin by treating the case where $\vec { v } _ { + } \in \{ \vec { i } , \vec { j } \}$.
grandes-ecoles 2016 Q4 View
We assume $n = 2$. We identify elements $x = \binom { x _ { 1 } } { x _ { 2 } } \in \mathbb { R } ^ { 2 }$ with vectors $\vec { x } = x _ { 1 } \vec { i } + x _ { 2 } \vec { j }$ of the Euclidean plane relative to an orthonormal frame $(\Omega , \vec { i } , \vec { j })$.
Let $O$ be the matrix of a rotation with center $\Omega$ and angle $\theta \in ] - \pi , \pi ]$ nonzero. Using a drawing, find two vectors $x _ { + }$ and $x _ { - }$ such that $$O x _ { + } = \operatorname { diag } ( 1 , - 1 ) x _ { + } \text { and } O x _ { - } = \operatorname { diag } ( - 1,1 ) x _ { - }$$ Then discuss according to the sign of $\theta$, which of $x _ { + }$ and $x _ { - }$ is strictly positive.
grandes-ecoles 2017 QI.B.3 View
We consider $A \in \mathcal{M}_{n}(\mathbb{R})$ and assume that $A_{s} \in \mathcal{S}_{n}^{++}(\mathbb{R})$.
a) Show that there exists a unique matrix $B$ in $\mathcal{S}_{n}^{++}(\mathbb{R})$ such that $B^{2} = A_{s}$.
b) Show that there exists a matrix $Q$ in $\mathcal{A}_{n}(\mathbb{R})$ such that $\operatorname{det}(A) = \operatorname{det}(A_{s})\operatorname{det}(I_{n} + Q)$.
c) Deduce that $\operatorname{det}(A) \geqslant \operatorname{det}(A_{s})$.
grandes-ecoles 2017 QV.B.4 View
We fix a natural number $p$ greater than or equal to 2. Prove that every invertible matrix in $\mathcal { M } _ { n } ( \mathbb { C } )$ admits at least one $p$-th root.
One may use the fact that every upper triangular and invertible matrix admits at least one upper triangular $p$-th root (as established in V.B.3).
grandes-ecoles 2018 Q6 View
We equip $\mathbb{R}_{n}[X]$ with the inner product defined by $$\langle P, Q \rangle = \int_{-1}^{1} P(x)Q(x)\,dx$$ For $j \in \mathbb{N}$, we define the polynomial $$P_{j}(X) = \frac{1}{2^{j} j!} \frac{d^{j}}{dX^{j}}\left[(X^{2}-1)^{j}\right]$$ By convention, $P_{0} = 1$. The subspace of $\mathbb{R}_{n}[X]$ formed by even polynomials is denoted $\Pi_{n}$, and that of odd polynomials is denoted $J_{n}$.
(a) Show that the family $\left(P_{j}\right)_{0 \leqslant j \leqslant n}$ is a basis of $\mathbb{R}_{n}[X]$.
(b) Deduce that the family $\left(P_{2j}\right)_{0 \leqslant j \leqslant \frac{n}{2}}$ is a basis of $\Pi_{n}$, while the family $\left(P_{2j+1}\right)_{0 \leqslant j \leqslant \frac{n-1}{2}}$ is a basis of $J_{n}$.
grandes-ecoles 2018 Q5 View
We consider three strictly positive integers $n , p$ and $k$ such that $\mathscr { M } _ { n , p } ^ { k } ( \mathbb { R } )$ is non-empty. Let $A$ be a matrix of $\mathscr { M } _ { n , p } ^ { k } ( \mathbb { R } )$.
Let $S = A A ^ { \mathrm { T } }$ and $\tilde { S } = A ^ { \mathrm { T } } A$.
(a) Verify that $S$ is a symmetric matrix that admits only non-negative eigenvalues and then show that $\operatorname { Im } ( A ) = \operatorname { Im } ( S )$.
(b) Let $u \in \mathbb { R } ^ { n }$ be an eigenvector of $S$ for an eigenvalue $\lambda > 0$ and let $v = A ^ { \mathrm { T } } u / \sqrt { \lambda } \in \mathbb { R } ^ { p }$. Show that $v$ is an eigenvector of $\tilde { S }$ for the eigenvalue $\lambda$ and $\| v \| _ { 2 } = \| u \| _ { 2 }$.
grandes-ecoles 2018 Q6 View
We consider three strictly positive integers $n , p$ and $k$ such that $\mathscr { M } _ { n , p } ^ { k } ( \mathbb { R } )$ is non-empty. Let $A$ be a matrix of $\mathscr { M } _ { n , p } ^ { k } ( \mathbb { R } )$. Let $S = A A ^ { \mathrm { T } }$ and $\tilde { S } = A ^ { \mathrm { T } } A$.
(a) Show that there exist $U \in \mathscr { M } _ { n , k } ( \mathbb { R } )$ and $\Lambda = \operatorname { diag } \left( \lambda _ { 1 } , \ldots , \lambda _ { k } \right) \in \mathscr { M } _ { k } ( \mathbb { R } )$ such that $S = U \Lambda U ^ { \mathrm { T } }$ with $\lambda _ { 1 } \geqslant \ldots \geqslant \lambda _ { k } > 0$ and $U ^ { \mathrm { T } } U = I _ { k }$.
(b) Show that $\operatorname { Im } ( S ) = \operatorname { Im } ( U )$ and that $U U ^ { \mathrm { T } }$ is the matrix of the orthogonal projection onto $\operatorname { Im } ( U )$ in $\mathbb { R } ^ { n }$.
(c) By setting $V = A ^ { \mathrm { T } } U D \in \mathscr { M } _ { p , k } ( \mathbb { R } )$ where $D = \operatorname { diag } \left( 1 / \sqrt { \lambda _ { 1 } } , \ldots , 1 / \sqrt { \lambda _ { k } } \right) \in \mathscr { M } _ { k } ( \mathbb { R } )$, show that $V ^ { \mathrm { T } } V = I _ { k }$ and $\tilde { S } = V \Lambda V ^ { \mathrm { T } }$.
grandes-ecoles 2018 Q7 View
We consider three strictly positive integers $n , p$ and $k$ such that $\mathscr { M } _ { n , p } ^ { k } ( \mathbb { R } )$ is non-empty. Let $A$ be a matrix of $\mathscr { M } _ { n , p } ^ { k } ( \mathbb { R } )$. Using the decompositions from question 6, deduce that $$A = U \Sigma V ^ { \mathrm { T } } ,$$ with $\Sigma = \operatorname { diag } \left( \sqrt { \lambda _ { 1 } } , \ldots , \sqrt { \lambda } _ { k } \right)$.
grandes-ecoles 2018 Q8 View
Let $A \in \mathscr { M } _ { n , p } ^ { k } ( \mathbb { R } )$ be a matrix of rank $k$ where $n , p$ and $k$ are strictly positive integers, $k \leqslant \min ( n , p )$. We consider the decomposition $A = U \Sigma V ^ { T }$ constructed in the first part. Let $l \in \mathbb { N } ^ { * }$ and $\widetilde { V } \in \mathscr { M } _ { p , l } ( \mathbb { R } )$ be such that $l < k$ and $\widetilde { V } ^ { \mathrm { T } } \widetilde { V } = I _ { l }$. We denote by $\left( \tilde { v } _ { 1 } , \ldots , \tilde { v } _ { l } \right) \in \left( \mathbb { R } ^ { p } \right) ^ { l }$ the family of columns of $\widetilde { V }$ and by $\left( v _ { 1 } , \ldots , v _ { k } \right) \in \left( \mathbb { R } ^ { p } \right) ^ { k }$ that of columns of $V$.
(a) Verify that $\left\| A - A \widetilde { V } \widetilde { V } ^ { \mathrm { T } } \right\| _ { F } ^ { 2 } = \| A \| _ { F } ^ { 2 } - \left\| A \widetilde { V } \widetilde { V } ^ { \mathrm { T } } \right\| _ { F } ^ { 2 }$.
(b) Show that $$\left\| A \widetilde { V } \widetilde { V } ^ { \mathrm { T } } \right\| _ { F } ^ { 2 } = \sum _ { h = 1 } ^ { k } \left( \lambda _ { h } \sum _ { m = 1 } ^ { l } \left\langle v _ { h } , \tilde { v } _ { m } \right\rangle _ { 2 } ^ { 2 } \right)$$ where $\langle , \rangle _ { 2 }$ denotes the usual inner product on $\mathbb { R } ^ { p }$.
grandes-ecoles 2018 Q9 View
Let $A \in \mathscr { M } _ { n , p } ^ { k } ( \mathbb { R } )$ be a matrix of rank $k$ where $n , p$ and $k$ are strictly positive integers, $k \leqslant \min ( n , p )$. We consider the decomposition $A = U \Sigma V ^ { T }$ constructed in the first part. Let $l \in \mathbb { N } ^ { * }$ and $\widetilde { V } \in \mathscr { M } _ { p , l } ( \mathbb { R } )$ be such that $l < k$ and $\widetilde { V } ^ { \mathrm { T } } \widetilde { V } = I _ { l }$. We denote by $\left( \tilde { v } _ { 1 } , \ldots , \tilde { v } _ { l } \right) \in \left( \mathbb { R } ^ { p } \right) ^ { l }$ the family of columns of $\widetilde { V }$ and by $\left( v _ { 1 } , \ldots , v _ { k } \right) \in \left( \mathbb { R } ^ { p } \right) ^ { k }$ that of columns of $V$.
We assume here that $\lambda _ { l } > \lambda _ { l + 1 }$.
(a) For all $l + 1 \leqslant i \leqslant k$ and all $1 \leqslant j \leqslant l$, we set $a _ { i } = \sum _ { m = 1 } ^ { l } \left\langle v _ { i } , \tilde { v } _ { m } \right\rangle _ { 2 } ^ { 2 }$ and $b _ { j } = 1 - \sum _ { m = 1 } ^ { l } \left\langle v _ { j } , \tilde { v } _ { m } \right\rangle _ { 2 } ^ { 2 }$. Show that the $\left( a _ { i } \right)$ and $\left( b _ { j } \right)$ are non-negative real numbers and that we have $\sum _ { i = l + 1 } ^ { k } a _ { i } \leqslant \sum _ { j = 1 } ^ { l } b _ { j }$.
(b) Show that $\left\| A \widetilde { V } \widetilde { V } ^ { \mathrm { T } } \right\| _ { F } ^ { 2 } \leqslant \sum _ { h = 1 } ^ { l } \lambda _ { h }$ and that we have equality if and only if $\operatorname { Vect } \left( \left\{ v _ { 1 } , \ldots , v _ { l } \right\} \right) = \operatorname { Im } ( \widetilde { V } )$ where $\operatorname { Vect } ( X )$ denotes the vector subspace spanned by $X \subset \mathbb { R } ^ { p }$.
(c) Let $M \in \mathscr { M } _ { n , p } ^ { l } ( \mathbb { R } )$. Show that $\| M - A \| _ { F } ^ { 2 } \geqslant \sum _ { h = l + 1 } ^ { k } \lambda _ { h }$ with equality if and only if $M = U _ { * } \Sigma _ { * } V _ { * } ^ { \mathrm { T } }$ where $\Sigma _ { * } = \operatorname { diag } \left( \sqrt { \lambda _ { 1 } } , \ldots , \sqrt { \lambda _ { l } } \right) , U _ { * }$ (resp. $V _ { * }$ ) is the matrix formed by the first $l$ columns of $U$ (resp. of $V$ ).