grandes-ecoles 2025 Q36
Properties of eigenvalues under matrix operations
View
We fix an integer $d \in \mathbb{N}^*$, and we equip $\mathbb{R}^d$ with the usual inner product denoted $\langle \cdot, \cdot \rangle$ and the associated Euclidean norm $\|\cdot\|$. We denote $C := \{x \in \mathbb{R}^d \mid \|x\| \leq 1\}$ the closed unit ball of $\mathbb{R}^d$. Let $M$ be a nonzero real symmetric matrix of size $d \times d$ such that $\forall x \in \mathbb{R}^d,\, \langle x, Mx \rangle \geq 0$. We define $f(x) := -\frac{1}{2}\langle x, Mx \rangle$, so that $\nabla f(x) = -Mx$. The sequence $(x_n)_{n \in \mathbb{N}}$ is defined by $$x_{n+1} := P_C(x_n - \tau \nabla f(x_n)), \quad \text{with} \quad P_C(x) := \begin{cases} x & \text{if } \|x\| \leq 1, \\ x/\|x\| & \text{otherwise.} \end{cases}$$ Suppose in this question that $\|x_0\| \geq 1$. a) Show that $$\forall n \in \mathbb{N} \setminus \{0\},\, x_n = \frac{(\mathrm{I}_d + \tau M)^n x_0}{\|(\mathrm{I}_d + \tau M)^n x_0\|}$$ b) Calculate $\lim_{n \rightarrow \infty} x_n$. Hint. Decompose $x_0 = \sum_{1 \leq i \leq d} \alpha_i e_i$ in an orthonormal basis of eigenvectors $(e_1, \cdots, e_d)$, associated with the eigenvalues $\lambda_1, \cdots, \lambda_d$ of $M$. Introduce the set of indices $I := \{i \in \llbracket 1, d \rrbracket \mid \alpha_i \neq 0\}$, the eigenvalue $\lambda := \max_{i \in I} \lambda_i$, and the vector $x_0' := \sum_{i \in I'} \alpha_i e_i$ where $I' := \{i \in I \mid \lambda_i = \lambda\}$.