grandes-ecoles 2016 Q13
Matrix Algebra and Product Properties
Let $(\Omega, \mathscr{A}, \mathbf{P})$ be a probability space and $X : \Omega \rightarrow \{1, \ldots, N\}$ a random variable with distribution $q \in \Sigma_{N}$. Let $M \in \mathscr{M}_{N,d}(\mathbb{R})$ defined by $M_{i,j} = g_{j}(i)$ for $(i,j) \in \{1, \ldots, N\} \times \{1, \ldots, d\}$, $p \in \Sigma_{N}$ and $m \in \mathbb{R}^{d}$. We denote by $A \in \mathscr{M}_{d}(\mathbb{R})$ the square matrix of size $d \times d$ defined for all $(k,l) \in \{1, \ldots, d\}^{2}$ by $$A_{lk} = \sum_{i=1}^{N} p_{i}(M_{il} - m_{l})(M_{ik} - m_{k}).$$
Verify that if $Y : \Omega \rightarrow \{1, \ldots, N\}$ is a random variable with distribution $p$, then $A_{lk} = \mathbf{E}((g_{l}(Y) - m_{l})(g_{k}(Y) - m_{k}))$ and then that $A$ is a symmetric matrix such that $\theta^{T} A \theta \geqslant 0$ for all $\theta \in \mathbb{R}^{d}$.