We consider $\alpha = (\alpha_i)_{i \in I} \in (\mathbb{R}_+^*)^I$ and $\beta = (\beta_j)_{j \in J} \in (\mathbb{R}_+^*)^J$ such that $\sum_{i \in I} \alpha_i = \sum_{j \in J} \beta_j = 1$. We denote by $\boldsymbol{p}$ the element of $F(\alpha, \beta)$ defined by $p_{ij} = \alpha_i \beta_j > 0$ for all $(i,j) \in I \times J$. Let $C = (C_{ij})_{(i,j) \in I \times J} \in \mathbb{R}_+^{I \times J}$ and $\epsilon > 0$. We consider $J_\epsilon : Q \rightarrow \mathbb{R}$ defined by $$J_\epsilon(\boldsymbol{q}) = \sum_{ij} q_{ij} C_{ij} + \epsilon \operatorname{KL}(\boldsymbol{q}, \boldsymbol{p})$$ (a) Verify that $F(\alpha, \beta)$ is a closed bounded set of $\mathbb{R}^{I \times J}$. (b) Show that there exists a unique $\boldsymbol{q}(\epsilon) \in Q$ minimizing $J_\epsilon$ on $F(\alpha, \beta)$. (c) By considering a simple counterexample, show that uniqueness is no longer true if we assume that $\epsilon = 0$.
We consider $\alpha = (\alpha_i)_{i \in I} \in (\mathbb{R}_+^*)^I$ and $\beta = (\beta_j)_{j \in J} \in (\mathbb{R}_+^*)^J$ such that $\sum_{i \in I} \alpha_i = \sum_{j \in J} \beta_j = 1$. We denote by $\boldsymbol{p}$ the element of $F(\alpha, \beta)$ defined by $p_{ij} = \alpha_i \beta_j > 0$ for all $(i,j) \in I \times J$. Let $C = (C_{ij})_{(i,j) \in I \times J} \in \mathbb{R}_+^{I \times J}$ and $\epsilon > 0$. We consider $J_\epsilon : Q \rightarrow \mathbb{R}$ defined by
$$J_\epsilon(\boldsymbol{q}) = \sum_{ij} q_{ij} C_{ij} + \epsilon \operatorname{KL}(\boldsymbol{q}, \boldsymbol{p})$$
(a) Verify that $F(\alpha, \beta)$ is a closed bounded set of $\mathbb{R}^{I \times J}$.\\
(b) Show that there exists a unique $\boldsymbol{q}(\epsilon) \in Q$ minimizing $J_\epsilon$ on $F(\alpha, \beta)$.\\
(c) By considering a simple counterexample, show that uniqueness is no longer true if we assume that $\epsilon = 0$.