In order to address the semantic redundancy, we propose to jointly model both the context and the response as an alternative to the mutual information objective [1]}, [2]}. The resulting distribution and the objective function can then be respectively expressed as
\(P(y_i,\mathbf {x}_i) = P(y_i|\mathbf {x}_i)P(\mathbf {x}_i)\) 
\(L_{Joint} = -logP_{\theta }(y_i|\mathbf {x}_i) -logP_{\theta }(\mathbf {x}_i)\) 
