While we include the unlikelihood baseline [44] (simply maximizing \(\log p(y_{w}|x)\), the log probability of the preferred response, while minimizing \(\log p(y_{l}|x)\), the log probability of the dispreferred response) in our sentiment experiments, we do not include it as a baseline in either the summarization 