Pre-trained language models, such as BERT (Vaswani et al., 2017; <cite>Devlin et al., 2019</cite> ) have recently gained huge success on a wide range of NLP tasks. However, since our framework deals with various auxiliary pieces (category, price, etc.), we cannot directly leverage these language models, which have only been trained on natural language inputs.