To address this problem, \(\mathsf {Starmie}\)  combines contrastive learning with a multi-column table encoder illustrated in Figure REF .
The model starts with serializing an input table into a string by concatenating cell values from each column and adding a special separator token “<s>” to indicate the start of each column.
Next, we feed the sequence as the input to a pre-trained LM such as RoBERTa [1]}.
<FIGURE>