KonTra at CMCL 2021 Shared Task: Predicting Eye Movements by Combining BERT with Surface, Linguistic and Behavioral Information
This paper describes the submission of the team KonTra to the CMCL 2021 Shared Task on eye tracking prediction. Our system combines the embeddings extracted from a fine tuned BERT model with surface, linguistic and behavioral features, resulting in an average mean absolute error of 4.22 across all 5 eye tracking measures. We show that word length and features representing the expectedness of a word are consistently the strongest predictors across all 5 eye tracking measures.
CMCL