The trained models are evaluated on the Italian section of the syntactic benchmark provided by <cite>Gulordava et al. (2018)</cite> , which includes various non-trivial number agreement constructions.