We fine-tune base RuBERT pretrained by DeepPavlov [1]}, base XLM-RoBERTa [2]} and a Logistic Regression classifier with character- and word-based features. In some experiments, we also trained SVM and Random Forest classifiers on the same features to compare their performance with Logistic Regression.
