File size: 543 Bytes
06f709c 6dad1a1 06f709c 6dad1a1 |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
language:
- ru
tags:
- PyTorch
- Transformers
---
# rugpt3large\_mailqa
Model was finetuned with sequence length 1024 for 516000 steps on a dataset of otvet.mail.ru questions and answers. The raw dataset can be found [here](https://www.kaggle.com/datasets/atleast6characterss/otvetmailru-full). Beware that the data contains a good portion of toxic language, so the answers can be unpredictable.
Jupyter notebook with an example of how to inference this model can be found in the [repository](https://github.com/NeuralPushkin/MailRu_Q-A) |