Create README.md

README.md

@@ -0,0 +1,23 @@
+# xlm-roberta-large for multilingual QA
+
+# Overview
+**Language Model**: xlm-roberta-large \\n**Downstream task**: Extractive QA \\n**Training data**: [XQuAD](https://github.com/deepmind/xquad)\\n**Testing Data**: [XQuAD](https://github.com/deepmind/xquad)
+
+# Hyperparameters
+
+```python
+batch_size = 48
+n_epochs = 13
+max_seq_len = 384
+doc_stride = 128
+learning_rate = 3e-5
+```
+
+# Performance
+
+Evaluated on held-out test set from XQuAD
+```python
+"exact_match": 87.12546816479401,
+"f1": 94.77703248802527,
+"test_samples": 2307
+```