mascIT commited on
Commit
9e433c4
1 Parent(s): c65f616

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -3,5 +3,20 @@ language:
3
  - it
4
  pipeline_tag: fill-mask
5
  ---
6
- This model (based on bert-tiny) has been trained from scratch on 5k italian Wikipedia articles and on a wide collection of italian words and dictionary definitions.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
 
 
3
  - it
4
  pipeline_tag: fill-mask
5
  ---
6
+
7
+ This model (based on [bert-tiny](https://huggingface.co/google/bert_uncased_L-2_H-128_A-2)) has been trained from scratch on 5k italian Wikipedia articles and on a wide collection of italian words and dictionary definitions.
8
+
9
+ The project is still a work in progress, new versions will come soon.
10
+
11
+ # Training
12
+
13
+ - epochs: 200
14
+ - lr: 1e-5
15
+ - optim: AdamW
16
+ - weight_decay: 1e-3
17
+
18
+ # Eval
19
+
20
+ - perplexity: 50
21
+
22