mascIT commited on
Commit
f7396e3
1 Parent(s): 412b007

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -2
README.md CHANGED
@@ -41,6 +41,32 @@ Use it as a foundational model to be finetuned for specific italian tasks.
41
  - optim: AdamW (beta_1=0.8)
42
  - weight_decay: 1e-2
43
 
44
- # Eval
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
45
 
46
- - perplexity: 19 (it's a 12MB model!)
 
41
  - optim: AdamW (beta_1=0.8)
42
  - weight_decay: 1e-2
43
 
44
+ - Dev set perplexity: 19 (it's a 12MB model!)
45
+ # Evaluation (UINAUIL)
46
+
47
+ Following the [UINAUIL setup](https://github.com/valeriobasile/uinauil/tree/main) we can summarise the following results on BERTINA-3M:
48
+
49
+ **CLASSIFICATION TASKS**
50
+ ```
51
+ task,type,p,r,f1,acc
52
+ haspeede,classification,0.699,0.687,0.680,0.685
53
+ ironita,classification,0.701,0.701,0.701,0.701
54
+ sentipolc,classification,0.649,0.588,0.587,0.560
55
+ ```
56
+
57
+ **ENTAILMENT TASKS**
58
+
59
+ ```
60
+ task,type,p,r,f1,acc
61
+ textualentailment,entailment,0.423,0.530,0.401,0.530
62
+ ```
63
+
64
+ **SEQUENCE TASKS**
65
+
66
+ ```
67
+ task,type,acc
68
+ eventi,NER,0.835
69
+ facta,NER,0.967
70
+ ```
71
+
72