johngiorgi
commited on
Commit
•
bd01102
1
Parent(s):
550385a
Add trigram block by default
Browse filesSimilar to PRIMERA-multinews and PRIMERA-multixscience, I have found that I get ROUGE scores much closer to those reported if I add a trigram block. I am proposing this be enabled by default in the HuggingFace config.
- config.json +1 -0
config.json
CHANGED
@@ -73,6 +73,7 @@
|
|
73 |
"model_type": "led",
|
74 |
"normalize_before": false,
|
75 |
"normalize_embedding": true,
|
|
|
76 |
"num_hidden_layers": 12,
|
77 |
"output_past": false,
|
78 |
"pad_token_id": 1,
|
|
|
73 |
"model_type": "led",
|
74 |
"normalize_before": false,
|
75 |
"normalize_embedding": true,
|
76 |
+
"no_repeat_ngram_size": 3,
|
77 |
"num_hidden_layers": 12,
|
78 |
"output_past": false,
|
79 |
"pad_token_id": 1,
|