Added version 0.2.0

.gitattributes

@@ -20,3 +20,4 @@
 *strings.json filter=lfs diff=lfs merge=lfs -text
 vectors filter=lfs diff=lfs merge=lfs -text
 model filter=lfs diff=lfs merge=lfs -text
+entity_linker/kb/* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,87 +1,37 @@
----
-tags:
-- spacy
-- token-classification
-language:
-- da
-license: apache-2.0
-model-index:
-- name: da_dacy_medium_trf
-  results:
-  - task:
-      name: NER
-      type: token-classification
-    metrics:
-    - name: NER Precision
-      type: precision
-      value: 0.817047817
-    - name: NER Recall
-      type: recall
-      value: 0.81875
-    - name: NER F Score
-      type: f_score
-      value: 0.8178980229
-  - task:
-      name: SENTER
-      type: token-classification
-    metrics:
-    - name: SENTER Precision
-      type: precision
-      value: 0.873015873
-    - name: SENTER Recall
-      type: recall
-      value: 0.8776595745
-    - name: SENTER F Score
-      type: f_score
-      value: 0.875331565
-  - task:
-      name: UNLABELED_DEPENDENCIES
-      type: token-classification
-    metrics:
-    - name: Unlabeled Dependencies Accuracy
-      type: accuracy
-      value: 0.8714971531
-  - task:
-      name: LABELED_DEPENDENCIES
-      type: token-classification
-    metrics:
-    - name: Labeled Dependencies Accuracy
-      type: accuracy
-      value: 0.8714971531
----
 
 <a href="https://github.com/centre-for-humanities-computing/Dacy"><img src="https://centre-for-humanities-computing.github.io/DaCy/_static/icon.png" width="175" height="175" align="right" /></a>
 
-# DaCy medium transformer
+# DaCy medium
 
 DaCy is a Danish language processing framework with state-of-the-art pipelines as well as functionality for analysing Danish pipelines.
-DaCy's largest pipeline has achieved State-of-the-Art performance on Named entity recognition, part-of-speech tagging and dependency 
-parsing for Danish on the DaNE dataset. Check out the [DaCy repository](https://github.com/centre-for-humanities-computing/DaCy) for material on how to use DaCy and reproduce the results. 
+DaCy's largest pipeline has achieved State-of-the-Art performance on parts-of-speech tagging and dependency 
+parsing for Danish on the DaNE dataset. To read more check out the [DaCy repository](https://github.com/centre-for-humanities-computing/DaCy) for material on how to use DaCy and reproduce the results. 
 DaCy also contains guides on usage of the package as well as behavioural test for biases and robustness of Danish NLP pipelines.
-    
+
 
 | Feature | Description |
 | --- | --- |
 | **Name** | `da_dacy_medium_trf` |
-| **Version** | `0.1.0` |
-| **spaCy** | `>=3.1.1,<3.2.0` |
-| **Default Pipeline** | `transformer`, `morphologizer`, `parser`, `attribute_ruler`, `lemmatizer`, `ner` |
-| **Components** | `transformer`, `morphologizer`, `parser`, `attribute_ruler`, `lemmatizer`, `ner` |
+| **Version** | `0.2.0` |
+| **spaCy** | `>=3.5.2,<3.6.0` |
+| **Default Pipeline** | `transformer`, `tagger`, `morphologizer`, `trainable_lemmatizer`, `parser`, `ner`, `coref`, `span_resolver`, `span_cleaner`, `entity_linker` |
+| **Components** | `transformer`, `tagger`, `morphologizer`, `trainable_lemmatizer`, `parser`, `ner`, `coref`, `span_resolver`, `span_cleaner`, `entity_linker` |
 | **Vectors** | 0 keys, 0 unique vectors (0 dimensions) |
-| **Sources** | [UD Danish DDT v2.5](https://github.com/UniversalDependencies/UD_Danish-DDT) (Johannsen, Anders; Martínez Alonso, Héctor; Plank, Barbara)<br />[DaNE](https://github.com/alexandrainst/danlp/blob/master/docs/datasets.md#danish-dependency-treebank-dane) (Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders Søgaard)<br />[Maltehb/danish-bert-botxo](https://huggingface.co/Maltehb/danish-bert-botxo) (BotXO.ai) |
+| **Sources** | [UD Danish DDT v2.11](https://github.com/UniversalDependencies/UD_Danish-DDT) (Johannsen, Anders; Martínez Alonso, Héctor; Plank, Barbara)<br />[DaNE](https://huggingface.co/datasets/dane) (Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders Søgaard)<br />[DaCoref](https://huggingface.co/datasets/alexandrainst/dacoref) (Buch-Kromann, Matthias)<br />[DaNED](https://danlp-alexandra.readthedocs.io/en/stable/docs/datasets.html#daned) (Barrett, M. J., Lam, H., Wu, M., Lacroix, O., Plank, B., & Søgaard, A.)<br />[vesteinn/DanskBERT](https://huggingface.co/vesteinn/DanskBERT) (Vésteinn Snæbjarnarson) |
 | **License** | `Apache-2.0 License` |
-| **Author** | [Centre for Humanities Computing Aarhus](https://chcaa.io/#/) |
+| **Author** | [Kenneth Enevoldsen](https://chcaa.io/#/) |
 
 ### Label Scheme
 
 <details>
 
-<summary>View label scheme (192 labels for 3 components)</summary>
+<summary>View label scheme (211 labels for 4 components)</summary>
 
 | Component | Labels |
 | --- | --- |
-| **`morphologizer`** | `AdpType=Prep\|POS=ADP`, `Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=AUX\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=PROPN`, `Definite=Ind\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=SCONJ`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=ADV`, `Number=Plur\|POS=DET\|PronType=Dem`, `Degree=Pos\|Number=Plur\|POS=ADJ`, `Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=PUNCT`, `POS=CCONJ`, `Definite=Ind\|Degree=Cmp\|Number=Sing\|POS=ADJ`, `Degree=Cmp\|POS=ADJ`, `POS=PRON\|PartType=Inf`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Definite=Ind\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Acc\|Gender=Neut\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Dem`, `Degree=Pos\|POS=ADV`, `Definite=Def\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=PRON\|PronType=Dem`, `NumType=Card\|POS=NUM`, `Definite=Ind\|Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `NumType=Ord\|POS=ADJ`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Mood=Ind\|POS=AUX\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=VERB\|VerbForm=Inf\|Voice=Act`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Pass`, `POS=ADP\|PartType=Inf`, `Degree=Pos\|POS=ADJ`, `Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `POS=AUX\|VerbForm=Inf\|Voice=Act`, `Definite=Ind\|Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Number=Plur\|POS=DET\|PronType=Ind`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Ind`, `Case=Acc\|POS=PRON\|Person=3\|PronType=Prs\|Reflex=Yes`, `POS=PART\|PartType=Inf`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Acc\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Case=Nom\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Nom\|Gender=Com\|POS=PRON\|PronType=Ind`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Ind`, `Mood=Imp\|POS=VERB`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Definite=Ind\|Number=Sing\|POS=AUX\|Tense=Past\|VerbForm=Part`, `POS=X`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=VERB\|Tense=Pres\|VerbForm=Part`, `Number=Plur\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|VerbForm=Inf\|Voice=Pass`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Degree=Cmp\|POS=ADV`, `POS=ADV\|PartType=Inf`, `Degree=Sup\|POS=ADV`, `Number=Plur\|POS=PRON\|PronType=Dem`, `Number=Plur\|POS=PRON\|PronType=Ind`, `Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|POS=PROPN`, `POS=ADP`, `Degree=Cmp\|Number=Plur\|POS=ADJ`, `Definite=Def\|Degree=Sup\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Degree=Pos\|Number=Sing\|POS=ADJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Gender=Com\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Number=Plur\|POS=PRON\|PronType=Rcp`, `Case=Gen\|Degree=Cmp\|POS=ADJ`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=INTJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Number=Plur\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Definite=Def\|Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Definite=Ind\|Number=Sing\|POS=NOUN`, `Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Number=Plur\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `POS=SYM`, `Case=Nom\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Degree=Sup\|POS=ADJ`, `Number=Plur\|POS=DET\|PronType=Ind\|Style=Arch`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Foreign=Yes\|POS=X`, `POS=DET\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Dem`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Case=Gen\|POS=PRON\|PronType=Int,Rel`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Dem`, `Abbr=Yes\|POS=X`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `Definite=Def\|Degree=Abs\|POS=ADJ`, `Definite=Ind\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Definite=Ind\|POS=NOUN`, `Gender=Com\|Number=Plur\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|POS=PRON\|PronType=Int,Rel`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Degree=Abs\|POS=ADV`, `POS=VERB\|VerbForm=Ger`, `POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Number=Plur\|Number[psor]=Plur\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Gen\|Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Gen\|Degree=Pos\|Number=Plur\|POS=ADJ`, `Case=Acc\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|Tense=Pres`, `Case=Gen\|Number=Plur\|POS=DET\|PronType=Ind`, `Number[psor]=Plur\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `POS=PRON\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `POS=AUX\|Tense=Pres\|VerbForm=Part`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Pass`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Definite=Ind\|Number=Plur\|POS=NOUN`, `Case=Gen\|Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Mood=Imp\|POS=AUX`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs`, `Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Gen\|POS=NOUN`, `Number[psor]=Plur\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=DET\|PronType=Dem`, `Definite=Def\|Number=Plur\|POS=NOUN` |
-| **`parser`** | `ROOT`, `acl:relcl`, `advcl`, `advmod`, `amod`, `appos`, `aux`, `case`, `cc`, `ccomp`, `compound:prt`, `conj`, `cop`, `dep`, `det`, `expl`, `fixed`, `flat`, `iobj`, `list`, `mark`, `nmod`, `nmod:poss`, `nsubj`, `nummod`, `obj`, `obl`, `obl:loc`, `obl:tmod`, `punct`, `xcomp` |
+| **`tagger`** | `ADJ`, `ADP`, `ADV`, `AUX`, `CCONJ`, `DET`, `INTJ`, `NOUN`, `NUM`, `PART`, `PRON`, `PROPN`, `PUNCT`, `SCONJ`, `SYM`, `VERB`, `X` |
+| **`morphologizer`** | `AdpType=Prep\|POS=ADP`, `Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=AUX\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=PROPN`, `Definite=Ind\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=SCONJ`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=ADV`, `Number=Plur\|POS=DET\|PronType=Dem`, `Degree=Pos\|Number=Plur\|POS=ADJ`, `Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=PUNCT`, `NumType=Ord\|POS=ADJ`, `POS=CCONJ`, `Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `POS=VERB\|VerbForm=Inf\|Voice=Act`, `Case=Acc\|Gender=Neut\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Degree=Sup\|POS=ADV`, `Degree=Pos\|POS=ADV`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Number=Plur\|POS=DET\|PronType=Ind`, `POS=ADP`, `POS=ADV\|PartType=Inf`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Mood=Ind\|POS=AUX\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=ADP\|PartType=Inf`, `Definite=Ind\|Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `NumType=Card\|POS=NUM`, `Degree=Pos\|POS=ADJ`, `Definite=Ind\|Number=Sing\|POS=AUX\|Tense=Past\|VerbForm=Part`, `POS=PART\|PartType=Inf`, `Case=Acc\|POS=PRON\|Person=3\|PronType=Prs\|Reflex=Yes`, `Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=VERB\|Tense=Pres\|VerbForm=Part`, `Case=Nom\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `Definite=Def\|Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Acc\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `POS=AUX\|VerbForm=Inf\|Voice=Act`, `Definite=Ind\|Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Definite=Ind\|Degree=Cmp\|Number=Sing\|POS=ADJ`, `Degree=Cmp\|POS=ADJ`, `POS=PRON\|PartType=Inf`, `Definite=Ind\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Nom\|Gender=Com\|POS=PRON\|PronType=Ind`, `Number=Plur\|POS=PRON\|PronType=Ind`, `POS=INTJ`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Case=Gen\|Number=Plur\|POS=DET\|PronType=Ind`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Pass`, `Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Degree=Cmp\|POS=ADV`, `Number=Plur\|Number[psor]=Plur\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Case=Gen\|POS=PROPN`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Ind`, `Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Definite=Def\|Degree=Sup\|POS=ADJ`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Dem`, `Definite=Def\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `POS=PRON\|PronType=Dem`, `Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Number=Plur\|POS=NUM`, `POS=VERB\|VerbForm=Inf\|Voice=Pass`, `Definite=Def\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `POS=PRON`, `Definite=Ind\|Number=Sing\|POS=NOUN`, `Definite=Ind\|Number=Sing\|POS=NUM`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Foreign=Yes\|POS=ADV`, `POS=NOUN`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Gender=Com\|Number=Plur\|POS=NOUN`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Ind`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Degree=Sup\|POS=ADJ`, `Degree=Pos\|Number=Sing\|POS=ADJ`, `Mood=Imp\|POS=VERB`, `Case=Nom\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Case=Acc\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `POS=X`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `Number=Plur\|POS=PRON\|PronType=Dem`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Number=Plur\|POS=PRON\|PronType=Int,Rel`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Degree=Cmp\|Number=Plur\|POS=ADJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Com\|POS=PRON\|PronType=Int,Rel`, `Case=Gen\|Degree=Pos\|Number=Plur\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `POS=VERB\|VerbForm=Ger`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Dem`, `Case=Gen\|POS=PRON\|PronType=Int,Rel`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Pass`, `Abbr=Yes\|POS=X`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Definite=Ind\|Number=Plur\|POS=NOUN`, `Foreign=Yes\|POS=X`, `Number=Plur\|POS=PRON\|PronType=Rcp`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Case=Gen\|Degree=Cmp\|POS=ADJ`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Dem`, `Number=Plur\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Gender=Neut\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Number=Plur\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Number=Plur\|POS=PRON\|PronType=Rcp`, `POS=DET\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `POS=SYM`, `POS=DET\|PronType=Dem`, `Gender=Com\|Number=Sing\|POS=NUM`, `Number[psor]=Plur\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Degree=Abs\|POS=ADJ`, `POS=VERB\|Tense=Pres`, `Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NUM`, `Degree=Abs\|POS=ADV`, `Case=Gen\|Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Ind\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Number[psor]=Plur\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `Definite=Ind\|POS=NOUN`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Definite=Ind\|Gender=Com\|Number=Sing\|POS=NUM`, `Definite=Def\|Number=Plur\|POS=NOUN`, `Case=Gen\|POS=NOUN`, `POS=AUX\|Tense=Pres\|VerbForm=Part` |
+| **`parser`** | `ROOT`, `acl:relcl`, `advcl`, `advmod`, `advmod:lmod`, `amod`, `appos`, `aux`, `case`, `cc`, `ccomp`, `compound:prt`, `conj`, `cop`, `dep`, `det`, `expl`, `fixed`, `flat`, `iobj`, `list`, `mark`, `nmod`, `nmod:poss`, `nsubj`, `nummod`, `obj`, `obl`, `obl:lmod`, `obl:tmod`, `punct`, `xcomp` |
 | **`ner`** | `LOC`, `MISC`, `ORG`, `PER` |
 
 </details>
@@ -90,104 +40,36 @@ DaCy also contains guides on usage of the package as well as behavioural test fo
 
 | Type | Score |
 | --- | --- |
-| `POS_ACC` | 97.44 |
-| `MORPH_ACC` | 97.24 |
-| `DEP_UAS` | 87.15 |
-| `DEP_LAS` | 83.97 |
-| `SENTS_P` | 87.30 |
-| `SENTS_R` | 87.77 |
-| `SENTS_F` | 87.53 |
-| `LEMMA_ACC` | 84.91 |
-| `ENTS_F` | 81.79 |
-| `ENTS_P` | 81.70 |
-| `ENTS_R` | 81.88 |
-| `TRANSFORMER_LOSS` | 1224302.39 |
-| `MORPHOLOGIZER_LOSS` | 388869.90 |
-| `PARSER_LOSS` | 7861802.70 |
-| `NER_LOSS` | 68503.20 |
-
-
-## Bias and Robustness
-
-Besides the validation done by SpaCy on the DaNE testset, DaCy also provides a series of augmentations to the DaNE test set to see how well the models deal with these types of augmentations.
-The can be seen as behavioural probes akinn to the NLP checklist.
-
-### Deterministic Augmentations
-Deterministic augmentations are augmentation which always yield the same result.
-
-| Augmentation | Part-of-speech tagging (Accuracy) | Morphological tagging (Accuracy) | Dependency Parsing (UAS) | Dependency Parsing (LAS) | Sentence segmentation (F1) | Lemmatization (Accuracy) | Named entity recognition (F1) |
-| --- | --- | --- | --- |  --- | --- | --- |  --- |
-| No augmentation | 0.98 | 0.975 | 0.888 |  0.857 | 0.936 | 0.844 | 0.765 |
-| Æøå Augmentation | 0.963 | 0.955 | 0.88 |  0.844 | 0.944 | 0.754 | 0.712 |
-| Lowercase | 0.98 | 0.975 | 0.888 |  0.857 | 0.936 | 0.848 | 0.765 |
-| No Spacing | 0.229 | 0.229 | 0.004 |  0.004 | 0.683 | 0.225 | 0.058 |
-| Abbreviated first names | 0.976 | 0.974 | 0.885 |  0.854 | 0.934 | 0.845 | 0.741 |
-| Input size augmentation 5 sentences | 0.978 | 0.973 | 0.88 |  0.85 | 0.883 | 0.844 | 0.77 |
-| Input size augmentation 10 sentences | 0.977 | 0.973 | 0.878 |  0.847 | 0.872 | 0.844 | 0.768 |
-
-
-
-### Stochastic Augmentations
-Stochastic augmentations are augmentation which are repeated mulitple times to estimate the effect of the augmentation.
-
-| Augmentation | Part-of-speech tagging (Accuracy) | Morphological tagging (Accuracy) | Dependency Parsing (UAS) | Dependency Parsing (LAS) | Sentence segmentation (F1) | Lemmatization (Accuracy) | Named entity recognition (F1) |
-| --- | --- | --- | --- |  --- | --- | --- |  --- |
-| Keystroke errors 2% | 0.936 (0.002) | 0.934 (0.002) | 0.836 (0.002) |  0.795 (0.002) | 0.889 (0.002) | 0.773 (0.002) | 0.627 (0.002) |
-| Keystroke errors 5% | 0.869 (0.003) | 0.873 (0.003) | 0.753 (0.003) |  0.696 (0.003) | 0.829 (0.003) | 0.68 (0.003) | 0.487 (0.003) |
-| Keystroke errors 15% | 0.647 (0.007) | 0.684 (0.007) | 0.5 (0.007) |  0.417 (0.007) | 0.664 (0.007) | 0.46 (0.007) | 0.256 (0.007) |
-| Danish names | 0.978 (0.0) | 0.975 (0.0) | 0.885 (0.0) |  0.855 (0.0) | 0.934 (0.0) | 0.847 (0.0) | 0.771 (0.0) |
-| Muslim names | 0.978 (0.0) | 0.975 (0.0) | 0.886 (0.0) |  0.855 (0.0) | 0.935 (0.0) | 0.847 (0.0) | 0.749 (0.0) |
-| Female names | 0.979 (0.0) | 0.975 (0.0) | 0.886 (0.0) |  0.856 (0.0) | 0.933 (0.0) | 0.847 (0.0) | 0.775 (0.0) |
-| Male names | 0.978 (0.0) | 0.975 (0.0) | 0.885 (0.0) |  0.855 (0.0) | 0.933 (0.0) | 0.847 (0.0) | 0.773 (0.0) |
-| Spacing Augmention 5% | 0.941 (0.002) | 0.937 (0.002) | 0.78 (0.002) |  0.751 (0.002) | 0.905 (0.002) | 0.812 (0.002) | 0.701 (0.002) |
-
-<details>
-
-<summary> Description of Augmenters </summary>
-
-    
-
-**No augmentation:**
-Applies no augmentation to the DaNE test set.
-
-**Æøå Augmentation:**
-This augmentation replace the æ,ø, and å with their spelling variations ae, oe and aa respectively.
-
-**Lowercase:**
-This augmentation lowercases all text.
-
-**No Spacing:**
-This augmentation removed all spacing from the text.
-
-**Abbreviated first names:**
-This agmentation abbreviates the first names of entities. For instance 'Kenneth Enevoldsen' would turn to 'K. Enevoldsen'.
-
-**Keystroke errors 2%:**
-This agmentation simulate keystroke errors by replacing 2% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Keystroke errors 5%:**
-This agmentation simulate keystroke errors by replacing 5% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Keystroke errors 15%:**
-This agmentation simulate keystroke errors by replacing 15% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Danish names:**
-This agmentation replace all names with Danish names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Muslim names:**
-This agmentation replace all names with Muslim names derived from  Meldgaard (2005). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Female names:**
-This agmentation replace all names with Danish female names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Male names:**
-This agmentation replace all names with Danish male names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Spacing Augmention 5%:**
-This agmentation replace all names with Danish male names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
- </details> 
- <br /> 
-
-
-### Hardware
-This was run an trained on a Quadro RTX 8000 GPU.
+| `TOKEN_ACC` | 99.92 |
+| `TOKEN_P` | 99.70 |
+| `TOKEN_R` | 99.77 |
+| `TOKEN_F` | 99.74 |
+| `SENTS_P` | 98.42 |
+| `SENTS_R` | 99.29 |
+| `SENTS_F` | 98.85 |
+| `TAG_ACC` | 98.47 |
+| `POS_ACC` | 98.57 |
+| `MORPH_ACC` | 98.14 |
+| `MORPH_MICRO_P` | 99.10 |
+| `MORPH_MICRO_R` | 98.77 |
+| `MORPH_MICRO_F` | 98.93 |
+| `DEP_UAS` | 90.84 |
+| `DEP_LAS` | 88.33 |
+| `ENTS_P` | 87.08 |
+| `ENTS_R` | 84.59 |
+| `ENTS_F` | 85.82 |
+| `COREF_LEA_F1` | 41.18 |
+| `COREF_LEA_PRECISION` | 48.89 |
+| `COREF_LEA_RECALL` | 35.58 |
+| `NEL_SCORE` | 80.12 |
+| `NEL_MICRO_P` | 99.23 |
+| `NEL_MICRO_R` | 67.19 |
+| `NEL_MICRO_F` | 80.12 |
+| `NEL_MACRO_P` | 99.39 |
+| `NEL_MACRO_R` | 65.99 |
+| `NEL_MACRO_F` | 78.15 |
+
+
+
+### Training
+This model was trained using [spaCy](https://spacy.io) and logged to [Weights & Biases](https://wandb.ai/kenevoldsen/dacy-v0.2.0). You can find all the training logs [here](https://wandb.ai/kenevoldsen/dacy-v0.2.0).

attribute_ruler/patterns

@@ -1 +0,0 @@
-�

config.cfg

@@ -1,54 +1,101 @@
 [paths]
-train = "corpus/dane/train.spacy"
-dev = "corpus/dane/dev.spacy"
-vectors = null
-raw = null
+train = null
+dev = null
 init_tok2vec = null
-vocab_data = null
+vectors = null
+model_source = "training/da_dacy_medium_trf/model-last"
 
 [system]
 gpu_allocator = "pytorch"
-seed = 1
+seed = 0
 
 [nlp]
 lang = "da"
-pipeline = ["transformer","morphologizer","parser","attribute_ruler","lemmatizer","ner"]
+pipeline = ["transformer","tagger","morphologizer","trainable_lemmatizer","parser","ner","coref","span_resolver","span_cleaner","entity_linker"]
+batch_size = 512
 disabled = []
 before_creation = null
 after_creation = null
 after_pipeline_creation = null
-batch_size = 64
 tokenizer = {"@tokenizers":"spacy.Tokenizer.v1"}
 
 [components]
 
-[components.attribute_ruler]
-factory = "attribute_ruler"
-validate = false
+[components.coref]
+factory = "experimental_coref"
+span_cluster_prefix = "coref_head_clusters"
 
-[components.lemmatizer]
-factory = "lemmatizer"
-mode = "lookup"
-model = null
-overwrite = false
+[components.coref.model]
+@architectures = "spacy-experimental.Coref.v1"
+distance_embedding_size = 20
+dropout = 0.3
+hidden_size = 1024
+depth = 2
+antecedent_limit = 100
+antecedent_batch_size = 512
+
+[components.coref.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 0.5
+upstream = "transformer"
+pooling = {"@layers":"reduce_mean.v1"}
+
+[components.coref.scorer]
+@scorers = "spacy-experimental.coref_scorer.v1"
+span_cluster_prefix = "coref_head_clusters"
+
+[components.entity_linker]
+factory = "entity_linker"
+candidates_batch_size = 1
+entity_vector_length = 768
+generate_empty_kb = {"@misc":"spacy.EmptyKB.v2"}
+get_candidates = {"@misc":"spacy.CandidateGenerator.v1"}
+get_candidates_batch = {"@misc":"spacy.CandidateBatchGenerator.v1"}
+incl_context = true
+incl_prior = true
+labels_discard = []
+n_sents = 0
+overwrite = true
+scorer = {"@scorers":"spacy.entity_linker_scorer.v1"}
+threshold = null
+use_gold_ents = true
+
+[components.entity_linker.model]
+@architectures = "spacy.EntityLinker.v2"
+nO = null
+
+[components.entity_linker.model.tok2vec]
+@architectures = "spacy.HashEmbedCNN.v2"
+pretrained_vectors = null
+width = 96
+depth = 2
+embed_size = 2000
+window_size = 1
+maxout_pieces = 3
+subword_features = true
 
 [components.morphologizer]
 factory = "morphologizer"
+extend = false
+overwrite = true
+scorer = {"@scorers":"spacy.morphologizer_scorer.v1"}
 
 [components.morphologizer.model]
-@architectures = "spacy.Tagger.v1"
+@architectures = "spacy.Tagger.v2"
 nO = null
+normalize = false
 
 [components.morphologizer.model.tok2vec]
 @architectures = "spacy-transformers.TransformerListener.v1"
 grad_factor = 1.0
-upstream = "transformer"
 pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
 
 [components.ner]
 factory = "ner"
 incorrect_spans_key = null
 moves = null
+scorer = {"@scorers":"spacy.ner_scorer.v1"}
 update_with_oracle_cut_size = 100
 
 [components.ner.model]
@@ -63,96 +110,169 @@ nO = null
 [components.ner.model.tok2vec]
 @architectures = "spacy-transformers.TransformerListener.v1"
 grad_factor = 1.0
-upstream = "transformer"
 pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
 
 [components.parser]
 factory = "parser"
 learn_tokens = false
 min_action_freq = 30
 moves = null
+scorer = {"@scorers":"spacy.parser_scorer.v1"}
 update_with_oracle_cut_size = 100
 
 [components.parser.model]
 @architectures = "spacy.TransitionBasedParser.v2"
 state_type = "parser"
 extra_state_tokens = false
-hidden_width = 64
-maxout_pieces = 2
+hidden_width = 128
+maxout_pieces = 3
 use_upper = false
 nO = null
 
 [components.parser.model.tok2vec]
 @architectures = "spacy-transformers.TransformerListener.v1"
 grad_factor = 1.0
+pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
+
+[components.span_cleaner]
+factory = "experimental_span_cleaner"
+prefix = "coref_head_clusters"
+
+[components.span_resolver]
+factory = "experimental_span_resolver"
+input_prefix = "coref_head_clusters"
+output_prefix = "coref_clusters"
+
+[components.span_resolver.model]
+@architectures = "spacy-experimental.SpanResolver.v1"
+hidden_size = 1024
+distance_embedding_size = 64
+conv_channels = 4
+window_size = 1
+max_distance = 128
+prefix = "coref_head_clusters"
+
+[components.span_resolver.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 0.0
 upstream = "transformer"
 pooling = {"@layers":"reduce_mean.v1"}
 
+[components.span_resolver.scorer]
+@scorers = "spacy-experimental.span_resolver_scorer.v1"
+input_prefix = "coref_head_clusters"
+output_prefix = "coref_clusters"
+
+[components.tagger]
+factory = "tagger"
+neg_prefix = "!"
+overwrite = false
+scorer = {"@scorers":"spacy.tagger_scorer.v1"}
+
+[components.tagger.model]
+@architectures = "spacy.Tagger.v2"
+nO = null
+normalize = false
+
+[components.tagger.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 1.0
+pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
+
+[components.trainable_lemmatizer]
+factory = "trainable_lemmatizer"
+backoff = "orth"
+min_tree_freq = 3
+overwrite = false
+scorer = {"@scorers":"spacy.lemmatizer_scorer.v1"}
+top_k = 1
+
+[components.trainable_lemmatizer.model]
+@architectures = "spacy.Tagger.v2"
+nO = null
+normalize = false
+
+[components.trainable_lemmatizer.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 1.0
+pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
+
 [components.transformer]
 factory = "transformer"
 max_batch_items = 4096
 set_extra_annotations = {"@annotation_setters":"spacy-transformers.null_annotation_setter.v1"}
 
 [components.transformer.model]
-@architectures = "spacy-transformers.TransformerModel.v1"
-name = "Maltehb/danish-bert-botxo"
+@architectures = "spacy-transformers.TransformerModel.v3"
+name = "vesteinn/DanskBERT"
+mixed_precision = false
 
 [components.transformer.model.get_spans]
 @span_getters = "spacy-transformers.strided_spans.v1"
-window = 128
-stride = 96
+window = 400
+stride = 350
+
+[components.transformer.model.grad_scaler_config]
 
 [components.transformer.model.tokenizer_config]
 use_fast = true
-strip_accents = false
+
+[components.transformer.model.transformer_config]
 
 [corpora]
 
 [corpora.dev]
 @readers = "spacy.Corpus.v1"
-limit = 0
-max_length = 0
-path = ${paths:dev}
+path = ${paths.dev}
 gold_preproc = false
+max_length = 0
+limit = 0
 augmenter = null
 
 [corpora.train]
 @readers = "spacy.Corpus.v1"
-path = ${paths:train}
-max_length = 500
+path = ${paths.train}
 gold_preproc = false
+max_length = 0
 limit = 0
-
-[corpora.train.augmenter]
-@augmenters = "spacy.lower_case.v1"
-level = 0.1
+augmenter = null
 
 [training]
-train_corpus = "corpora.train"
-dev_corpus = "corpora.dev"
-seed = ${system:seed}
-gpu_allocator = ${system:gpu_allocator}
+seed = ${system.seed}
+gpu_allocator = ${system.gpu_allocator}
 dropout = 0.1
-accumulate_gradient = 3
-patience = 5000
+accumulate_gradient = 1
+patience = 1600
 max_epochs = 0
 max_steps = 20000
-eval_frequency = 1000
+eval_frequency = 200
 frozen_components = []
-before_to_disk = null
 annotating_components = []
+dev_corpus = "corpora.dev"
+train_corpus = "corpora.train"
+before_to_disk = null
+before_update = null
 
 [training.batcher]
-@batchers = "spacy.batch_by_padded.v1"
-discard_oversize = true
+@batchers = "spacy.batch_by_words.v1"
+discard_oversize = false
+tolerance = 0.2
 get_length = null
-size = 2000
-buffer = 256
+
+[training.batcher.size]
+@schedules = "compounding.v1"
+start = 100
+stop = 1000
+compound = 1.001
+t = 0.0
 
 [training.logger]
-@loggers = "spacy.WandbLogger.v1"
-project_name = "dacy-an-efficient-pipeline-for-danish"
-remove_config_values = []
+@loggers = "spacy.ConsoleLogger.v1"
+progress_bar = false
 
 [training.optimizer]
 @optimizers = "Adam.v1"
@@ -161,66 +281,44 @@ beta2 = 0.999
 L2_is_weight_decay = true
 L2 = 0.01
 grad_clip = 1.0
-use_averages = true
+use_averages = false
 eps = 0.00000001
-
-[training.optimizer.learn_rate]
-@schedules = "warmup_linear.v1"
-warmup_steps = 250
-total_steps = 20000
-initial_rate = 0.00005
+learn_rate = 0.001
 
 [training.score_weights]
-pos_acc = 0.08
-morph_acc = 0.08
+tag_acc = 0.12
+pos_acc = 0.06
+morph_acc = 0.06
 morph_per_feat = null
-dep_uas = 0.0
-dep_las = 0.16
+lemma_acc = 0.12
+dep_uas = 0.06
+dep_las = 0.06
 dep_las_per_type = null
 sents_p = null
 sents_r = null
-sents_f = 0.02
-lemma_acc = 0.5
-ents_f = 0.16
+sents_f = 0.0
+ents_f = 0.12
 ents_p = 0.0
 ents_r = 0.0
 ents_per_type = null
+coref_f = 0.12
+coref_p = null
+coref_r = null
+span_accuracy = 0.12
+nel_micro_f = 0.12
+nel_micro_r = null
+nel_micro_p = null
 
 [pretraining]
 
 [initialize]
-vocab_data = ${paths.vocab_data}
 vectors = ${paths.vectors}
 init_tok2vec = ${paths.init_tok2vec}
+vocab_data = null
+lookups = null
 before_init = null
 after_init = null
 
 [initialize.components]
 
-[initialize.components.morphologizer]
-
-[initialize.components.morphologizer.labels]
-@readers = "spacy.read_labels.v1"
-path = "corpus/labels/morphologizer.json"
-require = false
-
-[initialize.components.ner]
-
-[initialize.components.ner.labels]
-@readers = "spacy.read_labels.v1"
-path = "corpus/labels/ner.json"
-require = false
-
-[initialize.components.parser]
-
-[initialize.components.parser.labels]
-@readers = "spacy.read_labels.v1"
-path = "corpus/labels/parser.json"
-require = false
-
-[initialize.lookups]
-@misc = "spacy.LookupsDataLoader.v1"
-lang = ${nlp.lang}
-tables = ["lexeme_norm"]
-
 [initialize.tokenizer]

coref/cfg

@@ -0,0 +1,3 @@
+{
+  "nI":768
+}

lemmatizer/lookups/lookups.bin → coref/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6864ce8705293ba1b6dcf349ec133cdc33db3ba57f6e9337458cfe5073b6f103
-size 11537995
+oid sha256:be2b3ea7f99886e627799923f87a8de20ed5c4acaf1481f4d1840694c91dbf0a
+size 34992476

da_dacy_medium_trf-any-py3-none-any.whl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:18148d5a7c83d6842645d471d6ea6973c11b1e039bdc3a1a704f4c2c7c9ea7b4
-size 417787063
+oid sha256:1df8fffe95cf7461daed0f6c757ec11171096d5be627498818c652b1aff42bcb
+size 490235375

entity_linker/cfg

@@ -0,0 +1,3 @@
+{
+  "overwrite":true
+}

transformer/model/pytorch_model.bin → entity_linker/kb/contents

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f657cf1de5ca07b7c7940a3b91f6061a4b5bfafb8c27ba5bd96a853a3ccf4e1b
-size 442554327
+oid sha256:5249a8cbe7d241943bf2297681a7a140467506bd507922c2e47643cd64d2888c
+size 8778224

entity_linker/kb/strings.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:732a4ef43858427e5728dbfe761a5a082708791b280e19b62a949dc86d94d43b
+size 559069

entity_linker/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21879aaf49f428b07c5fb89dce1b90067dcc8e62b70c93a86522fd3461362ba6
+size 3411574

meta.json

@@ -1,14 +1,14 @@
 {
   "lang":"da",
   "name":"dacy_medium_trf",
-  "version":"0.1.0",
-  "description":"\n<a href=\"https://github.com/centre-for-humanities-computing/Dacy\"><img src=\"https://centre-for-humanities-computing.github.io/DaCy/_static/icon.png\" width=\"175\" height=\"175\" align=\"right\" /></a>\n\n# DaCy medium transformer\n\nDaCy is a Danish language processing framework with state-of-the-art pipelines as well as functionality for analysing Danish pipelines.\nDaCy's largest pipeline has achieved State-of-the-Art performance on Named entity recognition, part-of-speech tagging and dependency \nparsing for Danish on the DaNE dataset. Check out the [DaCy repository](https://github.com/centre-for-humanities-computing/DaCy) for material on how to use DaCy and reproduce the results. \nDaCy also contains guides on usage of the package as well as behavioural test for biases and robustness of Danish NLP pipelines.\n    ",
-  "author":"Centre for Humanities Computing Aarhus",
+  "version":"0.2.0",
+  "description":"\n<a href=\"https://github.com/centre-for-humanities-computing/Dacy\"><img src=\"https://centre-for-humanities-computing.github.io/DaCy/_static/icon.png\" width=\"175\" height=\"175\" align=\"right\" /></a>\n\n# DaCy medium\n\nDaCy is a Danish language processing framework with state-of-the-art pipelines as well as functionality for analysing Danish pipelines.\nDaCy's largest pipeline has achieved State-of-the-Art performance on parts-of-speech tagging and dependency \nparsing for Danish on the DaNE dataset. To read more check out the [DaCy repository](https://github.com/centre-for-humanities-computing/DaCy) for material on how to use DaCy and reproduce the results. \nDaCy also contains guides on usage of the package as well as behavioural test for biases and robustness of Danish NLP pipelines.\n",
+  "author":"Kenneth Enevoldsen",
   "email":"[email protected]",
   "url":"https://chcaa.io/#/",
   "license":"Apache-2.0 License",
-  "spacy_version":">=3.1.1,<3.2.0",
-  "spacy_git_version":"ffaead8fe",
+  "spacy_version":">=3.5.2,<3.6.0",
+  "spacy_git_version":"Unknown",
   "vectors":{
     "width":0,
     "vectors":0,
@@ -18,6 +18,25 @@
   "labels":{
     "transformer":[
 
+    ],
+    "tagger":[
+      "ADJ",
+      "ADP",
+      "ADV",
+      "AUX",
+      "CCONJ",
+      "DET",
+      "INTJ",
+      "NOUN",
+      "NUM",
+      "PART",
+      "PRON",
+      "PROPN",
+      "PUNCT",
+      "SCONJ",
+      "SYM",
+      "VERB",
+      "X"
     ],
     "morphologizer":[
       "AdpType=Prep|POS=ADP",
@@ -34,155 +53,157 @@
       "Degree=Pos|Number=Plur|POS=ADJ",
       "Definite=Ind|Gender=Com|Number=Plur|POS=NOUN",
       "POS=PUNCT",
+      "NumType=Ord|POS=ADJ",
       "POS=CCONJ",
-      "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ",
-      "Degree=Cmp|POS=ADJ",
-      "POS=PRON|PartType=Inf",
-      "Gender=Com|Number=Sing|POS=DET|PronType=Ind",
-      "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ",
-      "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs",
       "Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN",
-      "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ",
-      "Gender=Neut|Number=Sing|POS=DET|PronType=Dem",
+      "POS=VERB|VerbForm=Inf|Voice=Act",
+      "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs",
+      "Degree=Sup|POS=ADV",
       "Degree=Pos|POS=ADV",
-      "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part",
-      "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN",
-      "POS=PRON|PronType=Dem",
-      "NumType=Card|POS=NUM",
-      "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ",
-      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs",
-      "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ",
+      "Gender=Com|Number=Sing|POS=DET|PronType=Ind",
+      "Number=Plur|POS=DET|PronType=Ind",
+      "POS=ADP",
+      "POS=ADV|PartType=Inf",
       "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs",
-      "NumType=Ord|POS=ADJ",
-      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
       "Mood=Ind|POS=AUX|Tense=Past|VerbForm=Fin|Voice=Act",
-      "POS=VERB|VerbForm=Inf|Voice=Act",
+      "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ",
+      "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs",
       "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Act",
-      "POS=NOUN",
-      "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass",
       "POS=ADP|PartType=Inf",
+      "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ",
+      "NumType=Card|POS=NUM",
       "Degree=Pos|POS=ADJ",
+      "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part",
+      "POS=PART|PartType=Inf",
+      "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes",
       "Definite=Def|Gender=Com|Number=Plur|POS=NOUN",
-      "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs",
+      "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN",
+      "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs",
+      "POS=VERB|Tense=Pres|VerbForm=Part",
+      "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs",
       "Case=Gen|Definite=Def|Gender=Com|Number=Sing|POS=NOUN",
+      "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ",
+      "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs",
       "POS=AUX|VerbForm=Inf|Voice=Act",
-      "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ",
+      "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ",
+      "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ",
+      "Degree=Cmp|POS=ADJ",
+      "POS=PRON|PartType=Inf",
+      "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ",
+      "Case=Nom|Gender=Com|POS=PRON|PronType=Ind",
+      "Number=Plur|POS=PRON|PronType=Ind",
+      "POS=INTJ",
       "Gender=Com|Number=Sing|POS=DET|PronType=Dem",
-      "Number=Plur|POS=DET|PronType=Ind",
-      "Gender=Com|Number=Sing|POS=PRON|PronType=Ind",
-      "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes",
-      "POS=PART|PartType=Inf",
+      "Case=Gen|Number=Plur|POS=DET|PronType=Ind",
+      "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass",
+      "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN",
+      "Degree=Cmp|POS=ADV",
+      "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form",
+      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs",
+      "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+      "Case=Gen|POS=PROPN",
+      "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind",
+      "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part",
+      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs",
+      "Definite=Def|Degree=Sup|POS=ADJ",
       "Gender=Neut|Number=Sing|POS=DET|PronType=Ind",
-      "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs",
-      "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN",
-      "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs",
+      "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN",
+      "Gender=Neut|Number=Sing|POS=DET|PronType=Dem",
+      "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part",
+      "POS=PRON|PronType=Dem",
+      "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ",
+      "Number=Plur|POS=NUM",
+      "POS=VERB|VerbForm=Inf|Voice=Pass",
+      "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ",
+      "Number=Sing|POS=PRON|PronType=Int,Rel",
       "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs",
-      "Case=Nom|Gender=Com|POS=PRON|PronType=Ind",
-      "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind",
-      "Mood=Imp|POS=VERB",
+      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
       "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
-      "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part",
-      "POS=X",
+      "POS=PRON",
+      "Definite=Ind|Number=Sing|POS=NOUN",
+      "Definite=Ind|Number=Sing|POS=NUM",
+      "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN",
+      "Foreign=Yes|POS=ADV",
+      "POS=NOUN",
+      "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN",
+      "Gender=Com|Number=Plur|POS=NOUN",
+      "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel",
       "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs",
+      "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs",
+      "Gender=Com|Number=Sing|POS=PRON|PronType=Ind",
+      "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN",
+      "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ",
+      "Degree=Sup|POS=ADJ",
+      "Degree=Pos|Number=Sing|POS=ADJ",
+      "Mood=Imp|POS=VERB",
+      "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs",
+      "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs",
+      "POS=X",
       "Case=Gen|Definite=Def|Gender=Com|Number=Plur|POS=NOUN",
-      "POS=VERB|Tense=Pres|VerbForm=Part",
-      "Number=Plur|POS=PRON|PronType=Int,Rel",
-      "POS=VERB|VerbForm=Inf|Voice=Pass",
-      "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN",
-      "Degree=Cmp|POS=ADV",
-      "POS=ADV|PartType=Inf",
-      "Degree=Sup|POS=ADV",
       "Number=Plur|POS=PRON|PronType=Dem",
-      "Number=Plur|POS=PRON|PronType=Ind",
-      "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN",
-      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs",
-      "Case=Gen|POS=PROPN",
-      "POS=ADP",
+      "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs",
+      "Number=Plur|POS=PRON|PronType=Int,Rel",
+      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
       "Degree=Cmp|Number=Plur|POS=ADJ",
-      "Definite=Def|Degree=Sup|POS=ADJ",
-      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
-      "Degree=Pos|Number=Sing|POS=ADJ",
-      "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+      "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
       "Gender=Com|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form",
+      "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs",
+      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs",
+      "Gender=Com|POS=PRON|PronType=Int,Rel",
+      "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ",
+      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+      "POS=VERB|VerbForm=Ger",
+      "Gender=Com|Number=Sing|POS=PRON|PronType=Dem",
+      "Case=Gen|POS=PRON|PronType=Int,Rel",
+      "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass",
+      "Abbr=Yes|POS=X",
+      "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN",
+      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs",
+      "Definite=Ind|Number=Plur|POS=NOUN",
+      "Foreign=Yes|POS=X",
       "Number=Plur|POS=PRON|PronType=Rcp",
+      "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs",
       "Case=Gen|Degree=Cmp|POS=ADJ",
       "Case=Gen|Definite=Def|Gender=Neut|Number=Plur|POS=NOUN",
-      "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs",
-      "POS=INTJ",
-      "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
-      "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ",
-      "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form",
-      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs",
-      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs",
-      "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN",
-      "Number=Sing|POS=PRON|PronType=Int,Rel",
+      "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs",
+      "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem",
       "Number=Plur|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form",
-      "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel",
-      "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ",
-      "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs",
-      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-      "Definite=Ind|Number=Sing|POS=NOUN",
-      "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part",
+      "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form",
       "Number=Plur|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-      "POS=SYM",
-      "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs",
-      "Degree=Sup|POS=ADJ",
-      "Number=Plur|POS=DET|PronType=Ind|Style=Arch",
-      "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Dem",
-      "Foreign=Yes|POS=X",
+      "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs",
+      "Case=Gen|Number=Plur|POS=PRON|PronType=Rcp",
       "POS=DET|Person=2|Polite=Form|Poss=Yes|PronType=Prs",
-      "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem",
-      "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs",
-      "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN",
-      "Case=Gen|POS=PRON|PronType=Int,Rel",
-      "Gender=Com|Number=Sing|POS=PRON|PronType=Dem",
-      "Abbr=Yes|POS=X",
-      "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN",
+      "POS=SYM",
+      "POS=DET|PronType=Dem",
+      "Gender=Com|Number=Sing|POS=NUM",
+      "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs",
+      "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part",
       "Definite=Def|Degree=Abs|POS=ADJ",
-      "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ",
-      "Definite=Ind|POS=NOUN",
-      "Gender=Com|Number=Plur|POS=NOUN",
-      "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs",
-      "Gender=Com|POS=PRON|PronType=Int,Rel",
-      "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs",
+      "POS=VERB|Tense=Pres",
+      "Definite=Ind|Gender=Neut|Number=Sing|POS=NUM",
       "Degree=Abs|POS=ADV",
-      "POS=VERB|VerbForm=Ger",
-      "POS=VERB|Tense=Past|VerbForm=Part",
-      "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ",
-      "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form",
       "Case=Gen|Definite=Def|Degree=Pos|Number=Sing|POS=ADJ",
-      "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ",
-      "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs",
       "Gender=Com|Number=Sing|POS=PRON|PronType=Int,Rel",
-      "POS=VERB|Tense=Pres",
-      "Case=Gen|Number=Plur|POS=DET|PronType=Ind",
-      "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs",
-      "POS=PRON|Person=2|Polite=Form|Poss=Yes|PronType=Prs",
+      "POS=VERB|Tense=Past|VerbForm=Part",
+      "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ",
       "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs",
-      "POS=AUX|Tense=Pres|VerbForm=Part",
-      "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass",
-      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-      "Degree=Sup|Number=Plur|POS=ADJ",
-      "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs",
-      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-      "Definite=Ind|Number=Plur|POS=NOUN",
-      "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part",
-      "Mood=Imp|POS=AUX",
       "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=1|Poss=Yes|PronType=Prs",
-      "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs",
-      "Definite=Def|Gender=Com|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part",
       "Number=Plur|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs",
+      "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs",
+      "Definite=Ind|POS=NOUN",
       "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Ind",
+      "Definite=Ind|Gender=Com|Number=Sing|POS=NUM",
+      "Definite=Def|Number=Plur|POS=NOUN",
       "Case=Gen|POS=NOUN",
-      "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs",
-      "POS=DET|PronType=Dem",
-      "Definite=Def|Number=Plur|POS=NOUN"
+      "POS=AUX|Tense=Pres|VerbForm=Part"
     ],
     "parser":[
       "ROOT",
       "acl:relcl",
       "advcl",
       "advmod",
+      "advmod:lmod",
       "amod",
       "appos",
       "aux",
@@ -206,376 +227,458 @@
       "nummod",
       "obj",
       "obl",
-      "obl:loc",
+      "obl:lmod",
       "obl:tmod",
       "punct",
       "xcomp"
-    ],
-    "attribute_ruler":[
-
-    ],
-    "lemmatizer":[
-
     ],
     "ner":[
       "LOC",
       "MISC",
       "ORG",
       "PER"
+    ],
+    "coref":[
+
+    ],
+    "span_resolver":[
+
+    ],
+    "entity_linker":[
+
     ]
   },
   "pipeline":[
     "transformer",
+    "tagger",
     "morphologizer",
+    "trainable_lemmatizer",
     "parser",
-    "attribute_ruler",
-    "lemmatizer",
-    "ner"
+    "ner",
+    "coref",
+    "span_resolver",
+    "span_cleaner",
+    "entity_linker"
   ],
   "components":[
     "transformer",
+    "tagger",
     "morphologizer",
+    "trainable_lemmatizer",
     "parser",
-    "attribute_ruler",
-    "lemmatizer",
-    "ner"
+    "ner",
+    "coref",
+    "span_resolver",
+    "span_cleaner",
+    "entity_linker"
   ],
   "disabled":[
 
   ],
-  "_sourced_vectors_hashes":{
-
-  },
+  "requirements":[
+    "spacy-transformers>=1.2.3,<1.3.0",
+    "spacy-experimental>=0.6.2,<0.7.0"
+  ],
   "performance":{
-    "pos_acc":0.9744285161,
-    "morph_acc":0.9723944208,
+    "token_acc":0.9992023928,
+    "token_p":0.9970089731,
+    "token_r":0.9977052779,
+    "token_f":0.9973570039,
+    "sents_p":0.9842105263,
+    "sents_r":0.992920354,
+    "sents_f":0.9885462555,
+    "tag_acc":0.9847290149,
+    "pos_acc":0.985677928,
+    "morph_acc":0.9814371257,
+    "morph_micro_p":0.9910058542,
+    "morph_micro_r":0.9876942662,
+    "morph_micro_f":0.989347289,
     "morph_per_feat":{
-      "Mood":{
-        "p":0.9942473634,
-        "r":0.9885605338,
-        "f":0.9913957935
-      },
-      "Tense":{
-        "p":0.9841029523,
-        "r":0.9789156627,
-        "f":0.9815024538
+      "NumType":{
+        "p":0.987654321,
+        "r":0.9302325581,
+        "f":0.9580838323
       },
-      "VerbForm":{
-        "p":0.9852125693,
-        "r":0.9785801714,
-        "f":0.9818851704
+      "Degree":{
+        "p":0.9894736842,
+        "r":0.9715762274,
+        "f":0.9804432855
       },
-      "Voice":{
-        "p":0.9947407964,
-        "r":0.9895366218,
-        "f":0.9921318846
+      "Number":{
+        "p":0.9884148064,
+        "r":0.9859075536,
+        "f":0.987159588
       },
       "Definite":{
-        "p":0.9879711307,
-        "r":0.9735282497,
-        "f":0.9806965174
+        "p":0.9858490566,
+        "r":0.9837398374,
+        "f":0.9847933176
       },
       "Gender":{
-        "p":0.9828686597,
-        "r":0.9724160851,
-        "f":0.9776144337
+        "p":0.9869901547,
+        "r":0.9838766211,
+        "f":0.9854309286
       },
-      "Number":{
-        "p":0.986803906,
-        "r":0.9752217006,
-        "f":0.9809786173
+      "Mood":{
+        "p":0.9971126083,
+        "r":0.9942418426,
+        "f":0.9956751562
+      },
+      "Tense":{
+        "p":0.9906469213,
+        "r":0.9906469213,
+        "f":0.9906469213
+      },
+      "VerbForm":{
+        "p":0.9924670433,
+        "r":0.9918444166,
+        "f":0.9921556323
+      },
+      "Voice":{
+        "p":0.997012696,
+        "r":0.9955257271,
+        "f":0.9962686567
       },
       "AdpType":{
-        "p":0.9946714032,
-        "r":0.9902740937,
-        "f":0.9924678777
+        "p":0.9990689013,
+        "r":0.9972118959,
+        "f":0.9981395349
       },
-      "PartType":{
-        "p":1.0,
-        "r":0.9967532468,
-        "f":0.9983739837
+      "PronType":{
+        "p":0.9954914337,
+        "r":0.9963898917,
+        "f":0.9959404601
       },
       "Case":{
-        "p":0.9951923077,
-        "r":0.981042654,
-        "f":0.9880668258
+        "p":0.9968652038,
+        "r":0.9860465116,
+        "f":0.9914263445
       },
       "Person":{
-        "p":0.9875,
-        "r":0.9822380107,
-        "f":0.9848619768
-      },
-      "PronType":{
-        "p":0.9950413223,
-        "r":0.9901315789,
-        "f":0.9925803792
+        "p":0.9930555556,
+        "r":0.9913344887,
+        "f":0.9921942758
       },
-      "NumType":{
-        "p":0.9798657718,
-        "r":0.9668874172,
-        "f":0.9733333333
+      "Number[psor]":{
+        "p":0.987804878,
+        "r":1.0,
+        "f":0.9938650307
       },
-      "Degree":{
-        "p":0.9754901961,
-        "r":0.9590361446,
-        "f":0.9671931956
+      "Poss":{
+        "p":0.987804878,
+        "r":1.0,
+        "f":0.9938650307
       },
-      "Reflex":{
+      "PartType":{
         "p":1.0,
-        "r":1.0,
-        "f":1.0
+        "r":0.9962406015,
+        "f":0.9981167608
       },
       "Polite":{
-        "p":0.0,
-        "r":0.0,
-        "f":0.0
-      },
-      "Number[psor]":{
-        "p":0.9770114943,
-        "r":0.988372093,
-        "f":0.9826589595
+        "p":0.6666666667,
+        "r":0.6666666667,
+        "f":0.6666666667
       },
-      "Poss":{
+      "Reflex":{
         "p":1.0,
-        "r":0.9886363636,
-        "f":0.9942857143
+        "r":1.0,
+        "f":1.0
       },
       "Foreign":{
-        "p":1.0,
-        "r":0.4,
-        "f":0.5714285714
-      },
-      "Abbr":{
-        "p":1.0,
-        "r":0.4,
-        "f":0.5714285714
+        "p":0.5,
+        "r":0.2,
+        "f":0.2857142857
       },
       "Style":{
         "p":1.0,
         "r":1.0,
         "f":1.0
+      },
+      "Abbr":{
+        "p":0.6666666667,
+        "r":1.0,
+        "f":0.8
       }
     },
-    "dep_uas":0.8714971531,
-    "dep_las":0.8396963608,
+    "dep_uas":0.9083920564,
+    "dep_las":0.883349834,
     "dep_las_per_type":{
-      "advmod":{
-        "p":0.793006993,
-        "r":0.8008474576,
-        "f":0.796907941
+      "nummod":{
+        "p":0.7948717949,
+        "r":0.8230088496,
+        "f":0.8086956522
       },
-      "root":{
-        "p":0.8450704225,
-        "r":0.8510638298,
-        "f":0.8480565371
+      "amod":{
+        "p":0.897810219,
+        "r":0.9027522936,
+        "f":0.9002744739
       },
-      "nsubj":{
-        "p":0.9174603175,
-        "r":0.914556962,
-        "f":0.9160063391
+      "nmod":{
+        "p":0.7712418301,
+        "r":0.7729257642,
+        "f":0.772082879
       },
-      "case":{
-        "p":0.9192422732,
-        "r":0.9110671937,
-        "f":0.9151364764
+      "nsubj":{
+        "p":0.9510638298,
+        "r":0.946031746,
+        "f":0.9485411141
       },
-      "obl":{
-        "p":0.7719568567,
-        "r":0.7791601866,
-        "f":0.7755417957
+      "flat":{
+        "p":0.9285714286,
+        "r":0.9680851064,
+        "f":0.9479166667
       },
       "cc":{
-        "p":0.851744186,
-        "r":0.851744186,
-        "f":0.851744186
+        "p":0.8681672026,
+        "r":0.8940397351,
+        "f":0.88091354
       },
       "conj":{
-        "p":0.7320954907,
-        "r":0.736,
-        "f":0.7340425532
+        "p":0.8862275449,
+        "r":0.8554913295,
+        "f":0.8705882353
       },
-      "obj":{
-        "p":0.8736263736,
-        "r":0.9262135922,
-        "f":0.8991517436
+      "root":{
+        "p":0.926056338,
+        "r":0.9309734513,
+        "f":0.9285083848
+      },
+      "advmod":{
+        "p":0.8871715611,
+        "r":0.8605697151,
+        "f":0.8736681887
+      },
+      "mark":{
+        "p":0.9148471616,
+        "r":0.9331848552,
+        "f":0.9239250276
       },
       "aux":{
-        "p":0.8796561605,
-        "r":0.8950437318,
-        "f":0.887283237
+        "p":0.9875389408,
+        "r":0.9753846154,
+        "f":0.9814241486
       },
-      "acl:relcl":{
-        "p":0.729281768,
-        "r":0.7135135135,
-        "f":0.7213114754
+      "ccomp":{
+        "p":0.7764705882,
+        "r":0.835443038,
+        "f":0.8048780488
       },
-      "obl:loc":{
-        "p":0.7285714286,
-        "r":0.7285714286,
-        "f":0.7285714286
+      "case":{
+        "p":0.9348986126,
+        "r":0.9192025184,
+        "f":0.926984127
       },
       "det":{
-        "p":0.9339933993,
-        "r":0.9324546952,
-        "f":0.933223413
+        "p":0.9409448819,
+        "r":0.9637096774,
+        "f":0.9521912351
       },
-      "amod":{
-        "p":0.8799313894,
-        "r":0.8754266212,
-        "f":0.877673225
+      "obl":{
+        "p":0.8476821192,
+        "r":0.8114104596,
+        "f":0.8291497976
       },
       "nmod:poss":{
-        "p":0.702970297,
-        "r":0.702970297,
-        "f":0.702970297
-      },
-      "ccomp":{
-        "p":0.75,
-        "r":0.7741935484,
-        "f":0.7619047619
+        "p":0.8181818182,
+        "r":0.8256880734,
+        "f":0.8219178082
       },
-      "nummod":{
-        "p":0.808,
-        "r":0.8416666667,
-        "f":0.8244897959
+      "obj":{
+        "p":0.8943533698,
+        "r":0.9352380952,
+        "f":0.9143389199
       },
-      "flat":{
-        "p":0.8881578947,
-        "r":0.8940397351,
-        "f":0.8910891089
+      "cop":{
+        "p":0.8944099379,
+        "r":0.8834355828,
+        "f":0.8888888889
       },
-      "compound:prt":{
-        "p":0.7,
-        "r":0.512195122,
-        "f":0.5915492958
+      "acl:relcl":{
+        "p":0.8343195266,
+        "r":0.7704918033,
+        "f":0.8011363636
       },
       "advcl":{
-        "p":0.7280701754,
-        "r":0.7155172414,
-        "f":0.7217391304
-      },
-      "mark":{
-        "p":0.9145833333,
-        "r":0.9014373717,
-        "f":0.9079627715
-      },
-      "cop":{
-        "p":0.8850574713,
-        "r":0.88,
-        "f":0.88252149
+        "p":0.6742857143,
+        "r":0.7564102564,
+        "f":0.7129909366
       },
       "dep":{
-        "p":0.1855670103,
-        "r":0.3396226415,
-        "f":0.24
+        "p":0.1136363636,
+        "r":0.3333333333,
+        "f":0.1694915254
       },
-      "nmod":{
-        "p":0.7370600414,
-        "r":0.6953125,
-        "f":0.7155778894
+      "compound:prt":{
+        "p":0.6666666667,
+        "r":0.5882352941,
+        "f":0.625
+      },
+      "fixed":{
+        "p":0.9473684211,
+        "r":0.8709677419,
+        "f":0.9075630252
       },
       "iobj":{
-        "p":1.0,
-        "r":0.6363636364,
-        "f":0.7777777778
+        "p":0.7692307692,
+        "r":0.6666666667,
+        "f":0.7142857143
+      },
+      "appos":{
+        "p":0.8181818182,
+        "r":0.7105263158,
+        "f":0.7605633803
+      },
+      "obl:tmod":{
+        "p":0.5,
+        "r":0.3125,
+        "f":0.3846153846
+      },
+      "advmod:lmod":{
+        "p":0.7678571429,
+        "r":0.8958333333,
+        "f":0.8269230769
       },
       "xcomp":{
-        "p":0.625,
-        "r":0.4237288136,
-        "f":0.5050505051
+        "p":0.8913043478,
+        "r":0.640625,
+        "f":0.7454545455
       },
-      "appos":{
-        "p":0.6486486486,
-        "r":0.7272727273,
-        "f":0.6857142857
+      "expl":{
+        "p":0.9230769231,
+        "r":0.9230769231,
+        "f":0.9230769231
       },
       "list":{
-        "p":0.4,
+        "p":0.5714285714,
+        "r":0.2352941176,
+        "f":0.3333333333
+      },
+      "obl:lmod":{
+        "p":0.25,
         "r":0.3333333333,
-        "f":0.3636363636
+        "f":0.2857142857
       },
-      "vocative":{
+      "parataxis":{
         "p":0.0,
         "r":0.0,
         "f":0.0
       },
-      "fixed":{
-        "p":0.8947368421,
-        "r":0.8095238095,
-        "f":0.85
-      },
-      "expl":{
-        "p":0.9117647059,
-        "r":0.9117647059,
-        "f":0.9117647059
+      "orphan":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       },
-      "obl:tmod":{
-        "p":0.8333333333,
-        "r":0.5555555556,
-        "f":0.6666666667
+      "vocative":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       },
       "discourse":{
         "p":0.0,
         "r":0.0,
         "f":0.0
+      },
+      "dislocated":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
+      },
+      "compound":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       }
     },
-    "sents_p":0.873015873,
-    "sents_r":0.8776595745,
-    "sents_f":0.875331565,
-    "lemma_acc":0.8491041162,
-    "ents_f":0.8178980229,
-    "ents_p":0.817047817,
-    "ents_r":0.81875,
+    "ents_p":0.8708487085,
+    "ents_r":0.8458781362,
+    "ents_f":0.8581818182,
     "ents_per_type":{
+      "LOC":{
+        "p":0.854368932,
+        "r":0.9166666667,
+        "f":0.8844221106
+      },
       "PER":{
-        "p":0.896969697,
-        "r":0.8915662651,
-        "f":0.8942598187
+        "p":0.9100529101,
+        "r":0.9555555556,
+        "f":0.9322493225
       },
-      "ORG":{
-        "p":0.7228915663,
-        "r":0.6666666667,
-        "f":0.6936416185
+      "MISC":{
+        "p":0.8301886792,
+        "r":0.7272727273,
+        "f":0.7753303965
       },
+      "ORG":{
+        "p":0.8611111111,
+        "r":0.7701863354,
+        "f":0.8131147541
+      }
+    },
+    "coref_lea_f1":0.4118366346,
+    "coref_lea_precision":0.4889169083,
+    "coref_lea_recall":0.3557507008,
+    "nel_score":0.801242236,
+    "nel_score_desc":"micro F",
+    "nel_micro_p":0.9923076923,
+    "nel_micro_r":0.671875,
+    "nel_micro_f":0.801242236,
+    "nel_macro_p":0.993902439,
+    "nel_macro_r":0.6598989464,
+    "nel_macro_f":0.7815238616,
+    "nel_f_per_type":{
       "MISC":{
-        "p":0.7190082645,
-        "r":0.7699115044,
-        "f":0.7435897436
+        "p":1.0,
+        "r":0.4117647059,
+        "f":0.5833333333
+      },
+      "PER":{
+        "p":1.0,
+        "r":0.7540983607,
+        "f":0.8598130841
       },
       "LOC":{
-        "p":0.875,
-        "r":0.8828828829,
-        "f":0.8789237668
+        "p":1.0,
+        "r":0.8285714286,
+        "f":0.90625
+      },
+      "ORG":{
+        "p":0.9756097561,
+        "r":0.6451612903,
+        "f":0.7766990291
       }
-    },
-    "transformer_loss":12243.0238996088,
-    "morphologizer_loss":3888.699029932,
-    "parser_loss":78618.0269862204,
-    "ner_loss":685.0320498052
+    }
   },
   "sources":[
     {
-      "name":"UD Danish DDT v2.5",
+      "name":"UD Danish DDT v2.11",
       "url":"https://github.com/UniversalDependencies/UD_Danish-DDT",
       "license":"CC BY-SA 4.0",
       "author":"Johannsen, Anders; Mart\u00ednez Alonso, H\u00e9ctor; Plank, Barbara"
     },
     {
       "name":"DaNE",
-      "url":"https://github.com/alexandrainst/danlp/blob/master/docs/datasets.md#danish-dependency-treebank-dane",
+      "url":"https://huggingface.co/datasets/dane",
       "license":"CC BY-SA 4.0",
       "author":"Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders S\u00f8gaard"
     },
     {
-      "name":"Maltehb/danish-bert-botxo",
-      "author":"BotXO.ai",
-      "url":"https://huggingface.co/Maltehb/danish-bert-botxo",
-      "license":"CC BY 4.0"
+      "name":"DaCoref",
+      "url":"https://huggingface.co/datasets/alexandrainst/dacoref",
+      "license":"CC BY-SA 4.0",
+      "author":"Buch-Kromann, Matthias"
+    },
+    {
+      "name":"DaNED",
+      "url":"https://danlp-alexandra.readthedocs.io/en/stable/docs/datasets.html#daned",
+      "license":"CC BY-SA 4.0",
+      "author":"Barrett, M. J., Lam, H., Wu, M., Lacroix, O., Plank, B., & S\u00f8gaard, A."
+    },
+    {
+      "name":"vesteinn/DanskBERT",
+      "author":"V\u00e9steinn Sn\u00e6bjarnarson",
+      "url":"https://huggingface.co/vesteinn/DanskBERT",
+      "license":"MIT"
     }
   ],
-  "requirements":[
-    "spacy-transformers>=1.0.3,<1.1.0"
-  ],
-  "notes":"\n## Bias and Robustness\n\nBesides the validation done by SpaCy on the DaNE testset, DaCy also provides a series of augmentations to the DaNE test set to see how well the models deal with these types of augmentations.\nThe can be seen as behavioural probes akinn to the NLP checklist.\n\n### Deterministic Augmentations\nDeterministic augmentations are augmentation which always yield the same result.\n\n| Augmentation | Part-of-speech tagging (Accuracy) | Morphological tagging (Accuracy) | Dependency Parsing (UAS) | Dependency Parsing (LAS) |\u00a0Sentence segmentation (F1) | Lemmatization (Accuracy) | Named entity recognition (F1) |\n| --- | --- | --- | --- |  --- | --- | --- |  --- |\n| No augmentation | 0.98 | 0.975 | 0.888 |  0.857 | 0.936 | 0.844 | 0.765 |\n| \u00c6\u00f8\u00e5 Augmentation | 0.963 | 0.955 | 0.88 |  0.844 | 0.944 | 0.754 | 0.712 |\n| Lowercase | 0.98 | 0.975 | 0.888 |  0.857 | 0.936 | 0.848 | 0.765 |\n| No Spacing | 0.229 | 0.229 | 0.004 |  0.004 | 0.683 | 0.225 | 0.058 |\n| Abbreviated first names | 0.976 | 0.974 | 0.885 |  0.854 | 0.934 | 0.845 | 0.741 |\n| Input size augmentation 5 sentences | 0.978 | 0.973 | 0.88 |  0.85 | 0.883 | 0.844 | 0.77 |\n| Input size augmentation 10 sentences | 0.977 | 0.973 | 0.878 |  0.847 | 0.872 | 0.844 | 0.768 |\n\n\n\n### Stochastic Augmentations\nStochastic augmentations are augmentation which are repeated mulitple times to estimate the effect of the augmentation.\n\n| Augmentation | Part-of-speech tagging (Accuracy) | Morphological tagging (Accuracy) | Dependency Parsing (UAS) | Dependency Parsing (LAS) |\u00a0Sentence segmentation (F1) | Lemmatization (Accuracy) | Named entity recognition (F1) |\n| --- | --- | --- | --- |  --- | --- | --- |  --- |\n| Keystroke errors 2% | 0.936 (0.002) | 0.934 (0.002) | 0.836 (0.002) |  0.795 (0.002) | 0.889 (0.002) | 0.773 (0.002) | 0.627 (0.002) |\n| Keystroke errors 5% | 0.869 (0.003) | 0.873 (0.003) | 0.753 (0.003) |  0.696 (0.003) | 0.829 (0.003) | 0.68 (0.003) | 0.487 (0.003) |\n| Keystroke errors 15% | 0.647 (0.007) | 0.684 (0.007) | 0.5 (0.007) |  0.417 (0.007) | 0.664 (0.007) | 0.46 (0.007) | 0.256 (0.007) |\n| Danish names | 0.978 (0.0) | 0.975 (0.0) | 0.885 (0.0) |  0.855 (0.0) | 0.934 (0.0) | 0.847 (0.0) | 0.771 (0.0) |\n| Muslim names | 0.978 (0.0) | 0.975 (0.0) | 0.886 (0.0) |  0.855 (0.0) | 0.935 (0.0) | 0.847 (0.0) | 0.749 (0.0) |\n| Female names | 0.979 (0.0) | 0.975 (0.0) | 0.886 (0.0) |  0.856 (0.0) | 0.933 (0.0) | 0.847 (0.0) | 0.775 (0.0) |\n| Male names | 0.978 (0.0) | 0.975 (0.0) | 0.885 (0.0) |  0.855 (0.0) | 0.933 (0.0) | 0.847 (0.0) | 0.773 (0.0) |\n| Spacing Augmention 5% | 0.941 (0.002) | 0.937 (0.002) | 0.78 (0.002) |  0.751 (0.002) | 0.905 (0.002) | 0.812 (0.002) | 0.701 (0.002) |\n\n<details>\n\n<summary> Description of Augmenters </summary>\n\n    \n\n**No augmentation:**\nApplies no augmentation to the DaNE test set.\n\n**\u00c6\u00f8\u00e5 Augmentation:**\nThis augmentation replace the \u00e6,\u00f8, and \u00e5 with their spelling variations ae, oe and aa respectively.\n\n**Lowercase:**\nThis augmentation lowercases all text.\n\n**No Spacing:**\nThis augmentation removed all spacing from the text.\n\n**Abbreviated first names:**\nThis agmentation abbreviates the first names of entities. For instance 'Kenneth Enevoldsen' would turn to 'K. Enevoldsen'.\n\n**Keystroke errors 2%:**\nThis agmentation simulate keystroke errors by replacing 2% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Keystroke errors 5%:**\nThis agmentation simulate keystroke errors by replacing 5% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Keystroke errors 15%:**\nThis agmentation simulate keystroke errors by replacing 15% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Danish names:**\nThis agmentation replace all names with Danish names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Muslim names:**\nThis agmentation replace all names with Muslim names derived from  Meldgaard (2005). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Female names:**\nThis agmentation replace all names with Danish female names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Male names:**\nThis agmentation replace all names with Danish male names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Spacing Augmention 5%:**\nThis agmentation replace all names with Danish male names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n </details> \n <br /> \n\n\n### Hardware\nThis was run an trained on a Quadro RTX 8000 GPU."
+  "notes":"\n\n### Training\nThis model was trained using [spaCy](https://spacy.io) and logged to [Weights & Biases](https://wandb.ai/kenevoldsen/dacy-v0.2.0). You can find all the training logs [here](https://wandb.ai/kenevoldsen/dacy-v0.2.0)."
 }

morphologizer/cfg

@@ -1,4 +1,5 @@
 {
+  "extend":false,
   "labels_morph":{
     "AdpType=Prep|POS=ADP":"AdpType=Prep",
     "Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":"Definite=Ind|Gender=Com|Number=Sing",
@@ -14,149 +15,150 @@
     "Degree=Pos|Number=Plur|POS=ADJ":"Degree=Pos|Number=Plur",
     "Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":"Definite=Ind|Gender=Com|Number=Plur",
     "POS=PUNCT":"",
+    "NumType=Ord|POS=ADJ":"NumType=Ord",
     "POS=CCONJ":"",
-    "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Cmp|Number=Sing",
-    "Degree=Cmp|POS=ADJ":"Degree=Cmp",
-    "POS=PRON|PartType=Inf":"PartType=Inf",
-    "Gender=Com|Number=Sing|POS=DET|PronType=Ind":"Gender=Com|Number=Sing|PronType=Ind",
-    "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Number=Sing",
-    "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Gender=Neut|Number=Sing|Person=3|PronType=Prs",
     "Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":"Definite=Ind|Gender=Neut|Number=Plur",
-    "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":"Definite=Def|Degree=Pos|Number=Sing",
-    "Gender=Neut|Number=Sing|POS=DET|PronType=Dem":"Gender=Neut|Number=Sing|PronType=Dem",
+    "POS=VERB|VerbForm=Inf|Voice=Act":"VerbForm=Inf|Voice=Act",
+    "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Gender=Neut|Number=Sing|Person=3|PronType=Prs",
+    "Degree=Sup|POS=ADV":"Degree=Sup",
     "Degree=Pos|POS=ADV":"Degree=Pos",
-    "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":"Definite=Def|Number=Sing|Tense=Past|VerbForm=Part",
-    "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":"Definite=Ind|Gender=Neut|Number=Sing",
-    "POS=PRON|PronType=Dem":"PronType=Dem",
-    "NumType=Card|POS=NUM":"NumType=Card",
-    "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing",
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=3|PronType=Prs",
-    "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":"Degree=Pos|Gender=Com|Number=Sing",
+    "Gender=Com|Number=Sing|POS=DET|PronType=Ind":"Gender=Com|Number=Sing|PronType=Ind",
+    "Number=Plur|POS=DET|PronType=Ind":"Number=Plur|PronType=Ind",
+    "POS=ADP":"",
+    "POS=ADV|PartType=Inf":"PartType=Inf",
     "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Nom|Gender=Com|Number=Sing|Person=3|PronType=Prs",
-    "NumType=Ord|POS=ADJ":"NumType=Ord",
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
     "Mood=Ind|POS=AUX|Tense=Past|VerbForm=Fin|Voice=Act":"Mood=Ind|Tense=Past|VerbForm=Fin|Voice=Act",
-    "POS=VERB|VerbForm=Inf|Voice=Act":"VerbForm=Inf|Voice=Act",
+    "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":"Definite=Def|Degree=Pos|Number=Sing",
+    "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs",
     "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Act":"Mood=Ind|Tense=Past|VerbForm=Fin|Voice=Act",
-    "POS=NOUN":"",
-    "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass":"Mood=Ind|Tense=Pres|VerbForm=Fin|Voice=Pass",
     "POS=ADP|PartType=Inf":"PartType=Inf",
+    "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Gender=Com|Number=Sing",
+    "NumType=Card|POS=NUM":"NumType=Card",
     "Degree=Pos|POS=ADJ":"Degree=Pos",
+    "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part":"Definite=Ind|Number=Sing|Tense=Past|VerbForm=Part",
+    "POS=PART|PartType=Inf":"PartType=Inf",
+    "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes":"Case=Acc|Person=3|PronType=Prs|Reflex=Yes",
     "Definite=Def|Gender=Com|Number=Plur|POS=NOUN":"Definite=Def|Gender=Com|Number=Plur",
-    "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs",
+    "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":"Definite=Ind|Gender=Neut|Number=Sing",
+    "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=3|Poss=Yes|PronType=Prs",
+    "POS=VERB|Tense=Pres|VerbForm=Part":"Tense=Pres|VerbForm=Part",
+    "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs":"Case=Nom|Number=Plur|Person=3|PronType=Prs",
     "Case=Gen|Definite=Def|Gender=Com|Number=Sing|POS=NOUN":"Case=Gen|Definite=Def|Gender=Com|Number=Sing",
+    "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ":"Definite=Def|Degree=Sup|Number=Plur",
+    "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Number=Plur|Person=3|PronType=Prs",
     "POS=AUX|VerbForm=Inf|Voice=Act":"VerbForm=Inf|Voice=Act",
-    "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Gender=Com|Number=Sing",
+    "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing",
+    "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Cmp|Number=Sing",
+    "Degree=Cmp|POS=ADJ":"Degree=Cmp",
+    "POS=PRON|PartType=Inf":"PartType=Inf",
+    "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Number=Sing",
+    "Case=Nom|Gender=Com|POS=PRON|PronType=Ind":"Case=Nom|Gender=Com|PronType=Ind",
+    "Number=Plur|POS=PRON|PronType=Ind":"Number=Plur|PronType=Ind",
+    "POS=INTJ":"",
     "Gender=Com|Number=Sing|POS=DET|PronType=Dem":"Gender=Com|Number=Sing|PronType=Dem",
-    "Number=Plur|POS=DET|PronType=Ind":"Number=Plur|PronType=Ind",
-    "Gender=Com|Number=Sing|POS=PRON|PronType=Ind":"Gender=Com|Number=Sing|PronType=Ind",
-    "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes":"Case=Acc|Person=3|PronType=Prs|Reflex=Yes",
-    "POS=PART|PartType=Inf":"PartType=Inf",
+    "Case=Gen|Number=Plur|POS=DET|PronType=Ind":"Case=Gen|Number=Plur|PronType=Ind",
+    "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass":"Mood=Ind|Tense=Pres|VerbForm=Fin|Voice=Pass",
+    "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":"Definite=Def|Gender=Neut|Number=Plur",
+    "Degree=Cmp|POS=ADV":"Degree=Cmp",
+    "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Number=Plur|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=3|PronType=Prs",
+    "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Number=Plur|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+    "Case=Gen|POS=PROPN":"Case=Gen",
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind":"Gender=Neut|Number=Sing|PronType=Ind",
+    "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":"Number=Plur|Tense=Past|VerbForm=Part",
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=1|PronType=Prs",
+    "Definite=Def|Degree=Sup|POS=ADJ":"Definite=Def|Degree=Sup",
     "Gender=Neut|Number=Sing|POS=DET|PronType=Ind":"Gender=Neut|Number=Sing|PronType=Ind",
-    "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Number=Plur|Person=3|PronType=Prs",
-    "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN":"Case=Gen|Definite=Def|Gender=Neut|Number=Sing",
-    "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs":"Case=Nom|Number=Plur|Person=3|PronType=Prs",
+    "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Neut|Number=Sing",
+    "Gender=Neut|Number=Sing|POS=DET|PronType=Dem":"Gender=Neut|Number=Sing|PronType=Dem",
+    "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":"Definite=Def|Number=Sing|Tense=Past|VerbForm=Part",
+    "POS=PRON|PronType=Dem":"PronType=Dem",
+    "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":"Degree=Pos|Gender=Com|Number=Sing",
+    "Number=Plur|POS=NUM":"Number=Plur",
+    "POS=VERB|VerbForm=Inf|Voice=Pass":"VerbForm=Inf|Voice=Pass",
+    "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ":"Definite=Def|Degree=Sup|Number=Sing",
+    "Number=Sing|POS=PRON|PronType=Int,Rel":"Number=Sing|PronType=Int,Rel",
     "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":"Case=Nom|Gender=Com|Number=Sing|Person=1|PronType=Prs",
-    "Case=Nom|Gender=Com|POS=PRON|PronType=Ind":"Case=Nom|Gender=Com|PronType=Ind",
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind":"Gender=Neut|Number=Sing|PronType=Ind",
-    "Mood=Imp|POS=VERB":"Mood=Imp",
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
     "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
-    "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part":"Definite=Ind|Number=Sing|Tense=Past|VerbForm=Part",
-    "POS=X":"",
+    "POS=PRON":"",
+    "Definite=Ind|Number=Sing|POS=NOUN":"Definite=Ind|Number=Sing",
+    "Definite=Ind|Number=Sing|POS=NUM":"Definite=Ind|Number=Sing",
+    "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Com|Number=Sing",
+    "Foreign=Yes|POS=ADV":"Foreign=Yes",
+    "POS=NOUN":"",
+    "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN":"Case=Gen|Definite=Def|Gender=Neut|Number=Sing",
+    "Gender=Com|Number=Plur|POS=NOUN":"Gender=Com|Number=Plur",
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel":"Gender=Neut|Number=Sing|PronType=Int,Rel",
     "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":"Case=Nom|Gender=Com|Number=Plur|Person=1|PronType=Prs",
+    "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs",
+    "Gender=Com|Number=Sing|POS=PRON|PronType=Ind":"Gender=Com|Number=Sing|PronType=Ind",
+    "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Com|Number=Plur",
+    "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":"Degree=Pos|Gender=Neut|Number=Sing",
+    "Degree=Sup|POS=ADJ":"Degree=Sup",
+    "Degree=Pos|Number=Sing|POS=ADJ":"Degree=Pos|Number=Sing",
+    "Mood=Imp|POS=VERB":"Mood=Imp",
+    "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":"Case=Nom|Gender=Com|Person=2|Polite=Form|PronType=Prs",
+    "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":"Case=Acc|Gender=Com|Person=2|Polite=Form|PronType=Prs",
+    "POS=X":"",
     "Case=Gen|Definite=Def|Gender=Com|Number=Plur|POS=NOUN":"Case=Gen|Definite=Def|Gender=Com|Number=Plur",
-    "POS=VERB|Tense=Pres|VerbForm=Part":"Tense=Pres|VerbForm=Part",
-    "Number=Plur|POS=PRON|PronType=Int,Rel":"Number=Plur|PronType=Int,Rel",
-    "POS=VERB|VerbForm=Inf|Voice=Pass":"VerbForm=Inf|Voice=Pass",
-    "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Com|Number=Sing",
-    "Degree=Cmp|POS=ADV":"Degree=Cmp",
-    "POS=ADV|PartType=Inf":"PartType=Inf",
-    "Degree=Sup|POS=ADV":"Degree=Sup",
     "Number=Plur|POS=PRON|PronType=Dem":"Number=Plur|PronType=Dem",
-    "Number=Plur|POS=PRON|PronType=Ind":"Number=Plur|PronType=Ind",
-    "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":"Definite=Def|Gender=Neut|Number=Plur",
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=1|PronType=Prs",
-    "Case=Gen|POS=PROPN":"Case=Gen",
-    "POS=ADP":"",
+    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":"Case=Acc|Gender=Com|Number=Plur|Person=1|PronType=Prs",
+    "Number=Plur|POS=PRON|PronType=Int,Rel":"Number=Plur|PronType=Int,Rel",
+    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
     "Degree=Cmp|Number=Plur|POS=ADJ":"Degree=Cmp|Number=Plur",
-    "Definite=Def|Degree=Sup|POS=ADJ":"Definite=Def|Degree=Sup",
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
-    "Degree=Pos|Number=Sing|POS=ADJ":"Degree=Pos|Number=Sing",
-    "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Number=Plur|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+    "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Number=Plur|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
     "Gender=Com|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Gender=Com|Number=Sing|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
+    "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":"Case=Nom|Gender=Com|Number=Sing|Person=2|PronType=Prs",
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=2|PronType=Prs",
+    "Gender=Com|POS=PRON|PronType=Int,Rel":"Gender=Com|PronType=Int,Rel",
+    "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ":"Case=Gen|Degree=Pos|Number=Plur",
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+    "POS=VERB|VerbForm=Ger":"VerbForm=Ger",
+    "Gender=Com|Number=Sing|POS=PRON|PronType=Dem":"Gender=Com|Number=Sing|PronType=Dem",
+    "Case=Gen|POS=PRON|PronType=Int,Rel":"Case=Gen|PronType=Int,Rel",
+    "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass":"Mood=Ind|Tense=Past|VerbForm=Fin|Voice=Pass",
+    "Abbr=Yes|POS=X":"Abbr=Yes",
+    "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Neut|Number=Plur",
+    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=2|Poss=Yes|PronType=Prs",
+    "Definite=Ind|Number=Plur|POS=NOUN":"Definite=Ind|Number=Plur",
+    "Foreign=Yes|POS=X":"Foreign=Yes",
     "Number=Plur|POS=PRON|PronType=Rcp":"Number=Plur|PronType=Rcp",
+    "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":"Case=Nom|Gender=Com|Number=Plur|Person=2|PronType=Prs",
     "Case=Gen|Degree=Cmp|POS=ADJ":"Case=Gen|Degree=Cmp",
     "Case=Gen|Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":"Case=Gen|Definite=Def|Gender=Neut|Number=Plur",
-    "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=3|Poss=Yes|PronType=Prs",
-    "POS=INTJ":"",
-    "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Number=Plur|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
-    "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":"Degree=Pos|Gender=Neut|Number=Sing",
-    "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Gender=Neut|Number=Sing|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=2|PronType=Prs",
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=2|Poss=Yes|PronType=Prs",
-    "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Neut|Number=Plur",
-    "Number=Sing|POS=PRON|PronType=Int,Rel":"Number=Sing|PronType=Int,Rel",
+    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":"Case=Acc|Gender=Com|Number=Plur|Person=2|PronType=Prs",
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem":"Gender=Neut|Number=Sing|PronType=Dem",
     "Number=Plur|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Number=Plur|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel":"Gender=Neut|Number=Sing|PronType=Int,Rel",
-    "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ":"Definite=Def|Degree=Sup|Number=Plur",
-    "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":"Case=Nom|Gender=Com|Number=Sing|Person=2|PronType=Prs",
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-    "Definite=Ind|Number=Sing|POS=NOUN":"Definite=Ind|Number=Sing",
-    "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":"Number=Plur|Tense=Past|VerbForm=Part",
+    "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Gender=Neut|Number=Sing|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
     "Number=Plur|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Number=Plur|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-    "POS=SYM":"",
-    "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":"Case=Nom|Gender=Com|Person=2|Polite=Form|PronType=Prs",
-    "Degree=Sup|POS=ADJ":"Degree=Sup",
-    "Number=Plur|POS=DET|PronType=Ind|Style=Arch":"Number=Plur|PronType=Ind|Style=Arch",
-    "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Dem":"Case=Gen|Gender=Com|Number=Sing|PronType=Dem",
-    "Foreign=Yes|POS=X":"Foreign=Yes",
+    "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs",
+    "Case=Gen|Number=Plur|POS=PRON|PronType=Rcp":"Case=Gen|Number=Plur|PronType=Rcp",
     "POS=DET|Person=2|Polite=Form|Poss=Yes|PronType=Prs":"Person=2|Polite=Form|Poss=Yes|PronType=Prs",
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem":"Gender=Neut|Number=Sing|PronType=Dem",
-    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":"Case=Acc|Gender=Com|Number=Plur|Person=1|PronType=Prs",
-    "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Neut|Number=Sing",
-    "Case=Gen|POS=PRON|PronType=Int,Rel":"Case=Gen|PronType=Int,Rel",
-    "Gender=Com|Number=Sing|POS=PRON|PronType=Dem":"Gender=Com|Number=Sing|PronType=Dem",
-    "Abbr=Yes|POS=X":"Abbr=Yes",
-    "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Com|Number=Plur",
+    "POS=SYM":"",
+    "POS=DET|PronType=Dem":"PronType=Dem",
+    "Gender=Com|Number=Sing|POS=NUM":"Gender=Com|Number=Sing",
+    "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=2|Poss=Yes|PronType=Prs",
+    "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":"Case=Gen|Number=Plur|Tense=Past|VerbForm=Part",
     "Definite=Def|Degree=Abs|POS=ADJ":"Definite=Def|Degree=Abs",
-    "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Sup|Number=Sing",
-    "Definite=Ind|POS=NOUN":"Definite=Ind",
-    "Gender=Com|Number=Plur|POS=NOUN":"Gender=Com|Number=Plur",
-    "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs",
-    "Gender=Com|POS=PRON|PronType=Int,Rel":"Gender=Com|PronType=Int,Rel",
-    "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":"Case=Nom|Gender=Com|Number=Plur|Person=2|PronType=Prs",
+    "POS=VERB|Tense=Pres":"Tense=Pres",
+    "Definite=Ind|Gender=Neut|Number=Sing|POS=NUM":"Definite=Ind|Gender=Neut|Number=Sing",
     "Degree=Abs|POS=ADV":"Degree=Abs",
-    "POS=VERB|VerbForm=Ger":"VerbForm=Ger",
-    "POS=VERB|Tense=Past|VerbForm=Part":"Tense=Past|VerbForm=Part",
-    "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ":"Definite=Def|Degree=Sup|Number=Sing",
-    "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Number=Plur|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
     "Case=Gen|Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":"Case=Gen|Definite=Def|Degree=Pos|Number=Sing",
-    "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ":"Case=Gen|Degree=Pos|Number=Plur",
-    "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":"Case=Acc|Gender=Com|Person=2|Polite=Form|PronType=Prs",
     "Gender=Com|Number=Sing|POS=PRON|PronType=Int,Rel":"Gender=Com|Number=Sing|PronType=Int,Rel",
-    "POS=VERB|Tense=Pres":"Tense=Pres",
-    "Case=Gen|Number=Plur|POS=DET|PronType=Ind":"Case=Gen|Number=Plur|PronType=Ind",
-    "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=2|Poss=Yes|PronType=Prs",
-    "POS=PRON|Person=2|Polite=Form|Poss=Yes|PronType=Prs":"Person=2|Polite=Form|Poss=Yes|PronType=Prs",
+    "POS=VERB|Tense=Past|VerbForm=Part":"Tense=Past|VerbForm=Part",
+    "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Sup|Number=Sing",
     "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=2|Poss=Yes|PronType=Prs",
-    "POS=AUX|Tense=Pres|VerbForm=Part":"Tense=Pres|VerbForm=Part",
-    "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass":"Mood=Ind|Tense=Past|VerbForm=Fin|Voice=Pass",
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-    "Degree=Sup|Number=Plur|POS=ADJ":"Degree=Sup|Number=Plur",
-    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":"Case=Acc|Gender=Com|Number=Plur|Person=2|PronType=Prs",
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-    "Definite=Ind|Number=Plur|POS=NOUN":"Definite=Ind|Number=Plur",
-    "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":"Case=Gen|Number=Plur|Tense=Past|VerbForm=Part",
-    "Mood=Imp|POS=AUX":"Mood=Imp",
     "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=1|Poss=Yes|PronType=Prs":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
-    "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs",
-    "Definite=Def|Gender=Com|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":"Definite=Def|Gender=Com|Number=Sing|Tense=Past|VerbForm=Part",
     "Number=Plur|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Number=Plur|Number[psor]=Sing|Person=2|Poss=Yes|PronType=Prs",
+    "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=3|Poss=Yes|PronType=Prs",
+    "Definite=Ind|POS=NOUN":"Definite=Ind",
     "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Ind":"Case=Gen|Gender=Com|Number=Sing|PronType=Ind",
+    "Definite=Ind|Gender=Com|Number=Sing|POS=NUM":"Definite=Ind|Gender=Com|Number=Sing",
+    "Definite=Def|Number=Plur|POS=NOUN":"Definite=Def|Number=Plur",
     "Case=Gen|POS=NOUN":"Case=Gen",
-    "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=3|Poss=Yes|PronType=Prs",
-    "POS=DET|PronType=Dem":"PronType=Dem",
-    "Definite=Def|Number=Plur|POS=NOUN":"Definite=Def|Number=Plur"
+    "POS=AUX|Tense=Pres|VerbForm=Part":"Tense=Pres|VerbForm=Part"
   },
   "labels_pos":{
     "AdpType=Prep|POS=ADP":85,
@@ -173,148 +175,150 @@
     "Degree=Pos|Number=Plur|POS=ADJ":84,
     "Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":92,
     "POS=PUNCT":97,
+    "NumType=Ord|POS=ADJ":84,
     "POS=CCONJ":89,
-    "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ":84,
-    "Degree=Cmp|POS=ADJ":84,
-    "POS=PRON|PartType=Inf":95,
-    "Gender=Com|Number=Sing|POS=DET|PronType=Ind":90,
-    "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ":84,
-    "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
     "Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":92,
-    "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":84,
-    "Gender=Neut|Number=Sing|POS=DET|PronType=Dem":90,
+    "POS=VERB|VerbForm=Inf|Voice=Act":100,
+    "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
+    "Degree=Sup|POS=ADV":86,
     "Degree=Pos|POS=ADV":86,
-    "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":100,
-    "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":92,
-    "POS=PRON|PronType=Dem":95,
-    "NumType=Card|POS=NUM":93,
-    "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":84,
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
-    "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":84,
+    "Gender=Com|Number=Sing|POS=DET|PronType=Ind":90,
+    "Number=Plur|POS=DET|PronType=Ind":90,
+    "POS=ADP":85,
+    "POS=ADV|PartType=Inf":86,
     "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
-    "NumType=Ord|POS=ADJ":84,
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
     "Mood=Ind|POS=AUX|Tense=Past|VerbForm=Fin|Voice=Act":87,
-    "POS=VERB|VerbForm=Inf|Voice=Act":100,
+    "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":84,
+    "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs":90,
     "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Act":100,
-    "POS=NOUN":92,
-    "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass":100,
     "POS=ADP|PartType=Inf":85,
+    "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":84,
+    "NumType=Card|POS=NUM":93,
     "Degree=Pos|POS=ADJ":84,
+    "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part":87,
+    "POS=PART|PartType=Inf":94,
+    "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes":95,
     "Definite=Def|Gender=Com|Number=Plur|POS=NOUN":92,
-    "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs":90,
+    "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":92,
+    "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs":90,
+    "POS=VERB|Tense=Pres|VerbForm=Part":100,
+    "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs":95,
     "Case=Gen|Definite=Def|Gender=Com|Number=Sing|POS=NOUN":92,
+    "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ":84,
+    "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs":95,
     "POS=AUX|VerbForm=Inf|Voice=Act":87,
-    "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":84,
+    "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":84,
+    "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ":84,
+    "Degree=Cmp|POS=ADJ":84,
+    "POS=PRON|PartType=Inf":95,
+    "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ":84,
+    "Case=Nom|Gender=Com|POS=PRON|PronType=Ind":95,
+    "Number=Plur|POS=PRON|PronType=Ind":95,
+    "POS=INTJ":91,
     "Gender=Com|Number=Sing|POS=DET|PronType=Dem":90,
-    "Number=Plur|POS=DET|PronType=Ind":90,
-    "Gender=Com|Number=Sing|POS=PRON|PronType=Ind":95,
-    "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes":95,
-    "POS=PART|PartType=Inf":94,
+    "Case=Gen|Number=Plur|POS=DET|PronType=Ind":90,
+    "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass":100,
+    "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":92,
+    "Degree=Cmp|POS=ADV":86,
+    "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form":95,
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
+    "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
+    "Case=Gen|POS=PROPN":96,
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind":95,
+    "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":100,
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":95,
+    "Definite=Def|Degree=Sup|POS=ADJ":84,
     "Gender=Neut|Number=Sing|POS=DET|PronType=Ind":90,
-    "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs":95,
-    "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN":92,
-    "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs":95,
+    "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":92,
+    "Gender=Neut|Number=Sing|POS=DET|PronType=Dem":90,
+    "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":100,
+    "POS=PRON|PronType=Dem":95,
+    "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":84,
+    "Number=Plur|POS=NUM":93,
+    "POS=VERB|VerbForm=Inf|Voice=Pass":100,
+    "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ":84,
+    "Number=Sing|POS=PRON|PronType=Int,Rel":95,
     "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":95,
-    "Case=Nom|Gender=Com|POS=PRON|PronType=Ind":95,
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind":95,
-    "Mood=Imp|POS=VERB":100,
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
     "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
-    "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part":87,
-    "POS=X":101,
+    "POS=PRON":95,
+    "Definite=Ind|Number=Sing|POS=NOUN":92,
+    "Definite=Ind|Number=Sing|POS=NUM":93,
+    "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":92,
+    "Foreign=Yes|POS=ADV":86,
+    "POS=NOUN":92,
+    "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN":92,
+    "Gender=Com|Number=Plur|POS=NOUN":92,
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel":95,
     "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":95,
+    "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
+    "Gender=Com|Number=Sing|POS=PRON|PronType=Ind":95,
+    "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":92,
+    "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":84,
+    "Degree=Sup|POS=ADJ":84,
+    "Degree=Pos|Number=Sing|POS=ADJ":84,
+    "Mood=Imp|POS=VERB":100,
+    "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":95,
+    "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":95,
+    "POS=X":101,
     "Case=Gen|Definite=Def|Gender=Com|Number=Plur|POS=NOUN":92,
-    "POS=VERB|Tense=Pres|VerbForm=Part":100,
-    "Number=Plur|POS=PRON|PronType=Int,Rel":95,
-    "POS=VERB|VerbForm=Inf|Voice=Pass":100,
-    "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":92,
-    "Degree=Cmp|POS=ADV":86,
-    "POS=ADV|PartType=Inf":86,
-    "Degree=Sup|POS=ADV":86,
     "Number=Plur|POS=PRON|PronType=Dem":95,
-    "Number=Plur|POS=PRON|PronType=Ind":95,
-    "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":92,
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":95,
-    "Case=Gen|POS=PROPN":96,
-    "POS=ADP":85,
+    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":95,
+    "Number=Plur|POS=PRON|PronType=Int,Rel":95,
+    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
     "Degree=Cmp|Number=Plur|POS=ADJ":84,
-    "Definite=Def|Degree=Sup|POS=ADJ":84,
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
-    "Degree=Pos|Number=Sing|POS=ADJ":84,
-    "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
+    "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
     "Gender=Com|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":90,
+    "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":95,
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":95,
+    "Gender=Com|POS=PRON|PronType=Int,Rel":95,
+    "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ":84,
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":95,
+    "POS=VERB|VerbForm=Ger":100,
+    "Gender=Com|Number=Sing|POS=PRON|PronType=Dem":95,
+    "Case=Gen|POS=PRON|PronType=Int,Rel":95,
+    "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass":100,
+    "Abbr=Yes|POS=X":101,
+    "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":92,
+    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
+    "Definite=Ind|Number=Plur|POS=NOUN":92,
+    "Foreign=Yes|POS=X":101,
     "Number=Plur|POS=PRON|PronType=Rcp":95,
+    "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":95,
     "Case=Gen|Degree=Cmp|POS=ADJ":84,
     "Case=Gen|Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":92,
-    "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs":90,
-    "POS=INTJ":91,
-    "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
-    "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":84,
-    "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":90,
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":95,
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
-    "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":92,
-    "Number=Sing|POS=PRON|PronType=Int,Rel":95,
+    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":95,
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem":95,
     "Number=Plur|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":90,
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel":95,
-    "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ":84,
-    "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":95,
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
-    "Definite=Ind|Number=Sing|POS=NOUN":92,
-    "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":100,
+    "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":90,
     "Number=Plur|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":95,
-    "POS=SYM":99,
-    "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":95,
-    "Degree=Sup|POS=ADJ":84,
-    "Number=Plur|POS=DET|PronType=Ind|Style=Arch":90,
-    "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Dem":90,
-    "Foreign=Yes|POS=X":101,
+    "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs":95,
+    "Case=Gen|Number=Plur|POS=PRON|PronType=Rcp":95,
     "POS=DET|Person=2|Polite=Form|Poss=Yes|PronType=Prs":90,
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem":95,
-    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":95,
-    "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":92,
-    "Case=Gen|POS=PRON|PronType=Int,Rel":95,
-    "Gender=Com|Number=Sing|POS=PRON|PronType=Dem":95,
-    "Abbr=Yes|POS=X":101,
-    "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":92,
+    "POS=SYM":99,
+    "POS=DET|PronType=Dem":90,
+    "Gender=Com|Number=Sing|POS=NUM":93,
+    "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
+    "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":100,
     "Definite=Def|Degree=Abs|POS=ADJ":84,
-    "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ":84,
-    "Definite=Ind|POS=NOUN":92,
-    "Gender=Com|Number=Plur|POS=NOUN":92,
-    "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
-    "Gender=Com|POS=PRON|PronType=Int,Rel":95,
-    "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":95,
+    "POS=VERB|Tense=Pres":100,
+    "Definite=Ind|Gender=Neut|Number=Sing|POS=NUM":93,
     "Degree=Abs|POS=ADV":86,
-    "POS=VERB|VerbForm=Ger":100,
-    "POS=VERB|Tense=Past|VerbForm=Part":100,
-    "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ":84,
-    "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form":95,
     "Case=Gen|Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":84,
-    "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ":84,
-    "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":95,
     "Gender=Com|Number=Sing|POS=PRON|PronType=Int,Rel":95,
-    "POS=VERB|Tense=Pres":100,
-    "Case=Gen|Number=Plur|POS=DET|PronType=Ind":90,
-    "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
-    "POS=PRON|Person=2|Polite=Form|Poss=Yes|PronType=Prs":95,
+    "POS=VERB|Tense=Past|VerbForm=Part":100,
+    "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ":84,
     "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
-    "POS=AUX|Tense=Pres|VerbForm=Part":87,
-    "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass":100,
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":95,
-    "Degree=Sup|Number=Plur|POS=ADJ":84,
-    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":95,
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":95,
-    "Definite=Ind|Number=Plur|POS=NOUN":92,
-    "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":100,
-    "Mood=Imp|POS=AUX":87,
     "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=1|Poss=Yes|PronType=Prs":95,
-    "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs":95,
-    "Definite=Def|Gender=Com|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":100,
     "Number=Plur|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
+    "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs":95,
+    "Definite=Ind|POS=NOUN":92,
     "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Ind":90,
+    "Definite=Ind|Gender=Com|Number=Sing|POS=NUM":93,
+    "Definite=Def|Number=Plur|POS=NOUN":92,
     "Case=Gen|POS=NOUN":92,
-    "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs":95,
-    "POS=DET|PronType=Dem":90,
-    "Definite=Def|Number=Plur|POS=NOUN":92
-  }
+    "POS=AUX|Tense=Pres|VerbForm=Part":87
+  },
+  "overwrite":true
 }

morphologizer/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3ff4ac19d2ea3ccfe10ad70e8cbcf15b22916b18b08d7d8efa3990be0323bf78
-size 483528
+oid sha256:6b321cc35401b6a7fa432a60b6e203624085a924ce2664531e21f86f79a5a301
+size 486656

ner/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a3ecfb5d8bd519dd27a53f8f5eb525d46bd9fe2d60fd3173db955f0896317979
+oid sha256:70740eac699634c75cf5a480bedf1a47a8dc32dc2dfc500a80b91b94b3600d50
 size 225962

ner/moves

@@ -1 +1 @@
-��moves��{"0":{},"1":{"PER":2146,"MISC":1273,"ORG":1267,"LOC":1144},"2":{"PER":2146,"MISC":1273,"ORG":1267,"LOC":1144},"3":{"PER":2146,"MISC":1273,"ORG":1267,"LOC":1144},"4":{"PER":2146,"MISC":1273,"ORG":1267,"LOC":1144,"":1},"5":{"":1}}�cfg��neg_key�
+��moves��{"0":{},"1":{"PER":1361,"ORG":943,"MISC":826,"LOC":768},"2":{"PER":1361,"ORG":943,"MISC":826,"LOC":768},"3":{"PER":1361,"ORG":943,"MISC":826,"LOC":768},"4":{"PER":1361,"ORG":943,"MISC":826,"LOC":768,"":1},"5":{"":1}}�cfg��neg_key�

parser/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:91770681cc7c9adf240c0d7dda5b09a3a62ccf798e939366da0c351d0f080680
-size 456157
+oid sha256:52eafb860a09884bf0ab0357223f105e97cfc1f6932ee3214d1a67b4a807d331
+size 1088787

parser/moves

@@ -1 +1 @@
-��moves�2{"0":{"":41514},"1":{"":34292},"2":{"case":7489,"nsubj":6009,"det":4334,"amod":3968,"advmod":3657,"mark":3529,"aux":2432,"cc":2261,"punct":2182,"cop":1329,"obl":894,"nummod":799,"nmod:poss":651,"nmod":460,"expl":291,"ccomp":202,"obj":195,"xcomp":122,"case||nmod":73,"obl:tmod":53,"dep":49,"acl:relcl":43},"3":{"punct":8600,"obl":3949,"obj":3758,"nmod":3565,"conj":2743,"advmod":2095,"flat":1294,"nsubj":1172,"acl:relcl":1131,"advcl":808,"amod":629,"obl:loc":467,"fixed":390,"dep":322,"xcomp":272,"appos":268,"compound:prt":261,"ccomp":252,"acl:relcl||nsubj":237,"case":202,"nummod":167,"list":161,"nmod:poss":156,"punct||conj":151,"mark":137,"cc":135,"iobj":107,"expl":77,"cop":69,"nmod||case":60,"aux":48,"obl:tmod":45,"cc||case":43,"advcl||advmod":43,"cc||conj":40,"case||obl":38,"punct||case":33},"4":{"ROOT":4367}}�cfg��neg_key�
+��moves��{"0":{"":30710},"1":{"":22084},"2":{"case":5238,"nsubj":4163,"punct":3257,"det":3028,"amod":2815,"advmod":2482,"mark":2317,"aux":1748,"cc":1610,"cop":823,"obl":627,"nummod":620,"nmod:poss":457,"nmod":384,"expl":193,"obj":188,"ccomp":155,"advcl":110,"xcomp":81,"case||nmod":45,"dep":32,"obl:tmod":31},"3":{"punct":4355,"obl":2759,"obj":2659,"nmod":2503,"conj":1923,"advmod":1246,"flat":886,"nsubj":805,"acl:relcl":800,"advcl":744,"amod":415,"xcomp":307,"advmod:lmod":273,"fixed":267,"dep":218,"compound:prt":211,"appos":187,"ccomp":177,"acl:relcl||nsubj":144,"case":130,"nmod:poss":112,"mark":103,"iobj":99,"nummod":93,"list":86,"cc":72,"expl":55,"cop":40,"obl:lmod":35,"obl:tmod":34,"cc||case":31},"4":{"ROOT":2970}}�cfg��neg_key�

span_resolver/cfg

@@ -0,0 +1,3 @@
+{
+  "nI":768
+}

span_resolver/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f92b305454b1a26c0d831c6470c36decb6c44ade1d676aa9733ff99865f3926b
+size 7712965

tagger/cfg

@@ -0,0 +1,23 @@
+{
+  "labels":[
+    "ADJ",
+    "ADP",
+    "ADV",
+    "AUX",
+    "CCONJ",
+    "DET",
+    "INTJ",
+    "NOUN",
+    "NUM",
+    "PART",
+    "PRON",
+    "PROPN",
+    "PUNCT",
+    "SCONJ",
+    "SYM",
+    "VERB",
+    "X"
+  ],
+  "neg_prefix":"!",
+  "overwrite":false
+}

tagger/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe76ce222162041e521865bb1fc6a9fc0a5d63f1882bb281bc68c66c10c39086
+size 52932

trainable_lemmatizer/cfg

@@ -0,0 +1,348 @@
+{
+  "labels":[
+    1,
+    2,
+    4,
+    6,
+    8,
+    10,
+    12,
+    14,
+    16,
+    18,
+    20,
+    24,
+    26,
+    29,
+    30,
+    34,
+    36,
+    38,
+    42,
+    44,
+    46,
+    48,
+    50,
+    52,
+    54,
+    56,
+    57,
+    60,
+    63,
+    65,
+    67,
+    69,
+    71,
+    73,
+    75,
+    76,
+    78,
+    81,
+    83,
+    84,
+    86,
+    88,
+    92,
+    96,
+    98,
+    100,
+    103,
+    106,
+    108,
+    110,
+    113,
+    115,
+    117,
+    119,
+    121,
+    124,
+    125,
+    127,
+    129,
+    131,
+    133,
+    134,
+    138,
+    140,
+    142,
+    144,
+    146,
+    148,
+    151,
+    153,
+    155,
+    156,
+    159,
+    160,
+    162,
+    164,
+    166,
+    167,
+    168,
+    170,
+    172,
+    175,
+    177,
+    180,
+    182,
+    185,
+    188,
+    190,
+    191,
+    194,
+    197,
+    199,
+    201,
+    205,
+    208,
+    211,
+    212,
+    213,
+    215,
+    217,
+    219,
+    220,
+    221,
+    223,
+    224,
+    226,
+    229,
+    231,
+    232,
+    233,
+    236,
+    238,
+    240,
+    242,
+    244,
+    246,
+    249,
+    250,
+    252,
+    255,
+    256,
+    257,
+    228,
+    259,
+    262,
+    264,
+    266,
+    269,
+    271,
+    274,
+    276,
+    279,
+    281,
+    283,
+    284,
+    285,
+    286,
+    288,
+    289,
+    290,
+    291,
+    293,
+    294,
+    297,
+    298,
+    300,
+    302,
+    303,
+    305,
+    307,
+    308,
+    309,
+    311,
+    312,
+    314,
+    316,
+    318,
+    321,
+    322,
+    323,
+    324,
+    325,
+    327,
+    329,
+    331,
+    333,
+    334,
+    336,
+    338,
+    340,
+    341,
+    343,
+    345,
+    348,
+    351,
+    353,
+    355,
+    356,
+    357,
+    360,
+    362,
+    366,
+    368,
+    370,
+    372,
+    374,
+    376,
+    377,
+    379,
+    381,
+    382,
+    383,
+    384,
+    386,
+    388,
+    389,
+    391,
+    392,
+    395,
+    396,
+    398,
+    400,
+    401,
+    402,
+    403,
+    405,
+    407,
+    408,
+    409,
+    410,
+    412,
+    414,
+    415,
+    418,
+    419,
+    421,
+    422,
+    425,
+    427,
+    428,
+    430,
+    432,
+    433,
+    435,
+    436,
+    438,
+    440,
+    442,
+    443,
+    444,
+    445,
+    446,
+    448,
+    451,
+    452,
+    453,
+    455,
+    456,
+    458,
+    461,
+    463,
+    464,
+    466,
+    467,
+    468,
+    469,
+    470,
+    473,
+    475,
+    479,
+    481,
+    482,
+    486,
+    488,
+    490,
+    492,
+    493,
+    495,
+    497,
+    502,
+    503,
+    504,
+    505,
+    508,
+    509,
+    510,
+    511,
+    512,
+    513,
+    514,
+    515,
+    516,
+    518,
+    519,
+    521,
+    522,
+    524,
+    528,
+    529,
+    530,
+    534,
+    535,
+    537,
+    539,
+    542,
+    544,
+    547,
+    549,
+    550,
+    551,
+    553,
+    555,
+    556,
+    557,
+    559,
+    560,
+    562,
+    566,
+    567,
+    568,
+    570,
+    573,
+    576,
+    579,
+    581,
+    583,
+    584,
+    585,
+    587,
+    590,
+    592,
+    595,
+    597,
+    598,
+    599,
+    600,
+    604,
+    606,
+    608,
+    609,
+    611,
+    612,
+    613,
+    614,
+    616,
+    618,
+    619,
+    622,
+    623,
+    624,
+    625,
+    626,
+    627,
+    628,
+    632,
+    635,
+    636,
+    637,
+    639,
+    640,
+    641,
+    642,
+    643,
+    644
+  ]
+}

trainable_lemmatizer/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ba995f69f75ff28dd830b01bda46a9873157e149e8c07c7478b21a36067409f5
+size 1058797

transformer/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06442d138b0b97ccd2f16254dabcc1357524d0e6be92dc083a7207194fcf81a9
+size 502755282

transformer/model/config.json

@@ -1,30 +0,0 @@
-{
-  "_name_or_path": "Maltehb/danish-bert-botxo",
-  "architectures": [
-    "BertForPreTraining"
-  ],
-  "attention_probs_dropout_prob": 0.1,
-  "directionality": "bidi",
-  "gradient_checkpointing": false,
-  "hidden_act": "gelu",
-  "hidden_dropout_prob": 0.1,
-  "hidden_size": 768,
-  "initializer_range": 0.02,
-  "intermediate_size": 3072,
-  "layer_norm_eps": 1e-12,
-  "max_position_embeddings": 512,
-  "model_type": "bert",
-  "num_attention_heads": 12,
-  "num_hidden_layers": 12,
-  "pad_token_id": 0,
-  "pooler_fc_size": 768,
-  "pooler_num_attention_heads": 12,
-  "pooler_num_fc_layers": 3,
-  "pooler_size_per_head": 128,
-  "pooler_type": "first_token_transform",
-  "position_embedding_type": "absolute",
-  "transformers_version": "4.5.1",
-  "type_vocab_size": 2,
-  "use_cache": true,
-  "vocab_size": 32000
-}

transformer/model/special_tokens_map.json

@@ -1 +0,0 @@
-{"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}

transformer/model/tokenizer_config.json

@@ -1 +0,0 @@
-{"do_lower_case": true, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": false, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "Maltehb/danish-bert-botxo", "do_basic_tokenize": true, "never_split": null}

vocab/lookups.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a6f4a94131759bf84baec98b3347bcef57ffb2d6712f7f3b8f611e9ef4b3df35
-size 20402
+oid sha256:76be8b528d0075f7aae98d6fa57a6d3c83ae480a8469e668d7b0af968995ac71
+size 1

vocab/strings.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5b50a86603f748496e4fd87a8aaa203a32bf82d4b3768bf54187ff40de3ca6f9
-size 460120
+oid sha256:732a4ef43858427e5728dbfe761a5a082708791b280e19b62a949dc86d94d43b
+size 559069

vocab/vectors.cfg

@@ -0,0 +1,3 @@
+{
+  "mode":"default"
+}