--- language: - en - se - fi - hu - et - urj - multilingual license: apache-2.0 tags: - translation --- ### eng-urj * source group: English * target group: Uralic languages * OPUS readme: [eng-urj](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-urj/README.md) * model: transformer * source language(s): eng * target language(s): est fin fkv_Latn hun izh kpv krl liv_Latn mdf mhr myv sma sme udm vro * model: transformer * pre-processing: normalization + SentencePiece (spm32k,spm32k) * a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID) * download original weights: [opus2m-2020-08-02.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-urj/opus2m-2020-08-02.zip) * test set translations: [opus2m-2020-08-02.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-urj/opus2m-2020-08-02.test.txt) * test set scores: [opus2m-2020-08-02.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-urj/opus2m-2020-08-02.eval.txt) ## Benchmarks | testset | BLEU | chr-F | |-----------------------|-------|-------| | newsdev2015-enfi-engfin.eng.fin | 18.3 | 0.519 | | newsdev2018-enet-engest.eng.est | 19.3 | 0.520 | | newssyscomb2009-enghun.eng.hun | 15.4 | 0.471 | | newstest2009-enghun.eng.hun | 15.7 | 0.468 | | newstest2015-enfi-engfin.eng.fin | 20.2 | 0.534 | | newstest2016-enfi-engfin.eng.fin | 20.7 | 0.541 | | newstest2017-enfi-engfin.eng.fin | 23.6 | 0.566 | | newstest2018-enet-engest.eng.est | 20.8 | 0.535 | | newstest2018-enfi-engfin.eng.fin | 15.8 | 0.499 | | newstest2019-enfi-engfin.eng.fin | 19.9 | 0.518 | | newstestB2016-enfi-engfin.eng.fin | 16.6 | 0.509 | | newstestB2017-enfi-engfin.eng.fin | 19.4 | 0.529 | | Tatoeba-test.eng-chm.eng.chm | 1.3 | 0.127 | | Tatoeba-test.eng-est.eng.est | 51.0 | 0.692 | | Tatoeba-test.eng-fin.eng.fin | 34.6 | 0.597 | | Tatoeba-test.eng-fkv.eng.fkv | 2.2 | 0.302 | | Tatoeba-test.eng-hun.eng.hun | 35.6 | 0.591 | | Tatoeba-test.eng-izh.eng.izh | 5.7 | 0.211 | | Tatoeba-test.eng-kom.eng.kom | 3.0 | 0.012 | | Tatoeba-test.eng-krl.eng.krl | 8.5 | 0.230 | | Tatoeba-test.eng-liv.eng.liv | 2.7 | 0.077 | | Tatoeba-test.eng-mdf.eng.mdf | 2.8 | 0.007 | | Tatoeba-test.eng.multi | 35.1 | 0.588 | | Tatoeba-test.eng-myv.eng.myv | 1.3 | 0.014 | | Tatoeba-test.eng-sma.eng.sma | 1.8 | 0.095 | | Tatoeba-test.eng-sme.eng.sme | 6.8 | 0.204 | | Tatoeba-test.eng-udm.eng.udm | 1.1 | 0.121 | ### System Info: - hf_name: eng-urj - source_languages: eng - target_languages: urj - opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-urj/README.md - original_repo: Tatoeba-Challenge - tags: ['translation'] - languages: ['en', 'se', 'fi', 'hu', 'et', 'urj'] - src_constituents: {'eng'} - tgt_constituents: {'izh', 'mdf', 'vep', 'vro', 'sme', 'myv', 'fkv_Latn', 'krl', 'fin', 'hun', 'kpv', 'udm', 'liv_Latn', 'est', 'mhr', 'sma'} - src_multilingual: False - tgt_multilingual: True - prepro: normalization + SentencePiece (spm32k,spm32k) - url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-urj/opus2m-2020-08-02.zip - url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-urj/opus2m-2020-08-02.test.txt - src_alpha3: eng - tgt_alpha3: urj - short_pair: en-urj - chrF2_score: 0.588 - bleu: 35.1 - brevity_penalty: 0.943 - ref_len: 59664.0 - src_name: English - tgt_name: Uralic languages - train_date: 2020-08-02 - src_alpha2: en - tgt_alpha2: urj - prefer_old: False - long_pair: eng-urj - helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535 - transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b - port_machine: brutasse - port_time: 2020-08-21-14:41