# Model Description

1.3 billion parameter [Megatron](https://aps.arxiv.org/pdf/1909.08053.pdf) version of [FinBERT](https://huggingface.co/TurkuNLP/bert-base-finnish-cased-v1).

# Evaluation results

## Document classification

Results have been measured on 10% of the datasets 

### [Ylilauta](https://github.com/spyysalo/ylilauta-corpus)

| Model          | Accuracy |
|--------------------|----------|
| **Megatron-finbert-1.3B-cased**  | **82.64%** |
| FinBERT-cased | 79.18% |


### [Yle](https://github.com/spyysalo/yle-corpus/tree/master)

| Model          | Accuracy |
|--------------------|----------|
| **Megatron-finbert-1.3B-cased**  | **82.64%** |
| FinBERT-cased | 79.18% |


More documentation coming soon...
{"language": ["fi"], "license": "apache-2.0"}
transformers pytorch tensorboard megatron-bert fi arxiv:1909.08053 license:apache-2.0 endpoints_compatible region:us
TAGS
#transformers #pytorch #tensorboard #megatron-bert #fi #arxiv-1909.08053 #license-apache-2.0 #endpoints_compatible #region-us 

Model Description
=================


1.3 billion parameter Megatron version of FinBERT.


Evaluation results
==================


Document classification
-----------------------


Results have been measured on 10% of the datasets


### Ylilauta



### Yle



More documentation coming soon...



### Ylilauta ### Yle



More documentation coming soon...
TAGS
#transformers #pytorch #tensorboard #megatron-bert #fi #arxiv-1909.08053 #license-apache-2.0 #endpoints_compatible #region-us 
 ### Ylilauta ### Yle



More documentation coming soon...