adalbertojunior commited on
Commit
0c2eff5
1 Parent(s): 9d84f0b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -3,4 +3,17 @@ language:
3
  - pt
4
  ---
5
 
 
6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  - pt
4
  ---
5
 
6
+ This model was distilled from [BERTimbau](https://huggingface.co/neuralmind/bert-base-portuguese-cased)
7
 
8
+ ## Usage
9
+
10
+ ```python
11
+ from transformers import AutoTokenizer # Or BertTokenizer
12
+ from transformers import AutoModelForPreTraining # Or BertForPreTraining for loading pretraining heads
13
+ from transformers import AutoModel # or BertModel, for BERT without pretraining heads
14
+ model = AutoModelForPreTraining.from_pretrained('adalbertojunior/distilbert-portuguese-cased')
15
+ tokenizer = AutoTokenizer.from_pretrained('adalbertojunior/distilbert-portuguese-cased', do_lower_case=False)
16
+ ```
17
+ You should fine tune it on your own data.
18
+
19
+ It can achieve accuracy up to 99% relative to the original BERTimbau in some tasks.