kiddothe2b
commited on
Commit
•
8a66300
1
Parent(s):
b973435
Update README.md
Browse files
README.md
CHANGED
@@ -8,11 +8,11 @@ tags:
|
|
8 |
datasets:
|
9 |
- wikipedia
|
10 |
model-index:
|
11 |
-
- name: kiddothe2b/
|
12 |
results: []
|
13 |
---
|
14 |
|
15 |
-
# Hierarchical Attention Transformer (HAT) /
|
16 |
|
17 |
## Model description
|
18 |
|
@@ -35,7 +35,7 @@ You can use this model directly with a pipeline for masked language modeling:
|
|
35 |
|
36 |
```python
|
37 |
from transformers import pipeline
|
38 |
-
mlm_model = pipeline('fill-mask', model='kiddothe2b/
|
39 |
mlm_model("Hello I'm a <mask> model.")
|
40 |
```
|
41 |
|
@@ -43,8 +43,8 @@ You can also fine-tun it for SequenceClassification, SequentialSentenceClassific
|
|
43 |
|
44 |
```python
|
45 |
from transformers import AutoTokenizer, AutoModelforSequenceClassification
|
46 |
-
tokenizer = AutoTokenizer.from_pretrained("kiddothe2b/
|
47 |
-
doc_classifier = AutoModelforSequenceClassification(model='kiddothe2b/
|
48 |
```
|
49 |
|
50 |
## Limitations and bias
|
|
|
8 |
datasets:
|
9 |
- wikipedia
|
10 |
model-index:
|
11 |
+
- name: kiddothe2b/hierarchical-transformer-LC1-mini-1024
|
12 |
results: []
|
13 |
---
|
14 |
|
15 |
+
# Hierarchical Attention Transformer (HAT) / hierarchical-transformer-LC1-mini-1024
|
16 |
|
17 |
## Model description
|
18 |
|
|
|
35 |
|
36 |
```python
|
37 |
from transformers import pipeline
|
38 |
+
mlm_model = pipeline('fill-mask', model='kiddothe2b/hierarchical-transformer-LC1-mini-1024', trust_remote_code=True)
|
39 |
mlm_model("Hello I'm a <mask> model.")
|
40 |
```
|
41 |
|
|
|
43 |
|
44 |
```python
|
45 |
from transformers import AutoTokenizer, AutoModelforSequenceClassification
|
46 |
+
tokenizer = AutoTokenizer.from_pretrained("kiddothe2b/hierarchical-transformer-LC1-mini-1024", trust_remote_code=True)
|
47 |
+
doc_classifier = AutoModelforSequenceClassification(model='kiddothe2b/hierarchical-transformer-LC1-mini-1024', trust_remote_code=True)
|
48 |
```
|
49 |
|
50 |
## Limitations and bias
|