pt-sk commited on
Commit
d39159a
1 Parent(s): 8e9602c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -4
README.md CHANGED
@@ -8,9 +8,7 @@ tags:
8
  datasets: pt-sk/research_papers_short
9
  metrics: CrossEntropyLoss
10
  ---
11
- This model using Mamba Architecuture trained on a research abstract dataset.
12
-
13
- mamba_reserach file contains the state dict of optimizer and the model.
14
 
15
  * Optimizer: AdamW
16
  * Leanring Rate: 0.001
@@ -31,4 +29,7 @@ mamba_model = Mamba.from_pretrained("pt-sk/mamba").to("cuda")
31
 
32
  Loading Tokenizer
33
  ```
34
- tokenizer = AutoTokenizer.from_pretrained('pt-sk/mamba')
 
 
 
 
8
  datasets: pt-sk/research_papers_short
9
  metrics: CrossEntropyLoss
10
  ---
11
+ This model uses Mamba Architecture trained on a research abstract dataset.
 
 
12
 
13
  * Optimizer: AdamW
14
  * Leanring Rate: 0.001
 
29
 
30
  Loading Tokenizer
31
  ```
32
+ tokenizer = AutoTokenizer.from_pretrained('pt-sk/mamba')
33
+ ```
34
+
35
+ mamba_reserach file contains the state dict of optimizer and the model.