pszemraj commited on
Commit
3449896
1 Parent(s): 025fa5e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -21,9 +21,10 @@ pipeline_tag: text-generation
21
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
22
  should probably proofread and complete it, then remove this comment. -->
23
 
24
- # PT-random-mega-ar-large-simple_wikipedia_LM-main-2048
 
 
25
 
26
- This model is a fine-tuned version of [pszemraj/random-mega-ar-large](https://huggingface.co/pszemraj/random-mega-ar-large) on the None dataset.
27
  It achieves the following results on the evaluation set:
28
  - Loss: 3.3412
29
  - Accuracy: 0.4360
 
21
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
22
  should probably proofread and complete it, then remove this comment. -->
23
 
24
+ # mega-ar-large-2048-simplewiki
25
+
26
+ This is a 'large' size autoregressive MEGA model initialized from random weights and trained on `pszemraj/simple_wikipedia_LM` for three epochs.
27
 
 
28
  It achieves the following results on the evaluation set:
29
  - Loss: 3.3412
30
  - Accuracy: 0.4360