ravi.naik commited on
Commit
d301033
1 Parent(s): 34d770d

Updated README

Browse files
Files changed (2) hide show
  1. README.md +24 -0
  2. out/redpajama/lit_model.pth +2 -2
README.md CHANGED
@@ -9,3 +9,27 @@ app_file: app.py
9
  pinned: false
10
  license: mit
11
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  pinned: false
10
  license: mit
11
  ---
12
+
13
+ # ERA-SESSION22 Training PyThia-160M from scratch on AWS Sagemaker
14
+ [**Repo Link**](https://github.com/RaviNaik/ERA-SESSION22/)
15
+
16
+ This is an implementation of Pythia-160M [LitGPT](https://github.com/Lightning-AI/lit-gpt) by LightningAI.
17
+ Dataset used to train: [RedPajama](https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T).
18
+
19
+ ### Tasks:
20
+ 1. :heavy_check_mark: Once done, share: screenshot of the logs showing your submission result and clearly showing PageMaker in the URL [800 pts]
21
+ 2. :heavy_check_mark: 4 sample predictions [200 pts]
22
+ 3. ✔️ The model moved to HuggingFace Spaces as an app. [1000 pts]
23
+
24
+ ### Training Log on AWS Sagemaker:
25
+ ![image](https://github.com/RaviNaik/ERA-SESSION22/assets/23289802/b549772f-847e-4f12-a6f6-6661abd36fc8)
26
+
27
+ ### Sample Results:
28
+ ![image](https://github.com/RaviNaik/ERA-SESSION22/assets/23289802/6ce0cccf-9694-4020-8e98-e2175c0e2261)
29
+
30
+ ![image](https://github.com/RaviNaik/ERA-SESSION22/assets/23289802/a21addc7-2d13-4a96-977c-2eaff2e8d414)
31
+
32
+ ![image](https://github.com/RaviNaik/ERA-SESSION22/assets/23289802/bdf88403-b430-49d3-a706-1210728c39ee)
33
+
34
+ ![image](https://github.com/RaviNaik/ERA-SESSION22/assets/23289802/27493648-9273-47a0-bc5f-42dcbf74cb87)
35
+
out/redpajama/lit_model.pth CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a2a0e7f19d1da4037227949c859675ad1c16add49cedd68aa15d0681369942a8
3
- size 56360960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b45015fea9b4dfdcb2f937e79a0c3cf5df931186af5dd899c3f94aa54d60bdf
3
+ size 127926272