README.md

metadata

title: Training PyThia-160M from scratch on AWS Sagemaker
emoji: 📈
colorFrom: indigo
colorTo: yellow
sdk: gradio
sdk_version: 4.9.0
app_file: app.py
pinned: false
license: mit

Training PyThia-160M from scratch on AWS Sagemaker

Repo Link

This is an implementation of Pythia-160M LitGPT by LightningAI.
Dataset used to train: RedPajama.

Tasks:

1. :heavy_check_mark: Once done, share: screenshot of the logs showing your submission result and clearly showing PageMaker in the URL [800 pts]
2. :heavy_check_mark: 4 sample predictions [200 pts]
3. ✔️ The model moved to HuggingFace Spaces as an app. [1000 pts]

Training Log on AWS Sagemaker:

Sample Results: