File size: 690 Bytes
f29eb56
 
7ed3fc2
 
 
f29eb56
7ed3fc2
 
 
 
 
 
 
 
db3899c
68327c6
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
---
license: apache-2.0
datasets:
- togethercomputer/RedPajama-Data-1T
- yahma/alpaca-cleaned
---

# OpenLLaMA: An Open Reproduction of LLaMA with Alpaca Lora Instruction Fine Tuning

- A permissively licensed open source reproduction of Meta AI's [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/) large language model. 
- A permissively licensed open source fine-tuning using [Alpaca Lora](https://github.com/tloen/alpaca-lora)

## Dataset and Training

- Base model from [openlm-research/open_llama_7b](https://huggingface.co/openlm-research/open_llama_7b)
- Instruction fine-tuned using [yahma/alpaca-cleaned](https://huggingface.co/datasets/yahma/alpaca-cleaned)