README.md

metadata

license: apache-2.0
datasets:
  - vietgpt/wikipedia_vi
  - oscar-corpus/OSCAR-2301
language:
  - vi
  - en
pipeline_tag: text-generation

Concept of open-llama-7b-vi

This is a OpenLLama model finetuned on texts in the Vietnamese language.

Model architecture

The model architecture is the same as the original OpenLLama model

Training Data

The models are trained on the Vietnamese version of Wikipedia. The generated corpus files are 1.5GB in total, containing approximately 1.3M sentences.