mesolitica
/

malaysian-llama2-7b-32k-instructions

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

malaysian-llama2-7b-32k-instructions / README.md

huseinzol05's picture

Create README.md

c5f2032 about 1 year ago

|

382 Bytes

metadata

language:
  - ms

QLORA Malaysian Llama2 7B 32k chat completions

QLORA https://huggingface.co/mesolitica/llama-7b-hf-32768-fpf on translated UltraChat, https://huggingface.co/datasets/mesolitica/google-translate-ultrachat.

We use exact Llama2 chat template.

README at https://github.com/mesolitica/malaya/tree/5.1/session/llama2#7b-16384-context-length-flash-attention-2