Hugging Face's logo

mesolitica
/
llama-7b-hf-32768-fpf

Text Generation
Transformers
Safetensors
Malay
llama
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

Full Parameter Finetuning 7B 32768 context length Llama2 on Malaysian text

README at https://github.com/huseinzol05/malaya/tree/5.1/session/llama2#full-parameter-finetuning

WandB, https://wandb.ai/mesolitica/fpf-Llama-2-7b-32k-hf?workspace=user-husein-mesolitica

Downloads last month
17
Safetensors
Model size
6.74B params
Tensor type
F32
·
FP16
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Space using mesolitica/llama-7b-hf-32768-fpf 1

Collection including mesolitica/llama-7b-hf-32768-fpf