Hugging Face's logo

iwaitu
/
llama3-70b-chinese-function-calling-4bit

Text Generation
Transformers
Safetensors
Chinese
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
1
Edit model card

iwaitu/llama3-70b-chinese-function-calling-4bit

基于 shenzhi-wang/Llama3-70B-Chinese-Chat 进行微调. 使用 bitsandbytes 进行量化到4bit

Downloads last month
5
Safetensors
Model size
37.4B params
Tensor type
F32
·
BF16
·
U8
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.