shenzhi-wang
/

Llama3.1-70B-Chinese-Chat

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

希望有一个30G左右的量化版本

#1

by yxh0774 - opened Jul 25

yxh0774

Jul 25

q3就差不多了

Owner Jul 26

q3_k_m版本来了
https://huggingface.co/shenzhi-wang/Llama3.1-70B-Chinese-Chat/blob/main/gguf/llama3.1_70b_chinese_chat_q3_k_m.gguf

yxh0774

Jul 26

谢谢，8b的版本我用过了，中文的反应非常好。现在我很期待70B的中文版

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment