Langboat
/

Mengzi3-13B-Base

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

This Model Has Now Been Quantized In EXL2 Format.

#1

by Kquant03 - opened Mar 31

Mar 31

Here are the links for the quantized files.

https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw2.5
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw3
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw3.5
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw3.7
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4.2
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4.4
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4.6
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4.8
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw5
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw5.5
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw6

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment