TheBlokeAI
/

llama-68m-GPTQ-sharded

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

llama-68m-GPTQ-sharded / quantize_config.json

Commit History

Upload folder using huggingface_hub

a26e784

TheBloke commited on Nov 14, 2023