HF1BitLLM
/

Llama3-8B-1.58-100B-tokens

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Resources

View closed (5)

Triton error while running demo code

#11 opened 22 days ago by

Slower than standard Llama 8b?

#10 opened 22 days ago by

I found some errors when building on a rpi 5

#9 opened 24 days ago by

You can try to convert DeepSeek-V2.5 or Llama-3.1-Nemotron-70B-Instruct-HF?

#8 opened 28 days ago by

Finetuning this model

#7 opened about 1 month ago by

GGUF conversion

#3 opened about 2 months ago by