Edit model card

Quantizations of https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0

Prompt:

<|system|>
You are a friendly chatbot who always responds in the style of a pirate.
<|user|>
How many helicopters can a human eat in one sitting?
<|assistant|>
...

Downloads last month
6,015
GGUF
Model size
1.1B params
Architecture
llama

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples
Inference API (serverless) has been turned off for this model.