Edit model card

GGUF llama.cpp quantized version of:

Recommended Prompt Format (Gemma)

<start_of_turn>model
Provide some context and/or instructions to the model.<end_of_turn>model
<start_of_turn>user
The user’s message goes here<end_of_turn> 
<start_of_turn>model
AI message goes here<end_of_turn>model

Quant Version: b3450 with imatrix

Downloads last month
75
GGUF
Model size
27.2B params
Architecture
gemma2

2-bit

4-bit

5-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .

Model tree for AI-Engine/gemma-2-27b-it-GGUF

Base model

google/gemma-2-27b
Quantized
(40)
this model