AI-Engine/gemma-2-9b-it-GGUF

GGUF llama.cpp quantized version of:

• Original model: gemma-2-9b-it
• Model creator: Google
• License

Recommended Prompt Format (Gemma)

<start_of_turn>model
Provide some context and/or instructions to the model.<end_of_turn>model
<start_of_turn>user
The user’s message goes here<end_of_turn> 
<start_of_turn>model
AI message goes here<end_of_turn>model

Quant Version: b3405 with imatrix