gemma-2-9b-bnb-4bit / README.md
evaldas-leliuga's picture
Add model
5a7d6d6 unverified
metadata
base_model: google/gemma-2-9b
license: other
license_name: gemma-terms-of-use
license_link: https://ai.google.dev/gemma/terms
inference: false
model_creator: Google
model_name: gemma-2-9b
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
  - gemma
  - arxiv:1910.09700

gemma-2-9b - bnb 4bit

Description

This model is 4bit quantized version of gemma-2-9b using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "".