phi-1-bnb-4bit / README.md
evaldas-leliuga's picture
Updated readme.md
799fefe verified
metadata
base_model: microsoft/phi-1
license: mit
inference: false
model_creator: Microsoft
model_name: phi-1
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
  - phi-1
  - arxiv:1910.09700

phi-1 - bnb 4bit

Description

This model is 4bit quantized version of phi-1 using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "<|endoftext|>".