README.md

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 3.0bpw
  - h6
  - exl2

Exllamav2 3.0bpw h6 quant for Midnight-Rose-103B-v2.0.3.

Default calibration dataset.