|
Quantized using 200 samples of 8192 tokens from an RP-oriented [PIPPA](https://huggingface.co/datasets/royallab/PIPPA-cleaned) dataset. |
|
|
|
Branches: |
|
- `main` -- rpcal-`measurement.json` |
|
|
|
|
|
Requires ExllamaV2 version 0.0.12 and up. |
|
|
|
Original model link: [crestf411/daybreak-miqu-1-70b-v1.0-hf](https://huggingface.co/crestf411/daybreak-miqu-1-70b-v1.0-hf) |
|
|
|
Original model README below. |
|
|
|
*** |
|
|
|
Model trained on the same dataset as [daybreak-mixtral-8x7b](https://huggingface.co/crestf411/daybreak-mixtral-8x7b-v1.0-hf) except directly on miqu-1-70b. |
|
|
|
Static and imatrix GGUF quants (thanks to [mradermacher](https://huggingface.co/mradermacher)): |
|
|
|
* https://huggingface.co/mradermacher/daybreak-miqu-1-70b-v1.0-hf-GGUF |
|
* https://huggingface.co/mradermacher/daybreak-miqu-1-70b-v1.0-hf-i1-GGUF |
|
|
|
EXL2 quants: |
|
* https://huggingface.co/crestf411/daybreak-miqu-1-70b-4.25bpw-v1.0-exl2 |
|
|
|
EXL2 measurements (for making your own quants): https://huggingface.co/crestf411/ExllamaV2-Measurements/blob/main/measurement-daybreak-miqu-1-70b-v1.0.json |
|
|