Quantized using 200 samples of 8192 tokens from an RP-oriented PIPPA dataset.
Branches:
main-- rpcal-measurement.json
Requires ExllamaV2 version 0.0.12 and up.
Original model link: crestf411/daybreak-miqu-1-70b-v1.0-hf
Original model README below.
Model trained on the same dataset as daybreak-mixtral-8x7b except directly on miqu-1-70b.
Static and imatrix GGUF quants (thanks to mradermacher):
- https://huggingface.co/mradermacher/daybreak-miqu-1-70b-v1.0-hf-GGUF
- https://huggingface.co/mradermacher/daybreak-miqu-1-70b-v1.0-hf-i1-GGUF
EXL2 quants:
EXL2 measurements (for making your own quants): https://huggingface.co/crestf411/ExllamaV2-Measurements/blob/main/measurement-daybreak-miqu-1-70b-v1.0.json