Midnight Miqu EXL2 Measurement Files
This repository contains EXL2 measurement files for quants made here.
Contents
Filename | Description | Model Link |
---|---|---|
midnight70b.json |
EXL2 measurement file for Midnight Miqu 70b | sophosympatheia/Midnight-Miqu-70B-v1.0 |
midnight103b.json |
EXL2 measurement file for Midnight Miqu 103b | sophosympatheia/Midnight-Miqu-103B-v1.0 |
midnight70b-v15.json |
EXL2 measurement file for Midnight Miqu 70b v1.5 | sophosympatheia/Midnight-Miqu-70B-v1.5 |
Merged-RP-Stew-V2-34B.json |
EXL2 measurement file for Merged RP Stew V2 34B | ParasiticRogue/Merged-RP-Stew-V2-34B |
perky70b.json |
EXL2 measurement file for Perky 70b | Dracones/perky-70b-v0.1 |
perky103b.json |
EXL2 measurement file for Perky 103b | Dracones/perky-103b-v0.1 |
miqu-1-70b-sf.json |
EXL2 measurement file for miqu-1-70b-sf | 152334H/miqu-1-70b-sf |
c4ai-command-r-v01.json |
EXL2 measurement file for Cohere Command R | CohereForAI/c4ai-command-r-v01 |
c4ai-command-r-v01-rpcal.json |
EXL2 measurement file for Cohere Command R, RP Calibrated again PIPPA-cleaned | CohereForAI/c4ai-command-r-v01 |
Mixtral-8x22B-v0.1.json |
EXL2 measurement file for Mixtral 8x22 v0.1 | mistral-community/Mixtral-8x22B-v0.1 |
mixtral-8x22b-instruct-oh.json |
EXL2 measurement file for mixtral-8x22b-instruct-oh | fireworks-ai/mixtral-8x22b-instruct-oh |
WizardLM-2-8x22B.json |
EXL2 measurement file for WizardLM-2-8x22B | microsoft/WizardLM-2-8x22B |
CodeQwen1.5-7B-Chat.json |
EXL2 measurement file for CodeQwen1.5-7B-Chat | Qwen/CodeQwen1.5-7B-Chat |
CodeQwen1.5-7B.json |
EXL2 measurement file for CodeQwen1.5-7B | Qwen/CodeQwen1.5-7B |
Mixtral-8x22B-Instruct-v0.1.json |
EXL2 measurement file for Mixtral-8x22B-Instruct-v0.1 | mistralai/Mixtral-8x22B-Instruct-v0.1 |
Llama-3-Lumimaid-70B-v0.1.json |
EXL2 measurement file for Llama-3-Lumimaid-70B-v0.1 | NeverSleep/Llama-3-Lumimaid-70B-v0.1 |