EXL2_Measurements / README.md
Dracones's picture
Upload folder using huggingface_hub
e2fde3c verified

Midnight Miqu EXL2 Measurement Files

This repository contains EXL2 measurement files for quants made here.

Contents

Filename Description Model Link
midnight70b.json EXL2 measurement file for Midnight Miqu 70b sophosympatheia/Midnight-Miqu-70B-v1.0
midnight103b.json EXL2 measurement file for Midnight Miqu 103b sophosympatheia/Midnight-Miqu-103B-v1.0
midnight70b-v15.json EXL2 measurement file for Midnight Miqu 70b v1.5 sophosympatheia/Midnight-Miqu-70B-v1.5
Merged-RP-Stew-V2-34B.json EXL2 measurement file for Merged RP Stew V2 34B ParasiticRogue/Merged-RP-Stew-V2-34B
perky70b.json EXL2 measurement file for Perky 70b Dracones/perky-70b-v0.1
perky103b.json EXL2 measurement file for Perky 103b Dracones/perky-103b-v0.1
miqu-1-70b-sf.json EXL2 measurement file for miqu-1-70b-sf 152334H/miqu-1-70b-sf
c4ai-command-r-v01.json EXL2 measurement file for Cohere Command R CohereForAI/c4ai-command-r-v01
c4ai-command-r-v01-rpcal.json EXL2 measurement file for Cohere Command R, RP Calibrated again PIPPA-cleaned CohereForAI/c4ai-command-r-v01
Mixtral-8x22B-v0.1.json EXL2 measurement file for Mixtral 8x22 v0.1 mistral-community/Mixtral-8x22B-v0.1
mixtral-8x22b-instruct-oh.json EXL2 measurement file for mixtral-8x22b-instruct-oh fireworks-ai/mixtral-8x22b-instruct-oh
WizardLM-2-8x22B.json EXL2 measurement file for WizardLM-2-8x22B microsoft/WizardLM-2-8x22B
CodeQwen1.5-7B-Chat.json EXL2 measurement file for CodeQwen1.5-7B-Chat Qwen/CodeQwen1.5-7B-Chat
CodeQwen1.5-7B.json EXL2 measurement file for CodeQwen1.5-7B Qwen/CodeQwen1.5-7B
Mixtral-8x22B-Instruct-v0.1.json EXL2 measurement file for Mixtral-8x22B-Instruct-v0.1 mistralai/Mixtral-8x22B-Instruct-v0.1
Llama-3-Lumimaid-70B-v0.1.json EXL2 measurement file for Llama-3-Lumimaid-70B-v0.1 NeverSleep/Llama-3-Lumimaid-70B-v0.1