File size: 4,602 Bytes
a1af7d0
 
e0abb73
a1af7d0
 
 
067ac4e
 
 
 
 
 
 
 
 
 
 
 
c298323
8eca10d
 
b78b50e
 
e2fde3c
8eca10d
78893bd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
# Midnight Miqu EXL2 Measurement Files

This repository contains EXL2 measurement files for quants made here.

## Contents

| Filename                        | Description                                                                                                         | Model Link                                                                                |
|---------------------------------|---------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------|
| `midnight70b.json`              | EXL2 measurement file for Midnight Miqu 70b                                                                         | [sophosympatheia/Midnight-Miqu-70B-v1.0](https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.0) |
| `midnight103b.json`             | EXL2 measurement file for Midnight Miqu 103b                                                                        | [sophosympatheia/Midnight-Miqu-103B-v1.0](https://huggingface.co/sophosympatheia/Midnight-Miqu-103B-v1.0) |
| `midnight70b-v15.json`          | EXL2 measurement file for Midnight Miqu 70b v1.5                                                                    | [sophosympatheia/Midnight-Miqu-70B-v1.5](https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.5) |
| `Merged-RP-Stew-V2-34B.json`    | EXL2 measurement file for Merged RP Stew V2 34B                                                                     | [ParasiticRogue/Merged-RP-Stew-V2-34B](https://huggingface.co/ParasiticRogue/Merged-RP-Stew-V2-34B) |
| `perky70b.json`                 | EXL2 measurement file for Perky 70b                                                                                 | [Dracones/perky-70b-v0.1](https://huggingface.co/Dracones/perky-70b-v0.1)                 |
| `perky103b.json`                | EXL2 measurement file for Perky 103b                                                                                | [Dracones/perky-103b-v0.1](https://huggingface.co/Dracones/perky-103b-v0.1)               |
| `miqu-1-70b-sf.json`            | EXL2 measurement file for miqu-1-70b-sf                                                                             | [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)                     |
| `c4ai-command-r-v01.json`       | EXL2 measurement file for Cohere Command R                                                                          | [CohereForAI/c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01)   |
| `c4ai-command-r-v01-rpcal.json` | EXL2 measurement file for Cohere Command R, RP Calibrated again PIPPA-cleaned                                       | [CohereForAI/c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01)   |
| `Mixtral-8x22B-v0.1.json`       | EXL2 measurement file for Mixtral 8x22 v0.1                                                                         | [mistral-community/Mixtral-8x22B-v0.1](https://huggingface.co/mistral-community/Mixtral-8x22B-v0.1) |
| `mixtral-8x22b-instruct-oh.json`       | EXL2 measurement file for mixtral-8x22b-instruct-oh                                                          | [fireworks-ai/mixtral-8x22b-instruct-oh](https://huggingface.co/fireworks-ai/mixtral-8x22b-instruct-oh) |
| `WizardLM-2-8x22B.json`       | EXL2 measurement file for WizardLM-2-8x22B                                                                            | [microsoft/WizardLM-2-8x22B](https://huggingface.co/microsoft/WizardLM-2-8x22B) |
| `CodeQwen1.5-7B-Chat.json`       | EXL2 measurement file for CodeQwen1.5-7B-Chat                                                                      | [Qwen/CodeQwen1.5-7B-Chat](https://huggingface.co/Qwen/CodeQwen1.5-7B-Chat) |
| `CodeQwen1.5-7B.json`       | EXL2 measurement file for CodeQwen1.5-7B                                                                                | [Qwen/CodeQwen1.5-7B](https://huggingface.co/Qwen/CodeQwen1.5-7B) |
| `Mixtral-8x22B-Instruct-v0.1.json`       | EXL2 measurement file for Mixtral-8x22B-Instruct-v0.1                                                      | [mistralai/Mixtral-8x22B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1) |
| `Llama-3-Lumimaid-70B-v0.1.json`       | EXL2 measurement file for Llama-3-Lumimaid-70B-v0.1                                                      | [NeverSleep/Llama-3-Lumimaid-70B-v0.1](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-70B-v0.1) |