llmixer
/

BigWeave-v8-90b-4.0bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

BigWeave-v8-90b-4.0bpw-h8-exl2 / README.md

llmixer's picture

Create README.md

acd7cce verified 10 months ago

|

297 Bytes

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 4.0bpw
  - h8
  - exl2

Exllamav2 4.0bpw h8 quant for BigWeave-v8-90b.

Calibration dataset: llmixer/20k_random_data