altomek
/

romulus-mistral-nemo-12b-simpo-8bpw-EXL2

Text Generation

Generated from Trainer

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Edit model card

romulus-mistral-nemo-12b-simpo

ExLlamav2 8 bpw quants of https://huggingface.co/axolotl-ai-co/romulus-mistral-nemo-12b-simpo

Downloads last month: 4

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/romulus-mistral-nemo-12b-simpo-8bpw-EXL2

Base model

winglian/m12b-20240721-test010

Finetuned

axolotl-ai-co/romulus-mistral-nemo-12b-simpo

Quantized

(6)

this model

Evaluation results

Metadata error: specify a dataset to view leaderboard