Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This is the test version for pruning. This model is a base model that will be pruned and quantized for on-device purpose.

I used mergekit for merging two models:

https://github.com/cg123/mergekit The two models I combined are:

https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v2 https://huggingface.co/kyujinpy/Sakura-SOLAR-Instruct-DPO-v2

I used GGUF quantization.

Downloads last month
2
GGUF
Model size
0 params
Architecture
llama

2-bit

4-bit

Inference API
Unable to determine this model's library. Check the docs .