Hugging Face's logo

DrNicefellow
/
airoboros-3_1-yi-34b-200k-gptq-exl2-4_5bpw

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
1
Edit model card

Instruction tune of Yi-34b-200k with Airoboros-3.1 (fp16)

Overview

This is a 4.5bpw quantized version of bhenrym14/airoboros-3_1-yi-34b-200k,

Downloads last month
10
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train DrNicefellow/airoboros-3_1-yi-34b-200k-gptq-exl2-4_5bpw