Hugging Face's logo

itdainb
/
SeaLLMs-v3-7B-bnb-4bit

Text Generation
Transformers
Safetensors
English
qwen2
text-generation-inference
unsloth
trl
conversational
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
Edit model card

Uploaded model

  • Developed by: itdainb
  • License: apache-2.0
  • Finetuned from model : SeaLLMs/SeaLLMs-v3-7B

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
11
Safetensors
Model size
4.46B params
Tensor type
FP16
·
F32
·
U8
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for itdainb/SeaLLMs-v3-7B-bnb-4bit

Base model

SeaLLMs/SeaLLMs-v3-7B
Quantized
(4)
this model

Collection including itdainb/SeaLLMs-v3-7B-bnb-4bit