Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
lllyasviel
/
omost-phi-3-mini-128k-8bits
like
6
Text Generation
Transformers
Safetensors
PyTorch
phi3
trl
sft
conversational
custom_code
text-generation-inference
8-bit precision
bitsandbytes
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
Edit model card
omost-phi-3-mini-128k-8bits is Omost's phi-3-mini model with 128k context length in fp8.
Downloads last month
115
Safetensors
Model size
3.82B params
Tensor type
F32
路
BF16
路
I8
路
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.