LLM (Chat)
Collection
2 items
•
Updated
Convert from TinyLlama/TinyLlama-1.1B-Chat-v1.0 and 4 bits quantized.
Require onnxruntime>=0.17.0
- Downloads last month
- 4
Inference API (serverless) does not yet support transformers.js models for this pipeline type.
Model tree for BricksDisplay/TinyLlama-1.1B-Chat-v1.0-q4
Base model
TinyLlama/TinyLlama-1.1B-Chat-v1.0
Quantized
this model