aghorbani
/

h2o-danube2-1.8b-chat-gguf

Text Generation

large language model

text-generation-inference

Model card Files Files and versions Community

Edit model card

h2o-danube2-1.8b-chat - GGUF

Model creator: H2O.ai
Original model: h2o-danube2-1.8b-chat

Description

This repo contains GGUF format model files for h2o-danube2-1.8b-chat.

Provided files

Downloads last month: 66

GGUF

Model size

1.83B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for aghorbani/h2o-danube2-1.8b-chat-gguf

Base model

h2oai/h2o-danube2-1.8b-chat

Quantized

(6)

this model