TeeZee
/

falcon-180B-chat-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

Falcon 180B Chat - AWQ

Model creator: Technology Innovation Institute
Original model: Falcon 180B Chat

Description

This repo contains AWQ model files for Technology Innovation Institute's Falcon 180B Chat. with correct chat template inside tokenizer_config.json

Contact

[email protected]

Downloads last month: 6

Safetensors

Model size

25.7B params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for TeeZee/falcon-180B-chat-AWQ

Base model

tiiuae/falcon-180B-chat

Quantized

(4)

this model

Dataset used to train TeeZee/falcon-180B-chat-AWQ