GGUF quants for https://huggingface.co/GritLM/GritLM-7B
GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.
Layers | Context | Template (Text Representation) | Template (Text Generation) |
---|---|---|---|
32 |
32768 |
<s><|user|> |
<s><|user|> |
- Downloads last month
- 46
Inference API (serverless) does not yet support gguf models for this pipeline type.