Commit
•
469c12c
1
Parent(s):
2409bd2
Update README.md
Browse files
README.md
CHANGED
|
@@ -2,6 +2,11 @@
|
|
| 2 |
license: gpl-3.0
|
| 3 |
---
|
| 4 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
This repository is for Guanaco model with 4-bit quantized weights. The model benefits from two novel techniques introduced by GPTQ: quantizing columns in order of decreasing activation size and performing sequential quantization within a single Transformer block. These innovations enable compact, consumer-level multilingual models to function effectively.
|
| 6 |
|
| 7 |
The Guanaco model aims to provide a minimal multilingual conversational model capable of handling simple Q&A interactions, with a comprehensive understanding of grammar, rich vocabulary, and stability similar to that of large-scale language models, for use as a human-computer interface.
|
|
|
|
| 2 |
license: gpl-3.0
|
| 3 |
---
|
| 4 |
|
| 5 |
+
Free T4 Colab demo:
|
| 6 |
+
|
| 7 |
+
[](https://colab.research.google.com/drive/1ESkKNHGdoocsz1F-Eiwx-9L-Ft3rYdfl#scrollTo=zLORi5OcPcIJ)
|
| 8 |
+
|
| 9 |
+
|
| 10 |
This repository is for Guanaco model with 4-bit quantized weights. The model benefits from two novel techniques introduced by GPTQ: quantizing columns in order of decreasing activation size and performing sequential quantization within a single Transformer block. These innovations enable compact, consumer-level multilingual models to function effectively.
|
| 11 |
|
| 12 |
The Guanaco model aims to provide a minimal multilingual conversational model capable of handling simple Q&A interactions, with a comprehensive understanding of grammar, rich vocabulary, and stability similar to that of large-scale language models, for use as a human-computer interface.
|