# gpt3-finnish-3B-GGML

Based on initial release of FinGPT-3 monolingual GPT-3-like model for Finnish from [TurkuNLP Research Group](https://huggingface.co/TurkuNLP).  

This model is quantized GGML format binary of [gpt3-finnish-3B](https://huggingface.co/TurkuNLP/gpt3-finnish-3B).  
| File | Description |
| ---- | --- |
| gpt3-finnish-3B.bloomz.ggml.q4_0.bin | 4 bit quantized. For inference using [bloomz.cpp](https://github.com/NouamaneTazi/bloomz.cpp) |

```bash
bloomz.cpp/main -m gpt3-finnish-3B.bloomz.ggml.q4_0.bin -t 4 -n 200 -p "Lasten loru:"
```

*Lasten loru:*  
*Lauri seulassa,*  
*pitkä tukka tuulessa.*  
*Lalli saunassa, kirves kainalossa.*  
{"language": ["fi"], "pipeline_tag": "text-generation"}
text-generation fi region:us
TAGS
#text-generation #fi #region-us 

gpt3-finnish-3B-GGML
====================


Based on initial release of FinGPT-3 monolingual GPT-3-like model for Finnish from TurkuNLP Research Group.


This model is quantized GGML format binary of gpt3-finnish-3B.



*Lasten loru:*  

*Lauri seulassa,*  

*pitkä tukka tuulessa.*  

*Lalli saunassa, kirves kainalossa.*



TAGS
#text-generation #fi #region-us 
