|
--- |
|
language: |
|
- en |
|
license: apache-2.0 |
|
tags: |
|
- KANaMoEv1 |
|
--- |
|
|
|
# Goekdeniz-Guelmez/KANama-fineweb-v1-test1 |
|
|
|
The Model [Goekdeniz-Guelmez/KANama-fineweb-v1-test1](https://huggingface.co/Goekdeniz-Guelmez/KANama-fineweb-v1-test1) was created using KANama. |
|
|
|
## Use with KANama |
|
|
|
```bash |
|
pip install KANama, transformers |
|
``` |
|
|
|
```python |
|
from model.handler import from_pretrained, quick_inference |
|
from transformers import AutoTokenizer |
|
|
|
tokenizer = AutoTokenizer.from_pretrained("Goekdeniz-Guelmez/KANama-fineweb-v1-test1") |
|
model = from_pretrained("path/to/model/folder") |
|
|
|
prompt="hello" |
|
|
|
input_tokens = tokenizer(prompt, return_tensors="pt").input_ids.to(device) |
|
|
|
generated_tokens, generated_text = quick_inference(model, input_tokens, max_new_tokens=50, tokenizer=tokenizer) |
|
print(generated_text) |
|
``` |
