---
base_model: Goekdeniz-Guelmez/j.o.s.i.e.v4o-7b-orpo-stage1-v1
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- trl
- orpo
- KANama
---

# Goekdeniz-Guelmez/KANama-fineweb-v1-test1

The Model [Goekdeniz-Guelmez/KANama-fineweb-v1-test1](https://huggingface.co/Goekdeniz-Guelmez/KANama-fineweb-v1-test1) was created using KANama.

## Use with KANama

```bash
pip install KANama, transformers
```

```python
from model.handler import from_pretrained, quick_inference
from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Doctor-Shotgun/TinyLlama-1.1B-32k")
model = from_pretrained("path/to/model/folder")

prompt="hello"

input_tokens = tokenizer(prompt, return_tensors="pt").input_ids.to(device)

generated_tokens, generated_text = quick_inference(model, input_tokens, max_new_tokens=50, tokenizer=tokenizer)
print(generated_text)
```