|
--- |
|
language: |
|
- el |
|
- en |
|
license: apache-2.0 |
|
pipeline_tag: text-generation |
|
tags: |
|
- finetuned |
|
inference: true |
|
base_model: |
|
- ilsp/Meltemi-7B-Instruct-v1.5 |
|
--- |
|
|
|
# Meltemi 7B Instruct v1.5 gguf |
|
|
|
This is [Meltemi 7B Instract v1.5](https://huggingface.co/ilsp/Meltemi-7B-Instruct-v1.5), the first Greek Large Language Model (LLM) published in the `gguf`, [llama.cpp](https://github.com/ggerganov/llama.cpp)-compatible format. |
|
|
|
# Model Information |
|
|
|
- Vocabulary extension of the Mistral 7b tokenizer with Greek tokens for lower costs and faster inference (**1.52** vs. 6.80 tokens/word for Greek) |
|
- 8192 context length |
|
|
|
For more details, please refer to the original model card [Meltemi 7B Instract v1.5](https://huggingface.co/ilsp/Meltemi-7B-Instruct-v1.5) |
|
|
|
# Instruction format |
|
|
|
You can do whatever you can with a standard [llama.cpp](https://github.com/ggerganov/llama.cpp) model |
|
|
|
## Basic Usage |
|
|
|
```shell |
|
llama-cli -m ./Meltemi-7B-Instruct-v1.5-F16.gguf -p "Ποιό είναι το νόημα της ζωής;" -n 128 |
|
``` |
|
|
|
## Conversation Mode |
|
|
|
```shell |
|
llama-cli -m ./Meltemi-7B-Instruct-v1.5-F16.gguf --conv |
|
``` |
|
|
|
## Web Server |
|
|
|
```shell |
|
llama-server -m ./Meltemi-7B-Instruct-v1.5-F16.gguf --port 8080 |
|
``` |
|
|
|
|
|
|
