This repo contains GGUF format model files for aion-labs/Aion-RP-Llama-3.1-8B.

Model Card

Model Description

This is a completely uncensored model that has been trained to excel at roleplaying and creative writing. It can utilize the full 131K context.

Prompt Format

The model uses the following prompt format:

__SYSTEM__: system message here
__USER__: user message here
__ASSISTANT__: assistant message here

The model is capable of multi-turn conversations. A system message is not required, however, performance can improve if detailed instructions are provided in a system message.

Important: the recommended default temperature for this model is 0.7. Setting the temperature to 1.0 can sometimes result in nonsensical output.

Downloads last month
981
GGUF
Model size
8.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

Inference API
Unable to determine this model's library. Check the docs .