DavidDutour's picture
Update README.md
4ddbec2 verified
|
raw
history blame
803 Bytes
metadata
license: creativeml-openrail-m
language:
  - fr
  - en
tags:
  - chatml

French Pro model

This version aims to be a multilingual model (EN 🇺🇸 + FR🇫🇷) to refine the specific professional tasks in French.

Dataset

EnnoAi-Pro has been trained on a French dataset to enhance its analysis and response quality. The dataset contains ~275K high-quality training samples of professional and general strategic themes.

Tuning

We use specific recipes with QLora methods to increase accuracy in advanced RAG contexts.

Prompt Format

We use the default ChatML format with system role support.

<|begin_of_text|><|im_start|>system
{SYSTEM_CONTEXT}<|im_end|>
<|im_start|>user
{USER_ENTRY}<|im_end|>
<|im_start|>assistant
{ASSISTANT_ENTRY}<|im_end|>

This model is under construction