ayazeyad/llama3.2-3B-fine-tuned-DS2

Model Description

The model ayazeyad/llama3.2-3B-fine-tuned-DS2 is a fine-tuned version of the Llama-3.2-3B model, This model is specifically designed for medical questions. The model was trained using a dataset of Arabic medical questions. This model is ideal for answering medical questions in Arabic in different medical categories.

The training dataset includes big Data of Arabic Healthcare Questions and Answers (AHQAD) from text data from kaggle. The dataset 'AHQAD' consists of more than 808 thousand questions and answers in 90 different categories.

Model Details

• Model Type: Transformer-based language model fine-tuned for text generation
• Languages: Arabic
• Base Model: meta-llama/Llama-3.2-3B
• Dataset: AHQAD
• Number of Parameters: 3 billion

Model Developer: Meta

Model Architecture:

Llama 3.2 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.