File size: 1,124 Bytes
94b3cb2 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
---
license: apache-2.0
---
Release: Oct 7, 2024
# Llama-JPSFT
Supervised fine-tuning was performed on meta-llama/Llama-3.1-8B-Instruct on a select ~140,000 query-response pairs from a diverse corpus of anonymized, scraped chat data, with a priority on casual conversation. BF16 mixed precision training was executed on NVIDIA A100 Tensor Core GPUs and precision reduction/quantization from safetensors to GGUF was then completed for q8_0, q6_k, and q4_k_m models. This project targets standard SFT as well as instruction-tuning for GPT-based architectures to generate significantly improved coherent and context-aware responses in multi-speaker conversations in casual Japanese.
約14万件の多様な匿名化されたチャットデータを基に、教師あり学習による微調整が実施されました。
Instruct Model: https://huggingface.co/ai-net/Llama-JPSFT-2.0
Precision Reduction and Quantization: https://huggingface.co/ai-net/Llama-JPSFT-2.0-GGUF
# 例えば:
{{user}}\
軽率に話しかけてくれる人が増えて嬉しいです！
llama-jpsft-2.0-q4_k_m.gguf\
それはいいことだね |