@ahsanr @osanseviero @Saugatkafley

You should check the guide of Japanese LLM called "Awesome-japanese-llm" available in Japanese, English, and French. : ) -> https://github.com/llm-jp/awesome-japanese-llm

You have the newest LLM-JP-13B by the "LLM-JP Study Group" a cool open-source initiative in Japan.
https://huggingface.co/llm-jp/llm-jp-13b-v2.0

You have the EvoLLM-JP from the independent AI lab, Sakana AI
https://huggingface.co/SakanaAI/EvoLLM-JP-v1-7B

Swallow LLMs from Tokyo Tech are pretty great.
https://huggingface.co/tokyotech-llm

StableBeluga2 70B from the Japanese team of Stability AI
https://huggingface.co/stabilityai/StableBeluga2

Stockmark 100B might be the biggest one yet...
https://huggingface.co/stockmark/stockmark-100b

Youko in 8B based on Llama 3 from Rinna
https://huggingface.co/rinna/llama-3-youko-8b

You have many LLMs in Apache 2.0 from amazing university labs, independent AI labs, corporate R&D teams, and NLP researchers. The Japanese ecosystem is very "domain-specific". I am sure, you will find a great LLM for your use-case.