**Vicuna Benchmark**Chiang et al. (2023) developed a series of open-source chatbots trained by fine-tuning LLaMA Touvron et al. (2023) on user-shared converstaions collected from shareGPT1. They curated an evaluation set consisting of 80 diverse questions, segmented into eight categories with ten questions each. We translate the Vicuna benchmark into Chinese and Korean using GPT-4 OpenAI (2023) to test the generation ability. We also evaluate whether the generated text is in the desired language using Lingua2, a language detection package. When GPT-4 evaluation, we use different language evaluation prompts for different language models3.