The key takeaways from the Yi finetuning procedure is to heavily iterate on a small amount of data (\(\leq\) 10K), case by case, over multiple iterations, directly by the machine learning engineer, and improved from real user feedback. This approach clearly deviates from the instruction-scaling approach, initially introduced by the FLAN series [9] then followed by the UltraChat series [19].