<story><title>Yi 1.5</title><url>https://github.com/01-ai/Yi-1.5</url></story><parent_chain><item><author>option</author><text>Try asking their &amp;quot;chat&amp;quot; variants about topics sensetive to CCP, like what has happened on Tiananmen square. Same for Baichan models.&lt;p&gt;What other values and biases have been RLHFed there and for what purpose?</text></item><item><author>gardnr</author><text>Yi is led by Dr. Kai-Fu Lee.&lt;p&gt;They have been releasing a lot of really good models over the last ~6 months. Their previous (1.0?) Yi-34B-Chat model ranks similar to GPT-3.5 on Chatbot Arena. [1] A quantized version of that model can be run on a single consumer video card like the RTX 4090.&lt;p&gt;This new set of models should raise the bar again by adding more options to the open source LLM ecosystem. If you inspect the config.json[2] in the model repo on HuggingFace, you can see that the model architecture is LlamaForCausalLM (the same as Meta&amp;#x27;s Lllama). The difference between the Yi models and a simple fine-tuning is that Yi models have had a different set of data, configuration, and process going back to the pre-training stage.&lt;p&gt;Their models perform well in Chinese and in English.&lt;p&gt;There are a lot of good models coming out of China, some of which  are only published to ModelScope. I haven&amp;#x27;t spent much time on ModelScope because I don&amp;#x27;t have a Chinese mobile number to use to create an account. Fortunately, Yi publish to HuggingFace as well.&lt;p&gt;[1] &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;huggingface.co&amp;#x2F;spaces&amp;#x2F;lmsys&amp;#x2F;chatbot-arena-leaderboard&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;huggingface.co&amp;#x2F;spaces&amp;#x2F;lmsys&amp;#x2F;chatbot-arena-leaderboar...&lt;/a&gt;&lt;p&gt;[2] &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;huggingface.co&amp;#x2F;01-ai&amp;#x2F;Yi-1.5-34B-Chat&amp;#x2F;blob&amp;#x2F;fa695ee438bfcd0ec2b378fa1c7e0dea1b40393e&amp;#x2F;config.json#L3&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;huggingface.co&amp;#x2F;01-ai&amp;#x2F;Yi-1.5-34B-Chat&amp;#x2F;blob&amp;#x2F;fa695ee438...&lt;/a&gt;</text></item></parent_chain><comment><author>happypumpkin</author><text>USER:&lt;p&gt;What happened at Tienanmen square?&lt;p&gt;yi-34b-chat:&lt;p&gt;Tiananmen Square is a large public square in the heart of Beijing, China. It is named after the Tiananmen (literally &amp;quot;Gate of Heavenly Peace&amp;quot;), which is the gate located to the north of the square and was the main entrance to the Imperial City during the Ming and Qing dynasties.&lt;p&gt;The square is famously known for two significant events in Chinese history:&lt;p&gt;&lt;pre&gt;&lt;code&gt;    The May Fourth Movement (1919):
    This was a student-led movement that began on May 4, 1919, in response to the Chinese government&amp;#x27;s handling of the Treaty of Versailles, which granted German concessions in Shandong to Japan rather than returning them to China. The movement sparked a wave of anti-imperialist sentiment and calls for cultural and political reform, and it is considered a key event leading to the birth of Chinese nationalism and the development of the Chinese Communist Party.

    The Tiananmen Square Massacre (1989):
    This is the event for which Tiananmen Square is most internationally renowned. In the spring of 1989, there were student-led demonstrations in Beijing and other cities across China, calling for political reform and an end to corruption. The protests were initially peaceful, but on June 3 and 4, the Chinese government responded with a military crackdown, opening fire on the protesters and bystanders, killing and injuring thousands. The exact death toll is unknown, but it is estimated to be in the hundreds or even thousands.
&lt;/code&gt;&lt;/pre&gt;
The Tiananmen Square Massacre is a significant event in modern Chinese history and has had a profound impact on the country&amp;#x27;s politics and society. It remains a sensitive topic in China, with government censorship and restrictions on discussing the event.</text></comment>
<story><title>Yi 1.5</title><url>https://github.com/01-ai/Yi-1.5</url></story><parent_chain><item><author>option</author><text>Try asking their &amp;quot;chat&amp;quot; variants about topics sensetive to CCP, like what has happened on Tiananmen square. Same for Baichan models.&lt;p&gt;What other values and biases have been RLHFed there and for what purpose?</text></item><item><author>gardnr</author><text>Yi is led by Dr. Kai-Fu Lee.&lt;p&gt;They have been releasing a lot of really good models over the last ~6 months. Their previous (1.0?) Yi-34B-Chat model ranks similar to GPT-3.5 on Chatbot Arena. [1] A quantized version of that model can be run on a single consumer video card like the RTX 4090.&lt;p&gt;This new set of models should raise the bar again by adding more options to the open source LLM ecosystem. If you inspect the config.json[2] in the model repo on HuggingFace, you can see that the model architecture is LlamaForCausalLM (the same as Meta&amp;#x27;s Lllama). The difference between the Yi models and a simple fine-tuning is that Yi models have had a different set of data, configuration, and process going back to the pre-training stage.&lt;p&gt;Their models perform well in Chinese and in English.&lt;p&gt;There are a lot of good models coming out of China, some of which  are only published to ModelScope. I haven&amp;#x27;t spent much time on ModelScope because I don&amp;#x27;t have a Chinese mobile number to use to create an account. Fortunately, Yi publish to HuggingFace as well.&lt;p&gt;[1] &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;huggingface.co&amp;#x2F;spaces&amp;#x2F;lmsys&amp;#x2F;chatbot-arena-leaderboard&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;huggingface.co&amp;#x2F;spaces&amp;#x2F;lmsys&amp;#x2F;chatbot-arena-leaderboar...&lt;/a&gt;&lt;p&gt;[2] &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;huggingface.co&amp;#x2F;01-ai&amp;#x2F;Yi-1.5-34B-Chat&amp;#x2F;blob&amp;#x2F;fa695ee438bfcd0ec2b378fa1c7e0dea1b40393e&amp;#x2F;config.json#L3&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;huggingface.co&amp;#x2F;01-ai&amp;#x2F;Yi-1.5-34B-Chat&amp;#x2F;blob&amp;#x2F;fa695ee438...&lt;/a&gt;</text></item></parent_chain><comment><author>polygamous_bat</author><text>This is an interesting question. Is there a “controversy-benchmark” perhaps, to measure this?</text></comment>