<story><title>Why is GPT-3 15.77x more expensive for certain languages?</title><url>https://denyslinkov.medium.com/why-is-gpt-3-15-77x-more-expensive-for-certain-languages-2b19a4adc4bc</url></story><parent_chain><item><author>FredPret</author><text>What an interesting aspect I haven&amp;#x27;t considered before. All the AIs will be trained on the available media - most of which is English.&lt;p&gt;I sometimes wonder what it takes to unseat a lingua franca, but it looks like we won&amp;#x27;t see that soon. English is set to dominate for a long time.</text></item></parent_chain><comment><author>og_kalu</author><text>Doesn&amp;#x27;t really matter. There&amp;#x27;s lots of positive transfer in individual language learning. Competence in one language bleeds into competence in others.
&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;arxiv.org&amp;#x2F;abs&amp;#x2F;2108.13349&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;arxiv.org&amp;#x2F;abs&amp;#x2F;2108.13349&lt;/a&gt;&lt;p&gt;GPT-3 is fluent in many languages despite English taking up 93% of the corpus by word count. French is next with 1.8%&lt;p&gt;&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;openai&amp;#x2F;gpt-3&amp;#x2F;blob&amp;#x2F;master&amp;#x2F;dataset_statistics&amp;#x2F;languages_by_word_count.csv&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;openai&amp;#x2F;gpt-3&amp;#x2F;blob&amp;#x2F;master&amp;#x2F;dataset_statisti...&lt;/a&gt;&lt;p&gt;Dunno the statistics of language presence with GPT-4 but it takes it up another level in terms of its multilingual capabilities.</text></comment>
<story><title>Why is GPT-3 15.77x more expensive for certain languages?</title><url>https://denyslinkov.medium.com/why-is-gpt-3-15-77x-more-expensive-for-certain-languages-2b19a4adc4bc</url></story><parent_chain><item><author>FredPret</author><text>What an interesting aspect I haven&amp;#x27;t considered before. All the AIs will be trained on the available media - most of which is English.&lt;p&gt;I sometimes wonder what it takes to unseat a lingua franca, but it looks like we won&amp;#x27;t see that soon. English is set to dominate for a long time.</text></item></parent_chain><comment><author>hirundo</author><text>This may be backwards. When AI can cheaply, quickly and with nuance intact translate between languages, it becomes easier to use a preferred non-dominant language, which would make English less dominant. There&amp;#x27;s less incentive to spend so much time learning this oddly irregular foreign tongue if the skill is embedded in your phone.</text></comment>