<story><title>How to Finetune GPT-Like Large Language Models on a Custom Dataset</title><url>https://lightning.ai/pages/blog/how-to-finetune-gpt-like-large-language-models-on-a-custom-dataset/</url></story><parent_chain><item><author>moffkalast</author><text>&amp;gt;  I can use smthg like GPT-4 to label data and then use that as a train set for my own LLM, right?&lt;p&gt;Yes, almost all improved LLama models are tuned exactly that way (trained on examples of questions and answers from say GPT 4). If OpenAI stole copyrighted works to train their models it is morally fair game to do the same to them regardless of their TOS. It&amp;#x27;s not like they can prove it anyway.&lt;p&gt;Plus there&amp;#x27;s the other point where they also say that everything generated by their models is public domain, so which one is it eh?</text></item><item><author>artembugara</author><text>Have a question to the Generative AI experts here.&lt;p&gt;So, I can use smthg like GPT-4 to label data and then use that as a train set for my own LLM, right?&lt;p&gt;EDIT: adding this from OpenAI Restriction TOS: &amp;quot;(iii) use output from the Services to develop models that compete with OpenAI;&amp;quot;</text></item></parent_chain><comment><author>fnordpiglet</author><text>Use of copyrighted material in such a way that it’s aggregated into statistical properties is almost certainly fair use. Use of the model to produce reproductions of copyrighted material then consuming or distributing it is almost certainly violating the copyright. But it was the facsimile of the material that’s the violation, not the abstract use of it to generate an aggregate model.</text></comment>
<story><title>How to Finetune GPT-Like Large Language Models on a Custom Dataset</title><url>https://lightning.ai/pages/blog/how-to-finetune-gpt-like-large-language-models-on-a-custom-dataset/</url></story><parent_chain><item><author>moffkalast</author><text>&amp;gt;  I can use smthg like GPT-4 to label data and then use that as a train set for my own LLM, right?&lt;p&gt;Yes, almost all improved LLama models are tuned exactly that way (trained on examples of questions and answers from say GPT 4). If OpenAI stole copyrighted works to train their models it is morally fair game to do the same to them regardless of their TOS. It&amp;#x27;s not like they can prove it anyway.&lt;p&gt;Plus there&amp;#x27;s the other point where they also say that everything generated by their models is public domain, so which one is it eh?</text></item><item><author>artembugara</author><text>Have a question to the Generative AI experts here.&lt;p&gt;So, I can use smthg like GPT-4 to label data and then use that as a train set for my own LLM, right?&lt;p&gt;EDIT: adding this from OpenAI Restriction TOS: &amp;quot;(iii) use output from the Services to develop models that compete with OpenAI;&amp;quot;</text></item></parent_chain><comment><author>jrm4</author><text>I&amp;#x27;m a lawyer so one should never break the law.&lt;p&gt;Nonethless, I can observe and predict that non-consensual &amp;quot;open sourcing&amp;quot; of these models would likely end up probably the best and safest way to do all of this stuff.</text></comment>