<story><title>Employees are feeding sensitive data to ChatGPT, raising security fears</title><url>https://www.darkreading.com/risk/employees-feeding-sensitive-business-data-chatgpt-raising-security-fears</url></story><parent_chain><item><author>jackson1442</author><text>I think this is different in that ChatGPT is expressly using your data as training in a probabilistic model. This means:&lt;p&gt;* Their contractors can (and do!) see your chat data to tune the model&lt;p&gt;* If the model is trained on your confidential data, it may start returning this data to other users (as we&amp;#x27;ve seen with Github Copilot regurgitating licensed software)&lt;p&gt;* The site even _tells you_ not to put confidential data in for these reasons.&lt;p&gt;Until OpenAI makes a version that you can stick on a server in your own datacenter, I wouldn&amp;#x27;t trust it with anything confidential.</text></item><item><author>wantsanagent</author><text>We saw these same fears with the release of Gmail. Why would you trust your &lt;i&gt;email&lt;/i&gt; to &lt;i&gt;Google?!!&lt;/i&gt; Aren&amp;#x27;t they going to train their spam filters on all your data? Aren&amp;#x27;t they going to sell it, or use it to sell you ads?&lt;p&gt;Corporations constantly put their most sensitive data in 3rd party tools. The executive in the article was probably copying his company strategy from Google docs.&lt;p&gt;Yes, there are good reasons for concern, but the power of the tool is simply too great to ignore.&lt;p&gt;Banning these tools will go the same way as prohibition did in the US, people will simply ignore it until it becomes too absurd to maintain and too profitable to not participate in.&lt;p&gt;Companies which are able to operate &lt;i&gt;without&lt;/i&gt; these fears will move faster, grow more quickly, and ultimately challenge companies restricted to operate without.&lt;p&gt;Now I think the article &lt;i&gt;should&lt;/i&gt; be a wake-up call for OpenAI. Messaging around what is and what is not used for training could be improved. Corporate accounts for Chat with clearer privacy policies would be great and warnings that, yes, LLMs do memorize data and you should treat anything you put into a free product on the web as fair game for someone&amp;#x27;s training algorithm.</text></item></parent_chain><comment><author>jacquesm</author><text>&amp;gt; I think this is different in that ChatGPT is expressly using your data as training in a probabilistic model.&lt;p&gt;Google tries hard to sell you on their auto-answers for emails (&amp;#x27;smart reply&amp;#x27;), wonder how those got trained...</text></comment>
<story><title>Employees are feeding sensitive data to ChatGPT, raising security fears</title><url>https://www.darkreading.com/risk/employees-feeding-sensitive-business-data-chatgpt-raising-security-fears</url></story><parent_chain><item><author>jackson1442</author><text>I think this is different in that ChatGPT is expressly using your data as training in a probabilistic model. This means:&lt;p&gt;* Their contractors can (and do!) see your chat data to tune the model&lt;p&gt;* If the model is trained on your confidential data, it may start returning this data to other users (as we&amp;#x27;ve seen with Github Copilot regurgitating licensed software)&lt;p&gt;* The site even _tells you_ not to put confidential data in for these reasons.&lt;p&gt;Until OpenAI makes a version that you can stick on a server in your own datacenter, I wouldn&amp;#x27;t trust it with anything confidential.</text></item><item><author>wantsanagent</author><text>We saw these same fears with the release of Gmail. Why would you trust your &lt;i&gt;email&lt;/i&gt; to &lt;i&gt;Google?!!&lt;/i&gt; Aren&amp;#x27;t they going to train their spam filters on all your data? Aren&amp;#x27;t they going to sell it, or use it to sell you ads?&lt;p&gt;Corporations constantly put their most sensitive data in 3rd party tools. The executive in the article was probably copying his company strategy from Google docs.&lt;p&gt;Yes, there are good reasons for concern, but the power of the tool is simply too great to ignore.&lt;p&gt;Banning these tools will go the same way as prohibition did in the US, people will simply ignore it until it becomes too absurd to maintain and too profitable to not participate in.&lt;p&gt;Companies which are able to operate &lt;i&gt;without&lt;/i&gt; these fears will move faster, grow more quickly, and ultimately challenge companies restricted to operate without.&lt;p&gt;Now I think the article &lt;i&gt;should&lt;/i&gt; be a wake-up call for OpenAI. Messaging around what is and what is not used for training could be improved. Corporate accounts for Chat with clearer privacy policies would be great and warnings that, yes, LLMs do memorize data and you should treat anything you put into a free product on the web as fair game for someone&amp;#x27;s training algorithm.</text></item></parent_chain><comment><author>renewiltord</author><text>Not that I don&amp;#x27;t expect them to do this, but how is it expressly said to be so?&lt;p&gt;&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;help.openai.com&amp;#x2F;en&amp;#x2F;articles&amp;#x2F;5722486-how-your-data-is-used-to-improve-model-performance&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;help.openai.com&amp;#x2F;en&amp;#x2F;articles&amp;#x2F;5722486-how-your-data-is...&lt;/a&gt;&lt;p&gt;&amp;gt; &lt;i&gt;OpenAI does not use data submitted by customers via our API to train OpenAI models or improve OpenAI’s service offering. In order to support the continuous improvement of our models, you can fill out this form to opt-in to share your data with us. Sharing your data with us not only helps our models become more accurate and better at solving your specific problem, it also helps improve their general capabilities and safety.&lt;/i&gt;</text></comment>