<story><title>Secret ChatGPT plugins can be revealed by removing a parameter from an API call</title><url>https://twitter.com/rez0__/status/1639259413553750021</url></story><parent_chain><item><author>koolba</author><text>&amp;gt; It is possible to use these unreleased plugins by setting up match-and-replace rules through an HTTP proxy. There are only client-side checks to validate that you have permission to use the plugins and they can be bypassed.&lt;p&gt;There’s no way I’m going to accept the intersection of “we take security very seriously” and implementing security checks purely client side. This and the recent title information leak are both canaries for how the rest of Open AI operates.</text></item></parent_chain><comment><author>danShumway</author><text>My conspiracy theory is that all of the &amp;quot;we take security very seriously&amp;quot; talk out of OpenAI has aligned with &amp;quot;our AI is so advanced and powerful that we have to take these existential risks very seriously and we have to make sure it doesn&amp;#x27;t turn evil.&amp;quot; And OpenAI doesn&amp;#x27;t seem very interested in security conversations that don&amp;#x27;t feed into that narrative[0].&lt;p&gt;I think it&amp;#x27;s (mostly) just propaganda. OpenAI focuses on dangers that make their AI seem more advanced than it is, and ignore dangers that don&amp;#x27;t play well to the press (like clientside validation). I&amp;#x27;m not even sure it&amp;#x27;s standard &amp;quot;we care about your security&amp;quot; company talk, I think it&amp;#x27;s mostly designed just to make people think of GPT as more cutting edge.&lt;p&gt;The &amp;quot;GPT paid someone to solve a captcha&amp;quot; release seems like pure publicity stunt to me, given that solving captchas by pretending to be blind is something other systems can already do without human help. But it played well in press releases.&lt;p&gt;----&lt;p&gt;[0]: To be fair, they have been focusing on alignment, but I honestly don&amp;#x27;t think alignment is a security measure, I think it&amp;#x27;s a general performance measure. We haven&amp;#x27;t seen strong evidence that alignment can stop prompt injection attacks, so I think mostly OpenAI mostly just cares about the potential negative press from their AI randomly insulting people.</text></comment>
<story><title>Secret ChatGPT plugins can be revealed by removing a parameter from an API call</title><url>https://twitter.com/rez0__/status/1639259413553750021</url></story><parent_chain><item><author>koolba</author><text>&amp;gt; It is possible to use these unreleased plugins by setting up match-and-replace rules through an HTTP proxy. There are only client-side checks to validate that you have permission to use the plugins and they can be bypassed.&lt;p&gt;There’s no way I’m going to accept the intersection of “we take security very seriously” and implementing security checks purely client side. This and the recent title information leak are both canaries for how the rest of Open AI operates.</text></item></parent_chain><comment><author>axg11</author><text>I don&amp;#x27;t think _this_ is a security check. These are essentially unlisted plugins. They will be released&amp;#x2F;approved and this is a way to allow some user to test the plugins (different client side software).</text></comment>