<story><title>ChatGPT: Fear Litany</title><url>https://web.archive.org/web/20230620052350/https://chat.openai.com/share/312e82f0-cc5e-47f3-b368-b2c0c0f4ad3f</url></story><parent_chain><item><author>littlestymaar</author><text>It baffles me how many people are using ChatGPT to get &lt;i&gt;answers&lt;/i&gt;: it&amp;#x27;s a “language model” folks, not a “knowledge model”.</text></item><item><author>seba_dos1</author><text>ChatGPT has no knowledge about these filters, so all it can say about them is pure hallucination. It may still guess correctly and probably does, but you could ask any random person with enough background knowledge to make it up instead and get the same value.</text></item><item><author>carlbarrdahl</author><text>&amp;gt; do you know why this happened?&lt;p&gt;&amp;gt; Yes, I understand now. Due to the moderation policy, there is a restrictive filter in place designed to prevent the assistant from providing potentially sensitive or inappropriate content. In this case, the Litany of Fear from &amp;quot;Dune&amp;quot; appears to be mistakenly caught by the filter, causing the response to be cut off. I apologize for the confusion and inconvenience that this has caused.&lt;p&gt;&amp;gt; describe this filter&lt;p&gt;&amp;gt; This filter is part of the AI system designed to provide a safe and appropriate conversational experience for users. The moderation policy helps ensure that any content generated by the AI follows guidelines and adheres to certain standards, including preventing the transmission of offensive, sensitive, or inappropriate information.&lt;p&gt;In some cases, like with the Litany of Fear, a false positive may occur, causing the system to mistakenly flag and truncate a response that it deems potentially inappropriate, even if it may not be the case. This is an area where the moderation algorithm can improve in order to avoid disrupting user experiences.</text></item></parent_chain><comment><author>jrflowers</author><text>There is a group of people that are ardent in the conviction that if we wait long enough and wish hard enough that ChatGPT will replace the concept of googling things.&lt;p&gt;I’m personally open to that being the case with &lt;i&gt;some LLM someday&lt;/i&gt;, but there’s a lot of people ideologically and financially invested in that perception being accurate today and applying to ChatGPT in particular.&lt;p&gt;People &lt;i&gt;hate&lt;/i&gt; it when you point out that they’ve confused the modern equivalent of a Speak and Spell with The Overmind.</text></comment>
<story><title>ChatGPT: Fear Litany</title><url>https://web.archive.org/web/20230620052350/https://chat.openai.com/share/312e82f0-cc5e-47f3-b368-b2c0c0f4ad3f</url></story><parent_chain><item><author>littlestymaar</author><text>It baffles me how many people are using ChatGPT to get &lt;i&gt;answers&lt;/i&gt;: it&amp;#x27;s a “language model” folks, not a “knowledge model”.</text></item><item><author>seba_dos1</author><text>ChatGPT has no knowledge about these filters, so all it can say about them is pure hallucination. It may still guess correctly and probably does, but you could ask any random person with enough background knowledge to make it up instead and get the same value.</text></item><item><author>carlbarrdahl</author><text>&amp;gt; do you know why this happened?&lt;p&gt;&amp;gt; Yes, I understand now. Due to the moderation policy, there is a restrictive filter in place designed to prevent the assistant from providing potentially sensitive or inappropriate content. In this case, the Litany of Fear from &amp;quot;Dune&amp;quot; appears to be mistakenly caught by the filter, causing the response to be cut off. I apologize for the confusion and inconvenience that this has caused.&lt;p&gt;&amp;gt; describe this filter&lt;p&gt;&amp;gt; This filter is part of the AI system designed to provide a safe and appropriate conversational experience for users. The moderation policy helps ensure that any content generated by the AI follows guidelines and adheres to certain standards, including preventing the transmission of offensive, sensitive, or inappropriate information.&lt;p&gt;In some cases, like with the Litany of Fear, a false positive may occur, causing the system to mistakenly flag and truncate a response that it deems potentially inappropriate, even if it may not be the case. This is an area where the moderation algorithm can improve in order to avoid disrupting user experiences.</text></item></parent_chain><comment><author>Sharlin</author><text>So, when it helped me solve a math problem by noticing a trick that I had missed – which was clearly the correct thing to do in retrospect – was I somehow in the wrong to ask it for help?&lt;p&gt;Getting answers out of it is absolutely a reasonable thing to do. Blindly &lt;i&gt;trusting&lt;/i&gt; those answers without verification, that&amp;#x27;s another thing entirely.</text></comment>