<story><title>When ChatGPT summarises, it does nothing of the kind</title><url>https://ea.rna.nl/2024/05/27/when-chatgpt-summarises-it-actually-does-nothing-of-the-kind/</url></story><parent_chain><item><author>ADeerAppeared</author><text>There&amp;#x27;s a fundamental problem with all these &amp;quot;summary&amp;quot; tasks, and it&amp;#x27;s obvious from the disclaimer that&amp;#x27;s on all these AI products: &amp;quot;AI can be wrong, you must verify this&amp;quot;.&lt;p&gt;A summary for which you must always read the un-summarized text &lt;i&gt;is useless as a summary&lt;/i&gt;, this should be obvious to literally everyone, yet AI developers stick their heads in the sand about it because RAG lets them pretend AI is more useful than it actually is.&lt;p&gt;RAG is useless, just fucking let it go and have AI stay in it&amp;#x27;s lane.</text></item></parent_chain><comment><author>probably_wrong</author><text>The solution is to feed both the text and the summary back to ChatGPT and ask it to identify any inconsistencies.&lt;p&gt;If you repeat these steps over and over for enough iterations eventually you will run out of money and the problem will be moot anyway</text></comment>
<story><title>When ChatGPT summarises, it does nothing of the kind</title><url>https://ea.rna.nl/2024/05/27/when-chatgpt-summarises-it-actually-does-nothing-of-the-kind/</url></story><parent_chain><item><author>ADeerAppeared</author><text>There&amp;#x27;s a fundamental problem with all these &amp;quot;summary&amp;quot; tasks, and it&amp;#x27;s obvious from the disclaimer that&amp;#x27;s on all these AI products: &amp;quot;AI can be wrong, you must verify this&amp;quot;.&lt;p&gt;A summary for which you must always read the un-summarized text &lt;i&gt;is useless as a summary&lt;/i&gt;, this should be obvious to literally everyone, yet AI developers stick their heads in the sand about it because RAG lets them pretend AI is more useful than it actually is.&lt;p&gt;RAG is useless, just fucking let it go and have AI stay in it&amp;#x27;s lane.</text></item></parent_chain><comment><author>qeternity</author><text>This is just a trust issue, which applies to pretty much any task where there is delegation.&lt;p&gt;If you ask an intern to summarize some text, you trust them to do a half decent job. You&amp;#x27;re not going to re-read the original text. The hiring process is meant to filter out bad interns.</text></comment>