<story><title>Publishing AI Slop Is a Choice</title><url>https://daringfireball.net/linked/2024/05/24/publishing-ai-slop-is-a-choice</url></story><parent_chain><item><author>skilled</author><text>The AI Overviews outrage is only the beginning. It has been 11 days since they made it public in the US, and it had been in experimentation for over a year before that.&lt;p&gt;Already now, a lot of users will associate Google AI Overviews with nonsense; eat rocks, cook spaghetti with gasoline. Google also showed how easily these AI Overviews can be manipulated, since they use RAG.&lt;p&gt;I think the &lt;i&gt;Slopception&lt;/i&gt; is only going to get worse. Slop in. Slop out.&lt;p&gt;And also, Google Research just happened to be sitting on AGREE[0]:&lt;p&gt;&amp;gt; a learning-based framework that enables LLMs to provide accurate citations in their responses, making them more reliable and increasing user trust&lt;p&gt;Which was published yesterday.&lt;p&gt;I tried to submit it[1] but it didn’t get much love.&lt;p&gt;[0]: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;research.google&amp;#x2F;blog&amp;#x2F;effective-large-language-model-adaptation-for-improved-grounding&amp;#x2F;&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;research.google&amp;#x2F;blog&amp;#x2F;effective-large-language-model-...&lt;/a&gt;&lt;p&gt;[1]: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;news.ycombinator.com&amp;#x2F;item?id=40469518&quot;&gt;https:&amp;#x2F;&amp;#x2F;news.ycombinator.com&amp;#x2F;item?id=40469518&lt;/a&gt;</text></item></parent_chain><comment><author>raydev</author><text>&amp;gt; Already now, a lot of users will associate Google AI Overviews with nonsense&lt;p&gt;A lot of tech-minded folks who actively follow this stuff on Twitter et al make this association, but the average person was already defaulting to reading the first (likely incorrect) hit on Google and moving on with their day. I&amp;#x27;m not sure they&amp;#x27;ll notice a dip in quality until it directly contradicts something they know about confidently.</text></comment>
<story><title>Publishing AI Slop Is a Choice</title><url>https://daringfireball.net/linked/2024/05/24/publishing-ai-slop-is-a-choice</url></story><parent_chain><item><author>skilled</author><text>The AI Overviews outrage is only the beginning. It has been 11 days since they made it public in the US, and it had been in experimentation for over a year before that.&lt;p&gt;Already now, a lot of users will associate Google AI Overviews with nonsense; eat rocks, cook spaghetti with gasoline. Google also showed how easily these AI Overviews can be manipulated, since they use RAG.&lt;p&gt;I think the &lt;i&gt;Slopception&lt;/i&gt; is only going to get worse. Slop in. Slop out.&lt;p&gt;And also, Google Research just happened to be sitting on AGREE[0]:&lt;p&gt;&amp;gt; a learning-based framework that enables LLMs to provide accurate citations in their responses, making them more reliable and increasing user trust&lt;p&gt;Which was published yesterday.&lt;p&gt;I tried to submit it[1] but it didn’t get much love.&lt;p&gt;[0]: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;research.google&amp;#x2F;blog&amp;#x2F;effective-large-language-model-adaptation-for-improved-grounding&amp;#x2F;&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;research.google&amp;#x2F;blog&amp;#x2F;effective-large-language-model-...&lt;/a&gt;&lt;p&gt;[1]: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;news.ycombinator.com&amp;#x2F;item?id=40469518&quot;&gt;https:&amp;#x2F;&amp;#x2F;news.ycombinator.com&amp;#x2F;item?id=40469518&lt;/a&gt;</text></item></parent_chain><comment><author>polski-g</author><text>Google AI was so much better when they used it to do useful things like create the best starcraft player in the world. Imagine if strategy game companies could license&amp;#x2F;extend DeepMind game AI.</text></comment>