<story><title>Security weaknesses of Copilot generated code in GitHub</title><url>https://arxiv.org/abs/2310.02059</url></story><parent_chain><item><author>steve1977</author><text>Which is why the term Artificial Intelligence is really a misnomer for LLMs. Artificial Mediocracy might be more fitting.</text></item><item><author>crooked-v</author><text>&amp;gt; Copilot gives you popular responses not correct ones.&lt;p&gt;That also sums up most of the issues with LLMs in general in one sentence.</text></item><item><author>faeriechangling</author><text>If a weakness is common, then of course Copilot is going to suggest it.  Copilot gives you popular responses not correct ones.  Yet if a weakness is common, it also means that human coders frequently make the same mistake as well.&lt;p&gt;The studies results are rather unsurprising and its conclusions are oft-repeated advice.  As many have said, treat copilot’s code in the same light you would treat a junior programmer’s code.</text></item></parent_chain><comment><author>Zambyte</author><text>It is artificial intelligence, it just isn&amp;#x27;t artificial general intelligence, nor artificial general knowledge. LLMs are artificial &lt;i&gt;linguistic&lt;/i&gt; intelligence. They are really good at linguistic operations that require intelligence, like summarizing long text, transforming disrespectful text into professional looking text, translation between languages to a certain degree, etc.&lt;p&gt;It is not possible to ask an LLM for factual knowledge, without providing it the source of the fact. Without a source of the fact, you can only ask an LLM to generate an answer to the question that is linguistically convincing. And they can do a &lt;i&gt;really&lt;/i&gt; good job at that. They can accidentally encode factual knowledge by predicting the next word correctly, but that should be regarded as an accident.</text></comment>
<story><title>Security weaknesses of Copilot generated code in GitHub</title><url>https://arxiv.org/abs/2310.02059</url></story><parent_chain><item><author>steve1977</author><text>Which is why the term Artificial Intelligence is really a misnomer for LLMs. Artificial Mediocracy might be more fitting.</text></item><item><author>crooked-v</author><text>&amp;gt; Copilot gives you popular responses not correct ones.&lt;p&gt;That also sums up most of the issues with LLMs in general in one sentence.</text></item><item><author>faeriechangling</author><text>If a weakness is common, then of course Copilot is going to suggest it.  Copilot gives you popular responses not correct ones.  Yet if a weakness is common, it also means that human coders frequently make the same mistake as well.&lt;p&gt;The studies results are rather unsurprising and its conclusions are oft-repeated advice.  As many have said, treat copilot’s code in the same light you would treat a junior programmer’s code.</text></item></parent_chain><comment><author>baz00</author><text>That&amp;#x27;s the most accurate term I&amp;#x27;ve heard to describe the situation.  I think it could get worse though because when I&amp;#x27;ve seen mediocre people work with mediocre people they generate sub-mediocre solutions through trying to be clever and failing spectacularly at it.</text></comment>