<story><title>Making AMD GPUs competitive for LLM inference</title><url>https://blog.mlc.ai/2023/08/09/Making-AMD-GPUs-competitive-for-LLM-inference</url></story><parent_chain><item><author>superkuh</author><text>&amp;gt; AMD GPUs using ROCm&lt;p&gt;Oh great. The AMD RX 580 was released in April 2018. AMD had already dropped ROCm support for it by 2021. They only supported the card for 3 years. 3 years. It&amp;#x27;s so lame it&amp;#x27;s bordering on fraudulent, even if not legally fraud. Keep this in mind when reading this news. The support won&amp;#x27;t last long, especially if you don&amp;#x27;t buy at launch. Then you&amp;#x27;ll be stuck in the dependency hell that is trying to use old drivers&amp;#x2F;stack.</text></item></parent_chain><comment><author>greenknight</author><text>&amp;gt; AMD RX 580 was released in April 2018&lt;p&gt;It was actually Apr 18, 2017 -- &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;en.wikipedia.org&amp;#x2F;wiki&amp;#x2F;Radeon_500_series&quot; rel=&quot;nofollow noreferrer&quot;&gt;https:&amp;#x2F;&amp;#x2F;en.wikipedia.org&amp;#x2F;wiki&amp;#x2F;Radeon_500_series&lt;/a&gt;</text></comment>
<story><title>Making AMD GPUs competitive for LLM inference</title><url>https://blog.mlc.ai/2023/08/09/Making-AMD-GPUs-competitive-for-LLM-inference</url></story><parent_chain><item><author>superkuh</author><text>&amp;gt; AMD GPUs using ROCm&lt;p&gt;Oh great. The AMD RX 580 was released in April 2018. AMD had already dropped ROCm support for it by 2021. They only supported the card for 3 years. 3 years. It&amp;#x27;s so lame it&amp;#x27;s bordering on fraudulent, even if not legally fraud. Keep this in mind when reading this news. The support won&amp;#x27;t last long, especially if you don&amp;#x27;t buy at launch. Then you&amp;#x27;ll be stuck in the dependency hell that is trying to use old drivers&amp;#x2F;stack.</text></item></parent_chain><comment><author>junrushao1994</author><text>tbh im not sure what amds plan is on ROCm support on consumer devices, but i dont really think amd is being fraudulent or something.&lt;p&gt;Both rocm and vulkan are supported in MLC LLM as mentioned in our blog post. we are aware that rocm is not sufficient to cover consumer hardwares, and in this case vulkan is a nice backup!</text></comment>