<story><title>The M2 is more advanced than it seemed</title><url>https://eclecticlight.co/2024/01/15/why-the-m2-is-more-advanced-that-it-seemed/</url></story><parent_chain></parent_chain><comment><author>mark_l_watson</author><text>A few months ago I bought a Mac with a M2 Pro 32G, and it is great for LLMs. I never thought that I would be running models like mixtral-8-7B-q3 locally on my own computer. I think the M2 Pro has 200GB&amp;#x2F;sec internal bandwidth, about 25% faster than the M3.&lt;p&gt;I think smaller models will keep getting better. For privacy and economic reasons, it makes sense to do as much AI on-device as possible.</text></comment>
<story><title>The M2 is more advanced than it seemed</title><url>https://eclecticlight.co/2024/01/15/why-the-m2-is-more-advanced-that-it-seemed/</url></story><parent_chain></parent_chain><comment><author>ilaksh</author><text>Are PC laptops going to catch up? I wonder if there is some kind of conflict of interest with Nvidia holding back more capable PC chips or software integration.</text></comment>