<story><title>SlowLlama: Finetune llama2-70B and codellama on MacBook Air without quantization</title><url>https://github.com/okuvshynov/slowllama</url></story><parent_chain><item><author>SillyUsername</author><text>So I keep getting told &amp;quot;Macs don&amp;#x27;t use memory like Windows&amp;quot;, &amp;quot;8GB is fine for everything on Mac&amp;quot; (with quotes from people who use it to Photoshop) and &amp;quot;the SSD is so fast if you use virtual memory anyway it&amp;#x27;s not noticeable&amp;quot;...
Is 8GB suitable for LLM use like this, and has anybody actually used it?</text></item></parent_chain><comment><author>LeoPanthera</author><text>LLMs are notoriously RAM-hungry. It’s not fair to judge what a MacBook comes with against what LLaMa2 needs. That is not normal use of a MacBook.</text></comment>
<story><title>SlowLlama: Finetune llama2-70B and codellama on MacBook Air without quantization</title><url>https://github.com/okuvshynov/slowllama</url></story><parent_chain><item><author>SillyUsername</author><text>So I keep getting told &amp;quot;Macs don&amp;#x27;t use memory like Windows&amp;quot;, &amp;quot;8GB is fine for everything on Mac&amp;quot; (with quotes from people who use it to Photoshop) and &amp;quot;the SSD is so fast if you use virtual memory anyway it&amp;#x27;s not noticeable&amp;quot;...
Is 8GB suitable for LLM use like this, and has anybody actually used it?</text></item></parent_chain><comment><author>jzelinskie</author><text>Apple really shouldn&amp;#x27;t sell Macs with less than 16GiB of RAM. The first set of M1s got some bad press because so many folks were plagued by pop-ups saying they were out of memory -- from heavy browser usage not even intense workloads.</text></comment>