<story><title>Transformer architecture optimized for Apple Silicon</title><url>https://github.com/apple/ml-ane-transformers</url></story><parent_chain><item><author>lotsofpulp</author><text>“Hey siri, what is today’s date?”&lt;p&gt;“Sorry, I’m having trouble connecting to the network”</text></item><item><author>threeseed</author><text>They do have a search engine though with Siri Suggestions. Which has a user base of ~1.5b+ people.&lt;p&gt;We only see the tip of the iceberg so who knows what else it is capable of.</text></item><item><author>highwaylights</author><text>Maybe, but Apple doesn’t have a search to rival Google (or even an assistant, given the state of Siri).&lt;p&gt;Focusing on privacy and on-device learning is great, but when the strength of these models is in consuming all the data they can hoover up your motive is at odds with your philosophy.</text></item><item><author>davnicwil</author><text>I really think you have hit the nail on the head here. Apple has a ridiculous, almost unfathomably deep moat for training and running personalised, customised LLMs and other AI models on the &amp;#x27;edge&amp;#x27; with these Apple Silicon chips in all their devices.&lt;p&gt;We must be talking orders of magnitude differences in operational cost, not to mention completely unique features like privacy. The very definition of disruption, waiting in the wings.&lt;p&gt;Not only that, but this model of &amp;#x27;wait in the wings and pounce when the tech is really there and absolutely nail it&amp;#x27; is Apple&amp;#x27;s forté, aligned completely with the cultural and strategic DNA of the company.</text></item><item><author>endisneigh</author><text>i&amp;#x27;d say within 5 years apple will have optimized apple silicon and their tech, along with language model improvements, such that you will be able to get gpt-4 level performance in the iPhone 19 with inference happening entirely locally.&lt;p&gt;openai is doing great work and is serious competition, but I think many underestimate big tech. once they&amp;#x27;re properly motivated they&amp;#x27;ll catch up quick. I think we can agree that openai is a sufficient motivator.</text></item></parent_chain><comment><author>epistasis</author><text>Me: Hey Siri, call &amp;lt;my city&amp;gt; Toyota.&lt;p&gt;Siri: I&amp;#x27;m sorry, that contact is not in your list&lt;p&gt;Me: Siri, what is the number for &amp;lt;my city&amp;gt; Toyota.&lt;p&gt;Siri: &amp;lt;my city&amp;gt; Toyota&amp;#x27;s phone number is 123-456-7890 [said too fast to remember or write down in one go]&lt;p&gt;Me: Siri, call &amp;lt;my city&amp;gt; Toyota&lt;p&gt;Siri: I&amp;#x27;m sorry, you do not have that contact number.&lt;p&gt;Me: &amp;amp;$@@&amp;amp;&amp;#x2F;&amp;amp;&amp;amp;&amp;#x2F;&amp;amp;!!!</text></comment>
<story><title>Transformer architecture optimized for Apple Silicon</title><url>https://github.com/apple/ml-ane-transformers</url></story><parent_chain><item><author>lotsofpulp</author><text>“Hey siri, what is today’s date?”&lt;p&gt;“Sorry, I’m having trouble connecting to the network”</text></item><item><author>threeseed</author><text>They do have a search engine though with Siri Suggestions. Which has a user base of ~1.5b+ people.&lt;p&gt;We only see the tip of the iceberg so who knows what else it is capable of.</text></item><item><author>highwaylights</author><text>Maybe, but Apple doesn’t have a search to rival Google (or even an assistant, given the state of Siri).&lt;p&gt;Focusing on privacy and on-device learning is great, but when the strength of these models is in consuming all the data they can hoover up your motive is at odds with your philosophy.</text></item><item><author>davnicwil</author><text>I really think you have hit the nail on the head here. Apple has a ridiculous, almost unfathomably deep moat for training and running personalised, customised LLMs and other AI models on the &amp;#x27;edge&amp;#x27; with these Apple Silicon chips in all their devices.&lt;p&gt;We must be talking orders of magnitude differences in operational cost, not to mention completely unique features like privacy. The very definition of disruption, waiting in the wings.&lt;p&gt;Not only that, but this model of &amp;#x27;wait in the wings and pounce when the tech is really there and absolutely nail it&amp;#x27; is Apple&amp;#x27;s forté, aligned completely with the cultural and strategic DNA of the company.</text></item><item><author>endisneigh</author><text>i&amp;#x27;d say within 5 years apple will have optimized apple silicon and their tech, along with language model improvements, such that you will be able to get gpt-4 level performance in the iPhone 19 with inference happening entirely locally.&lt;p&gt;openai is doing great work and is serious competition, but I think many underestimate big tech. once they&amp;#x27;re properly motivated they&amp;#x27;ll catch up quick. I think we can agree that openai is a sufficient motivator.</text></item></parent_chain><comment><author>dmd</author><text>“hey siri, what’s the weather today?”&lt;p&gt;“Now playing Eminem Love the way you lie featuring Rihanna”</text></comment>