<story><title>Artificial intelligence gives weather forecasters a new edge</title><url>https://www.nytimes.com/interactive/2024/07/29/science/ai-weather-forecast-hurricane.html</url></story><parent_chain><item><author>lainga</author><text>Sigh... don&amp;#x27;t make me bind a hotkey to paste my spiel about how these non-primitive-equation-based models are bad at long tails and freak weather...&lt;p&gt;Ed.: too late! &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;news.ycombinator.com&amp;#x2F;item?id=40577332&quot;&gt;https:&amp;#x2F;&amp;#x2F;news.ycombinator.com&amp;#x2F;item?id=40577332&lt;/a&gt;</text></item></parent_chain><comment><author>Majromax</author><text>Long tails and freak weather are the hottest topics of research in the area of data-driven weather forecasting.  ECMWF, highlighted in this article, is attempting to extend its ML forecast system to ensemble predictions (&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;www.ecmwf.int&amp;#x2F;en&amp;#x2F;about&amp;#x2F;media-centre&amp;#x2F;aifs-blog&amp;#x2F;2024&amp;#x2F;enter-ensembles&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;www.ecmwf.int&amp;#x2F;en&amp;#x2F;about&amp;#x2F;media-centre&amp;#x2F;aifs-blog&amp;#x2F;2024&amp;#x2F;e...&lt;/a&gt;).&lt;p&gt;If these methods work, they&amp;#x27;ll likely &lt;i&gt;improve&lt;/i&gt; our ability to model long tails.  Traditional NWP is extremely expensive, so cutting-edge models can have either high resolution xor large ensembles.  You need high resolution for the detail, but you need large ensembles to see into the tails of the distribution; it&amp;#x27;s a persistent problem.&lt;p&gt;In inference, ML-based models run a bit over two orders of magnitude faster than traditional NWP, with the gains split between running on GPUs (possibly replicable) and fantastic levels of numerical intensity thanks to everything being matrix-matrix products (much harder to replicate with conventional algorithms).  That opens a lot of freedom to expand ensemble sizes and the like.</text></comment>
<story><title>Artificial intelligence gives weather forecasters a new edge</title><url>https://www.nytimes.com/interactive/2024/07/29/science/ai-weather-forecast-hurricane.html</url></story><parent_chain><item><author>lainga</author><text>Sigh... don&amp;#x27;t make me bind a hotkey to paste my spiel about how these non-primitive-equation-based models are bad at long tails and freak weather...&lt;p&gt;Ed.: too late! &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;news.ycombinator.com&amp;#x2F;item?id=40577332&quot;&gt;https:&amp;#x2F;&amp;#x2F;news.ycombinator.com&amp;#x2F;item?id=40577332&lt;/a&gt;</text></item></parent_chain><comment><author>kardos</author><text>The limitations of the non-physics-based models is under rapid exploration and the bounds of their utility will be a lot more clear in a year or two. For now, they seem to outperform physics-based models in larger scales. The future may be a hybrid: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;arxiv.org&amp;#x2F;abs&amp;#x2F;2407.06100v2&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;arxiv.org&amp;#x2F;abs&amp;#x2F;2407.06100v2&lt;/a&gt;</text></comment>