<story><title>FlashAttention: Fast Transformer training with long sequences</title><url>https://www.adept.ai/blog/flashier-attention</url></story><parent_chain></parent_chain><comment><author>thawab</author><text>The same author Tri Dao, released FlashAttention 2 in July.&lt;p&gt;&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;together.ai&amp;#x2F;blog&amp;#x2F;tri-dao-flash-attention&quot; rel=&quot;nofollow noreferrer&quot;&gt;https:&amp;#x2F;&amp;#x2F;together.ai&amp;#x2F;blog&amp;#x2F;tri-dao-flash-attention&lt;/a&gt;</text></comment>
<story><title>FlashAttention: Fast Transformer training with long sequences</title><url>https://www.adept.ai/blog/flashier-attention</url></story><parent_chain></parent_chain><comment><author>kken</author><text>Here is a recent interview with the author of FlashAttention, Tri Dao:&lt;p&gt;&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;www.youtube.com&amp;#x2F;watch?v=J4-qZ6KBalk&quot;&gt;https:&amp;#x2F;&amp;#x2F;www.youtube.com&amp;#x2F;watch?v=J4-qZ6KBalk&lt;/a&gt;</text></comment>