<story><title>Nvidia will build 700-petaflop supercomputer for University of Florida</title><url>https://venturebeat.com/2020/07/21/nvidia-collaborates-with-the-university-of-florida-to-build-700-petaflop-ai-supercomputer/</url></story><parent_chain></parent_chain><comment><author>OffensiveTomato</author><text>One of Nvidia&amp;#x27;s confounders is actually a UF alumnus. Good way to give back!</text></comment>
<story><title>Nvidia will build 700-petaflop supercomputer for University of Florida</title><url>https://venturebeat.com/2020/07/21/nvidia-collaborates-with-the-university-of-florida-to-build-700-petaflop-ai-supercomputer/</url></story><parent_chain></parent_chain><comment><author>boulos</author><text>Sigh, I wish people wouldn’t say “peta&lt;i&gt;flop&lt;/i&gt;” for these.&lt;p&gt;&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;www.nvidia.com&amp;#x2F;en-us&amp;#x2F;data-center&amp;#x2F;a100&amp;#x2F;&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;www.nvidia.com&amp;#x2F;en-us&amp;#x2F;data-center&amp;#x2F;a100&amp;#x2F;&lt;/a&gt; is the most official reference. If you scroll to the bottom, you’ll see that an A100 part can do ~20 Teraflops (either FP32 or FP64 in little-matrix aka tensor mode). When they say “each A100 can do 5 petaflops”, they mean each DGX which has 8 such cards and thus they mean 600-ish something-ops per card. The generous assumption is that’s FP16 or bfloat16 for sparse ops, and therefore they are “flops”.&lt;p&gt;The reality is that if someone says “supercomputer” in the general sense, they mean scientific computing and so mean a double-precision LINPACK benchmark. The 1120 A100 parts (8x140) doing 20 “real” teraflops each has an absolute peak of about 22 Petaflops (and older code without tensor mode would be half that on FP64).&lt;p&gt;tl;dr: ML isn’t scientific computing, and those are different flops, but “10 petaflops” just doesn’t sound as impressive.</text></comment>