<story><title>Announcing YouTube-8M: A Large and Diverse Labeled Video Dataset for Research</title><url>https://research.googleblog.com/2016/09/announcing-youtube-8m-large-and-diverse.html</url></story><parent_chain></parent_chain><comment><author>JosephRedfern</author><text>If, for some reason, you wanted a list of all of the video IDs (I couldn&amp;#x27;t easily find such a list), then I wrote a crappy scraper to pull them out: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;gist.github.com&amp;#x2F;JosephRedfern&amp;#x2F;d60bdc584d84b1451cc6052e955b755c&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;gist.github.com&amp;#x2F;JosephRedfern&amp;#x2F;d60bdc584d84b1451cc605...&lt;/a&gt;.&lt;p&gt;I can post a URL to the output once it&amp;#x27;s finished running, if it&amp;#x27;d be of any use to anyone. Oh, and be warned, there&amp;#x27;s a strong chance that it&amp;#x27;s buggy. It&amp;#x27;s certainly not optimised (no threads).&lt;p&gt;EDIT: The script has now run. I&amp;#x27;ve scraped ~10,000,000 Video IDs, but only ~5.5m of these IDs are unique, so there&amp;#x27;s probably a bug in my script somewhere (but I need sleep now). Files containing IDs for various categories are listed here: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;redfern.me&amp;#x2F;public&amp;#x2F;yt8m&amp;#x2F;&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;redfern.me&amp;#x2F;public&amp;#x2F;yt8m&amp;#x2F;&lt;/a&gt;, some notes are here: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;redfern.me&amp;#x2F;public&amp;#x2F;yt8m&amp;#x2F;README.md&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;redfern.me&amp;#x2F;public&amp;#x2F;yt8m&amp;#x2F;README.md&lt;/a&gt;, and .tar.gz&amp;#x27;d archive is available here: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;redfern.me&amp;#x2F;public&amp;#x2F;yt8m&amp;#x2F;yt8m-ids-probably-incomplete.tar.gz&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;redfern.me&amp;#x2F;public&amp;#x2F;yt8m&amp;#x2F;yt8m-ids-probably-incomplete....&lt;/a&gt;.</text></comment>
<story><title>Announcing YouTube-8M: A Large and Diverse Labeled Video Dataset for Research</title><url>https://research.googleblog.com/2016/09/announcing-youtube-8m-large-and-diverse.html</url></story><parent_chain></parent_chain><comment><author>iverjo</author><text>This is nice :) Kudos to the Youtube guys for releasing this. I&amp;#x27;m a data scientist in a startup where one of the things I do is create multi-label models for classifying YouTube videos. My current model has 90 % precision and 69 % recall, while Youtube-8M has 78 % precision and 14 % recall, with respect to the human raters. I guess one of the reasons is that my model only has around 100 categories, while Youtube-8M has 4800. It&amp;#x27;s like comparing apples with pears, but still interesting.</text></comment>