<story><title>Show HN: Realtime Hacker News Summarization Using Machine Learning</title><url>http://hn10.org/index.html</url></story><parent_chain></parent_chain><comment><author>ecesena</author><text>Not sure what do you use to scrape, but I can recommend newspaper to extract text.&lt;p&gt;I contributed a while ago and it was pretty solid.&lt;p&gt;&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;codelucas&amp;#x2F;newspaper&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;codelucas&amp;#x2F;newspaper&lt;/a&gt;</text></comment>
<story><title>Show HN: Realtime Hacker News Summarization Using Machine Learning</title><url>http://hn10.org/index.html</url></story><parent_chain></parent_chain><comment><author>xiamx</author><text>Got that this is using nltk. Can you comment on which summarization algorithm you are using (TextRank, SumBasic and etc.) What&amp;#x27;s the motivation towards choosing one algorithm over another and how&amp;#x27;s its performance on average HN articles?</text></comment>