<story><title>33GB of public domain JSTOR articles, and a manifesto</title><url>http://thepiratebay.org/torrent/6554331/Papers_from_Philosophical_Transactions_of_the_Royal_Society__fro</url></story><parent_chain><item><author>giberson</author><text>If I weren&apos;t too timid to risk doing so, I would do the following (read I hope someone else does this).&lt;p&gt;Process the pdf&apos;s with an OCR program to extract as much text from each document as possible. The extraction should be done page by page, so the extracted text can be referenced to a PDF page#.&lt;p&gt;Then, provide a searchable/browse-able directory of the extracted content. Each page of text has link to the original PDF page so you can easily open up the PDF to the page the text was extracted from.&lt;p&gt;I&apos;d also make all text user editable wiki style. Combined with the inline PDF page references it would be super easy for any user to fix up translation errors from the OCR process. Tie in a karma system to the users profile so that edits can be thanked/kudos on a job well done to help with automating moderation of user edits by rating the user&apos;s current karma to decide if the edit should be accepted automatically or provided as an alternate version other users can check and rate up if they think it should replace current version.&lt;p&gt;Maybe mash in an image cropping service so diagrams can be cropped from the PDF and inserted inline with the translated text. Provide simple wiki formatting markup to allow users to format the articles.&lt;p&gt;Use ad revenue/donations to alleviate/cover hosting costs.&lt;p&gt;1, 2, 3, go.</text></item></parent_chain><comment><author>anigbrowl</author><text>Well, most of this already exists in Google books, where I&apos;m reading some of these particular scientific journals right now, can switch to OCRed text at any time (albeit with ftrange contemporarie fpelling), or download a facsimile of any public domain work in PDF format. The only thing they don&apos;t have in place (and should add) is the wiki-style crowd editing.&lt;p&gt;So the guy has basically built a 33gb torrent of stuff that was already freely available to the public, just from a different source.</text></comment>
<story><title>33GB of public domain JSTOR articles, and a manifesto</title><url>http://thepiratebay.org/torrent/6554331/Papers_from_Philosophical_Transactions_of_the_Royal_Society__fro</url></story><parent_chain><item><author>giberson</author><text>If I weren&apos;t too timid to risk doing so, I would do the following (read I hope someone else does this).&lt;p&gt;Process the pdf&apos;s with an OCR program to extract as much text from each document as possible. The extraction should be done page by page, so the extracted text can be referenced to a PDF page#.&lt;p&gt;Then, provide a searchable/browse-able directory of the extracted content. Each page of text has link to the original PDF page so you can easily open up the PDF to the page the text was extracted from.&lt;p&gt;I&apos;d also make all text user editable wiki style. Combined with the inline PDF page references it would be super easy for any user to fix up translation errors from the OCR process. Tie in a karma system to the users profile so that edits can be thanked/kudos on a job well done to help with automating moderation of user edits by rating the user&apos;s current karma to decide if the edit should be accepted automatically or provided as an alternate version other users can check and rate up if they think it should replace current version.&lt;p&gt;Maybe mash in an image cropping service so diagrams can be cropped from the PDF and inserted inline with the translated text. Provide simple wiki formatting markup to allow users to format the articles.&lt;p&gt;Use ad revenue/donations to alleviate/cover hosting costs.&lt;p&gt;1, 2, 3, go.</text></item></parent_chain><comment><author>crocowhile</author><text>That is what jstor is about actually: full text search of a number of articles.</text></comment>