<commit_before>
h2. About

I've been scraping some sites recently for a side-project, and it occurred to me that I could save the target site bandwidth (and probably speed up the scrape process) if I check the google cache first, and only scrape the site itself as a last resort.

Thus was fromthecache.com born. When you enter a URL, it will return the cached version from google if available; if not, it will scrape the original site.

Another use is an easy way to post mirror links when a site goes down - simply put fromthecache.com/ in front of the URL and you have an instant cache link.

h2. Demo Site

You can try out a live demo of the project at "fromthecache.com":http://fromthecache.com/. 

I'm not sure about the legalities of removing the google cache header text (I do link to the google cache result though), and I have a suspicion the site may end up blocked from google anyway for looking like a bot.

Feel free to call the service programmatically if you wish, and basically do whatever you want with it. If anyone has complaints or comments, please "drop me a line":http://recursive-design.com/contact.<commit_msg>Updated README.<commit_after>
h2. About

I've been scraping some sites recently for a side-project, and it occurred to me that I could save the target site bandwidth (and probably speed up the scrape process) if I *check the google cache first*, and only scrape the site itself as a last resort.

Thus was "fromthecache.com":http://fromthecache.com/ born. When you enter a URL, it will return the cached version from google if available; if not, it will scrape the original site. It stores the resulting page in memcached for 30 minutes, so popular requests return instantly.

Another use is an easy way to post mirror links when a site goes down - simply put _fromthecache.com/_ in front of the URL and you have an instant cache link.

h2. Demo Site

You can try out a live demo of the project at "fromthecache.com":http://fromthecache.com/. 

I'm not sure about the legalities of removing the google cache header text (I do link to the google cache result though), and I have a suspicion the site may end up blocked from google anyway for looking like a bot.

Feel free to call the service programmatically if you wish, and basically do whatever you want with it. If anyone has complaints or comments, please "drop me a line":http://recursive-design.com/contact.
{'fraction_non_alphanumeric': 0.04710295956648604, 'fraction_numerical': 0.0025010421008753647, 'mean_word_length': 4.095541401273885, 'pattern_counts': {'":': 5, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3044974', 'n_tokens_mistral': 616, 'n_tokens_neox': 589, 'n_words': 397}