<commit_before># sam-s-club-auctions
Members of sam's club can bid on a product listed in auctions site . The following automated scripts makes users work painless. All they need is a twitter account and guts to reply with their bid value on tweets posted by sam's club . Doesn't this sounds awesome ? 

![Alt text](/utils/image1.png?raw=true "Image 1")
 

## Scraper
The scraper is written in python language.It scrapes the auctions from sam's club new auctions page. we can restrict number of auction pages to be scraped. As soon as scraping is completed , auctions images are stored in auction_images sub repo with auction_id as a file name , similarly auction details such as item name, auction end time , current bid value are stored in auction_details sub repo.

## Twitter
The script reads all the auction images and its details from the local storage and posts it in sam's club twitter page.

##Installation
python3 samsclubscraper.py
python3 ../twitter/post_tweets.py




###dependencies
[beautifulSoup](https://www.crummy.com/software/BeautifulSoup/bs4/doc/)

[Urllib](https://docs.python.org/2/library/urllib.html)

[Tweepy](http://tweepy.readthedocs.io/en/v3.5.0/api.html)



<commit_msg>updated with new content<commit_after># sam-s-club-auctions
Members of sam's club can bid on a product listed in auctions site . The following automated scripts makes users work painless. All they need is a twitter account and guts to reply with their bid value on tweets posted by sam's club . Doesn't this sounds awesome ? 

![Alt text](/utils/image1.png?raw=true "Image 1")
 

## Scraper
The scraper is written in python language.It scrapes the auctions from sam's club new auctions page. we can restrict number of auction pages to be scraped. As soon as scraping is completed , auctions images are stored in auction_images sub repo with auction_id as a file name , similarly auction details such as item name, auction end time , current bid value are stored in auction_details sub repo.

## Twitter
The script reads all the auction images and its details from the corresponding auctions_images and auctions_details folders and posts it in sam's club twitter page.

##Installation
python3 samsclubscraper.py
python3 ../twitter/post_tweets.py




###dependencies
[beautifulSoup](https://www.crummy.com/software/BeautifulSoup/bs4/doc/)

[Urllib](https://docs.python.org/2/library/urllib.html)

[Tweepy](http://tweepy.readthedocs.io/en/v3.5.0/api.html)




{'fraction_non_alphanumeric': 0.07654723127035831, 'fraction_numerical': 0.007328990228013029, 'mean_word_length': 4.472160356347438, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4566503', 'n_tokens_mistral': 748, 'n_tokens_neox': 693, 'n_words': 306}