<commit_before>scraper
=======
[![Build Status](https://travis-ci.org/sselph/scraper.svg?branch=master)](https://travis-ci.org/sselph/scraper) [![GoDoc](https://godoc.org/github.com/sselph/scraper?status.svg)](https://godoc.org/github.com/sselph/scraper)

An auto-scraper for EmulationStation written in Go using hashes.
This currently works with NES, SNES, N64, GB, GBC, GBA, MD, SMS, 32X, GG, PCE, A2600, LNX, MAME/FBA(see below), Dreamcast(bin/gdi), PSX(bin/cue), ScummVM, SegaCD, WonderSwan, WonderSwan Color ROMs.

How it Works
------------
The script works by crawling a directory of ROM files looking for known extensions. When it finds a file it hashes the ROM data minus any headers or special file formatting with the goal of hashing only the data pulled from the original game. It compares this hash to a DB I've compiled to look up the correct game in theGamesDB.net. It downloads the metadata and builds the gamelist.xml file.

If you have RetroPie-Setup 3.1 or later you can follow [the instructions on their wiki](https://github.com/RetroPie/RetroPie-setup/wiki/scraper) instead.

Donate
------
I don't accept donations but I'm raising money for Children's Healthcare of Atlanta:

[![Extra Life](https://bfapps1.boundlessfundraising.com/badge/extralife/display/319247/539/status.jpg)](https://goo.gl/diu5oU)

Or feel free to donate to:<commit_msg>Give proper attribution to OpenVGDB<commit_after>scraper
=======
[![Build Status](https://travis-ci.org/sselph/scraper.svg?branch=master)](https://travis-ci.org/sselph/scraper) [![GoDoc](https://godoc.org/github.com/sselph/scraper?status.svg)](https://godoc.org/github.com/sselph/scraper)

An auto-scraper for EmulationStation written in Go using hashes.
This currently works with NES, SNES, N64, GB, GBC, GBA, MD, SMS, 32X, GG, PCE, A2600, LNX, MAME/FBA(see below), Dreamcast(bin/gdi), PSX(bin/cue), ScummVM, SegaCD, WonderSwan, WonderSwan Color ROMs.

How it Works
------------
The script works by crawling a directory of ROM files looking for known extensions. When it finds a file it hashes the ROM data minus any headers or special file formatting with the goal of hashing only the data pulled from the original game. It compares this hash to a DB from [OpenVGDB](https://github.com/OpenVGDB/OpenVGDB) to look up the correct game in theGamesDB.net. It downloads the metadata and builds the gamelist.xml file.

If you have RetroPie-Setup 3.1 or later you can follow [the instructions on their wiki](https://github.com/RetroPie/RetroPie-setup/wiki/scraper) instead.

Donate
------
I don't accept donations but I'm raising money for Children's Healthcare of Atlanta:

[![Extra Life](https://bfapps1.boundlessfundraising.com/badge/extralife/display/319247/539/status.jpg)](https://goo.gl/diu5oU)

Or feel free to donate to:
{'fraction_non_alphanumeric': 0.12239770279971285, 'fraction_numerical': 0.01507537688442211, 'mean_word_length': 4.618951612903226, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 15, 'lorem ipsum': 0, 'www.': 0, 'xml': 2}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5945725', 'n_tokens_mistral': 979, 'n_tokens_neox': 908, 'n_words': 305}