<commit_before># scrapbook

- Language : Haste (http://haste-lang.org/)

- Service  : Scrap all URLs of my interest

- Details  : A wep page that displays collected URLs and has a form to add new URL.<commit_msg>build description added<commit_after># scrapbook

- Language : Haste (http://haste-lang.org/)

- Service  : Scrap all URLs of my interest

- Details  : A wep page that displays collected URLs and has a form to add new URL.

### How to build and setup on your server
1. You need Haste and MySQL.
2. Select where to launch your application. ex) www.example.com/scrap
3. In src/Main.hs, edit following lines:
  - downloader = "www.example.com/scrap/download.php"
  - uploader = "www.example.com/scrap/uploader.php"
4. Create a table of following schema into any MySQL database:
	CREATE TABLE `scrapbook` (
	`id` int(10) unsigned NOT NULL AUTO_INCREMENT,
	`url` varchar(127) NOT NULL,
	`info` varchar(127) DEFAULT NULL,
	PRIMARY KEY (`id`)
	)
5. In download.php and uploader.php, enter your mysql id, pwd, and database name.
6. Run the command: `haste-cabal build`. You get Main.js in the folder src.
7. Move following files to www.example.com/scrap/.
  - index.html
  - Main.js
  - download.php
  - uploader.php
{'fraction_non_alphanumeric': 0.10327868852459017, 'fraction_numerical': 0.012295081967213115, 'mean_word_length': 3.4725274725274726, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5945652', 'n_tokens_mistral': 411, 'n_tokens_neox': 395, 'n_words': 157}