<commit_before>FoursquareAttendanceCrawler
=============================

## Settings

Open the `etc/settings-example.json` file and change the `foursquare_api_accounts` and `crawl_folder` properties. You can obtain credentials for the Foursquare API by creating an application at https://foursquare.com/developers/apps.

After setting the parameters to the appropriate values, change the name of the file to `etc/settings.json`, otherwise the program will not find it:

  $ mv etc/settings-example.json etc/settings.json


## Listing all the venues of a city

  $ java -Dfile.encoding=UTF-8 -classpath bin:lib/commons-io-2.4.jar:lib/commons-lang-2.6.jar:lib/gson-1.7.1.jar eu.smartfp7.foursquare.ExhaustiveTrendsCrawling london
<commit_msg>readme edits<commit_after>FoursquareAttendanceCrawler
=============================

### Settings

Open the `etc/settings-example.json` file and change the `foursquare_api_accounts` and `crawl_folder` properties. You can obtain credentials for the Foursquare API by creating an application at https://foursquare.com/developers/apps.

After setting the parameters to the appropriate values, change the name of the file to `etc/settings.json`, otherwise the program will not find it:

```shell
  $ mv etc/settings-example.json etc/settings.json
```


### Listing all the venues of a city

```
  $ java -Dfile.encoding=UTF-8 -classpath bin:lib/commons-io-2.4.jar:lib/commons-lang-2.6.jar:lib/gson-1.7.1.jar eu.smartfp7.foursquare.ExhaustiveTrendsCrawling london
```

{'fraction_non_alphanumeric': 0.13297872340425532, 'fraction_numerical': 0.011968085106382979, 'mean_word_length': 5.068548387096774, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2510008', 'n_tokens_mistral': 477, 'n_tokens_neox': 462, 'n_words': 134}