<commit_before># OGN Receiver Database

A parser for <http://wiki.glidernet.org/list-of-receivers>,
returns the list-of-receivers in a machine-readable format (see [data format](#data-format)).

## Installation

- Install dependencies

  ```
  pip install -r requirements.txt
  ```

## Usage

- mkreceiverjson.py

  Fetch the list-of-receivers from wiki.glidernet.org and output it
  into a (machine-readable) file `receivers.json`.

  ```
  mkreceiverjson.py --out receivers.json --obfuscate
  ```

- mkstatistics.py

  Generate some statistics from `receivers.json`.

  ```
  mkstatistics.py --in receivers.json
  ```

## Data format

### receivers.json

Specification: [receiverlist-schema-0.2.0](receiverlist-schema-0.2.0.json)

Example:
```
{ 'receivers':
  [
    {
      'callsign': "N0CALL",
      'description': "An OGN receiver located on planet earth",
      'photos': ["https://example.com/ogn/receiver-photo.jpg"],
      'contact': "<EMAIL>",
      'country': "None"
    },
  ],
  },
  'timestamp': "2016-02-04T11:11:11",
  'version': '0.2.0'
}
```

## License

Licensed under the [AGPLv3](LICENSE) or later.
<commit_msg>README: Add an example of data analysis with jq<commit_after># OGN Receiver Database

A parser for <http://wiki.glidernet.org/list-of-receivers>,
returns the list-of-receivers in a machine-readable format (see [data format](#data-format)).

## Installation

- Install dependencies

  ```
  pip install -r requirements.txt
  ```

## Usage

- mkreceiverjson.py

  Fetch the list-of-receivers from wiki.glidernet.org and output it
  into a (machine-readable) file `receivers.json`.

  ```
  mkreceiverjson.py --out receivers.json --obfuscate
  ```

- mkstatistics.py

  Generate some statistics from `receivers.json`.

  ```
  mkstatistics.py --in receivers.json
  ```

## Data format

### receivers.json

Specification: [receiverlist-schema-0.2.0](receiverlist-schema-0.2.0.json)

Example:
```
{ 'receivers':
  [
    {
      'callsign': "N0CALL",
      'description': "An OGN receiver located on planet earth",
      'photos': ["https://example.com/ogn/receiver-photo.jpg"],
      'contact': "<EMAIL>",
      'country': "None"
    },
  ],
  },
  'timestamp': "2016-02-04T11:11:11",
  'version': '0.2.0'
}
```

## Data analysis ([jq](https://stedolan.github.io/jq/) required)

Show all receiver callsigns, grouped by country:
```
cat receivers.json | jq ".receivers | group_by(.country) | map({(.[0].country): [.[].callsign]})"
```

## License

Licensed under the [AGPLv3](LICENSE) or later.

{'fraction_non_alphanumeric': 0.1677240285487708, 'fraction_numerical': 0.020222045995241873, 'mean_word_length': 3.4575971731448765, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 3, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '696202', 'n_tokens_mistral': 940, 'n_tokens_neox': 881, 'n_words': 200}