<commit_before># Abstractive Sentence Summarization

An implementation of the Rush, Chopra, Weston work
<http://arxiv.org/abs/1509.00685>

Our implementation differs in that we fix the context and summary token
embedding matrix. Two scenarios are possible:

1. Both embedding matrices are initialised from GloVe
2. Context embedding matrix are initialised from Skip-Thought Vectors <http://arxiv.org/abs/1506.06726>, summary from
   GloVe

Helptext is available for running our code by doing:

```bash
python ass_train.py -h
```

To download our dataset, feel free to use our utility code available in
`download_data/`.

GloVe data needs to be downloaded to access the GloVe embedding (default).
SkipThoughts data needs to be downloaded to access the SkipThoughts embeddings.

We reccommend training on a system with GPU support.<commit_msg>change README<commit_after># Abstractive Sentence Summarization

An implementation of the Rush, Chopra, Weston work
<http://arxiv.org/abs/1509.00685>

Our implementation differs in that we fix the context and summary token
embedding matrix. Two scenarios are possible:

1. Both embedding matrices are initialised from GloVe
2. Context embedding matrix are initialised from Skip-Thought Vectors <http://arxiv.org/abs/1506.06726>, summary from
   GloVe

Helptext is available for running our code by doing:

```bash
python ass_train.py -h
```

The small training corpus is under `data/`. Each JSON file contains three fields `title`, `full_text`, `summary`. They're downloaded with scripts in `download_data/`.

GloVe data needs to be downloaded to access the GloVe embedding (default).
SkipThoughts data needs to be downloaded to access the SkipThoughts embeddings.

We reccommend training on a system with GPU support.
{'fraction_non_alphanumeric': 0.06310403638430927, 'fraction_numerical': 0.02274019329164298, 'mean_word_length': 4.808580858085809, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 8, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6825947', 'n_tokens_mistral': 535, 'n_tokens_neox': 481, 'n_words': 230}