<commit_before>[![GoDoc](https://godoc.org/github.com/bakape/thumbnailer?status.svg)](https://godoc.org/github.com/bakape/thumbnailer)
# thumbnailer
Package thumbnailer provides a more efficient image/video/audio/PDF thumbnailer
than available with native Go processing libraries through GraphicsMagic and
ffmpeg bindings.


For a comprehensive list of file formats supported by default, check the `matchers` slice in `mime.go`.

## Dependencies
* GCC or Clang
* make
* pkg-config
* pthread
* ffmpeg >= 3.0 libraries (libavcodec, libavutil, libavformat)
* GraphicsMagick

NB: ffmpeg and GM should be compiled with all the dependency libraries for
formats you want to process. On most Linux distributions you should be fine with
the packages in the stock repositories.<commit_msg>Document extra FFMPEG dep<commit_after>[![GoDoc](https://godoc.org/github.com/bakape/thumbnailer?status.svg)](https://godoc.org/github.com/bakape/thumbnailer)
# thumbnailer
Package thumbnailer provides a more efficient image/video/audio/PDF thumbnailer
than available with native Go processing libraries through GraphicsMagic and
ffmpeg bindings.


For a comprehensive list of file formats supported by default, check the `matchers` slice in `mime.go`.

## Dependencies
* GCC or Clang
* make
* pkg-config
* pthread
* ffmpeg >= 3.0 libraries (libavcodec, libavutil, libavformat, libswscale)
* GraphicsMagick

NB: ffmpeg and GM should be compiled with all the dependency libraries for
formats you want to process. On most Linux distributions you should be fine with
the packages in the stock repositories.
{'fraction_non_alphanumeric': 0.0777496839443742, 'fraction_numerical': 0.0025284450063211127, 'mean_word_length': 5.357429718875502, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 5, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '847964', 'n_tokens_mistral': 471, 'n_tokens_neox': 440, 'n_words': 173}