<commit_before>GLuaParser
==========

WIP Lexer/Parser for Garry's mod's variant of Lua.

# Compiling

- Make sure cabal is installed
- `cabal configure && cabal build`
- The executable will appear in the `dist/build/gluaparser/` folder
<commit_msg>Describe profiling in README<commit_after>GLuaParser
==========

WIP Lexer/Parser for Garry's mod's variant of Lua.

# Compiling

- Make sure cabal is installed
- `cabal configure && cabal build`
- The executable will appear in the `dist/build/gluaparser/` folder

# Profiling
This program can be profiled. Compile the program with profiling tags:

`ghc --make -prof -auto-all -rtsopts Main`

Then execute the compiled program with RTS options:
`./Main <command> <file>  +RTS -K100M -p -hc`
{'fraction_non_alphanumeric': 0.11366711772665765, 'fraction_numerical': 0.0040595399188092015, 'mean_word_length': 4.24822695035461, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3416491', 'n_tokens_mistral': 252, 'n_tokens_neox': 237, 'n_words': 90}