<commit_before># miniTeX

***
								
## 1. About

miniTeX is a simple text formatting language intended to illustrate the basics of languages such as TeX. This repository contains the code for the compiler of the language. The grammar can be found in `Notes.txt`

## 2. Language

My code is written in **C11**. I have made use of the _Flex_ and _Bison_ tools for lexical analysis and parser generation.


## 3. Operating System

miniTeX compiles and works correctly on Windows 10 with Flex 2.5.4a using the GCC 6.3 C compiler. It should also work on other platforms and with other versions of Flex even though I haven't confirmed that by testing.

## 4. List of files

The following files should be in the miniTeX folder:
>      1. miniTeX.l
>      2. miniTeX.y
>      3. miniTeX.h
>      4. ExampleSourceFile.txt<commit_msg>Fixed typo<commit_after># miniTeX

***
								
## 1. About

miniTeX is a simple text formatting language intended to illustrate the basics of languages such as TeX. This repository contains the code for the compiler of the language. The grammar can be found in `Notes.md`.

## 2. Language

My code is written in **C11**. I have made use of the _Flex_ and _Bison_ tools for lexical analysis and parser generation.


## 3. Operating System

miniTeX compiles and works correctly on Windows 10 with Flex 2.5.4a using the GCC 6.3 C compiler. It should also work on other platforms and with other versions of Flex even though I haven't confirmed that by testing.

## 4. List of files

The following files should be in the miniTeX folder:
>      1. miniTeX.l
>      2. miniTeX.y
>      3. miniTeX.h
>      4. ExampleSourceFile.txt
{'fraction_non_alphanumeric': 0.05996365838885524, 'fraction_numerical': 0.02059357964869776, 'mean_word_length': 3.2467866323907457, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 11, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '275569', 'n_tokens_mistral': 525, 'n_tokens_neox': 446, 'n_words': 250}