<commit_before>*) add -saveast flag to c2p.py for AST output

*) fix situation where the following compiles: 'int b = sum(a, b);', the rightmost b does not exist yet

CODE GENERATION:
*) finish/check pointers (&(*aa);)
*) static arrays + array subscripting
*) test all unary, binary an ternary operators
*) check argument loading for functions
*) new names for declarationProcessor and definitionProcessor


EXTRAS:
*) continue, break
*) for loops
*) const correctnes
*) implicit and explicit type conversions
*) nested functions
*) check whether all paths in a function body end with a return statement
    maybe:
    *) add warnings
    *) warning when variable declarations have no initializer
    *) warning when overinitializing arrays
    *) default parameters
    *) inline functions
    *) enums


DONE:
*) recognize printf/scanf after import stdio
*) fix very long nested expressions
*) check if parameter node code generation can be 'pass'



FIX:

This works ok:
    int a, b;
    a = 10;
    b = 5;

This does not, lines 2 and 3 refer enter a wrong nesting depth value (2 instead of 0) <commit_msg>updated TODO<commit_after>*) add -saveast flag to c2p.py for AST output

CODE GENERATION:
*) finish/check pointers (&(*aa);)
*) static arrays + array subscripting
*) test all unary, binary an ternary operators
*) check argument loading for functions
*) new names for declarationProcessor and definitionProcessor


EXTRAS:
*) continue, break
*) for loops
*) const correctnes
*) implicit and explicit type conversions
*) nested functions
*) check whether all paths in a function body end with a return statement
    maybe:
    *) add warnings
    *) warning when variable declarations have no initializer
    *) warning when overinitializing arrays
    *) default parameters
    *) inline functions
    *) enums


DONE:
*) recognize printf/scanf after import stdio
*) fix very long nested expressions
*) check if parameter node code generation can be 'pass'



FIX:

====

the following compiles: 'int b = sum(a, b);', the rightmost b does not exist yet

=====

This works ok:
    int a, b;
    a = 10;
    b = 5;

This does not, lines 2 and 3 refer enter a wrong nesting depth value (2 instead of 0)
{'fraction_non_alphanumeric': 0.08197463768115942, 'fraction_numerical': 0.007246376811594203, 'mean_word_length': 3.833698030634573, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2024426', 'n_tokens_mistral': 611, 'n_tokens_neox': 575, 'n_words': 294}