<commit_before>Validation marker,Explanation
R_1,The data frame overlaps in date of the record until 2015-12-31 because of merging the different data sources. All entries from the BNetzA get a marker because of a very high probability of duplication
R_2,The start_up_date column has no entry (NA/Null)
R_3,"All power plant entries which do not have ""start up (Inbetriebnahme)"" listed as reason for their entry will get a marker. Explanation: The BNetzA power plant list entries include a reason for their entry, e.g. ""start up"", ""retrofit"" etc. If another reason than ""start up"" is given it means that the power plant is already existing and thus most likely already included in our data set. Due to the missing unique identifier and no possiblity to check for duplicates it is likely that those entries are duplicates."
R_4,start_up_date of PV system is older than 1975.
R_5,energy_source contains '#NV' value.
R_6,electrical_capacity is not specified.<commit_msg>deleted validation marker for #NV value as energy_source, not necessary any more<commit_after>Validation marker,Explanation
R_1,The data frame overlaps in date of the record until 2015-12-31 because of merging the different data sources. All entries from the BNetzA get a marker because of a very high probability of duplication
R_2,The start_up_date column has no entry (NA/Null)
R_3,"All power plant entries which do not have ""start up (Inbetriebnahme)"" listed as reason for their entry will get a marker. Explanation: The BNetzA power plant list entries include a reason for their entry, e.g. ""start up"", ""retrofit"" etc. If another reason than ""start up"" is given it means that the power plant is already existing and thus most likely already included in our data set. Due to the missing unique identifier and no possiblity to check for duplicates it is likely that those entries are duplicates."
R_4,start_up_date of PV system is older than 1975.
R_5,electrical_capacity is not specified.
{'fraction_non_alphanumeric': 0.050177394830207805, 'fraction_numerical': 0.017739483020780537, 'mean_word_length': 5.1114551083591335, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2238107', 'n_tokens_mistral': 541, 'n_tokens_neox': 499, 'n_words': 298}