<commit_before>***Billboard Data - Year 2000***

Upon looking at Billboard data in the year 2000, the first thing I wanted to know was how the top songs for the year are determined. 

Before we can get to that though, I had to clean some of the data to a usable form -- namely turning the date into pd.datetime standard and turning the weeks in 
which the song was not on the chart into np.nan so these data can be understood.

Turns out, a scoring system
is used where a song is given a set number of points based on its rank for each week that it is on the chart. 100 points is given to the top song of the week and
1 point to the 100th song. Knowing this, I found the top 25 songs of the year by adding a new columns to the data frame (number of weeks on chart) and calculating
each song's score. 
<commit_msg>blog post<commit_after>***Billboard Data - Year 2000***

Upon looking at Billboard data in the year 2000, the first thing I wanted to know was how the top songs for the year are determined. 

Before we can get to that though, I had to clean some of the data to a usable form -- namely turning the date into pd.datetime standard and turning the weeks in 
which the song was not on the chart into np.nan so these data can be understood.

Turns out, Billboard used a scoring system where a song is given a set number of points based on its rank for each week that it is on the chart. 100 points is given to the top song of the week and
1 point to the 100th song. Knowing this, I found the top 25 songs of the year by adding a new columns to the data frame (number of weeks on chart) and calculating
each song's score. 

{'fraction_non_alphanumeric': 0.03192142418661756, 'fraction_numerical': 0.020871700429711478, 'mean_word_length': 3.6839080459770117, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2958278', 'n_tokens_mistral': 444, 'n_tokens_neox': 397, 'n_words': 311}