<commit_before>Feature vector:
 -- crime_latlong.csv
year
month
latitude
longitude
neighbourhood (one hot) (~x20)

-- grafitti.csv + utilities.py (number_of_graffiti_points)
50m graffiti count
100m graffiti count

-- homeless_shelters/doc.csv + utilities.py (number_of_homeless_shelters_at)
distance to adults
distance to men
distance to women/families
distance to youth

-- latlong_property_tax_20*.csv + utilities.py (avg_closest_properties)
Average value of the 5 closest properties
Average value of the 10 closest properties

-- rapid_transit_stations.csv
Closest skytrain station (one hot) (x20)
Distance to closest skytrain

-- street_lighting_poles.csv + utilities.py (number_of_street_lights_at)
50m light poles count

-- VANCOUVER_SEA_ISLAND_CCG/summary_data.csv
Total precipitation per month and year
Mean temp per month and year
Min temp per month and year
Max temp per month and year

~56 items in feature vector<commit_msg>Editted names of functions required for some vector fields<commit_after>Feature vector:
 -- crime_latlong.csv
year
month
latitude
longitude
neighbourhood (one hot) (~x20)

-- grafitti.csv + utilities.py (number_of_graffiti_points)
50m graffiti count
100m graffiti count

-- homeless_shelters/doc.csv + utilities.py (number_of_homeless_shelters_at)
distance to adults
distance to men
distance to women/families
distance to youth

-- latlong_property_tax_20*.csv + utilities2.py (avg_closest_properties)
Average value of the 5 closest properties
Average value of the 10 closest properties

-- rapid_transit_stations.csv + utilities2.py (closest_skytrain)
Closest skytrain station (one hot) (x20)
Distance to closest skytrain

-- street_lighting_poles.csv + utilities.py (number_of_street_lights_at)
50m light poles count

-- VANCOUVER_SEA_ISLAND_CCG/summary_data.csv
Total precipitation per month and year
Mean temp per month and year
Min temp per month and year
Max temp per month and year

~56 items in feature vector
{'fraction_non_alphanumeric': 0.05837173579109063, 'fraction_numerical': 0.01945724526369688, 'mean_word_length': 5.406557377049181, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5753393', 'n_tokens_mistral': 662, 'n_tokens_neox': 605, 'n_words': 209}