<commit_before>name | what | when | how | format
tag_support | count, user and time for all tags above threshold | 6.12.13 | extract_dataset.supported_tags(DB, 20, 2, 0) | dict indexed by tag
tag_support.txt | text version of the previous | 6.12.13 | tag_support.py | plain text
out.patch | diff after tag cleaning | 6.11.13 | compare_tags.py | patch format
supported | original version of tag_support | 11.11.13 | extract_dataset.supported_tags(DB, 150, 25, 500) | dict indexed by tag
user_status | user and tourist status in SF | 31.10.13 | more_query.get_user_status(with_count=False) | dict id:bool
user_status_full | user and (photo count, tourist status) in SF | 3.11.13 | more_query.get_user_status(with_count=True) | dict id:(int,bool)
time_entropy.ods/txt | tags and their time entropy in SF | 7.11.13 | more_query.time_entropy() | plain text<commit_msg>add 4SQ categories<commit_after>name | what | when | how | format
tag_support | count, user and time for all tags above threshold | 6.12.13 | extract_dataset.supported_tags(DB, 20, 2, 0) | dict indexed by tag
tag_support.txt | text version of the previous | 6.12.13 | tag_support.py | plain text
out.patch | diff after tag cleaning | 6.11.13 | compare_tags.py | patch format
supported | original version of tag_support | 11.11.13 | extract_dataset.supported_tags(DB, 150, 25, 500) | dict indexed by tag
user_status | user and tourist status in SF | 31.10.13 | more_query.get_user_status(with_count=False) | dict id:bool
user_status_full | user and (photo count, tourist status) in SF | 3.11.13 | more_query.get_user_status(with_count=True) | dict id:(int,bool)
time_entropy.ods/txt | tags and their time entropy in SF | 7.11.13 | more_query.time_entropy() | plain text
raw_categories | categories answer from Foursquare | 28.02.14 | FSCategories.get_categories() | json dict
{'fraction_non_alphanumeric': 0.09961894393032118, 'fraction_numerical': 0.05715841045182363, 'mean_word_length': 4.798107255520505, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1096414', 'n_tokens_mistral': 661, 'n_tokens_neox': 576, 'n_words': 196}