<jupyter_start><jupyter_text>Presentation - Group 1Members:* <NAME>- 2017B5A70667P* <NAME>          - 2017B5A10768P* <NAME>        - 2017B5A70606P* <NAME>          - 2018ABPS0755P* <NAME>             - 2017A7PS0013P  RolesIndex Creation Code- AvinashQuery Tester Code - Manan and TulikaWordNet Improvization - MananZone Improvization - Avinash and SrijenOptimal Weighing of Optimizations - TulikaFinding Queries - SrijenReport - Tulika and SrujanaImprovization Ideas - Everyone  Demo Code Importing Libraries<jupyter_code>#Importing Libraries and functions
from test_queries import test_queries
from query_finder import queries_finder_func as accumulator
from index_creation import corpus_parser<jupyter_output><empty_output><jupyter_text>Index Creation<jupyter_code>#Run if you want to parse corpus
location = './Text_corpus/wiki_00'
corpus_parser(location)<jupyter_output>Parsing Progress: Document_id = 1526 : Abnerin25uke of Prussiarave of Brandenburg-Kulmbach
Documents separated and parsed
Populating Zone-Term Frequency Table with doc 15261526
Populating Term-Frequency Table done
Zone Vector created for doc_no:15261526
Document vector creation done<jupyter_text>Testing using a query<jupyter_code>#Test query with custom parameters to configure optimziations
test_queries(open_web=False,use_zones=False,enable_query_relaxation=False)
#Test query showing all improvizations
accumulator()<jupyter_output>Type the query: Academy awards
Normal:
316 0.184 Academy Award for Best Production Design
340 0.088 <NAME>
1247 0.087 <NAME>
324 0.084 Academy Awards
869 0.084 American Film Institute
593 0.073 Animation
910 0.069 Ar<NAME>
1449 0.056 Alan Kay
851 0.055 <NAME>
800 0.052 Anime

With zone:
324 0.222 Academy Awards
316 0.222 Academy Award for Best Production Design
340 0.088 <NAME>
1247 0.087 Alfonso Cuarón
869 0.084 American Film Institute
593 0.073 Animation
910 0.069 Arne Kaijser
1449 0.056 Al<NAME>
851 0.055 <NAME>
800 0.052 Anime

With Hypernym:
844 1.662 Amsterdam
1216 1.068 Athens
308 0.631 Aristotle
316 0.184 Academy Award for Best Production Design
340 0.088 <NAME>
1247 0.087 Alfonso Cuarón
324 0.084 Academy Awards
869 0.084 American Film Institute
593 0.073 Animation
910 0.069 Arne Kaijser

With Synonym:
869 1.712 American Film Institute
844 1.662 Amsterdam
800 1.605 Anime
851 1.568 <NAME>
593 1.523 Animation
872 1.503 Akira Kurosaw[...]
{'fraction_non_alphanumeric': 0.060810810810810814, 'fraction_numerical': 0.13935810810810811, 'mean_word_length': 5.137305699481865, 'pattern_counts': {'":': 0, '<': 25, '<?xml version=': 0, '>': 25, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '3', 'dir': 'jupyter-structured-clean-dedup', 'id': '155247', 'license': 'MIT', 'n_tokens_mistral': 1006, 'n_tokens_neox': 757, 'n_words': 270, 'path': 'presentation.ipynb', 'repo_name': 'manan-paneri-99/Vector-Space-based-Document-Retrieval-system', 'size': '2455'}