<jupyter_start><jupyter_text>March Madness Data Analysis Log<jupyter_code>import pandas as pd

df = pd.read_csv(
        "https://raw.githubusercontent.com/IGARDS/RPLib/master/data/dataset_tool_datasets.tsv",sep='\t')

df_games = df.loc[(df['Type'] == 'Games') & (df['Dataset Name'].str.contains('March Madness'))]
df_games.set_index('Dataset ID',inplace=True)
df_games<jupyter_output><empty_output><jupyter_text>D Matrix Creation<jupyter_code>for ix in df_games.index:
    !python ../../pipelines/create_D_from_games.py {ix} {ix}<jupyter_output>load_D_from_games
https://raw.githubusercontent.com/IGARDS/marchmadness_study/master/data/2002teams.txt
https://raw.githubusercontent.com/IGARDS/marchmadness_study/master/data/2002games.txt
https://raw.githubusercontent.com/IGARDS/marchmadness_study/master/data/2002MadnessTeams.txt
team2           Alabama  Alcorn_St  Arizona  ...  Wisconsin  Wyoming  Xavier
team1                                        ...                            
Alabama             NaN        NaN      NaN  ...        NaN      NaN     NaN
Alcorn_St           NaN        NaN      NaN  ...        NaN      NaN     NaN
Arizona             NaN        NaN      NaN  ...        NaN      NaN     NaN
Boston_College      NaN        NaN      NaN  ...        NaN      NaN     NaN
Boston_Univ         NaN        NaN      NaN  ...        NaN      NaN     NaN
...                 ...        ...      ...  ...        ...      ...     ...
Wake_Forest         NaN        NaN      0.0  ...        NaN      NaN     NaN
Winthrop            NaN [...]<jupyter_text>Manual Update to dataset_tool_Ds.tsvNow you must manually make changes to dataset_tool_Ds.tsv and push.  LOP Card Creation  Dataset IDs<jupyter_code>for ix in df_games.index:
    print(ix)
    !python ../../pipelines/create_lop_card.py {ix} {ix}<jupyter_output>1
    Dataset ID                                               Link
0            1  https://raw.githubusercontent.com/IGARDS/RPLib...
1            2  https://raw.githubusercontent.com/IGARDS/RPLib...
2            3  https://raw.githubusercontent.com/IGARDS/RPLib...
3            4  https://raw.githubusercontent.com/IGARDS/RPLib...
4            5  https://raw.githubusercontent.com/IGARDS/RPLib...
5            6  https://raw.githubusercontent.com/IGARDS/RPLib...
6            7  https://raw.githubusercontent.com/IGARDS/RPLib...
7            8  https://raw.githubusercontent.com/IGARDS/RPLib...
8            9  https://raw.githubusercontent.com/IGARDS/RPLib...
9           10  https://raw.githubusercontent.com/IGARDS/RPLib...
10          11  https://raw.githubusercontent.com/IGARDS/RPLib...
11          12  https://raw.githubusercontent.com/IGARDS/RPLib...
(65, 65)
Academic license - for non-commercial use only - expires 2022-09-05
Using license file /home/jupyter-pander14/gurobi.lic
Found mult[...]<jupyter_text>Show how you can import a LOP Card<jupyter_code>import sys
from pathlib import Path
home = str(Path.home()) # all other paths are relative to this path. 
sys.path.insert(0,home)
%load_ext autoreload
%autoreload 2
import RPLib.pyrplib as pyrplib
lop_card = pyrplib.base.LOPCard.from_json("./1_lop_card.json")
lop_card._instance
pd.DataFrame(lop_card.solutions)<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.11688311688311688, 'fraction_numerical': 0.01948051948051948, 'mean_word_length': 2.0490103675777567, 'pattern_counts': {'":': 0, '<': 15, '<?xml version=': 0, '>': 15, 'https://': 16, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 11, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '4', 'dir': 'jupyter-structured-clean-dedup', 'id': '646856', 'license': 'MIT', 'n_tokens_mistral': 1158, 'n_tokens_neox': 1059, 'n_words': 200, 'path': 'data/marchmadness/Analysis.ipynb', 'repo_name': 'IGARDS/RPLib', 'size': '3234'}