<jupyter_start><jupyter_text>Show number of solved instances  mlpProb<jupyter_code>mlp_agressive[mlp_agressive['times']<5000].count()<jupyter_output><empty_output><jupyter_text>mlpProb_cautious<jupyter_code>probsat_new[probsat_new['times']<5000].count()<jupyter_output><empty_output><jupyter_text>old probSAT<jupyter_code>probsat_old[probsat_old['times']<5000].count()<jupyter_output><empty_output><jupyter_text>Sparrow2Riss<jupyter_code>s2r[s2r['times']<5000].count()<jupyter_output><empty_output><jupyter_text>gluHack<jupyter_code>gluHack[gluHack['times']<5000].count()<jupyter_output><empty_output><jupyter_text>Compute par2 score  mlpProb<jupyter_code>mlp_agressive['times'].sum()<jupyter_output><empty_output><jupyter_text>mlpProb_cautious<jupyter_code>probsat_new['times'].sum()<jupyter_output><empty_output><jupyter_text>Sparrow2Riss<jupyter_code>s2r['times'].sum()<jupyter_output><empty_output><jupyter_text>probSAT old<jupyter_code>probsat_old['times'].sum()<jupyter_output><empty_output><jupyter_text>gluHack<jupyter_code>gluHack['times'].sum()<jupyter_output><empty_output><jupyter_text>Show performance on 'qhid' instances<jupyter_code>A = probsat_old[probsat_old['type'] == 'qhid']
A[A['times']<5000].count()
A = mlp_agressive[mlp_agressive['type'] == 'qhid']
A[A['times']<5000].count()
A = s2r[s2r['type'] == 'qhid']
A[A['times']<5000].count()<jupyter_output><empty_output><jupyter_text>Test statistic significance  MLPProb vs. Sparrow2Riss<jupyter_code>ttest_rel(s2r['times'], mlp_agressive['times'])
wilcoxon(s2r['times'], mlp_agressive['times'])<jupyter_output><empty_output><jupyter_text>MLPProb vs. gluHack<jupyter_code>ttest_rel(gluHack['times'], mlp_agressive['times'])
wilcoxon(gluHack['times'], mlp_agressive['times'])<jupyter_output><empty_output><jupyter_text>MLPProb vs. old probSAT<jupyter_code>ttest_rel(probsat_old['times'], mlp_agressive['times'])
wilcoxon(probsat_old['times'], mlp_agressive['times'])
total = len(gluHack)
total<jupyter_output><empty_output><jupyter_text>How many hidden instances did probSAT solve?<jupyter_code>A = probsat_old[(probsat_old['type']=='komb') | (probsat_old['type']=='qhid') | (probsat_old['type']=='barthel')]
len(A[A['times']<5000])
A = probsat_old[(probsat_old['type']!='komb') & (probsat_old['type']!='qhid') & (probsat_old['type']=='barthel')]
len(A[A['times']<5000])<jupyter_output><empty_output><jupyter_text>How many hidden instances did sparrow2Riss solve?<jupyter_code>A = s2r[(s2r['type']=='komb') | (s2r['type']=='qhid') | (s2r['type']=='barthel')]
len(A[A['times']<5000])
A = s2r[(s2r['type']!='komb') & (s2r['type']!='qhid') & (s2r['type']!='barthel')]
len(A[A['times']<5000])<jupyter_output><empty_output><jupyter_text>How many hidden instances did gluHack solve?<jupyter_code>A = gluHack[(gluHack['type']=='komb') | (gluHack['type']=='qhid') | (gluHack['type']=='barthel')]
len(A[A['times']<5000])
A = gluHack[(s2r['type']!='komb') & (gluHack['type']!='qhid') & (gluHack['type']!='barthel')]
len(A[A['times']<5000])<jupyter_output><empty_output><jupyter_text>How many hidden instances did probSAT solve? (Split by domain)<jupyter_code>A = probsat_old[(probsat_old['type']=='barthel')]
len(A[A['times']<5000])
A = probsat_old[(probsat_old['type']=='komb')]
len(A[A['times']<5000])
A = probsat_old[(probsat_old['type']=='qhid')]
len(A[A['times']<5000])<jupyter_output><empty_output><jupyter_text>How many hidden instances did gluHack solve? (Split by domain)<jupyter_code>A = gluHack[(gluHack['type']=='barthel')]
len(A[A['times']<5000])
A = gluHack[(gluHack['type']=='komb')]
len(A[A['times']<5000])
A = gluHack[(gluHack['type']=='qhid')]
len(A[A['times']<5000])<jupyter_output><empty_output><jupyter_text>How many hidden instances did sparrow2Riss solve? (Split by domain)<jupyter_code>A = s2r[(s2r['type']=='barthel')]
len(A[A['times']<5000])
A = s2r[(s2r['type']=='komb')]
len(A[A['times']<5000])
A = s2r[(s2r['type']=='qhid')]
len(A[A['times']<5000])<jupyter_output><empty_output><jupyter_text>How many hidden instances did mlp_agressive solve? (Split by domain)<jupyter_code>A = mlp_agressive[(mlp_agressive['type']=='barthel')]
len(A[A['times']<5000])
A = mlp_agressive[(mlp_agressive['type']=='komb')]
len(A[A['times']<5000])
A = mlp_agressive[(mlp_agressive['type']=='qhid')]
len(A[A['times']<5000])<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.21663577386468952, 'fraction_numerical': 0.030583873957367932, 'mean_word_length': 18.89400921658986, 'pattern_counts': {'":': 0, '<': 111, '<?xml version=': 0, '>': 85, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '21', 'dir': 'jupyter-structured-clean-dedup', 'id': '90192', 'license': 'CC-BY-4.0', 'n_tokens_mistral': 2019, 'n_tokens_neox': 1872, 'n_words': 161, 'path': 'SAT_competition18_results/compare_results.ipynb', 'repo_name': 'jahehalo/potential_of_restarts_hidden', 'size': '4316'}