<jupyter_start><jupyter_text>There is a slight skew for the association-based method to have higher intra-group L100 overlap<jupyter_code>df1 = pd.DataFrame({'val':df_L100.intersect_infer_only, 'method':'infer only'})
df2 = pd.DataFrame({'val':df_L100.intersect_assoc_only, 'method':'assoc only'})
df = pd.concat([df1,df2])
sns.boxplot('method', 'val', data = df)
plt.ylabel('genes overlap between\neach L100 group and list')
plt.show()
from scipy.stats import mannwhitneyu 
mannwhitneyu(df_L100.intersect_infer_only, df_L100.intersect_assoc_only)<jupyter_output><empty_output><jupyter_text>Check not just the infer/assoc only genes, but all infer genes, and all assoc genes<jupyter_code>df1 = pd.DataFrame({'val':df_L100.intersect_infer, 'method':'infer'})
df2 = pd.DataFrame({'val':df_L100.intersect_assoc, 'method':'assoc'})
df = pd.concat([df1,df2])
sns.boxplot('method', 'val', data = df)
plt.ylabel('genes overlap between\neach L100 group and list')
plt.show()
from scipy.stats import mannwhitneyu 
mannwhitneyu(df_L100.intersect_infer, df_L100.intersect_assoc)<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.13764813126709208, 'fraction_numerical': 0.037374658158614404, 'mean_word_length': 8.305084745762711, 'pattern_counts': {'":': 0, '<': 9, '<?xml version=': 0, '>': 9, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '2', 'dir': 'jupyter-structured-clean-dedup', 'id': '572388', 'license': 'MIT', 'n_tokens_mistral': 458, 'n_tokens_neox': 415, 'n_words': 81, 'path': 'notebooks/01-overlap_gs-L100.ipynb', 'repo_name': 'pritchardlabatpsu/cga', 'size': '1097'}