<jupyter_start><jupyter_text>Import dataThe competition winner prediction on the open test data is not found on the competition data folder (GitHub or Google Drive). To create it, I pointed Colab to the [winner notebook](https://github.com/bolgebrygg/Force-2020-Machine-Learning-competition/blob/master/lithology_competition/code/OlawaleI/FORCE_Submission_File.ipynb) on GitHub.Also, I updated the data input folder to point to the [competition shared Google Drive folder](https://drive.google.com/drive/folders/1GIkjq4fwgwbiqVQxYwoJnOJWVobZ91pL) by adding a shorcut to my personal Google Drive. This way I can access the data without duplicating cloud storage.Finally, I created a [Google Drive shared folder](https://drive.google.com/drive/folders/1ilFw-gfCSbvRjkbEDygTjuxN-Ixa3wxg) named `lith_pred` to keep the results of the Colab runs.In this notebook, I explore the result of running the winning code on the open test data, in an attemp to reproduce and test the scoring function.  Lithology mapping<jupyter_code>lithology_numbers = {30000: 0,
                     65030: 1,
                     65000: 2,
                     80000: 3,
                     74000: 4,
                     70000: 5,
                     70032: 6,
                     88000: 7,
                     86000: 8,
                     99000: 9,
                     90000: 10,
                     93000: 11}<jupyter_output><empty_output><jupyter_text>Olawale hidden y_pred<jupyter_code>output_root = ROOT_DIR / 'data/external'
olawale_open_test_pred_path = output_root / 'olawale_open_test_pred.csv'
if not olawale_open_test_pred_path.is_file():
    download_competition_files()
olawale_open_test_pred = pd.read_csv(olawale_open_test_pred_path)
olawale_open_test_pred.head()
y_pred = olawale_open_test_pred['# lithology'].map(lithology_numbers)

y_pred<jupyter_output><empty_output><jupyter_text>y_true<jupyter_code>csv_open_test_path = ROOT_DIR / 'data/external/open_test_y_true.csv'

csv_open_test = pd.read_csv(csv_open_test_path, ',')
csv_open_test.head()
y_true = csv_open_test['FORCE_2020_LITHOFACIES_LITHOLOGY'].map(lithology_numbers)<jupyter_output><empty_output><jupyter_text>Score<jupyter_code>olawale_open_test_score = score(y_true, y_pred)
print(f'Olawale open test score is: {olawale_open_test_score:.4f}')<jupyter_output>Olawale open test score is: -0.5148
{'fraction_non_alphanumeric': 0.08234295415959253, 'fraction_numerical': 0.039898132427843805, 'mean_word_length': 3.87991718426501, 'pattern_counts': {'":': 0, '<': 16, '<?xml version=': 0, '>': 16, 'https://': 3, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '4', 'dir': 'jupyter-structured-clean-dedup', 'id': '251946', 'license': 'BSD-3-Clause', 'n_tokens_mistral': 886, 'n_tokens_neox': 794, 'n_words': 176, 'path': 'notebooks/3.1-rp-competition-winner-olawale-open-test-score.ipynb', 'repo_name': 'RafaelPinto/force_2020_lith', 'size': '2356'}