<commit_before>---
layout: post
title:  "Capstone Project"
---

Can we improve **Aviation Safety** by studying accident data from the past?
[Capstone project on github](https://github.com/roshanlulu/gaProjects/tree/master/capstoneProject)

Executive Summary
![]({{ site.url }}/assets/images/runway.gif)

# Table of Contents<a id='toc'></a>
1. [Introduction](#intro)
2. [Data Sources](#datasource)
3. [Data Scrapping](#datascrapping)
4. [Exploratory Data Analysis](#eda)
    - [EDA Summary/Feature Selection](#examine)
    - [Data Dictionary](#datadict)
5. [Feature Engineering](#featureeng)
    - [Feature engineering - Latitude and Longitude](#latlon)
    - [Feature Engineering - Continent](#continent)
    - [Feature Engineering - Weather, Hemisphere](#weather)
6. [Map Visualization](#mapviz)
7. [Data Insights/Tableau](#insights)
8. [Classifying common causes of plane crashes - NLP](#nlp)
9. [Locations with high density of crashes - Clustering](#clustering)
10. [Results interpretation and Recommendation](#result)
11. [Future steps](#future)

# 1. Introduction<a id='intro'></a>
[Go back to table of contents](#toc)

In my capstone project I will be analysing the various aviation accidents that have occurred over the past few decades. Various data-science techniques such as data scrapping, data munging, machine learning, nlp will be employed thoughout this project. 
<commit_msg>added github path<commit_after>---
layout: post
title:  "Capstone Project"
---

Can we improve **Aviation Safety** by studying accident data from the past?

[Click here to view my capstone project on github](https://github.com/roshanlulu/gaProjects/tree/master/capstoneProject)

![]({{ site.url }}/assets/images/runway.gif)

# Table of Contents<a id='toc'></a>
1. [Introduction](#intro)
2. [Data Sources](#datasource)
3. [Data Scrapping](#datascrapping)
4. [Exploratory Data Analysis](#eda)
    - [EDA Summary/Feature Selection](#examine)
    - [Data Dictionary](#datadict)
5. [Feature Engineering](#featureeng)
    - [Feature engineering - Latitude and Longitude](#latlon)
    - [Feature Engineering - Continent](#continent)
    - [Feature Engineering - Weather, Hemisphere](#weather)
6. [Map Visualization](#mapviz)
7. [Data Insights/Tableau](#insights)
8. [Classifying common causes of plane crashes - NLP](#nlp)
9. [Locations with high density of crashes - Clustering](#clustering)
10. [Results interpretation and Recommendation](#result)
11. [Future steps](#future)

# 1. Introduction<a id='intro'></a>
[Go back to table of contents](#toc)

In my capstone project I will be analysing the various aviation accidents that have occurred over the past few decades. Various data-science techniques such as data scrapping, data munging, machine learning, nlp will be employed thoughout this project. 

{'fraction_non_alphanumeric': 0.12826943747760658, 'fraction_numerical': 0.01003224650662845, 'mean_word_length': 5.0302375809935205, 'pattern_counts': {'":': 0, '<': 11, '<?xml version=': 0, '>': 11, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5920534', 'n_tokens_mistral': 888, 'n_tokens_neox': 801, 'n_words': 283}