<commit_before>---
topic: "Data science / Web App"
desc: "R"
lecture_date: 2017-08-21 09:00:00.00-7:00
week: "3"
ready: true
---


# Morning:

## 08:45-10am: Paul (Data Mining / Visualization)
  * Junpiter notebook and data analysis intro [notebook](https://drive.google.com/open?id=0B4nPq7yIvSF_NkRYNEVXTnQ3Z3M)
  
  Note: the datascience package is still being setup as of 8/21.
  
  
  Here is a workaround to avoid using jupyter notebook while still run our code
  1. Download the python code that we run in class [dataintro.py](https://drive.google.com/file/d/0B4nPq7yIvSF_Xy14UDhTcW9vdk0/view?usp=sharing)
  
  2. Go to the terminal and start ipython by typing the following command. ipython is the same python that we used before except it allows
  us to show interactive features of python, i.e. plotting.
  
  ipython
  
  %pylab
 
  3. You are now in the ipython environment. You will first go to the directory that you have downloaded
  the dataintro.py by using cd commands
  
  4. Then run the dataintro.py script by executing 

  %run dataintro.py
 
  5. After the code runs, one last command to show the figures
  
  pylab.show()
  
  You should see the plots displayed properly.  
<commit_msg>Update 0821.md<commit_after>---
topic: "Data science / Web App"
desc: "R"
lecture_date: 2017-08-21 09:00:00.00-7:00
week: "3"
ready: true
---


# Morning:

## 08:45-10am: Paul (Data Mining / Visualization)
  * Junpiter notebook and data analysis intro [notebook](https://drive.google.com/open?id=0B4nPq7yIvSF_NkRYNEVXTnQ3Z3M)
  
  Note: the datascience package is still being setup as of 8/21.
  
  
  Here is a workaround to avoid using jupyter notebook while still run our code
  * Download the python code that we run in class [dataintro.py](https://drive.google.com/file/d/0B4nPq7yIvSF_Xy14UDhTcW9vdk0/view?usp=sharing)
  
  * Go to the terminal and start ipython by typing the following command. ipython is the same python that we used before except it allows us to show interactive features of python, i.e. plotting.
  
   ipython
  
   %pylab
 
  * You are now in the ipython environment. You will first go to the directory that you have downloaded the dataintro.py by using cd commands
  
  * Then run the dataintro.py script by executing 

   %run dataintro.py
 
  * After the code runs, one last command to show the figures
  
   pylab.show()
  
  You should see the plots displayed properly.  

{'fraction_non_alphanumeric': 0.07580778790389395, 'fraction_numerical': 0.037696768848384424, 'mean_word_length': 3.4393382352941178, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2190175', 'n_tokens_mistral': 887, 'n_tokens_neox': 813, 'n_words': 306}