<commit_before>#+TITLE: Practical aspects of Deep Learning

* Table of Contents :TOC_3_gh:
- [[#optimization-alogrithms][Optimization alogrithms]]
  - [[#mini-batch-gradient-descent][Mini-batch gradient descent]]
  - [[#understanding-mini-batch-gradient-descent][Understanding mini-batch gradient descent]]
  - [[#exponentially-weighted-averages][Exponentially weighted averages]]
  - [[#understanding-exponentially-weighted-averages][Understanding exponentially weighted averages]]

* Optimization alogrithms
** Mini-batch gradient descent
[[file:img/screenshot_2017-10-18_07-50-21.png]]

[[file:img/screenshot_2017-10-18_07-56-43.png]]

** Understanding mini-batch gradient descent
[[file:img/screenshot_2017-10-18_08-00-20.png]]

[[file:img/screenshot_2017-10-18_08-23-00.png]]

[[file:img/screenshot_2017-10-18_08-25-46.png]]
** Exponentially weighted averages
[[file:img/screenshot_2017-10-21_17-25-56.png]]

[[file:img/screenshot_2017-10-21_17-25-29.png]]

** Understanding exponentially weighted averages<commit_msg>Working on deep learning<commit_after>#+TITLE: Practical aspects of Deep Learning

* Table of Contents :TOC_3_gh:
- [[#optimization-alogrithms][Optimization alogrithms]]
  - [[#mini-batch-gradient-descent][Mini-batch gradient descent]]
  - [[#understanding-mini-batch-gradient-descent][Understanding mini-batch gradient descent]]
  - [[#exponentially-weighted-averages][Exponentially weighted averages]]
  - [[#understanding-exponentially-weighted-averages][Understanding exponentially weighted averages]]

* Optimization alogrithms
** Mini-batch gradient descent
[[file:img/screenshot_2017-10-18_07-50-21.png]]

[[file:img/screenshot_2017-10-18_07-56-43.png]]

** Understanding mini-batch gradient descent
[[file:img/screenshot_2017-10-18_08-00-20.png]]

[[file:img/screenshot_2017-10-18_08-23-00.png]]

[[file:img/screenshot_2017-10-18_08-25-46.png]]
** Exponentially weighted averages
[[file:img/screenshot_2017-10-21_17-25-56.png]]

[[file:img/screenshot_2017-10-21_17-25-29.png]]

** Understanding exponentially weighted averages
[[file:img/screenshot_2017-10-21_17-33-22.png]]

[[file:img/screenshot_2017-10-21_17-35-50.png]]
{'fraction_non_alphanumeric': 0.15134633240482823, 'fraction_numerical': 0.10492107706592387, 'mean_word_length': 6.255892255892256, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '510355', 'n_tokens_mistral': 934, 'n_tokens_neox': 756, 'n_words': 102}