<commit_before>---
layout: page
title: Optimization
permalink: /optimization
hide: true
---

## Instructor

| ![<NAME>][KevinMcGuinness-photo]  |
|:-:|
|  [<NAME> (KM)](KevinMcGuinness-web)     |

[KevinMcGuinness-web]: https://www.insight-centre.org/users/kevin-mcguinness
[KevinMcGuinness-photo]: img/instructors/KevinMcGuinness.jpg "<NAME>"

## Slides

* [Slides](slides/D2L3-optimization.pdf)

## Video lecture

(to be added)


## Related work

* Ioffe, Sergey, and <NAME>. ["Batch normalization: Accelerating deep network training by reducing internal covariate shift."](http://arxiv.org/abs/1502.03167) arXiv preprint arXiv:1502.03167 (2015). [Review](https://theberkeleyview.wordpress.com/2016/01/15/batch-normalization-accelerating-deep-network-training-by-reducing-internal-covariate-shift/)
* Zeiler, <NAME>., and <NAME>. ["Stochastic pooling for regularization of deep convolutional neural networks."](http://arxiv.org/abs/1301.3557) ICLR 2013.
*  Jaderberg, Max, <NAME>, and <NAME>. [Spatial transformer networks.](http://papers.nips.cc/paper/5854-spatial-transformer-networks) Advances in Neural Information Processing Systems 2015. ([Video](https://youtu.be/6NOQC_fl1hQ) and [Slides](http://www.slideshare.net/xavigiro/spatial-transformer-networks) by Victor Campos])
*  Courbariaux, Matthieu, <NAME>, and <NAME>. ["BinaryConnect: Training Deep Neural Networks with binary weights during propagations."](http://papers.nips.cc/paper/5647-shape-and-illumination-from-shading-using-the-generic-viewpoint-assumption) In Advances in Neural Information Processing Systems, pp. 3105-3113. 2015.<commit_msg>Slides link fixed<commit_after>---
layout: page
title: Optimization
permalink: /optimization
hide: true
---

## Instructor

| ![<NAME>][KevinMcGuinness-photo]  |
|:-:|
|  [<NAME> (KM)](KevinMcGuinness-web)     |

[KevinMcGuinness-web]: https://www.insight-centre.org/users/kevin-mcguinness
[KevinMcGuinness-photo]: img/instructors/KevinMcGuinness.jpg "<NAME>"

## Slides

* [Slides](slides/D3L3-optimization.pdf)

## Video lecture

(to be added)


## Related work

* Ioffe, Sergey, and <NAME>. ["Batch normalization: Accelerating deep network training by reducing internal covariate shift."](http://arxiv.org/abs/1502.03167) arXiv preprint arXiv:1502.03167 (2015). [Review](https://theberkeleyview.wordpress.com/2016/01/15/batch-normalization-accelerating-deep-network-training-by-reducing-internal-covariate-shift/)
* Zeiler, <NAME>., and <NAME>. ["Stochastic pooling for regularization of deep convolutional neural networks."](http://arxiv.org/abs/1301.3557) ICLR 2013.
*  Jaderberg, Max, <NAME>, and <NAME>. [Spatial transformer networks.](http://papers.nips.cc/paper/5854-spatial-transformer-networks) Advances in Neural Information Processing Systems 2015. ([Video](https://youtu.be/6NOQC_fl1hQ) and [Slides](http://www.slideshare.net/xavigiro/spatial-transformer-networks) by <NAME>])
*  Courbariaux, Matthieu, <NAME>, and <NAME>. ["BinaryConnect: Training Deep Neural Networks with binary weights during propagations."](http://papers.nips.cc/paper/5647-shape-and-illumination-from-shading-using-the-generic-viewpoint-assumption) In Advances in Neural Information Processing Systems, pp. 3105-3113. 2015.
{'fraction_non_alphanumeric': 0.15265280794291033, 'fraction_numerical': 0.04343779087806392, 'mean_word_length': 5.396825396825397, 'pattern_counts': {'":': 0, '<': 24, '<?xml version=': 0, '>': 24, 'https://': 6, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7342327', 'n_tokens_mistral': 1239, 'n_tokens_neox': 1072, 'n_words': 216}