<commit_before>+++
audioDuration = "00:31:35"
audioFile = "Google.Cloud.Platform.Podcast.Episode.136.mp3"
audioSize = 45896571 
categories = ["Reinforcement Learning", "Navigation", "Robotics", "DeepMind", "Machine Learning"]
date = "2018-07-18"
description = "On this episode of the podcast, Mark and Melanie delve into the fascinating world of robotics and reinforcement learning."
draft = false
episodeNumber = 136
hosts = ["<NAME>", "<NAME>"]
title = "Robotics, Navigation, and Reinforcement Learning with <NAME>"
image = "/images/post/raia.jpeg"
linked = false
+++

On this episode of the podcast, [Mark](https://twitter.com/Neurotic) and [Melanie](https://twitter.com/nyghtowl) delve into the fascinating world of robotics and reinforcement learning. We discuss advances in the field, including how robots are learning to navigate new surroundings and how machine learning is helping us understand the human mind better.

<!--more-->

##### <NAME>

[<NAME>](https://twitter.com/raiahadsell), a senior research scientist at DeepMind, has worked on deep learning and robotics problems for the past 15 years. After completing a PhD at New York University, which featured a self-supervised deep learning vision system for a mobile robot, her research continued at Carnegie Mellon’s Robotics Institute and SRI International, and in early 2014 she joined DeepMind in London to develop artificial general intelligence. Her current research focuses on the challenge of interactive learning for AI agents and robots, including subjects such as neural memory for real world navigation and lifelong learning. 

##### Cool things of the week

* AI Adventures How to Make a Data Science Project with Kaggle [site](https://towardsdatascience.com/cooking-up-a-data-science-project-using-kaggle-datasets-and-kernels-fca2b678e268)
* Predict your future costs with Google Cloud Billing cost forecast [blog](https://cloudplatform.googleblog.com/2018/07/predict-your-future-costs-with-google-cloud-billing-cost-forecast.html) and [site](https://cloud.google.com//billing/docs/how-to/reports#cost-forecast)
* Kaggle Competition Winning Solutions [site](https://www.kaggle.com/sudalairajkumar/winning-solutions-of-kaggle-competitions/)
    - Google Cloud Platform Podcast Episode 84: Kaggle with Wendy Kan [podcast](https://www.gcppodcast.com/post/episode-84-kaggle-with-wendy-kan/)
* Introducing Jib — build Java Docker images better [blog](https://cloudplatform.googleblog.com/2018/07/introducing-jib-build-java-docker-images-better.html) 
    - Google Container Tools [site](https://github.com/GoogleContainerTools/jib)

##### Interview

* <NAME> [site](http://raiahadsell.com/index.html)
* Learning to Navigate Cities Without a Map [research paper](https://arxiv.org/pdf/1804.00168.pdf) and [blog](https://deepmind.com/blog/learning-to-navigate-cities-without-a-map/)
* Unsupervised Predictive Memory in a Goal-Directed Agent | MERLIN [research paper](https://arxiv.org/pdf/1803.10760.pdf)
* Nature: Vector-based navigation using grid-like representations in AI [research paper](https://www.nature.com/articles/s41586-018-0102-6.epdf)
* DeepMind has trained an AI to unlock the mysteries of your brain [site](http://www.wired.co.uk/article/deepmind-newest-network-mimics-the-gps-cells-in-your-brain)
* Navigating with grid-like representations in artificial agents [blog](https://deepmind.com/blog/grid-cells/)
* DeepMind [site](https://deepmind.com) and [blog](https://deepmind.com/blog/)
* Boston Dynamics [site](https://www.bostondynamics.com)
* Google Brain Robotics [site](https://ai.google/research/teams/brain/robotics)
* Transylvanian Machine Learning Summer School [site](https://tmlss.ro)
* IMPALA:  Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures [research paper](https://arxiv.org/pdf/1802.01561.pdf)
* <NAME> - Grid Cells and the Brain's Spatial Mapping System [video](https://www.youtube.com/watch?v=Ekzec9e1Y4Y)
* The Nobel Prize in Physiology or Medicine 2014 [site](https://www.nobelprize.org/nobel_prizes/medicine/laureates/2014/)
* TensorFlow [site](https://www.tensorflow.org)

<div style="text-align: center">
  <img src="/images/post/raia.jpeg" style="margin: auto; max-width: 25%;">
  <p><NAME></p>
</div>

##### Question of the week

How do you connect a Google Cloud Source repository to an existing Git repository? [site](https://cloud.google.com/source-repositories/docs/connecting-hosted-repositories) and [blog](http://blog.plataformatec.com.br/2013/05/how-to-properly-mirror-a-git-repository/)

##### Where can you find us next?

We’ll both be at [Cloud NEXT!](https://cloud.withgoogle.com/next18/sf/) 

* Mark will be talking about Agones [blog](https://cloudplatform.googleblog.com/2018/03/introducing-Agones-open-source-multiplayer-dedicated-game-server-hosting-built-on-Kubernetes.html)

Melanie will speak at [PyCon Russia](http://pycon.ru/2018/en/) July 22nd<commit_msg>ep. 136 social links<commit_after>+++
audioDuration = "00:31:35"
audioFile = "Google.Cloud.Platform.Podcast.Episode.136.mp3"
audioSize = 45896571 
categories = ["Reinforcement Learning", "Navigation", "Robotics", "DeepMind", "Machine Learning"]
date = "2018-07-18"
description = "On this episode of the podcast, Mark and Melanie delve into the fascinating world of robotics and reinforcement learning."
draft = false
episodeNumber = 136
hosts = ["<NAME>", "<NAME>"]
title = "Robotics, Navigation, and Reinforcement Learning with <NAME>"
image = "/images/post/raia.jpeg"
linked = true
googlePlusLink = "https://plus.google.com/b/117267610519909886476/+Gcppodcast/posts/VbGgvKeieks"
redditLink = "https://www.reddit.com/r/gcppodcast/comments/8zw0lq/episode_136_robotics_navigation_and_reinforcement/"
+++

On this episode of the podcast, [Mark](https://twitter.com/Neurotic) and [Melanie](https://twitter.com/nyghtowl) delve into the fascinating world of robotics and reinforcement learning. We discuss advances in the field, including how robots are learning to navigate new surroundings and how machine learning is helping us understand the human mind better.

<!--more-->

##### <NAME>

[<NAME>](https://twitter.com/raiahadsell), a senior research scientist at DeepMind, has worked on deep learning and robotics problems for the past 15 years. After completing a PhD at New York University, which featured a self-supervised deep learning vision system for a mobile robot, her research continued at Carnegie Mellon’s Robotics Institute and SRI International, and in early 2014 she joined DeepMind in London to develop artificial general intelligence. Her current research focuses on the challenge of interactive learning for AI agents and robots, including subjects such as neural memory for real world navigation and lifelong learning. 

##### Cool things of the week

* AI Adventures How to Make a Data Science Project with Kaggle [site](https://towardsdatascience.com/cooking-up-a-data-science-project-using-kaggle-datasets-and-kernels-fca2b678e268)
* Predict your future costs with Google Cloud Billing cost forecast [blog](https://cloudplatform.googleblog.com/2018/07/predict-your-future-costs-with-google-cloud-billing-cost-forecast.html) and [site](https://cloud.google.com//billing/docs/how-to/reports#cost-forecast)
* Kaggle Competition Winning Solutions [site](https://www.kaggle.com/sudalairajkumar/winning-solutions-of-kaggle-competitions/)
    - Google Cloud Platform Podcast Episode 84: Kaggle with Wendy Kan [podcast](https://www.gcppodcast.com/post/episode-84-kaggle-with-wendy-kan/)
* Introducing Jib — build Java Docker images better [blog](https://cloudplatform.googleblog.com/2018/07/introducing-jib-build-java-docker-images-better.html) 
    - Google Container Tools [site](https://github.com/GoogleContainerTools/jib)

##### Interview

* <NAME> [site](http://raiahadsell.com/index.html)
* Learning to Navigate Cities Without a Map [research paper](https://arxiv.org/pdf/1804.00168.pdf) and [blog](https://deepmind.com/blog/learning-to-navigate-cities-without-a-map/)
* Unsupervised Predictive Memory in a Goal-Directed Agent | MERLIN [research paper](https://arxiv.org/pdf/1803.10760.pdf)
* Nature: Vector-based navigation using grid-like representations in AI [research paper](https://www.nature.com/articles/s41586-018-0102-6.epdf)
* DeepMind has trained an AI to unlock the mysteries of your brain [site](http://www.wired.co.uk/article/deepmind-newest-network-mimics-the-gps-cells-in-your-brain)
* Navigating with grid-like representations in artificial agents [blog](https://deepmind.com/blog/grid-cells/)
* DeepMind [site](https://deepmind.com) and [blog](https://deepmind.com/blog/)
* Boston Dynamics [site](https://www.bostondynamics.com)
* Google Brain Robotics [site](https://ai.google/research/teams/brain/robotics)
* Transylvanian Machine Learning Summer School [site](https://tmlss.ro)
* IMPALA:  Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures [research paper](https://arxiv.org/pdf/1802.01561.pdf)
* <NAME> - Grid Cells and the Brain's Spatial Mapping System [video](https://www.youtube.com/watch?v=Ekzec9e1Y4Y)
* The Nobel Prize in Physiology or Medicine 2014 [site](https://www.nobelprize.org/nobel_prizes/medicine/laureates/2014/)
* TensorFlow [site](https://www.tensorflow.org)

<div style="text-align: center">
  <img src="/images/post/raia.jpeg" style="margin: auto; max-width: 25%;">
  <p><NAME></p>
</div>

##### Question of the week

How do you connect a Google Cloud Source repository to an existing Git repository? [site](https://cloud.google.com/source-repositories/docs/connecting-hosted-repositories) and [blog](http://blog.plataformatec.com.br/2013/05/how-to-properly-mirror-a-git-repository/)

##### Where can you find us next?

We’ll both be at [Cloud NEXT!](https://cloud.withgoogle.com/next18/sf/) 

* Mark will be talking about Agones [blog](https://cloudplatform.googleblog.com/2018/03/introducing-Agones-open-source-multiplayer-dedicated-game-server-hosting-built-on-Kubernetes.html)

Melanie will speak at [PyCon Russia](http://pycon.ru/2018/en/) July 22nd
{'fraction_non_alphanumeric': 0.1281135258509477, 'fraction_numerical': 0.028877642155403394, 'mean_word_length': 5.213316892725031, 'pattern_counts': {'":': 0, '<': 31, '<?xml version=': 0, '>': 31, 'https://': 56, 'lorem ipsum': 0, 'www.': 17, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2503011', 'n_tokens_mistral': 3376, 'n_tokens_neox': 3007, 'n_words': 844}