<jupyter_start><jupyter_text>Deep neural networks I  Software for deep learning Deep learning is about composing differentiable functions into more complex functions, represented as a computation graph, and then using automatic differentiation ("autograd") to compute gradients, which we can pass to an optimizer, to fit the function to data. This is sometimes called "differentiable programming".There are several libraries that can execute such computation graphs on hardware accelerators, such as GPUs. (Some libraries also support distributed computation, but we will not need use this feature in this book.) We list a few popular libraries below.            Name        Functionality      More info              Tensorflow 2             Accelerated numpy-like library with autograd support. Keras API.     TF notebook                        JAX        Accelerated numpy, functional code transformations (autograd, JIT, VMAP, etc)                          JAX notebook             Pytorch          Similar to TF 2              Official PyTorch tutorials                       MXNet             Similar to TF 2. Gluon  API.                                Dive into deep learning book              Multilayer perceptrons (MLPs)In this section, we give some examples of MLPs using TF2.(* denotes official TF tutorials, which are not part of the pyprobml repo.)* [Auto-MPG regression *](https://www.tensorflow.org/tutorials/keras/regression)* [Tabular medical data classification *](https://www.tensorflow.org/tutorials/structured_data/feature_columns)*  [FashionMNIST image classification](https://colab.research.google.com/github/probml/pyprobml/blob/master/notebooks/dnn/fashion_mlp_tf.ipynb) * [FashionMNIST image classification *](https://www.tensorflow.org/tutorials/keras/classification)* [IMDB movie review sentiment classification](https://colab.research.google.com/github/probml/pyprobml/blob/master/notebooks/dnn/imdb_mlp_tf.ipynb) * [IMDB movie review sentiment classification using pre-trained word embeddings from TF-hub *](https://www.tensorflow.org/tutorials/keras/text_classification_with_hub)* [IMDB movie review sentiment classification using keras pre-processed data *](https://www.tensorflow.org/tutorials/keras/text_classification)  Convolutional neural networks (CNNs)In this section, we give some examples of CNNs using TF2. (* denotes official TF tutorials, which are not part of the pyprobml repo.) Image classification * [FashionMNIST image classification](https://colab.research.google.com/github/probml/pyprobml/blob/master/notebooks/dnn/fashion_cnn_tf.ipynb) * [Dogs vs cats image classification *](https://www.tensorflow.org/tutorials/images/classification)* [Transfer learning of a mobilenet model (trained on Imagenet) from keras to dogs vs cats classification *](https://www.tensorflow.org/tutorials/images/transfer_learning)* [Transfer learning of a mobilenet model (trained on Imagenet) from TF-hub to flower classification *](https://www.tensorflow.org/tutorials/images/transfer_learning_with_hub) Other vision tasks * [Image segmentation using Oxford-IIT pets dataset *](https://www.tensorflow.org/tutorials/images/segmentation)* [Object detection using TF-hub *](https://github.com/tensorflow/hub/blob/master/examples/colab/object_detection.ipynb)* [More advanced object detection *](https://github.com/tensorflow/models/blob/master/research/object_detection/object_detection_tutorial.ipynb)<jupyter_code><jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.08376511226252159, 'fraction_numerical': 0.0014392630972941854, 'mean_word_length': 4.1711309523809526, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 14, 'lorem ipsum': 0, 'www.': 9, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '1', 'dir': 'jupyter-structured-clean-dedup', 'id': '171517', 'license': 'MIT', 'n_tokens_mistral': 938, 'n_tokens_neox': 883, 'n_words': 295, 'path': 'notebooks-old/dnn1/dnn.ipynb', 'repo_name': 'seyi/pyprobml', 'size': '3474'}