Elective in AITensorflow: TensorFlow 2.0 Tutorial

Tutor: Temirlan Zharkynbek

Tensorflow 2.0x

Pagina 2

Example #1: from official webpage of Tensorflow

Pagina 3

tf.function

Pagina 4

Training

Pagina 5

Use tf.GradientTape to train the model:

Pagina 6

tf.function (explanation 1)

Pagina 7

tf.function (explanation 2)

Pagina 8

tf.GradientTape (explanation)

Pagina 9

Tensorflow

This tutorial walks you through the process of building a simple CIFAR-10 image classifier using deep learning. In this tutorial, we will:

● Define a model● Set up a data pipeline● Train the model● Accelerate training speed with multiple GPUs● Add callbacks for monitoring progress/updating learning schedules

Pagina 10

Defining a model

Pagina 11

Setting up a data pipeline

Pagina 12

● Loading: Copying the dataset (e.g. images and labels) from storage into the program's memory.

● Preprocessing: transforming the dataset. For example, in image classification, we might resize, whiten, shuffle, or batch images.

● Feeding: shoveling examples from a dataset into a training loop.

The tf.data.Dataset class

Pagina 13

The TensorFlow Dataset class serves two main purposes:

● It acts as a container that holds training data.● It can be used to perform alterations on elements of the training data.

Data augmentation

Pagina 14

Let's augment the CIFAR-10 dataset by performing the following steps on every image:

● Pad the image with a black, four-pixel border.● Randomly crop a 32 x 32 region from the padded image.● Flip a coin to determine if the image should be horizontally flipped.

Blocks of the Residual Networks (ResNet)

Pagina 15

Training the model and #GPU

Pagina 16

A Keras model needs to be compiled before training. Compilation essentially defines three things: the loss function, the optimizer and the metrics for evaluation:

Setting up a data pipeline

Pagina 17

● Loading: Copying the dataset (e.g. images and labels) from storage into the program's memory.

● Preprocessing: transforming the dataset. For example, in image classification, we might resize, whiten, shuffle, or batch images.

● Feeding: shoveling examples from a dataset into a training loop.

Tensorboard & Learning rate schedule

Pagina 18

Model fit

Pagina 19

References

Pagina 20

● https://lambdalabs.com/blog/tensorflow-2-0-tutorial-01-image-classification-basics/

● https://github.com/tensorflow/docs/blob/master/site/en/tutorials/quickstart/advanced.ipynb