ImageNet Inception v3

class deepobs.tensorflow.testproblems.imagenet_inception_v3.imagenet_inception_v3(batch_size, weight_decay=0.0005)[source]

DeepOBS test problem class for the Inception version 3 architecture on ImageNet.

Details about the architecture can be found in the original paper.

There are many changes from the paper to the official Tensorflow implementation as well as the model.txt that can be found in the sources of the original paper. We chose to implement the version from Tensorflow (with possibly some minor changes)

In the original paper they trained the network using:

  • 100 Epochs.
  • Batch size 32.
  • RMSProp with a decay of 0.9 and \(\epsilon = 1.0\).
  • Initial learning rate 0.045.
  • Learning rate decay every two epochs with exponential rate of 0.94.
  • Gradient clipping with threshold 2.0
Parameters:
  • batch_size (int) -- Batch size to use.
  • weight_decay (float) -- Weight decay factor. Weight decay (L2-regularization) is used on the weights but not the biases. Defaults to 5e-4.
dataset

The DeepOBS data set class for ImageNet.

train_init_op

A tensorflow operation initializing the test problem for the training phase.

train_eval_init_op

A tensorflow operation initializing the test problem for evaluating on training data.

test_init_op

A tensorflow operation initializing the test problem for evaluating on test data.

losses

A tf.Tensor of shape (batch_size, ) containing the per-example loss values.

regularizer

A scalar tf.Tensor containing a regularization term.

accuracy

A scalar tf.Tensor containing the mini-batch mean accuracy.

set_up()[source]

Set up the Inception v3 test problem on ImageNet.