predictions = Dense(output_dim=num_classes, activation='softmax', name=
    'newDense')(predictions)
Training a dense layer from bottleneck features vs. freezing all layers but the last - should be the same, but they behave differently