Phi Divergence Constrained Ambiguous Stochastic Programs for Data Driven Optimization
This paper investigates the use of ph divergences in ambiguous (or distributionally robust) two stage stochastic programs. Classical stochastic programming assumes the distribution of uncertain parameters are known. However, the true distribution is unknown in many applications. Especially in cases where there is little data or not much trust in the data, an ambiguity set of distributions can be used to hedge against the distributional uncertainty. ph divergences (e.g. Kullback Leibler divergence, kh distance, etc. provide a natural way to create an ambiguity set of distributions that are centered around a nominal distribution. The nominal distribution can be obtained by using observed data, expert opinions, simulations, and so forth. In this paper, we present a classification of ph divergences to elucidate their use for models with different properties and sources of data. We illustrate our classification on ph divergences that result in common risk optimization models. A condition for assessing the value of collecting additional data is derived, and we demonstrate that the ph divergence based ambiguous program behaves essentially the same as the associated non ambiguous stochastic program as more data is collected. We present a decomposition based solution algorithm to solve the resulting model. Finally, we demonstrate the behavior of ph divergences in an optimization setting for a numerical example.