Our initial evaluations in AWS (shown in Figure REF ) demonstrate that, in different attempts, the inference execution time of an application (Oil Spill) on the same machine type can be highly stochastic. Similar stochasticity is found for chameleon cloud while we run the oil spill detection application 30 times within same VM instance. Hence to capture this randomness (aka consistent heterogeneity) that is caused by several factors, such as transient failures or multi-tenancy [1]}, [2]}, we base our analysis on 30 times execution of the same request within same VM.
<TABLE><TABLE>