Similarly, define \(F_i(x) \triangleq \mathbb {E}_\mathbf {D}[\hat{F}_i(x)]\) . First, from classical generalization results such as Theorem 26.5 of [1]} or Theorem 3.3 of [2]}, we directly conclude the following proposition, which bounds the true loss of the classifier as a function of the empirical loss.
