Comparison with online learning. Online learning studies problems where a learner interacts with a set of experts such that at each learning round the learner makes decision based on advice received from the experts [1]}, [2]}. The learner may observe the loss associated with a subset of experts after decision making, which can be modeled using a feedback graph [3]}, [4]}. In EFL-FG, each pre-trained model is also viewed as an expert. However, there is a major innovative difference compared with online learning with feedback graph: the proposed EFL-FG constructs and refines the feedback graph to improve the performance while in online learning, the feedback graph is generated in an adversarial manner.
