As mentioned previously, in this hybrid system, we use an actor-critic neural coreference model, where two neural networks are trained to model the actor and critic separately. One important reason that we use an actor-critic model instead of other reinforcement learning models is because it is known to converge more smoothly and have better training performance on a system with a large state space [1]}, which is like our scenario.
