Since the update rule is now independent of the next action taken, and rather dependent on the expected action-value, Expected Sarsa can indeed converge [1]}. In case of a greedy policy \(\pi \) , Expected Sarsa is the same as Q-learning.
