We associate the estimated value of the state-action function in Q-LKH to each city and call it Q-value of the city. It is used as the basis for selecting and sorting the candidate cities. The initial Q-value \(Q(i,j)\)  for the candidate city \(j\)  of city \(i\)  is deﬁned the same as that in ([1]} [1]}):
\(Q(i,j)=\frac{w(\pi )}{\alpha (i,j)+d(i,j)}.\) 
