where \(p^t_\theta =\frac{\pi (s, a; \theta _{\pi })}{\pi (s, a; \theta _{old})} \)  is the probability ratio of the current policy and previous policy; \(A^\pi (s, a)\)  is the advantage function [1]}.
