We first describe phase 1).
We define a reward function \(\mathcal {R} : S^\otimes \rightarrow \mathbb {R}\)  and a discount factor function \(\Gamma : S^\otimes \rightarrow \lbrace \gamma , \gamma _{acc} \rbrace \)  inspired by [1]}, where \(\gamma , \gamma _{acc} \in (0,1)\) , as follows.

R (s) =
{
\(& (1 - \gamma _{acc})r_n & &\text{if} \ s \in Acc^\otimes , \\& 0 & &\text{otherwise},\) 
