1. A value function representing method of reinforcement learning characterized by dealing with an incomplete perception problem by using a complex number value function for a value function and introducing time series information into a phase part of a complex number or the phase part and an amplitude part.