1. A non-transitory computer-readable physical storage medium having tangibly recorded thereon a video game program to be executed by a computer of a video game device, wherein the video game program obtains control data from a control device including an image capturing unit that captures an image of a marker object, wherein the control data is captured image data obtained by the image capturing unit or data obtained by performing a predetermined operation on the captured image data, wherein the video game program displays a game image on a display device, the game image being an image of a virtual game space in which a controlled object is moved by a game process using the control data, and wherein the video game program instructs the computer to perform: displaying a reference image at a predetermined position on a screen of the display device; displaying a pointer image at a position on the screen pointed at by the control device; not controlling the controlled object when the pointer image has not reached inside a predetermined area including at least a portion of the reference image, and controlling the controlled object to act according to a position of the marker object in the captured image based on the control data after the pointer image reaches inside the predetermined area, wherein: the video game program instructs the computer to further perform detection determination for determining whether or not a position of at least one marker object is in the captured image; and the displaying a reference image and the displaying a pointer image are performed when it is determined that at least one marker position is not detected in the captured image.