1. An image-based object tracking system, comprising: an object, on a surface of the object is disposed with a color stripe, the color stripe dividing the surface of the object into a first section and a second section; a camera, configured to capture real-time images of the object; a computing device, an object tracking algorithm is stored in the computing device; and a display device, comprising a display screen and electrically connected to the computing device, and the display screen configured to display the real-time images of the object; wherein, when the computing device starts the operation of the object tracking algorithm, the computing device performs the following steps: (i) checking whether color characteristics of the object stored in a database of the computing device, otherwise starting a step of color learning to store the color characteristics of the object in the database of the computing device; (ii) creating an object tracking window; and (iii) when the image of the object enters into the object tracking window, tracking the position of the object based on the color characteristics of the object stored in the database; wherein the step (iii) comprises: based on the color characteristics of the object stored in the database, splitting the image of the object and the image of a background in which the object exists; labeling the first section and the second section of the object; pairing the first section and the second section; and tracking the position of the object.