1. A method of extracting content from a note with color segments using a computer system having one or more processors and memories, comprising: receiving, by the one or more processors, image data comprising a visual representation of a note having a plurality of predefined color segments; generating, by the one or more processors, a plurality of indicators, each indicator indicative of a color class of a respective pixel or group of pixels in the image data and based on color values of the pixel or group of pixels; based on the generated plurality of indicators, determining, by the one or more processors, general boundaries within the image data of the color segments; and extracting, by the one or more processors and from the image data, content comprising a set of multiple content pieces using the general boundaries, each of the content pieces corresponding to a different one of the color segments of the note.