1. A color chart detection apparatus that detects a color chart from an image representing the color chart, the color chart including a plurality of palettes arranged in a predefined order, the apparatus comprising: a palette color pixel extracting unit which, for each of a predetermined number, not smaller than three, of palettes selected from among the plurality of palettes, extracts any pixel having a color component corresponding to the palette from the image; a combination detecting unit which selects at least three palettes from the predetermined number of palettes to form a first group and which, when a combination of pixels selected on a palette-by-palette basis from among the pixels extracted for the respective palettes included in the first group is arranged in accordance with the predefined order, detects each of the pixels included in the combination as being a candidate pixel that is likely to represent a corresponding one of the palettes included in the first group; and a palette information computing unit which, based on the candidate pixel, computes color information representing color of the palette corresponding to the candidate pixel on the image and position information representing position of the corresponding palette on the image.