1. A microscope system, comprising: a microscope that generates an observation image of a specimen; an image obtaining unit that obtains an RGB image of the specimen; a spectroscopic information obtaining unit that obtains spectroscopic information of the specimen; an analyzer that analyzes the RGB image; a determining unit that determines a necessity of obtaining the spectroscopic information based on a result of the analysis of the analyzer; and a control unit that controls an operation of the spectroscopic information obtaining unit based on a result of the determination of the determining unit.