1. A co-aperture multi-field of view (FOV) image-spectrum cooperative detection system, comprising: an infrared optical window, a large FOV two-dimensional scanning mirror, a co-aperture multi-FOV main optical system, a large FOV scanning detector, a staring infrared detector, an infrared non-imaging broadband spectrum measuring unit, a data processing unit, a control unit, and a servo system, wherein the large FOV two-dimensional scanning mirror is controlled by the servo system to rotate and adjust an orientation to aim at a target area, and is used for reflecting the light of the target area to the co-aperture multi-FOV main optical system; the co-aperture multi-FOV main optical system is used for focusing large FOV scanning infrared light to the large FOV scanning detector, focusing staring infrared light to the staring infrared detector; and at the same time, focusing the rest of light to the infrared non-imaging broadband spectrum measuring unit for spectrum measurement; the large FOV scanning detector is used for performing large FOV infrared imaging on the target area, and transmitting the infrared image after A/D conversion to the data processing unit; the staring infrared detector is used for performing staring infrared imaging on the target area, and transmitting the infrared image after A/D conversion to the data processing unit; the infrared non-imaging broadband spectrum measuring unit is used for performing spectrum measurement analysis on the target, and transmitting infrared spectrum data of the target to the data processing unit; the data processing unit is used for merging the large FOV scanning infrared image data, the staring infrared image data, and the infrared broadband spectrum data of the target; and the control unit is used for controlling, by the servo system, the large FOV two-dimensional scanning mirror to track movement of a moving target and a dynamic phenomenon according to a data processing result obtained by the merging of the data processing unit.