1. A system of object detection across disparate fields of view, comprising: a data processing hardware system having an object detection component, an object classification component, and an object matching component, the data processing system obtains a first image generated by a first recording device, the first recording device having a first field of view; the object detection component of the data processing hardware system detects, from the first image, a first object present within the first field of view; the object classification component of the data processing hardware system determines a first level classification category of the first object and determines, from the first level classification category of the first object, a second level classification category of the first object; the data processing hardware system generates a descriptor of the first object based on at least one of the first level classification category of the first object and the second level classification category of the first object; the data processing hardware system creates, for the first object, a data structure indicating a probability identifier for the descriptor of the first object; the data processing system obtains a second image generated by a second recording device, the second recording device having a second field of view different than the first field of view; the object detection component of the data processing hardware system detects, from the second image, a second object present within the second field of view; the data processing hardware system generates a descriptor of the second object based on at least one of a first level classification category of the second object and a second level classification category of the second object; and the object matching component of the data processing hardware system correlates the first object with the second object based on the descriptor of the first object, the probability identifier for the descriptor of the first object, and the descriptor of the second object.