1. A mail sorting system, comprising: an imaging device configured to obtain an image of a mail piece being sorted; an image recognition device configured to process the image into image data; a processor configured to: compare the image data with a plurality of patterns, wherein each of the plurality of patterns are associated with a corresponding confidence threshold, and wherein the plurality of patterns identify spatial information of corresponding pattern field elements; determine a confidence level of the comparison of the image data according to a success in matching the image data with the pattern field elements; compare the confidence level with the confidence threshold associated with the pattern; if the confidence threshold is met, select the corresponding pattern; and assemble output associated with the selected pattern, wherein the output corresponds to a predetermined format; and an output device configured to apply the output to the mail piece.