1. A system for detecting a hitch angle between a vehicle and a trailer, comprising: an imaging device configured to capture images of the trailer; a controller configured to: process images captured by the imaging device; derive a template image; rotate the template image relative to a search image about an imaged hitch point that is common to the template image and the search image, wherein the location of the imaged hitch point corresponds to a selected one of a number of candidate hitch point locations having a highest confidence score based on a match quality between the template image and the search image; and determine the hitch angle based on an angle at which the template image is rotated relative to the search image to generate a match therebetween.