1. A method implemented by one or more computing devices to improve feature tracking through an image sequence, the method comprising: tracking one or more features in the image sequence including a plurality of frames by the one or more computing devices, the tracking including detecting the one or more features in the image sequence by the one or more computing devices, the detecting including, for each feature: computing an energy value for one or more color channels of the feature in at least one frame of the image sequence by the one or more computing devices; and comparing the computed energy value for the one or more color channels to a threshold by the one or more computing devices; and for at least one detected feature, tracking the respective feature by the one or more computing devices according to at least one color channel for which the respective energy value is determined to be above the threshold such that at least one other color channel for which the respective energy value is determined to be below the threshold is not used in said tracking by the one or more computing devices.