You can drive the sight in the dovetail to correct for windage, and if necessary file it down to correct for elevation.
This was often done on the original guns during the 19th century, but they used sights intended for muzzle loading rifles.