1. A biometric authentication device that performs biometric authentication based on biometric information input to a connected terminal device, the biometric authentication device comprising: a storage unit configured to store a first enrolled template and first information including a parameter representing an input environment of the first enrolled template; a receiving unit configured to receive biometric information transmitted from the terminal device, a second enrolled template stored in the terminal device, and second information including a parameter representing an input environment of the second enrolled template; an authentication unit configured to perform authentication of a person who inputs the biometric information by matching the received biometric information and the first enrolled template; a selecting unit configured to select the first enrolled template or the second enrolled template, based on the first information and the second information, when the biometric information is accepted by the authentication unit; and an updating unit configured to update the first enrolled template stored in the storage unit to the second enrolled template when the second enrolled template is selected by the selecting unit.