Actually, Mr. Key, while a slaveowner at one point, freed his slaves and went on to work to free other slaves.

And the anthem does not endorse slavery at all. The "slaves" to which it refers were those people who were impressed into naval service, which was quite common at that time. Indeed, as you may recall, it was one of the causes of the War of 1812: Americans were being pressed into service.