The goal of this multi-center, open-label trial is to measure the impact of treating metastatic anaplastic thyroid cancer patients with immune checkpoint therapy. This trial will potentially lead to the development of new therapy for anaplastic thyroid cancer. The drug to be administered, pembrolizumab is FDA approved with known side effects and is active in many tumor types.