In this research study, the investigators are evaluating the activity of fulvestrant alone, fulvestrant and palbociclib, or fulvestrant, palbociclib, and avelumab combined, in participants with metastatic hormone receptor positive HER2 negative breast cancer that has previously stopped responding to prior palbociclib and endocrine therapy.