This study is evaluating how ruxolitinib affects premalignant breast cells. One half of the study participants will receive ruxolitinib for approximately 15 days, and the other half will receive a placebo (sugar pill) for approximately 15 days. Once study participants have completed their ruxolitinib or placebo, participants will undergo surgery to remove the premalignant breast tissue.