This pilot phase I/II trial studies the side effects and best dose of plerixafor after radiation therapy and temozolomide and to see how well it works in treating patients with newly diagnosed high grade glioma. Plerixafor may stop the growth of tumor cells by blocking blood flow to the tumor. Drugs used in chemotherapy, such as temozolomide, work in different ways to stop the growth of tumor cells, either by killing the cells or by stopping them from dividing. Radiation therapy uses high energy x rays to kill tumor cells. Giving plerixafor after radiation therapy and temozolomide may be an effective treatment for high grade glioma.