This phase II trial studies regorafenib in treating patients with neuroendocrine tumors that have spread from the primary site (place where it started) to other places in the body. Regorafenib may stop the growth of tumor cells by blocking some of the enzymes needed for cell growth.