The goal of this clinical research study is to learn if tremelimumab in combination with MEDI4736 can help to control colorectal cancer that has spread to the liver. The safety of these drugs will also be studied.