You can use a conventional refinance to eliminate your FHA loan insurance altogether, or you can reduce your mortgage insurance premium by refinancing into another FHA loan. You may have a higher rate of MIP than what is available today. Here is a history of FHA MIP. Prior to January 2008 : 0.50% annual MIP; October 2008 : 0.55% annual MIP