Why You Should Refinance Out of FHA into a Conventional Loan – Closing costs. One of the disadvantages of refinancing out of a FHA loan into a conventional loan are the closing costs. Closing costs are fees charged by lenders for originating the loan. The average closing costs are between 1.5% – 3% of the loan amount. On a $200,000 mortgage the closing costs can be as high as $6,000.