Letâs say you have $300,000 in retirement savings and plan to withdraw 4 percent ($12,000) annually for 30 years. If your portfolio declines by 10 percent in the first year of your retirement, itâs already sunk to $258,000 at the end of year one, including your first year of withdrawals.