things came to a head a few years ago , grandpa said , when richards tried to get the city to invoke imminent domain , claiming grandpa 's 'shack ' was an eyesore and his fishing business was a front .