now there remained for the ageing educator a more passive game that had been a minor passion with the winters family for generations , initially making its appearance on the lawn of their mansion in oyster bay during the early twenties .