Voters unseated one-term Mayor Michael L. O'Reilly and two Town Council members who supported creation of the day labor center. They replaced them with challengers who want to bar the use of taxpayer money for the facility and limit access to legal immigrants. Fewer than 2,600 people voted.