St. Anne's Church (facing Anne Street South) has some colorful 19th-century stained glass, and provides the setting for lunchtime concerts (look for the notices in the vestibule).
St. Anne's Church offers lunchtime concerts twice a week.