Man arrested after portrait of queen defaced at Westminster Abbey June 13, 2013 -- Updated 1451 GMT (2251 HKT) Employees of Momart, an art transportation company, hold a portrait of Queen Elizabeth II before it is moved into Westminster Abbey on May 17 in London. A 41-year-old man is arrested on suspicion of causing criminal damage, police say A portrait of Queen Elizabeth II at Westminster Abbey was defaced with paint The portrait, by Ralph Heimans, is being taken down until the damage can be remedied The abbey has been the site of the coronation of English kings and queens since 1066 London (CNN) -- A man has been arrested after a portrait of Queen Elizabeth II was defaced with paint Thursday at Westminster Abbey in London, police said. The 41-year-old man is being held at a central London police station on suspicion of causing criminal damage, London's Metropolitan Police said. The suspect has not been named by police. The portrait, by the Australian-born artist Ralph Heimans, is being taken down until the damage can be remedied, the abbey said in a statement. It went on public display last month as part of the abbey's celebrations for the 60th anniversary of the queen's coronation. The 9-foot by 11-foot oil painting depicts the queen in state dress, including the crimson velvet robe she wore for her coronation in 1953, in an imagined scene at night in the abbey. According to the abbey website, it captures the queen "in a moment of solitary reflection." Last week, the queen and other royals attended a service at the abbey to mark 60 years since her coronation there. Westminster Abbey is also where Prince William married Catherine Middleton in 2011. CNN's Richard Allen Greene contributed to this report