Blosset died without heir, and the château passed to his nephew Jean Le Veneur, Bishop of Lisieux, who became a Cardinal in 1533, and who constructed the Renaissance châtelet, known as the pavillon du cardinal Jean Le Veneur.
At the time of the French Wars of Religion (1562–98), the château was again strengthened, with the construction of the western bastion, but during the following century the sumptuous grand apartments were built.
In the 17th century, Tanneguy II Le Veneur, comte de Tillières (d.1652), was dispatched to England to negotiate the marriage of Henrietta Maria of France, sister of Louis XIII, to the future King Charles I. Tanneguy II lived on his estates at Tillières and left Carrouges to his brother Jacques, abbot of Silly.
In 1637, Jacques Le Veneur resigned his abbacy to devote himself entirely to Carrouges.
He decorated the chateau and the park, starting from plans and drawings prepared by Maurice Gabriel, an architect from Argentan.

At the end of the 18th century, Alexis Le Veneur, vicomte de Tillières (1746–1833), a soldier and progressive, was one of the supporters of the philosopher Jean-Jacques Rousseau.
He was elected mayor of Carrouges and administrator of the Orne department, then first president of the Conseil général de l'Orne, and finally represented Orne  in the Corps législatif.
He was made a Count of the Empire by Napoleon Bonaparte.
In total, the château remained in the La Veneur family for five centuries, until 23 April 1936, on which date Marie Gaston Tanneguy IX, comte Le Veneur de Tillières, sold the château into state ownership, for F200,000.
It has been classed as a monument historique since 1927, and is now in the care of the Centre des monuments nationaux.
Blosset died without heir, and the château passed to his nephew Jean Le Veneur, Bishop of Lisieux, who became a Cardinal in 1533, and who constructed the Renaissance châtelet, known as the pavillon du cardinal Jean Le Veneur. At the time of the French Wars of Religion (1562–98), the château was again strengthened, with the construction of the western bastion, but during the following century the sumptuous grand apartments were built. In the 17th century, Tanneguy II Le Veneur, comte de Tillières (d.1652), was dispatched to England to negotiate the marriage of Henrietta Maria of France, sister of Louis XIII, to the future King Charles I. Tanneguy II lived on his estates at Tillières and left Carrouges to his brother Jacques, abbot of Silly. In 1637, Jacques Le Veneur resigned his abbacy to devote himself entirely to Carrouges. He decorated the chateau and the park, starting from plans and drawings prepared by Maurice Gabriel, an architect from Argentan.
At the end of the 18th century, Alexis Le Veneur, vicomte de Tillières (1746–1833), a soldier and progressive, was one of the supporters of the philosopher Jean-Jacques Rousseau. He was elected mayor of Carrouges and administrator of the Orne department, then first president of the Conseil général de l'Orne, and finally represented Orne  in the Corps législatif. He was made a Count of the Empire by Napoleon Bonaparte. In total, the château remained in the La Veneur family for five centuries, until 23 April 1936, on which date Marie Gaston Tanneguy IX, comte Le Veneur de Tillières, sold the château into state ownership, for F200,000. It has been classed as a monument historique since 1927, and is now in the care of the Centre des monuments nationaux.
Château de Carrouges