But as the mass increases, so does the influence of gravity.
Gravity wins: it doesn't matter what the composition is (metal, ice, rock) or the history (getting knocked around), because gravity is strong enough to shape the object into a sphere.