To understand the loss topography better, we present planar views of these models using codehttps://github.com/g-benton/loss-surface-simplexes from [1]}.
We see how, in the plane covering the heuristic and generalizing models, a central barrier intrudes on the linear connecting edge between heuristic and generalizing models (Fig. REF ). On the other hand, the heuristic and generalizing models each occupy separate planes that exhibit only a small central barrier. Visibly, this barrier is smallest for the perimeter composed of generalizing models and largest for the mixed perimeter. These topographies motivate the following notion of an \(\epsilon \) -convex basin.
