1. A system for determining behavior data used by an autonomous vehicle, the system comprising: a memory configured to store an object model; and one or more processors in communication with the memory, the one or more processors configured to: identify a type of driving environment and a geographic location of the driving environment; receive, from a monitoring source, object data associated with a detected object; analyze the object data to determine an object classification for the detected object, the object classification identifying a class of objects; determine whether an object model currently exists for the object classification, wherein the object model correlates the expected behavior of objects within the determined object classification with the identified type of driving environment and the identified geographic location; determine a new object model for the object classification based on the received object data when an object model does not currently exist for the object classification; update the currently-existing object model for the object classification based on the received object data when an object model currently exists for the object classification; and control the autonomous vehicle based on the object model.