1. A method for annotating general objects contained in video content, the method comprising: sending video data to a client device; receiving a first annotation from the client device defining a boundary around a portion of a first frame of the video data; tracking the first annotation through multiple frames of the video content; determining other annotations determined to be associated with annotation that match the first annotation within a threshold, the other annotations being received from other client devices and being located in the first frame or other frames from the first frame; combining the other annotations and the first annotation into an object track for an object; and associating a tag with the object in the object track, the tag being input by at least one of the client devices.