1. A method for exchanging information in a shared interactive environment, comprising: selecting a first object wherein the first object is one of 1) a first physical device at a remote location shown in a live video image, and 2) an icon on a computing device, wherein the live video image shows a view of the remote location which includes a plurality of physical devices including the first physical device; causing information associated with the first object to be transferred to a second object wherein the second object is the other of 1) the first physical device at the remote location shown in the live video image, and 2) the icon on the computing device; annotating the view of the remote location shown in the live video image with an annotation; automatically transferring the annotation to the first physical device if the annotation is at least partially drawn over the first physical device as it appears in the live video image; displaying the annotation on the first physical device such that the annotation can be viewed at the remote location; wherein the first physical device has a dynamically defined hotpot in the live video image; wherein the transfer is brought about by manipulating a visual representation of the information in the live video image; wherein manipulating includes interacting with the first object in the live video image and the second object; and wherein the first physical device is part of the shared interactive environment.