1. A computer implemented method for navigating in panoramic image data, comprising: determining, by one or more computing devices, an intersection of a ray, extended from a camera viewport through a position of a first panoramic image, and a three-dimensional virtual model, wherein the position is selected by a user; determining, by one or more computing devices and based on the intersection, a second panoramic image such that the second panoramic image is located according to the intersection of the ray and the three-dimensional virtual model; retrieving, by one or more computing devices, the second panoramic image; orienting, by one or more computing devices, the retrieved second panoramic image to face the intersection; and displaying, by one or more computing devices, the oriented second panoramic image to the user to navigate from the first panoramic image to the second panoramic image.