1. A three-dimensional (3D) pointing sensing apparatus, comprising: an image generation unit to photograph a first light source and a second light source in a light emitting unit, and to generate an image including an image of the first light source and an image of a second light source, wherein light emitted from the first light source and light emitted from the second light source pass through a hole of the three-dimensional (3D) pointing sensing apparatus; and an orientation calculation unit to calculate an orientation of a vector between the first light source and the second light source of the light emitting unit, using a size difference between the image of the first light source and the image of the second light source in the image to calculate a first angle of the vector with respect to a first two dimensional plane of the image generation unit using at least one processing device, wherein the orientation calculation unit calculates the orientation of the vector between the first light source and the second light source based in part on the first angle of the vector, wherein the orientation calculation unit calculates the orientation of the vector between the first light source and the second light source of the light emitting unit, using a position of the image of the first light source and a position of the image of the second light source to calculate a second angle of the vector with respect to a second two dimensional plane of the image generation unit, and wherein the orientation calculation unit calculates the orientation of the vector between the first light source and the second light source based on the first angle of the vector and the second angle of the vector.