1. A method of coding light ray information that is pixel data arranged in two dimensions obtained by receiving a ray of light from a subject by an image pickup element and includes information about a position on a predetermined surface and information about an incident angle when a ray of light from a subject enters the surface, comprising: dividing the light ray information into two or more two-dimensional blocks including two or more of the pixel data and information about an angle of the ray of light spreading in a different direction from the subject; obtaining two or more processing unit blocks, wherein each of two or more processing unit blocks comprises of two or more two-dimensional blocks; executing a first coding process to obtain first block unit information composing first image information about the subject by coding each of the processing unit blocks; and executing a second coding process to obtain second block unit information composing second image information different types from the first image information by coding each of the processing unit blocks, wherein the first coding process is applied to pixel data of a predetermined pixel in each of the two or more two-dimensional blocks in the processing unit block and the second coding process is applied to pixel data of pixels other than the predetermined pixel, and wherein the second coding process includes coding of a word which is obtained by sequentially generating two or more difference data between pixel data of adjacent pixels in the two-dimensional block, taking the predetermined pixel as a start point, and by arranging the generated two or more difference data in one dimension.