hereinafter , a game machine to which a game system according to an embodiment of the present invention is applied will be described with reference to the drawings . incidentally , the game machine of the present invention provides a game of an action type in which a player explores a virtual game space and carries out a predetermined mission by operating a character ( which may be hereinafter referred to as a “ player character ”) set as an operation target . fig1 is a diagram schematically illustrating an external appearance of a game machine 1 . as illustrated in fig1 , the game machine 1 includes a dedicated housing 2 of a jug type . an elliptical space is formed inside the dedicated housing 2 , and the player plays a game inside the dedicated housing 2 . fig2 is a diagram schematically illustrating the inside of the dedicated housing 2 . as illustrated in fig2 , a game machine main body 3 , a large monitor 4 ( for example , a liquid crystal display device ( lcd )) serving as a main display device , and two gun - type controllers 5 serving as an input device that symbolizes a weapon given to the player are provided inside the dedicated housing 2 . in addition , a small monitor 7 serving as a sub display device is provided on an upper portion of each gun - type controller 5 . incidentally , although not illustrated in the drawings , the game machine main body 3 may be provided with various kinds of input devices and output devices disposed in a typical game machine for business such as a button to make a selection or a decision , a power switch , and a volume operating switch . various kinds of devices are stored inside the game machine main body 3 . fig3 is a schematic diagram illustrating a control system of the game machine 1 including some of various kinds of devices in the game machine main body 3 . as illustrated in fig3 , a control unit 10 , a speaker unit 11 , and an external storage device 12 are included as various kinds of devices in the game machine main body 3 . the control unit 10 is configured as a computer unit in which a microprocessor is combined with peripheral devices such as a main storage device ( a random access memory ( ram ) or a read only memory ( rom )) or the like , which are necessary for an operation of the microprocessor . the large monitor 4 , each small monitor 7 , the gun - type controller 5 , the speaker unit 11 , and the external storage device 12 are connected to the control unit 10 . besides , various kinds of peripheral devices can be connected to the control unit 10 , but illustration thereof is not provided . the external storage device 12 is a storage device including a non - volatile storage medium such as a magnetic storage medium , an optical storage medium , an electrically erasable programmable read - only memory ( eeprom ). in addition to an operating system to implement basic control of the control unit 10 , a game program 14 serving as application software to execute a game according to a predetermined procedure , and a game data 15 appropriately referred to by the game program 14 are recorded in the external storage device 12 . the game data 15 includes a variety of image data of an object or the like . as the control unit 10 reads and executes the game program 14 , various kinds of logical devices necessary for execution of a game are generated in the control unit 10 . an image processing unit 16 is formed in the control unit 10 as one of the logical devices . the image processing unit 16 executes various kinds of calculation processes necessary for generating an image to be displayed on the large monitor 4 and each small monitor 7 . the details of the image processing unit 16 will be described later . the gun - type controller 5 is provided with a sighting detecting sensor ss serving as a detecting device . fig4 is a perspective view of the gun - type controller 5 seen from the right front . the sighting detecting sensor ss detects a direction in which a muzzle 5 j faces . various kinds of known sensors may be used as the sighting detecting sensor ss . in the present embodiment , as an example of the sighting detecting sensor ss , as will be described later , a biaxial sensor using a lever , which detects a moving direction of the gun - type controller 5 , is installed inside a platform to which the gun - type controller 5 is attached . however , the present invention is not limited to this embodiment , and various kinds of sensors such as a gyroscopic sensor , a geomagnetic sensor , or an acceleration sensor may be used as the sighting detecting sensor ss . fig5 is a diagram schematically illustrating the movable range of the gun - type controller 5 . both of two arrows a and b of fig5 represent the movable range of the gun - type controller 5 . as illustrated in fig5 , the gun - type controller 5 is configured so as to be able to move in both in a horizontal direction and a vertical direction . a range in the vertical direction indicated by the arrow a from below to above the large monitor 4 and a range in the horizontal direction indicated by the arrow b from one side to the other side of the dedicated housing 2 are set as the movable range . the sighting detecting sensor ss detects a direction in which the muzzle 5 j faces in the movable range indicated by the arrows a and b . incidentally , in fig5 , for convenience of description , the movable range is illustrated for each gun - type controller 5 , but in each actual gun - type controller 5 , the movable range is set in both the corresponding vertical direction and the horizontal direction . in addition , in the gun - type controller 5 , a small camera 8 serving as a photographing device is provided in front of the small monitor 7 as illustrated in fig4 . each small camera 8 can photograph a predetermined range related to a direction in which the muzzle 5 j of each gun - type controller 5 faces . each gun - type controller 5 outputs an image imaged by each small camera 8 to the control unit 10 . in addition , each gun - type controller 5 is provided with a trigger unit 5 t serving as an operating unit that receives the player &# 39 ; s operation . each gun - type controller 5 outputs a signal corresponding to an operation of each trigger unit 5 t to the control unit 10 . next , an example of an image displayed on each of the monitors 4 and 7 will be described . fig6 is a diagram schematically illustrating an example of the inside of the dedicated housing 2 in which the player is playing a game . fig6 illustrates an example in which the game of the game machine 1 is being played by two players . each player uses each gun - type controller 5 . the large monitor 4 displays a main image mg representing a form of a virtual 3d game space ( not illustrated ) such as an indoor place set as a place in which a player character moves . the virtual 3d game space is one in which a game space logically generated on a memory and displayed as the main image mg is expressed as a 3d model . in the example of fig6 , one player p is playing a game in a state in which the muzzle 5 j of the first gun - type controller 5 a faces the main image mg of the large monitor 4 . meanwhile , the small monitor 7 of each gun - type controller 5 displays a sub image sg according to a direction in which the muzzle 5 j faces . an image photographed by the small camera 8 provided in each gun - type controller 5 is used as the sub image sg . in the example of fig6 , the other player ( not illustrated ) causes the muzzle 5 j of the second gun - type controller 5 b to face one player p . in this case , the small monitor 7 of the second gun - type controller 5 b displays an image of a real space photographed by the small camera 8 , that is , the player p who is playing the game and the first gun - type controller 5 a , and parts of the game machine main body 3 and the large monitor 4 as the sub image sg . furthermore , an enemy character ac is present on the sub image sg . the enemy character ac is not present on the real space photographed by the small camera 8 and present only on the sub image sg . in other words , each small monitor 7 displays an image in which the image of the real space photographed by each small camera 8 is synthesized with images of various kinds of objects such as the enemy character ac as the sub image sg . various kinds of objects present in the image of the real space are dealt in the same manner as various kinds of objects in the virtual 3d game space present in the large monitor 4 . in other words , the enemy character ac is dealt as a target on which an action such as an attack is executed , similarly to when the enemy character ac is present in the main image mg . a sighting marker sm representing the position that the muzzle 5 j faces is displayed on the center of each sub image sg . fig6 illustrates an example in which the sighting marker sm overlaps one of the enemy characters ac , and the trigger unit 5 t of the second gun - type controller 5 b is operated in this state . as described above , the player causes the game to progress based on the range displayed on the main image mg of the virtual 3d game space , and the player is required to cope with an extended real space in which images of various kinds of objects are synthesized with the image of the real space through the small monitor 7 . incidentally , various kinds of other information such as a gauge as well as the above - mentioned information are appropriately displayed on the large monitor 4 and each small monitor 7 . next , a process executed by the image processing unit 16 ( see the control unit 10 of fig3 ) will be described . the image processing unit 16 renders the main image mg according to a procedure of a so - called 3d computer graphics process in order to display the above - described main image mg on each monitor 4 . the rendering is actualized such that the image processing unit 16 constructs the virtual 3d game space , sets a virtual camera in the virtual 3d game space , and generates a 2d image of a space photographed by the virtual camera . specifically , the image processing unit 16 controls a point - of - view position and a photographing direction of the virtual camera , and virtually photographs a space of a part of the 3d virtual game space through the virtual camera . in addition , the image processing unit 16 calculates a 2d image in which the photographed virtual 3d game space is projected on the virtual screen . and , the image processing unit 16 renders the obtained 2d image on a frame memory , and outputs an image signal corresponding to the rendered image data to the large monitor 4 with a predetermined period . as a result , the main image mg is displayed on the large monitor 4 . incidentally , a display element such as a gauge to be superimposed on the main image mg is rendered such that the display element is appropriately superimposed on a frame memory . in addition , positions of various kinds of objects and the position of the virtual camera in the virtual 3d game space are defined by 3d coordinates according to a tri - axial orthogonal coordinate system ( world coordinates ) of x , y , and z axes . a series of processes such as arrangement of various kinds of objects in the virtual 3d game space , the point of view of the virtual camera , control of the virtual camera according to the photographing direction , and photographing by the virtual camera are performed using a known process such as a modeling process and a rendering process in the 3d computer graphics process . further , in order to cause the sub image sg to be displayed on the small monitor 7 , the image processing unit 16 executes a synthesis image generating process illustrated in fig7 with a predetermined period ( or when a certain condition such as a progress state of a game is satisfied ). fig7 is a flowchart illustrating an example of a synthesis image generating process routine executed by the image processing unit 16 . as illustrated in fig7 , in step s 1 , the image processing unit 16 calculates a photographing range photographed by the small camera 8 based on a signal from the sighting detecting sensor ss . specifically , first , a direction of the muzzle 5 j is calculated based on the signal from the sighting detecting sensor ss . for example , this calculation is actualized by calculating a change angle ( in both the horizontal direction and the vertical direction ) from the initial position set to the muzzle 5 j . for example , the position at which a plane forming the muzzle 5 j is parallel to the large monitor 4 may be used as the initial position of the muzzle 5 j . then , the image processing unit 16 calculates a predetermined range in a direction in which the muzzle 5 j faces based on the calculated direction of the muzzle 5 j as the photographing range , so that the process of step s 1 is actualized . next , in step s 2 , the image processing unit 16 calculates positions of various kinds of fixed devices such as the large monitor 4 , the gun - type controller 5 , and the game machine main body 3 in the photographing range . for example , this calculation is actualized by comparing positions of various devices which are set in advance with respect to the initial position of the gun - type controller 5 with the change angle of the gun - type controller 5 and calculating changed positions of various devices in the photographing range . next , in step s 3 , the image processing unit 16 calculates positions of various kinds of objects to be arranged with respect to various kinds of devices by a comparison with the positions of various kinds of devices calculated in step s 2 . in step s 4 , a synthesis image in which the image photographed by the small camera 8 is synthesized with images of various kinds of objects is generated on a frame memory such that various kinds of objects are arranged on the positions calculated in step s 3 . next , in step s 5 , an image signal corresponding to image data of the synthesis image generated in step s 4 is output to each small monitor 7 in a predetermined period , and then the current routine ends . as a result , the sub image sg is displayed on the small monitor 7 . as described above , according to the game machine of this embodiment , various kinds of objects such as the enemy character ac can be synthesized with the image of the real space photographed by each small camera 8 , and the synthesis result can be displayed on each small monitor 7 as the sub image sg . in addition , various kinds of objects in the sub image sg are dealt in the same manner as various kinds of objects in the main image mg . thus , the space which can be used for the progress of a game or the like can be extended to the real space as well as the virtual 3d game space . additionally , each small camera 8 is provided in each gun - type controller 5 operated by the player , and the photographing range is set by the player . as a result , since the player &# 39 ; s operation can be reflected in the real space to be extended , realistic sensation of the game can be improved . accordingly , as a result , amusement of the game can be improved . in the above embodiment , the control unit 10 functions as a synthesis image output device by executing the routine of fig7 . in addition , a combination of the small camera 8 and the control unit 10 functions as an image generating device by executing the routine of fig7 . the present invention is not limited to the above embodiment and can be actualized in an appropriate embodiment . in the above embodiment , each small camera 8 is provided in each gun - type controller 5 , but the present invention is not limited to this embodiment as long as an area around the main display device 4 can be photographed . for example , the photographing device may be provided in a fixed position different from an input device . fig8 a and 8b are diagrams illustrating an example in which a photographing device is provided in a fixed position . fig8 a illustrates an example of an image photographed by the photographing device installed at the fixed position , and fig8 b illustrates an example of an image photographed by the photographing device after a predetermined time from the state of fig8 a . as illustrated in fig8 a , in the photographing range of the photographing device , an area around the main display device 4 including each player , each gun - type controller 5 , and the main display device 4 is included . in addition , as illustrated in fig8 b , the enemy character ac present in the main image mg of the main display device 4 in fig8 a runs out up to the range corresponding to the real space . in this case , each small monitor 7 may be configured so as to calculate a predetermined range in a direction in which the muzzle 5 j of each gun - type controller 5 faces and output an image corresponding to the range calculated from the image photographed by the photographing device . in the above embodiment , the image photographed by each small camera 8 is used as a predetermined image , and various kinds of objects are synthesized with this image , but the present invention is not limited to this embodiment . for example , the photographing device may not be provided , and a 2d image generated based on a space of a part of the virtual 3d game space may be used as the predetermined image . in this case , for example , based on the same image representing the form of the same virtual 3d space , an image including a friendly character can be displayed on the main display device , and an image in which the enemy character is synthesized with the friendly character ( that is , an image in which a character that is the friendly character on the main display device changes to the enemy character on the sub display device ) can be displayed on the sub display device . as a result , the virtual 3d game space can have multiplicity . alternatively , when a range of the virtual 3d game space which is in common with the main display device is calculated as a range to be displayed on the sub display device , a 2d image based on the virtual 3d space may be used ; when the other ranges are calculated as ranges to be displayed on the sub display device , an image photographed by the photographing device may be used , so that a synthesis image may be generated by combining the virtual 3d game space with the real space . in the above embodiment , an operation of the gun - type controller is used as the player &# 39 ; s action , but the present invention is not limited to this embodiment . for example , the player &# 39 ; s line of sight may be used as the player &# 39 ; s action . for this reason , in the above embodiment , a gyroscopic sensor or the like is used as an example of the detecting device that detects an operation of the input device , but a target detected by the detecting device is not limited to this operation . thus , a device that can detect the player &# 39 ; s action may be used as the detecting device . a known line - of - sight detecting sensor may be used as an example of the detecting device that detects the player &# 39 ; s action to detect the player &# 39 ; s line of sight . in addition , as an example of the line - of - sight detecting sensor , there may be used a sensor of a type that receives infrared light irradiated toward an observer ( player ) from a plurality of places around an observation target ( the large monitor 4 or the like ) through a light receiving unit installed at an observer side , and detects a direction in which the light receiving unit faces based on a light reception state . alternatively , a camera may be used as another example of the detecting device . as an example of an embodiment in which a camera is used as the detecting device , the player &# 39 ; s action such as a direction of the muzzle of the gun - type controller may be detected by processing an image photographed by the small camera 8 installed in the gun - type controller , an image photographed by a camera installed around the player , or the like . in addition , the condition such as the predetermined period or the progress state of a game is used as an example of the execution condition of the routine of fig7 , but the present invention is not limited to these conditions . for example , an option of a game , a level of a player , a certain operation of a player , or the like may be used as the execution condition of the routine of fig7 . in addition , the small monitor 7 is not limited to the embodiment in which the small monitor 7 is installed in the input device , and for example , the small monitor 7 may be installed at a fixed position near the input device . in addition , in the above embodiment , the gun - type controller imitating a gun is used as the input device , but the present invention is not limited to this embodiment , and , for example , various input devices such as an input device imitating a bow may be used as the input device .
disclosed is a game system wherein two - dimensional images are generated on the basis of a virtual three - dimensional space used in the progression of a game , and a game screen using said two - dimensional images is displayed on a large monitor . said game system is provided with : small monitors separate from the large monitor ; and small cameras that can image the area around the large monitor . the game system combines images taken by the small cameras together with other images and outputs the results to the small monitors .