1. An image processing apparatus of a mobile terminal, the apparatus comprising: a camera module configured to receive an image or video captured by at least a pair of cameras installed in the mobile terminal; a display unit; a communication unit configured to exchange information with a three-dimensional (3D) television (TV); an encoder; a decoder; and a controller operatively connected to the camera module, the display unit, the encoder, the decoder and the communication unit, the controller configured to convert the image or video received by the camera module into one of a three-dimensional (3D) image and a 3D video corresponding to a 3D image format of the 3D television; control the encoder such that the 3D image or 3D video is encoded by the encoder; determine whether or not the communication unit is connected to the 3D television via a high definition multimedia interface (HDMI) connection or a server via a H.264 connection; control the decoder such that the encoded 3D image or 3D video is decoded by the decoder if the communication unit is determined to be connected to the 3D television via the HDMI connection; transmit the decoded 3D image or 3D video to the 3D television if the communication unit is determined to be connected to the 3D television via the HDMI connection; and transmit the encoded 3D image or 3D video to the server, without decoding the encoded 3D image or 3D video, if the communication unit is determined to be connected to the server via the H.264 connection, wherein the controller is configured to generate a 3D image format setup menu for setting the 3D image format of the 3D television, and display the 3D image format setup menu on the display unit, and when an icon denoting a particular type of 3D glasses displayed on the 3D image format setup menu is selected, the controller is configured to convert the image or video received by the camera module into the 3D image format corresponding to the 3D television, wherein the controller is configured to convert the 3D image or 3D video into an image having one of a side-by-side format and a frame sequential format.