1. An apparatus for bi-directional sign language/speech translation in real time comprising: a processor; and a non-transitory computer readable medium storing program instructions, when executed, causing the processor to: analyze a used pattern of sign language by a user in view of current surrounding environment information of the user to generate sign category information via a pattern analyzer; recognize a speech externally made through a microphone via a speech-sign outputter and output a sign corresponding to the speech via a display of the speech-sign outputter; and recognize a sign sensed through a camera via a sign-speech outputter and output a speech corresponding to the sign via a speaker of the sign-speech outputter, wherein the pattern analyzer transmits the sign category information to the speech-sign outputter to output a text or a sign corresponding to the sign category information via the display or to the sign-speech outputter to output a speech corresponding to the sign category information via the speaker, wherein the pattern analyzer comprises a sign category keyword comparator configured to compare the sign category information with the sign corresponding to the speech or the speech corresponding to the sign to determine whether the sign category information is correct, and wherein the sign category keyword comparator transmits a signal related to whether the sign category information is correct to the speech-sign outputter or the sign-speech outputter to block the text, the sign, or the speech corresponding to the sign category information.