Gan et al.<cite> [4]</cite> proposed Semantic Concept Network (SCN) integrating semantic concept to a LSTM network. SCN factorized each weight matrix of the attribute integrated the LSTM model to reduce the number of parameters. We employed SCN-LSTM as a language generator to verify the effectiveness of our method.