Bi directional recurrent neural network with ranking loss for spoken language understanding
This paper presents our latest investigation of recurrent neural networks for the slot filling task of spoken language understanding. We implement a bi directional Elman type recurrent neural network which takes the information not only from the past but also from the future context to predict the semantic label of the target word. Furthermore, we propose to use ranking loss function to train the model. This improves the performance over the cross entropy loss function. On the ATIS benchmark data set, we achieve a new state of the art result of 95.56% F1 score without using any additional knowledge or data sources.
2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)