There have been several attempts at modeling context in robots. However, either these attempts assume a fixed number of contexts or use a rule-based approach to determine when to increment the number of contexts. In this paper, we pose the task of when to increment as a learning problem, which we solve using a Recurrent Neural Network. We show that the network successfully (with 98 testing accuracy) learns to predict when to increment, and demonstrate, in a scene modeling problem (where the correct number of contexts is not known), that the robot increments the number of contexts in an expected manner (i.e., the entropy of the system is reduced). We also present how the incremental model can be used for various scene reasoning tasks.
Although context has been widely studied in other fields, it has not received sufficient attention in the robotics community, except for, e.g., @cite_24 who used spatial relations between objects as contextual prior for object detection in a Markov Random Field; @cite_8 , who adapted Latent Dirichlet Allocation on top of object concepts for rule-based incremental context modeling; and @cite_14 , who proposed using a variant of Bayesian Networks for context modeling in underwater robots.
@cite_24 @cite_14 @cite_8
2667996719 2152608974 145548212 2157104268
This paper presents ongoing research in the SWARMs project towards facilitating context awareness in underwater robots. In particular, the focus of this paper is put on the context reasoning part. The underwater environment introduces uncertainties in context data which lead to difficulties in the context reasoning phase. As probability is the best well-known formalism for computational scientific reasoning under uncertainties, the emerging and effective probabilistic reasoning method, namely, Multi-Entity Bayesian Network (MEBN), is explored for its feasibility to reason under uncertainties in the SWARMs project. A simple use case for oil spill monitoring is used to verify the usefulness of MEBN. The results show that the MEBN is a promising approach to reason about context in the presence of uncertainties in the underwater robot field. In this paper, we formalize and model context in terms of a set of concepts grounded in the sensorimotor interactions of a robot. The concepts are modeled as a web using Markov Random Field (MRF), inspired from the concept web hypothesis for representing concepts in humans. On this concept web, we treat context as a latent variable of Latent Dirichlet Allocation (LDA), which is a widely-used method in computational linguistics for modeling topics in texts. We extend the standard LDA method in order to make it incremental so that: 1) it does not relearn everything from scratch given new interactions (i.e., it is online); and 2) it can discover and add a new context into its model when necessary. We demonstrate on the iCub platform that, partly owing to modeling context on top of the concept web, our approach is adaptive, online, and robust: it is adaptive and online since it can learn and discover a new context from new interactions. It is robust since it is not affected by irrelevant stimuli and it can discover contexts after a few interactions only. Moreover, we show how to use the context learned in such a model for two important tasks: object recognition and planning. Contextual modeling is a critical issue in scene understanding. Object detection accuracy can be improved by exploiting tendencies that are common among object configurations. However, conventional contextual models only exploit the tendencies of normal objects; abnormal objects that do not follow the same tendencies are hard to detect through contextual model. This paper proposes a novel generative model that detects abnormal objects by meeting four proposed criteria of success. This model generates normal as well as abnormal objects, each following their respective tendencies. Moreover, this generation is controlled by a latent scene variable. All latent variables of the proposed model are predicted through optimization via population-based Markov Chain Monte Carlo, which has a relatively short convergence time. We present a new abnormal dataset classified into three categories to thoroughly measure the accuracy of the proposed model for each category; the results demonstrate the superiority of our proposed approach over existing methods. The paper presents a new model for context dependent interpretation of linguistic expressions about spatial proximity between objects in a natural scene. The paper discusses novel psycholinguistic experimental data that tests and verifies the model. The model has been implemented, and enables a conversational robot to identify objects in a scene through topological spatial relations (e.g. "X near Y"). The model can help motivate the choice between topological and projective prepositions.