Building AI reasoning systems that can perform such housekeeping tasks is an important scientific goal that has seen a lot of recent interest from the embodied AI community.
The community has recently tackled various problems such as navigation [1]}, [2]}, [3]}, [4]}, [5]}, [6]}, interaction and manipulation [7]}, [8]}, instruction following [9]}, [10]}, and embodied question answering [11]}, [12]}, [13]}.
Each of these tasks defines a goal, e.g. navigating to a given location, moving objects to correct locations, or answering a question correctly.
However, defining a goal for tidying a messy house is more tedious – one will have to write down a rule for where every object can or cannot be kept. Previous works in semantic reasoning frameworks for physical and relational commonsense [14]}, [15]}, [16]}, [17]}, [18]}, [19]} are often limited to specific settings (e.g. evaluating multi-relational embeddings) without instantiating these tasks in a physically plausible scenario, or by not capturing the full context of a complete household (e.g. table-top organization).
We believe the time may be right to bridge the gap between the above two lines of research.
