Extensive research is conducted on relationships inference between entities of data in image segmentation [1]}, [2]}, graph recovery for interactive physical systems [3]}, [4]}. Recently, researchers engaged spatio-temporal graphs to model pedestrians relationships to each other [5]}, [6]}. More advanced approaches such as [7]}, [8]}, [9]}, [10]} evaluate the relational importance between pedestrians using neural attention technique. In addition to using attention, [11]} deploys the refinery process that iterates over variants of the neighborhood until it selects the best neighbors set for each pedestrian. In our work, we similarly target neighborhood selection problems but with fewer iterations and faster recurrent cell called Grid-LSTM that requires fewer training epochs.
