Some methods attempt to provide contextual information for single person activity classification by concatenating the action scores of all the neighbor persons [17,18] or extracting spatiotemporal distributions of surroundings persons [6,7].