Influence of average pooling. In contrast to the original memory networks [1]}, we add an average pooling layer inside the memory layer, which takes advantage of the spatial organization of the information in the video imprint. Figure REF  demonstrates the influence of adding the average pooling layer. We can see that the recounting maps are smoother and more reasonable, especially for TCG based video imprint. In addition, with benefits from finer resolution of input feature maps, the epitome based video imprint can hold more spatial information, and the recounting results are more reasonable than TCG based video imprint.
