Patch Selection.
Many computer vision methods select attention-worthy regions from an image, e.g., region proposal network [1]}, multi-instance learning [2]}, top-\(K\)  patch selection [3]}, [4]}, attention sampling [5]}. These approaches observe an entire image and find all attention-worthy patches simultaneously. Our model observes an image only partially and sequentially. Furthermore, it selects a single optimal patch to attend at a given time.
