@inproceedings{
kangpeng2024interactive,
title={Interactive Segmentation by Considering First-Click Intentional Ambiguity},
author={Kangpeng Hu and Sun Quansen and Yinghui Sun and Tao Wang},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=VmSRPbpD9c}
}
Interactive segmentation task aims at taking into account the influence of user preferences on the basis of general semantic segmentation in order to obtain the specific target-of-interest. Given the fact that most of the related algorithms generate a single mask only, the robustness of which might be constrained due to the diversity of user intention in the early interaction stage, namely the vague selection of object part/whole object/adherent object, especially when there's only one click. To handle this, we propose a novel framework called Diversified Interactive Segmentation Network (DISNet) in which we revisit the peculiarity of first click: given an input image, DISNet outputs multiple candidate masks under the guidance of first click only, it then utilizes a Dual-attentional Mask Correction (DAMC) module consisting of two branches: a) Masked attention based on click propagation. b) Mixed attention within first click, subsequent clicks and image w.r.t. position and feature space. Moreover, we design a new sampling strategy to generate GT masks with rich semantic relations. The comparison between DISNet and mainstream algorithms demonstrates the efficacy of our methods, which further exemplifies the decisive role of first click in the realm of interactive segmentation.
Interactive Segmentation by Considering First-Click Intentional Ambiguity
Kangpeng Hu Sun Quansen Yinghui Sun Tao Wang