Flag mistake not working

#4
by egrace479 - opened
HDR Imageomics Institute org

The Flag Mistake button is not functioning properly.

HDR Imageomics Institute org
edited May 29

Agreed that we will remove the flag button until it can be made functional to record the predictions and the user-input correct classification (at a minimum).

@thompsonmj , @jlisawu

HDR Imageomics Institute org
edited May 30

The demo has been updated to disable the button for flagging Zero-Shot and Open-Ended predictions. Next steps involve decisions on how flagged mistakes can be used to provide the most research value as well as handle licenses appropriately for submitted images.

Notes from discussions on flagging:

  • When an image is submitted and the user believes a prediction to be incorrect, they may wish to flag the error. To use the image, the user will need to answer whether the image is their IP and that they grant us permission to use it. If it is not theirs, they should be prompted to provide the original license and source URL or public domain indication.
  • Even if we cannot use the image for whatever licensing reason, we may still benefit from knowing the flagged prediction(s), the user's suggested correct classification, and a trait-based description of why the user believes the prediction to be incorrect vs. their proposed classification.
  • To prompt high-quality flagging responses, we should provide a description of how the flagged responses will be used to make improvements.

Sign up or log in to comment