Multimodal Procedure Learning:
Another class of methods work with multi-modal data, like narrated text and videos [1]}, [2]}, [3]}, [4]}, [5]}, [6]}, [7]}, [8]}, [9]}.
These works use Automatic Speech Recognition (ASR) to obtain the text, which is not perfect.
Due to this, the output needs to be manually cleaned, which is not scalable.
Additionally, such methods assume an alignment between the text and videos [1]}, [5]}, [8]}, which might not be accurate for most cases [13]}, [14]}.
Instead, we use only the visual modality as an input to the framework.
Due to this, we eliminate the need to obtain narrations that might be inaccurate and make our framework scalable.
