Our study has several important limitations.
Construct Validity. Defining exactly when debugging episodes and activities start and end is challenging and potentially susceptible to human error. To minimize the risk incorrect codes, we collected past definitions of debugging [1]}, [2]}, [3]} and used these to create an initial definitions. As we built the initial coding scheme, we refined the definitions until two authors were able to independently and consistently annotate the start and end of video segments within one to two seconds.
