BACKGROUND

Technical Field

The disclosed embodiments generally relate to systems and methods for analysis of videos of surgical procedures.

Background Information

When performing a surgical procedure, it may be beneficial to automatically identify surgical planes or review video of previous steps or expected future steps for a surgeon to review during an ongoing surgical procedure. Furthermore, there is a need to analyze videos to automatically populate a post-operative report, or to view statistical data with links to surgical videos that substantiate the statistic. In addition, there is a need to identify patient data derived from surgical equipment location data and to assign surgical teams to prospective surgeries.

Therefore, there is a need for unconventional approaches that efficiently and effectively analyze surgical videos to enable a medical professional to receive support during an ongoing surgical procedure, view performance related statistics and data, and to facilitate scheduling and patient-data collection.

SUMMARY

Systems, methods, and computer readable media related to statistical analysis across surgical videos are disclosed. The methods may include receiving a plurality of video frames from a plurality of surgical videos of a plurality of surgical procedures performed by a specific medical professional, wherein each surgical video is associated with a differing patient. The methods may further disclose accessing a set of surgical event-related categories, wherein each surgical event-related category is denoted by a differing category indicator and analyzing the received plurality of video frames of each surgical video to identify a plurality of surgical events in each of the plurality of surgical videos, and wherein each of the identified plurality of surgical events in each of the plurality of surgical videos is defined by a differing subgroup of frames.

The method may further include assigning each differing subgroup of frames to one of the surgical event-related categories to thereby interrelate subgroups of frames from differing surgical procedures under an associated common surgical event-related category. The subgroup of frames may be associated with each surgical event-related category to derive at least one statistic associated with each subgroup of frames. Statistics may then be aggregated within each category of surgical events and displayed together with the surgical event-related categories for selection. Finally, upon receiving a selection of a particular surgical event-related category at least part of the frames assigned to the particular surgical event-related category are presented.

Systems, methods, and computer readable media related to video detection of surgical instrument deviations from a surgical plane are disclosed. Some disclosed embodiments may include receiving a plurality of video frames from a surgical video feed and analyzing at least some of the plurality of video frames to identify a surgical instrument therein. The embodiments may further involve evaluating the plurality of video frames with the identified surgical instrument therein to ascertain an interface area corresponding to a location of an interaction between the identified surgical instrument and tissue and accessing stored data characterizing a surgical plane corresponding to the location of the interaction.

The stored data may be used to determine whether the interface area is outside of the surgical plane and outputting an out-of-surgical plane signal indicating a deviation from the surgical plane by the surgical instrument.

Systems, methods, and computer readable media related to providing intraoperative video review are disclosed. They may involve receiving a plurality of video frames from a surgical video of an ongoing surgical procedure and accessing stored data based on prior surgical procedures. They may also involve predicting based on the plurality of video frames and the stored data relating to prior surgical procedures, at least one expected future event in the ongoing surgical procedure. Disclosed embodiments may also involve generating for intra-surgical presentation, at least one option to review at least one surgical video clip associated with the expected future event in the surgical procedure.

In addition, disclosed embodiments may involve accessing a data structure containing the at least one surgical video clip and outputting for intra-surgical presentation, the at least one surgical video clip associated with the expected future event.

Consistent with disclosed embodiments, systems, methods, computer readable media, and apparatus related to analyzing surgical procedures and assessing surgical competency of subjects are disclosed. Disclosed embodiments may include receiving a plurality of video frames associated with at least one surgical procedure and accessing stored data based on prior surgical procedures. Disclosed embodiments may further include processing, using the stored data, the plurality of video frames to assess at least one of tissue handling, economy of motion, depth perception and surgical procedure flow in the plurality of video frames. Based on the assessment of at least one of tissue handling, economy of motion, depth perception and surgical procedure flow, a competency-related score for a subject may be generated. Disclosed embodiments may also include selecting, from the plurality of video frames, at least one video clip from which the competency score was derived and outputting the score, and presenting in association with the at least one score, a link to the at least one video clip.

Disclosed systems, methods, and computer readable media may relate to aggregating and analyzing equipment, time, and space data to update medical records. They may involve receiving a plurality of video frames from a surgical video of an ongoing surgical procedure and accessing stored data based on prior surgical procedures. They may also involve predicting based on the plurality of video frames and the stored data relating to prior surgical procedures, at least one expected future event in the ongoing surgical procedure. Disclosed embodiments may also involve generating for intra-surgical presentation, at least one option to review at least one surgical video clip associated with the expected future event in the surgical procedure.

In addition, disclosed embodiments may involve accessing a data structure containing the at least one surgical video clip and outputting for intra-surgical presentation, the at least one surgical video clip associated with the expected future event.

Systems, methods, and computer readable media related to assigning surgical teams to prospective surgeries are disclosed. They may involve analyzing a plurality of video frames of prior surgical procedures performed by a particular surgeon to ascertain a skill level of the particular surgeon and accessing a data structure containing patient characteristics associated with the prior surgical procedures. They may also involve accessing a surgical schedule including a plurality of prospective surgical procedures overlapping in time and obtaining patient characteristics associated with the prospective surgical procedures. Disclosed embodiments may also involve analyzing the plurality of video frames of prior surgical procedures to ascertain an expected amount of time for the particular surgeon to perform at least one particular prospective surgical procedure from among the plurality of prospective surgical procedures.

In addition, disclosed embodiments may involve determining requirements for the at least one particular prospective surgical procedure, the requirements including a required skill level of a participating surgeon based on the patient characteristics associated with the at least one particular prospective surgical procedure and an expected amount of time to perform the at least one particular prospective surgical procedure. They may also involve determining whether the particular surgeon meets the requirements of the at least one particular prospective surgical procedure based on the skill level of the particular surgeon and the expected amount of time for the particular surgeon to perform the at least one particular prospective surgical procedure. Disclosed embodiments may involve outputting an indicator that the particular surgeon meets the requirements of the at least one particular prospective surgical procedure.

