TECHNICAL FIELD

The present disclosure generally relates to systems and methods for foreground and background processing of content in a live video.

BACKGROUND

Live video communication over the Internet is a popular means of communications among users around the world as video communication applications allow users to engage in live, face-to-face sessions. Occasionally, other individuals may inadvertently enter the field of view in the background while a participant is engaging in a live video conferencing session. This can be distracting to other participants viewing the live video.

SUMMARY

In accordance with one embodiment, a computing device generates a user interface, the user interface including a viewing window, the user interface further comprising a toolbar including a selection tool. The computing device displays a live video depicting at least one individual in the viewing window of the user interface. The computing device generates at least one segmentation mask for the at least one individual depicted in the live video, wherein the at least one segmentation mask comprises facial feature vectors of a facial region of each individual, wherein each facial feature vector is generated from facial features of each individual.

The computing device obtains selection of at least one individual depicted in the live video based on operation of the selection tool to designate at least one selected facial feature vector corresponding to the selected at least one individual. The computing device compares facial feature vectors in a facial region of each of individuals depicted in the live video with the selected at least one facial feature vector corresponding to the selected at least one individual.

The computing device converts the segmentation masks of individuals with corresponding facial feature vectors that do not match the selected facial feature vector to a filter mask and composites the filter mask comprising facial feature vectors that do not match the selected facial feature vector with a background content of the live video to generate composited background content. The computing device applies a graphical effect to the composited background content and displays a modified video comprising the segmentation mask and the composited background content when the selected at least one individual is in a field of view of the webcam.

Another embodiment is a system that comprises a memory storing instructions and a processor coupled to the memory. The processor is configured by the instructions to generate a user interface, the user interface including a viewing window, the user interface further comprising a toolbar including a selection tool. The processor is further configured to display a live video depicting at least one individual in the viewing window of the user interface. The processor is further configured to generate at least one segmentation mask for the at least one individual depicted in the live video, wherein the at least one segmentation mask comprises facial feature vectors of a facial region of each individual, wherein each facial feature vector is generated from facial features of each individual.

The processor is further configured to obtain selection of at least one individual depicted in the live video based on operation of the selection tool to designate at least one selected facial feature vector corresponding to the selected at least one individual. The processor is further configured to compare facial feature vectors in a facial region of each of individuals depicted in the live video with the selected at least one facial feature vector corresponding to the selected at least one individual.

The processor is further configured to convert the segmentation masks of individuals with corresponding facial feature vectors that do not match the selected facial feature vector to a filter mask. The processor is further configured to composite the filter mask comprising facial feature vectors that do not match the selected facial feature vector with a background content of the live video to generate composited background content. The processor is further configured to apply a graphical effect to the composited background content and display a modified video comprising the segmentation mask and the composited background content when the selected at least one individual is in a field of view of the webcam.

Another embodiment is a non-transitory computer-readable storage medium storing instructions to be implemented by a computing device having a processor, wherein the instructions, when executed by the processor, cause the computing device to generate a user interface, the user interface including a viewing window, the user interface further comprising a toolbar including a selection tool. The processor is further configured to display a live video depicting at least one individual in the viewing window of the user interface. The processor is further configured to generate at least one segmentation mask for the at least one individual depicted in the live video, wherein the at least one segmentation mask comprises facial feature vectors of a facial region of each individual, wherein each facial feature vector is generated from facial features of each individual.

The processor is further configured to obtain selection of at least one individual depicted in the live video based on operation of the selection tool to designate at least one selected facial feature vector corresponding to the selected at least one individual. The processor is further configured to compare facial feature vectors in a facial region of each of individuals depicted in the live video with the selected at least one facial feature vector corresponding to the selected at least one individual.

The processor is further configured to convert the segmentation masks of individuals with corresponding facial feature vectors that do not match the selected facial feature vector to a filter mask. The processor is further configured to composite the filter mask comprising facial feature vectors that do not match the selected facial feature vector with a background content of the live video to generate composited background content. The processor is further configured to apply a graphical effect to the composited background content and display a modified video comprising the segmentation mask and the composited background content when the selected at least one individual is in a field of view of the webcam

Other systems, methods, features, and advantages of the present disclosure will be or become apparent to one with skill in the art upon examination of the following drawings and detailed description. It is intended that all such additional systems, methods, features, and advantages be included within this description, be within the scope of the present disclosure, and be protected by the accompanying claims.

