FIELD OF THE INVENTION

The present invention relates to the field of video communication and human face analysis techniques.

BACKGROUND OF THE INVENTION

With the development of technology, the civilian cameras have been gradually used in families. Users can initiate real-time video viewing of the camera through a mobile APP, and the mobile APP can also initiate a video call with the camera. However, there are no comprehensive front-end devices suitable for elderly families available on the markets that can set a key to communicate with the preset family's mobile APP, and no devices and methods for the front-end device to collect human face video clips for physical sign analysis.

SUMMARY OF THE INVENTION

The present invention aims to overcome the shortcomings of the prior art and provide a system integrating video communication and physical sign analysis.

To achieve the object, the present invention adopts the following technical solutions:

A system integrating video communication and physical sign analysis, comprising:

at least one front-end device, and the front-end devices may be configured to receive other devices or external data and/or signals. In some preferred embodiments, the front-end device may directly receive external data and/or signals, in some preferred embodiments, the front-end device may receive external data and/or signals indirectly through other devices, in some preferred embodiments, the front-end device may receive at least one type of data and/or signals, in some preferred embodiments, the front-end device may directly process the received data and/or signals, in some preferred embodiments, the front-end device may process the received data and/or signals through other devices, in some preferred embodiments, the front-end device may comprise a data and/or signal processing device, in some preferred embodiments, the data and/or signal processing device may be a processor, in some preferred embodiments, the front-end device may further comprise a camera device, a display device, an audio device, and/or a button device, in some preferred embodiments, the camera device, the display device, the audio device and the button device may all be connected to the processor, in some preferred embodiments, the processor may be connected to the Internet network wiredly or wirelessly.

In some preferred embodiments, the system of the present invention may further comprise a mobile device, in some preferred embodiments, a mobile device is capable of interconnecting with the front-end device and establishing data communication, in some preferred embodiments, the mobile device may establish data communication with one or more of the front-end devices, in some preferred embodiments, the mobile device can establish interconnection with other front-end devices through one of the front-end devices, in some preferred embodiments, the mobile device may receive the data and/or signals of other front-end devices through a front-end device, in some preferred embodiments, the mobile device may receive data and/or signals of a plurality of front-end devices directly at the same time.

In some preferred embodiments, the front-end device and the mobile device may achieve video communication, and the front-end device can perform the physical sign analysis according to the images collected by the camera device. In some preferred embodiments, the mobile device may send the collected images to the front-end device for physical sign analysis. In some preferred embodiments, the front-end device may perform physical sign analysis on the image collected by itself.

Further, the button device comprises a preset button and a physical sign analysis trigger button. In some preferred embodiments, the physical sign analysis can be triggered by a button. In this way, the physical sign analysis is not carried out automatically. In some preferred embodiments, the physical sign analysis can be triggered automatically. In this way, the physical sign analysis may be preset; in some preferred embodiments, the physical sign analysis may be manually and selectively triggered by a button.

Further, the camera device is a conventional camera having a certain resolution. In some preferred embodiments, the camera device may be a conventional camera with a resolution of less than 200 W. For example, in some preferred embodiments, the camera device may adopt a 1080P camera. Of course, a camera with a resolution greater than 200 W may be used as required. In some preferred embodiments, the camera device may adopt a binocular camera. In some preferred embodiments, the camera device may adopt an IP camera.

Further, the display screen is an ordinary display screen or a touch display screen. In some preferred embodiments, a CRT display screen is used, in some preferred embodiments, a LCD display screen is used, in some preferred embodiments, a touch display screen may be a vector pressure sensing technology touch screen, a resistance technology touch screen, a capacitance technology touch screen, an infrared technology touch screen and/or a surface acoustic wave technology touch screen.

Further, the process for the front-end device to perform physical sign analysis comprises:

(1) capturing the video by the camera device and sending to the processor, and displaying on the display device;

(2) performing human face detection analysis of the captured video frame by frame by the processor, and acquiring the largest human face close to the middle position of the video only;

(3) positioning the coordinates of several feature points for the human face detected by each frame by algorithm;

(4) extracting pixel RGB values of the area enclosed by several feature points for the human face image of each frame of the face in a time slice and performing time series analysis to form physical sign analysis waveform data;

(5) sending the physical sign analysis waveform data and the human face images to the physical sign analysis service for deep learning of the relevant physical index indexes to obtain the relevant physical sign indexes of the person.

In some preferred embodiments, physical sign indexes include a certain part of a human body that may be different from other human bodies, such as the head, the legs, in some preferred embodiments, physical signs indexes may include an element of a human body that may be different from other human bodies, such as the size of the head, the length of the legs, and the height of the human body, etc. In some preferred embodiments, physical sign indexes may be elements that are easily identified in image recognition; in some preferred embodiments, physical sign indexes may be a single element or a combination of elements. In some preferred embodiments, the recognition priority of the physical sign indexes may be set, for example, recognizing some elements in priority, for example, the eye size. When a human body cannot be distinguished from other human bodies by these elements, other elements may be further recognized, and so forth.

Further, a process of recording the physical sign indexes is included, specifically, comparing the current human face with the customer group face database to obtain the customer number, and recording the physical sign indexes obtained in the step (5) in the physical sign data record sheet of the customer number.

Further, the initiator of the video communication is a front-end device or a mobile device. In some preferred embodiments, the front-end device initiates a video communication request, in some preferred embodiments, the front-end device initiates a video communication request by using another device, in some preferred embodiments, the front-end device initiates a video communication request to the mobile device actively and establishes a communication with the mobile device, in some preferred embodiments, the mobile device initiates a video communication request to the front-end device actively, and establishes a communication with the front-end device to perform information interaction.

Further, during video communication, the front-end device or mobile device is the client of the video communication, and the client registers and maintains the registration status on the video communication. In some preferred embodiments, the client firstly completes the registration on the video communication, and then performs video communication, in some preferred embodiments, the video communication means that the front-end device or the mobile device records video and perform communication of the recorded video via data or other ways, in some preferred embodiments, the recorded video can be transmitted during the communication process.

Further, the registration process of the client comprises:

(1) assigning each client a unique client identification number; in some preferred embodiments, the identification number may be a string of characters, in some preferred embodiments, the identification number may be a code having security function, for example, an identification number that needs to be verified, in some preferred embodiments, the identification number may not include security certification information.

(2) initiating a registration application to the video communication service cloud when the client is running, and the registration application including registration information such as the client identification number and the client IP address of the current client; in some preferred embodiments, the registered client has a uniquely identifiable identity on the video communication service cloud, in some preferred embodiments, once the client is registered on the video communication service cloud, its registration information can be queried, in some preferred embodiments, the video/information/data sent by the client can be queried through the registration information.

(3) generating a client status table by the video communication service cloud according to the registration information; in some preferred embodiments, the client status table may include information of the client, in some preferred embodiments, the client status table may also include the status of the client, for example, whether the client is online, or whether the client is offline, or the duration of online of the client, or the duration of offline of the client, etc.

(4) periodically sending heartbeat information to the video communication service cloud by the client, and refreshing the client status table by the video communication service cloud after receiving the heartbeat information.

Further, the process of initiating video communication by the client comprises:

(1) configuring a contact list on the client and binding a button to the contact persons in the contact list;

(2) initiating a video communication connection request to another client through the video communication service cloud by the current client;

(3) feeding back the current status information by another client, and feeding back the information of connection failure if the current status is in the call or during the call; and feeding back the information such as the IP address if the current status is no answer.

The present invention can achieve the following beneficial effects. Based on some applications in the prior art, the present invention combines video collection technology and human face analysis technology to perform physical sign analysis and obtain related indexes. In addition, the invention provides one-to-one or one-to-more video communication services for all registered clients through the video communication service cloud, and connects any two clients via the video communication service cloud to facilitate the interconnection of a front-end device and a mobile app. The elderly or children who use the front-end device may directly connect with adult's mobile phone app via this service, to facilitate communication; moreover, the front-end device may also analyze the physical signs of the smart device users through the video collected by the camera device, and send these physical sign information to the mobile phone app via the communication services such that the users of mobile phone app can know them at any time.

