WO2012142793A1

WO2012142793A1 - Video communication terminal and video communication method

Info

Publication number: WO2012142793A1
Application number: PCT/CN2011/076751
Authority: WO
Inventors: 姜韦
Original assignee: 中兴通讯股份有限公司
Priority date: 2011-04-21
Filing date: 2011-07-01
Publication date: 2012-10-26
Also published as: CN102752573A; CN102752573B

Abstract

Disclosed is a video communication terminal, comprising an audio module, a video module, an adjustment module and a control module. The audio module is used to acquire audio information, convert the acquired audio information into an audio signal and then transfer the audio signal to the control module. The video module is used to acquire video information, convert the video information into a video signal and then transfer the video signal to the control module. The control module is used to determine adjustment parameters of the video module according to the received audio signal and video signal, and send the adjustment parameters to the adjustment module. The adjustment module is used to adjust the video module according to the adjustment parameters. The video communication terminal of the present invention automatically tracks the face of a user.

Description

Video communication terminal and video communication method

The present invention relates to the field of communications, and in particular, to a video communication terminal and a video communication method. Background technique

With the development of wireless communication technology, wireless communication terminal equipment, commonly known as wireless terminal, has become a must-have item in people's lives. The basic function of a wireless terminal is to provide voice calls. In recent years,

3G technology has gradually matured, and video calling technology has gradually introduced wireless terminals. Video calling methods are becoming more and more popular among users.

Most of the built-in cameras of existing wireless terminals are fixed inside the wireless terminal, or can only be rotated at a small angle. When the user makes a video call, because the camera has a limited viewing range, the user often has a change in the position of the wireless terminal. The avatar is out of the framing range of the camera, so that the other party of the video call cannot see the video avatar of the user. Summary of the invention

The present invention provides a video communication terminal that automatically tracks a user's face.

In order to solve the above technical problems, the present invention employs the following technical solutions:

In one aspect, the present invention discloses a video communication terminal, including an audio module, a video module, an adjustment module, and a control module, wherein the control module is respectively connected to the audio module, the video module, and the adjustment module, and the adjustment module Connected to the video module;

The audio module is configured to collect audio information, and convert the collected audio information into an audio signal, and then transmit the audio information to the control module;

The video module is configured to collect video information, and convert the video information into a video signal, and then transmit the video information to the control module; The control module is configured to determine a video module adjustment parameter according to the received audio signal and the video signal, and send the adjustment parameter to the adjustment module;

The adjusting module is configured to adjust the video module according to the adjustment parameter.

In an embodiment of the video communication terminal, the audio module includes at least three audio buffers;

The intensity of the audio signal collected by the audio collector is inversely proportional to the distance between the audio collector and the sound source;

The audio collector is disposed at different locations of the video communication terminal.

In an embodiment of the video communication terminal, the audio module further includes an analysis sub-module configured to perform frequency domain analysis on the pre-collected audio signal to obtain features of the audio signal.

In an embodiment of the video communication terminal, the audio module further includes a filtering submodule, configured to filter the noise signal in the audio signal according to the audio signal feature.

In an embodiment of the video communication terminal, the control module determines a video module adjustment parameter according to the received audio signal and the video signal, as follows:

The control module determines the position of the sound source according to the position of the at least three audio collectors and the audio signals of different intensities collected by the audio collector;

According to the requirement of placing the sound source on the imaging point of the video module, the angle and/or the telescopic distance that the video module needs to rotate is determined, and the video module is adjusted as a parameter.

In an embodiment of the video communication terminal, the adjusting parameters include:

Video module rotation angle, and / or video module telescopic distance.

In another aspect, the present invention also discloses a video communication method, including:

The audio module collects the audio information, and converts the collected audio information into an audio signal and transmits the audio information to the control module;

The video module collects the video information, and converts the video information into a video signal and transmits the video information to the control module; The control module determines a video module adjustment parameter according to the received audio signal and the video signal, and sends the adjustment parameter to the adjustment module;

The adjustment module adjusts the video module according to the adjustment parameter.

In an embodiment of the video communication method, before the audio module converts the collected audio information into an audio signal and transmits the audio information to the control module, the method further includes:

The analysis sub-module in the audio module performs frequency domain analysis on the pre-collected audio signal to obtain characteristics of the audio signal.

In an embodiment of the video communication method, after the obtaining the feature of the audio signal, the method further includes:

A filter sub-module in the audio module filters the noise signal in the audio signal based on the characteristics of the audio signal.

In an embodiment of the video communication method, the control module determines, according to the received audio signal and the video signal, that the video module adjustment parameter is:

Compared with the prior art, the beneficial effects of the present invention are:

The invention discloses a video communication terminal, which comprises an audio module, a video module, an adjustment module and a control module. The audio module is used for collecting audio information, and converting the collected audio information into an audio signal and transmitting it to the office. a control module; the video module is configured to collect video information, and convert the video information into a video signal and then transmit the video information to the control module; the control module is configured to determine a video module adjustment according to the received audio signal and the video signal And adjusting the parameter to the adjustment module; the adjustment module is configured to adjust the video module according to the adjustment parameter. The video communication terminal of the present invention determines the position of the user's face according to the voice of the user, and then adjusts The whole video module automatically tracks the user's face, avoiding the user's face falling out of the viewfinder range of the video module caused by shaking, etc., so that the user's face is always in the video image, and the image is clearly imaged, which brings better use to the user. Experience. DRAWINGS

FIG. 1 exemplarily describes a system configuration diagram of a video communication terminal of the present invention;

FIG. 2 exemplarily depicts an audio collector profile on the video communication terminal of the present invention; FIG. 3 exemplarily illustrates a schematic diagram of determining a sound source location of the video communication terminal of the present invention; FIG. 4 exemplarily describes the present invention The adjustment module in the adjustment of the schematic diagram of the video module; FIG. 5 exemplarily describes the flow chart of the video communication method of the present invention. detailed description

The video communication terminal disclosed in the present invention includes an audio module, a video module, an adjustment module, and a control module, wherein the control module is respectively connected to the audio module, the video module, and the adjustment module, and the adjustment module is The video modules are connected.

The present invention will be further described in detail below with reference to the drawings in conjunction with the specific embodiments. Embodiment 1:

As shown in FIG. 1 , a video communication terminal according to an embodiment of the present invention includes an audio module, a video module, an adjustment module, and a control module, where the control module is respectively connected to the audio module, the video module, and the adjustment module. The adjustment module is connected to the video module.

The audio module is configured to collect audio information, convert the collected audio information into an audio signal, and transmit the audio information to the control module.

The video module is configured to collect video information, convert the video information into a video signal, and then transmit the video information to the control module.

The video module is usually a camera.

The control module is configured to determine a video module according to the received audio signal and the video signal Adjust the parameters and send adjustment parameters to the adjustment module.

The adjustment module is configured to control rotation and expansion of the video module according to the adjustment parameter. The adjustment module is usually a small stepping motor, which can drive the video module to rotate up and down and left and right, and can also drive the video module to advance or retreat in a small range.

The audio module includes at least three audio buffers; the intensity of the audio signal collected by the audio collector is inversely proportional to the distance between the audio collector and the sound source, that is, the audio collector and the sound The farther the source is, the smaller the intensity of the audio signal collected by the 釆, and the closer the distance, the greater the intensity of the audio signal collected by 釆.

The audio collector is disposed at different positions of the video communication terminal.

Audio collectors are typically high sensitivity microphones.

In general, three high-sensitivity microphones can already determine the direction of video collection, and increase the number of microphones to make the determined video collection direction more accurate. The three high-sensitivity microphones are usually triangular.

The audio module further includes an analysis sub-module for performing frequency domain analysis on the pre-collected audio signal to obtain characteristics of the audio signal.

The audio module further includes a filtering sub-module for filtering a noise signal in the audio signal according to the audio signal characteristic.

In general, the video communication terminal is not always in a relatively quiet environment. The audio collector of this embodiment has high sensitivity, and the noisy environment may cause misjudgment. Therefore, the video communication terminal of this embodiment must first In a relatively quiet environment, the user's voice information is collected and analyzed in the frequency domain to obtain the characteristics of the user's audio signal.

Since the basic frequency of each person's speaking voice is relatively stable, after obtaining the user's audio signal characteristics, if used in an environment with relatively high noise, the filtering sub-module in the audio module can be based on the pre-collected audio signal. The feature of filtering the noise signal outside the fundamental frequency can improve the accuracy of the judgment of the video communication terminal. The following is an example in which three audio buffers are arranged on the video communication terminal in a triangular manner as an example to illustrate how the control module locates the direction of the video collection according to the received audio signal.

The positions of the three audio collectors 8, B, and C are as shown in Fig. 2. After the three audio collectors collect the audio information of the same sound source at the same time, they are converted into audio signals, and the above three The audio signal is sent to the control module.

Since the intensity of the audio signal and the distance between the microphone and the sound source are inversely proportional, the distance between each microphone and the sound source can be known based on the intensity of the audio signal.

How much distance corresponds to how much intensity of the audio signal strength, can be set at the factory. As shown in Figure 3, the method for determining the location of the sound source is:

If the distance between the audio collector A and the sound source is a, then the audio collector A is the center of the sphere, and the sphere having the radius a is formed; the distance between the audio collector B and the sound source is b, then Taking the audio collector B as the center of the sphere, the sphere having the radius b; the distance between the audio collector C and the sound source is c, then the audio collector C is the center of the sphere, and the sphere having the radius c is made; The intersection of the three spheres is the position of the sound source.

The image captured by the camera has an imaging interval, and the imaging interval includes an imaging range of the planar image, and an imaging clear distance in the depth direction.

In this embodiment, the purpose of the camera adjustment is to make the user's full face clear image, and the full face is located in the center of the image. Therefore, adjusting the camera needs to adjust two parameters, one is to adjust the camera and the sound source (human face) The distance, the second is to image the sound source (human mouth) in the right position, so that the entire face is in the center of the image.

The sound source generally refers to the user's mouth. Referring to the human face, it can be found that the mouth is located symmetrically on the left and right sides of the person's face, about two-thirds from top to bottom.

Therefore, in the embodiment, the determined imaging direction includes: setting a position from the top to the bottom of the center line of the imaging range of the camera to be an imaging point in a case where the imaging clear distance is ensured. In order to place the sound source on the imaging point of the video module, the control module needs to determine the angle and/or the telescopic distance that the video module needs to rotate, that is, the video module adjustment parameter.

After determining the video module adjustment parameters, the control module sends the adjustment parameters to the adjustment module, where the adjustment parameters include:

The rotation angle of the video module and the telescopic distance of the video module.

If the video module does not need to be rotated, or the video module does not need to be stretched, the corresponding parameter is zero.

As shown in Figure 4, after receiving the adjustment parameters, the adjustment module rotates the video module according to the angle and controls the video module to expand and contract the appropriate distance so that the face is clearly imaged and located at the center of the image.

According to the position of the user's mouth, adjusting the orientation and distance of the video module in real time, the video communication terminal of the present invention can track the user's face all the time, so that the user's face is always at the center of the video image, and the image is clear, which can overcome the shaking, etc. The cause of the user's disengagement from the scope of the view, to meet the needs of users in many aspects.

Embodiment 2:

As shown in FIG. 5, a video communication method of an embodiment includes the following steps:

Step 101: The analysis sub-module in the audio module performs frequency domain analysis on the pre-collected audio signal to obtain features of the audio signal.

Step 102: When the video communication terminal is used for communication, the audio module collects audio information of the user during the call and converts the audio information into an audio signal.

Step 103: The filtering submodule of the audio module filters the noise signal in the audio signal according to the audio signal feature, and transmits the noise signal to the control module.

Step 104: The video module collects video information, converts the video information into a video signal, and transmits the video information to the control module.

Step 105: The control module determines a video module according to the received audio signal and the video signal. Integral parameters, and send adjustment parameters to the adjustment module;

Step 106: The adjustment module adjusts the video module according to the adjustment parameter, so that the video module can track the orientation of the user's face in real time.

The invention discloses a video communication terminal, which comprises an audio module, a video module, an adjustment module and a control module. The audio module is used for collecting audio information, and converting the collected audio information into an audio signal and transmitting it to the office. a control module; the video module is configured to collect video information, and convert the video information into a video signal and then transmit the video information to the control module; the control module is configured to determine a video module adjustment according to the received audio signal and the video signal And adjusting the parameter to the adjustment module; the adjustment module is configured to adjust the video module according to the adjustment parameter. The video communication terminal of the present invention determines the position of the user's face according to the voice of the user, and then adjusts the video module to automatically track the face of the user, thereby avoiding the user's face being separated from the viewing range of the video module due to shaking or the like, so that the user's face is always located. The video image is clearly imaged, giving the user a better experience.

The above is a further detailed description of the present invention in connection with the specific embodiments, and the specific embodiments of the present invention are not limited to the description. It is to be understood by those skilled in the art that the present invention may be practiced without departing from the spirit and scope of the invention.

Claims

Claim

A video communication terminal, comprising: an audio module, a video module, an adjustment module, and a control module, wherein the control module is respectively connected to the audio module, the video module, and the adjustment module, and the adjustment module is The video modules are connected;

The video module is configured to collect video information, convert the video information into a video signal, and transmit the video information to the control module;

The control module is configured to determine a video module adjustment parameter according to the received audio signal and the video signal, and send the adjustment parameter to the adjustment module;

2. The video communication terminal according to claim 1, wherein the audio module comprises at least three audio buffers;

The video communication terminal according to claim 2, wherein the audio module further comprises an analysis sub-module, configured to perform frequency domain analysis on the pre-collected audio signal to obtain features of the audio signal.

4. The video communication terminal according to claim 3, wherein the audio module further comprises a filtering submodule configured to filter the noise signal in the audio signal according to the audio signal characteristic.

The video communication terminal according to any one of claims 2 to 4, wherein the control module determines the video module adjustment parameter according to the received audio signal and the video signal, as follows: The control module determines the position of the sound source according to the position of the at least three audio collectors and the audio signals of different intensities collected by the audio collector;

The video communication terminal according to claim 5, wherein the adjustment parameter comprises:

Video module rotation angle, and / or video module telescopic distance.

7. A video communication method, characterized in that the method comprises:

The video module collects the video information, and converts the video information into a video signal and transmits the video information to the control module;

The control module determines a video module adjustment parameter according to the received audio signal and the video signal, and sends the adjustment parameter to the adjustment module;

The video communication method according to claim 7, wherein before the audio module converts the collected audio information into an audio signal and transmits the audio information to the control module, the method further includes:

The video communication method according to claim 8, wherein after the obtaining the feature of the audio signal, the method further comprises:

The video communication method according to any one of claims 7 to 9, characterized in that The control module determines the video module adjustment parameter according to the received audio signal and the video signal: the control module is different according to the position of the at least three audio collectors of the audio module and the intensity of the audio collector An audio signal that determines the location of the sound source;