CN112995565B - Camera adjustment method of display device, display device and storage medium - Google Patents
Camera adjustment method of display device, display device and storage medium Download PDFInfo
- Publication number
- CN112995565B CN112995565B CN201911304253.7A CN201911304253A CN112995565B CN 112995565 B CN112995565 B CN 112995565B CN 201911304253 A CN201911304253 A CN 201911304253A CN 112995565 B CN112995565 B CN 112995565B
- Authority
- CN
- China
- Prior art keywords
- camera
- user
- center point
- image
- user image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000007246 mechanism Effects 0.000 claims abstract description 96
- 230000005540 biological transmission Effects 0.000 claims abstract description 36
- 238000004590 computer program Methods 0.000 claims description 17
- 230000015654 memory Effects 0.000 claims description 12
- 238000004891 communication Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 7
- 230000033001 locomotion Effects 0.000 description 7
- 238000013507 mapping Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000009471 action Effects 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000001276 controlling effect Effects 0.000 description 3
- 238000013527 convolutional neural network Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000000306 recurrent effect Effects 0.000 description 2
- 230000006403 short-term memory Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007787 long-term memory Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The application discloses a camera adjusting method of display equipment, the display equipment and a storage medium, wherein the display equipment comprises a display screen, a camera, a driving mechanism, a power mechanism and a transmission mechanism; the method comprises the following steps: receiving a video call request from a target contact; responding to a video call request, and displaying a first user interface on a display screen; when the user is detected to accept the video call request, the camera is driven to move to the lifting position through the driving mechanism; starting a camera, sending a shooting instruction to the camera, and enabling the camera to acquire video data of a video call with a target contact according to the shooting instruction; and adjusting the position of the camera through the power mechanism and/or the transmission mechanism according to the video data so as to enable the camera to be aligned to a user. The method can reduce the risk of leakage of the user privacy and improve the use experience of the user in the video call scene.
Description
Technical Field
The present disclosure relates to the field of communications technologies, and in particular, to a method for adjusting a camera of a display device, and a storage medium.
Background
The camera has the functions of shooting pictures, recording short pictures and carrying out network video, and provides convenience for life of people. With the development of the television industry and the network industry, the technology of the intelligent television is mature. The camera is combined with the television, so that the functions of video call, video conference and the like can be realized, and convenience is provided for life and work of people. The camera matched with the existing television is usually fixed on the television, and when a user does not need to use the camera to carry out video call and the like, the camera cannot move to a shielded or hidden position, so that the risk of leakage of user privacy exists.
Disclosure of Invention
The main purpose of the application is to provide a camera adjusting method of display equipment, display equipment and a storage medium, aiming at avoiding that a camera collects user information when a video call is not connected, so that the risk of user privacy leakage is reduced, and the use experience of a user in a video call scene is improved.
In order to achieve the above object, the present application provides a camera adjustment method of a display device, where the display device includes a display screen, a camera, a driving mechanism, a power mechanism and a transmission mechanism, where the driving mechanism is used to drive the camera to rise or fall, and the power mechanism and the transmission mechanism are used to drive the camera to rotate; the method comprises the following steps:
Receiving a video call request from a target contact; responding to the video call request, and displaying a first user interface on the display screen, wherein the camera is positioned at a retracted position when the first user interface is displayed; when the video call request is detected to be accepted by the user, the camera is driven to move to a lifting position by the driving mechanism; starting the camera and sending a shooting instruction to the camera so that the camera can acquire video data of a video call with the target contact according to the shooting instruction; and adjusting the position of the camera through the power mechanism and/or the transmission mechanism according to the video data so as to enable the camera to be aligned to the user.
In addition, in order to achieve the above object, the present application further provides a display device including a memory and a processor; the memory is used for storing a computer program; the processor is configured to execute the computer program and implement the camera adjustment method of the display device as described above when the computer program is executed.
In addition, to achieve the above object, the present application also provides a computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to implement the camera adjustment method of the display device as described above.
The application provides a camera adjusting method of display equipment, the display equipment and a storage medium, which can control a camera in a television to be lifted and opened after a user receives a video call request. Before the user is detected to accept the video call request, the television cannot respond to the request of the video call APP for opening the camera to raise the camera or open the camera, so that the risk of user privacy leakage is reduced, and the use experience of the user in a video call scene is improved. In addition, after the camera rises, can adjust the camera to adapt to different users or the different demands of same user, even the user removes or under the circumstances such as different user height differences are great, need not user's limbs action and can adjust the camera automatically and arrive suitable shooting angle, thereby more comprehensively catch user's image, improved the result of use of camera and improved user's use experience.
Drawings
Fig. 1 is a schematic architecture diagram of a communication system according to an embodiment of the present application;
fig. 2 is a flowchart of a camera adjustment method of a display device according to an embodiment of the present disclosure;
fig. 3 is a schematic diagram of an application scenario of a camera adjustment method of a display device according to an embodiment of the present application;
Fig. 4 is a second application scenario diagram of a camera adjustment method of a display device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a display device according to an embodiment of the present application.
The realization, functional characteristics and advantages of the present application will be further described with reference to the embodiments, referring to the attached drawings.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
The camera adjusting method of the display device, which is related to the embodiment of the application, is mainly applied to the display device. The display device may include a television, a refrigerator, a computer, a washing machine, etc. having a display screen for displaying a preview interface. The following description will take a display device as an example of a television set, but the display device is not limited to the television set. The display device comprises a display screen, a camera, a driving mechanism, a power mechanism and a transmission mechanism.
The driving mechanism is used for driving the camera to rise or fall, and the power mechanism and the transmission mechanism are used for driving the camera to rotate. In particular, the power mechanism and/or the transmission mechanism can drive the camera to rotate along the first shaft and/or the second shaft. The power mechanism can drive the camera to rotate along the first shaft; the transmission mechanism can drive the camera to rotate along the second shaft. The first axis extends in a horizontal direction, and the second axis is perpendicular to the first axis.
In some embodiments, the display device further comprises a microphone, also referred to as a "microphone", for converting sound signals into electrical signals.
Referring to fig. 1, fig. 1 is a schematic architecture diagram of a communication system 100 according to an embodiment of the present application, where the communication system 100 may include a display device (e.g., a television 101) and an electronic device (e.g., an electronic device 102). The television 101 may be connected (e.g., wired or wireless) with the electronic device 102 via one or more communication networks, for example. Illustratively, the television 101 may establish a Wi-Fi connection with the electronic device 102 via a wireless fidelity (wireless fidelity, wi-Fi) protocol, but the communication network may also be implemented using any other network communication protocol, which is not limited herein.
In some embodiments, the communication system 100 may also include an application server 103. The application server 103 may be one or more. The application server 103 is used to communicate with Applications (APP) installed on the television 101 and the electronic device 102 via one or more communication networks.
Taking the video call APP with the video call function as an example, the user a can use the video call APP in the electronic device 102 to perform a video call with the user B. For example, user a may invite user B to make a video call in video call APP of electronic device 102, and in turn, electronic device 102 may send a video call request to application server 103 inviting user B. The video call request may carry parameters such as an identifier of the user B in the video call APP (e.g., a nickname and an account number of the user B). After receiving the video call request, the application server 103 may determine that the receiving party of the current call request is the user B according to the identifier of the user B in the video call APP in the video call request, and query the electronic device associated with the user B as the television 101. Further, the application server 103 may forward the video call request sent by the electronic device 102 to the television 101 of user B.
If the television 101 detects that the user B accepts the video call request sent by the user a at this time, the television 101 may continue to send the acquired voice and image to the electronic device 102 in real time through the application server 103. Meanwhile, the electronic device 102 may also send the acquired voice and image to the television 101 in real time through the application server 103, so that the user a may perform video call with the user B.
Illustratively, the video call APP may be a WeChat APP, a QQ APP, a short message APP, or the like. When the user B uses the video call APP to carry out video call with the contact person, the video call APP can send the voice acquired by the microphone to the contact person in real time, and can send the image acquired by the camera to the contact person in real time.
The specific structure of the electronic device 102 and the television 101 may be the same or different. By way of example, the electronic device 102 may be a cell phone, tablet computer, wearable electronic device with wireless communication capability (e.g., a smart watch), smart television with wireless communication capability, desktop computer, laptop computer (Laptop), etc.
Referring to fig. 2, fig. 2 is a flowchart illustrating a camera adjusting method of a display device according to an embodiment of the disclosure. The camera adjusting method may include steps S101 to S105, etc., and specifically may be as follows:
S101, receiving a video call request from a target contact.
Specifically, the user can install a video call APP having a video call (also referred to as a video phone) function in the television. The user can add one or more contacts when using the video call APP and record basic information of each contact, such as the name, phone number, address, mailbox or group to which the contact belongs.
The audio manager of the television set may include an audio mode. The audio mode may include a talk mode and a normal mode. For example, after the video call APP receives a video call request sent by a target contact, the camera may be turned on to collect an image of the user. The audio manager may be periodically requested to query the current audio mode before turning on the camera. When the current audio mode is detected to be a call mode, the user is informed of the video call request.
After the television receives the video call request, the television cannot raise the camera in response to the request of opening the camera by the video call APP before the video call request is detected to be accepted by the user. Accordingly, after receiving the video call request, the video call APP may request the television to raise the camera. At this time, the television can first determine whether the user accepts the video call request. If it is detected that the user accepts the video call request, the television may raise the camera. Thus, when the video call is not connected, the television cannot pop up the camera to interfere with the use experience of the user. Meanwhile, if the user does not answer the video call request, the television can reduce the pop-up of the camera once, so that the service life of the camera is prolonged.
S102, responding to the video call request, and displaying a first user interface on the display screen.
Wherein the camera is in a retracted position when the first user interface is presented. Illustratively, taking the target contact Jimmy as an example, the target contact Jimmy uses the electronic device 102 to send a video call request to the user Peter, inviting Peter to make a video call. After detecting the Jimmy invite Peter to video call operation, the electronic device 102 may send a video call request for inviting Peter to video call to the application server 103. Further, the application server 103 may send the video call request to Peter's television.
Before receiving a video call request sent by a target contact Jimmy, a television of Peter is in an un-lifted state, namely, the camera is in a retracted position. After receiving the video call request from the target contact Jimmy forwarded by the application server 103, the television of the user Peter responds to the video call request, and the television can display a first user interface for performing video call with the target contact Jimmy. For example, as shown in fig. 3, after the television receives a video call request from the target contact Jimmy, the television may display a first user interface 201 for video call with the target contact Jimmy. The first user interface 201 may include a first control 202 for receiving the current video call request, a second control 203 for rejecting the current video call request, and a third control 204 for switching the video chat to a voice chat. Of course, the first user interface presented by the television may include, in addition to the GUI that can be seen by the user, a presentation manner such as a ring tone corresponding to the video call request, which is not limited herein.
And S103, when the user is detected to accept the video call request, the driving mechanism drives the camera to move to the lifting position.
Taking the first user interface 201 shown in fig. 3 as an example, if the television detects that the user clicks the first control 202 in the first user interface 201, that is, the television detects that the user accepts the current video call request, it indicates that the user is willing to accept the current video call request. At this time, the television can transmit the collected video (voice and image) to the target contact Jimmy in real time, and in addition, the television can receive and play the video sent by the target contact Jimmy in real time. For example, the television may receive voice and images from the electronic device 102 of the target contact Jimmy via the application server 103. If it is detected that the user clicks the second control 203 in the first user interface 201, it indicates that the user is not willing to accept the video call request. At this time, the television may send a message for rejecting the video call to the electronic device 102 of the target contact Jimmy through the application server 103, and cancel the video call with the target contact Jimmy.
If the user clicks the third control 204 in the first user interface 201, it is indicated that the user is not willing to accept the video call request, but can accept the voice call request, that is, when the television detects that the user switches the video call to the voice call, the television can transmit the collected voice to the target contact Jimmy in real time, and in addition, the television can receive and play the voice sent by the target contact Jimmy in real time. For example, the television may receive speech from the electronic device 102 of the target contact Jimmy via the application server 103.
Of course, the user accepts the video call request not limited to the click operation described above, but may accept the video call request by operating a remote controller or the like in other manners, which is not limited herein.
When the user is detected to accept the video call request from the target contact person, the camera of the television is lifted through the driving mechanism, namely, the camera of the television is driven to move to the lifting position. If the user is not detected to accept the video call request from the target contact person, the camera of the television does not need to be lifted, so that the phenomenon that the use experience of the user is interfered by the lifting of the camera when the video call is not connected is avoided, and meanwhile, the overall attractiveness of the television is also influenced.
S104, starting the camera, and sending a shooting instruction to the camera so that the camera can acquire video data of the video call with the target contact according to the shooting instruction.
Specifically, after the camera is lifted, the camera is started, and a shooting instruction is sent to the camera. And the camera acquires video data of the video call with the target contact after receiving the shooting instruction. The camera may collect frame image data. The video data includes at least one frame of preview image data.
Still exemplified by the video call request sent by the target contact Jimmy. When the camera is completely lifted from the non-display side of the display screen of the television, the television can open the camera to start to collect images. Or the television can also open the camera to start to collect images in the process of lifting the camera. As shown in fig. 4, after the camera 10 is completely lifted from the non-display side of the display screen of the television, the television may jump from the first user interface 201 to the second user interface 301. The television can display the image content 302 acquired by the camera 10 in real time in the second user interface 301. And, the television can display the image content 303 sent from the target contact Jimmy in real time in the second user interface 301. Meanwhile, after the user receives the video call request, the television can also send the voice content acquired by the microphone to the target contact Jimmy in real time, and the television can receive and play the voice content sent by the target contact Jimmy in real time, so that the video call process is realized.
S105, adjusting the position of the camera through the power mechanism and/or the transmission mechanism according to the video data so as to enable the camera to be aligned to the user.
After the camera collects video data of the video call with the target contact person according to the shooting instruction, the position of the camera is adjusted through the power mechanism and/or the transmission mechanism according to the video data until the camera is aligned to the user. So, can adjust the camera of TV set to adapt to different users or the different demands of same user, even the user removes or under the great etc. circumstances of different user height differences, need not user's limbs action can automatically regulated camera to suitable shooting angle, thereby more comprehensively catch user's image, improved the result of use of camera and improved user's use experience.
It will be appreciated that when a plurality of users are included in the video data, one of the users moves and the camera does not make an adjustment. When the user image includes a plurality of users, the movement of the camera may be designed according to actual requirements, which is not limited herein.
In some embodiments, the video data comprises a user image. The adjusting the position of the camera according to the video data through the power mechanism and/or the transmission mechanism comprises the following steps:
performing face recognition on the user image to determine a face image of the user; judging whether the camera is aligned to the user or not according to the face image and the user image; if the camera is not aligned with the user, determining shooting angle information of the camera; according to the shooting angle information of the camera and the target shooting angle information, the camera is driven to rotate in the vertical direction through the power mechanism and/or is driven to rotate in the horizontal direction through the transmission mechanism so as to adjust the position of the camera.
Specifically, the user image may be a person image of a peripheral area in front of the television set, which is collected by the camera, and the person image of the peripheral area is generally a user of the television set, and is transmitted to the display screen, so that the television set obtains the user image collected by the camera.
In some embodiments, the performing face recognition on the user image to determine a face image of the user specifically includes: and inputting the user image into a pre-trained face recognition model to output the face image of the user.
The pre-trained face recognition model can be obtained by performing model training on an original neural network based on a large number of face sample images. The original neural network may be a convolutional neural network (CNN, convolutional neural networks), a recurrent neural network (RNN, recurrent neural networks), a Long short term memory (LSTM, long/short term memory) network, a YOLO9000 network, an AlexNet network, or VGGNet, among others.
After a face image of a user is determined, whether the camera is aimed at the user is judged based on the face image and the user image. And if the camera is not aligned with the user, executing the steps of determining shooting angle information of the camera and determining target shooting angle information of the camera. If the camera is aligned to the user, keeping the shooting direction of the camera unchanged, and executing the step of acquiring the user image acquired by the camera.
In some embodiments, the determining whether the camera is aimed at the user according to the face image and the user image specifically includes: judging whether the camera is aligned to the user according to the center point coordinates of the face image and the center point coordinates of the user image; if the coordinates of the central point of the face image are the same as those of the user image, judging that the camera is aligned to the user; and if the coordinates of the central point of the face image are different from those of the user image, judging that the camera is not aligned with the user.
The center point coordinates of the face image and the center point coordinates of the user image may be obtained during the face recognition process of the user image, that is, during the process of determining the face image of the user, the center point coordinates of the face image and the center point coordinates of the user image are also obtained. The center point coordinates of the face image and the center point coordinates of the user image may also be obtained by obtaining the center point coordinates of the face image according to the contour size of the face image after the face of the user image is identified to determine the face image of the user, and obtaining the center point coordinates of the user image according to the contour size of the user image.
Illustratively, the center point coordinates (x 1, y 1) of the face image are the midpoint coordinates of the two eye regions of the user, x1 is the center point abscissa of the face image, and y1 is the center point ordinate of the face image. The central point coordinates (x 2, y 2) of the user image are the intersection points of the diagonals of the user image, x2 is the central point abscissa of the user image, and y2 is the central point ordinate of the user image. If x2 is the same as x1 and y2 is the same as y1, then determining that the camera is aimed at the user. If x2 is different from x1, or y2 is different from y1, determining that the camera is not aligned with the user.
In some embodiments, whether the camera is aligned to the user is determined according to whether the center point coordinates of the face image and the center point coordinates of the user image satisfy a preset alignment condition. If the center point coordinates of the face image and the center point coordinates of the user image meet preset alignment conditions, judging that the camera is aligned to the user; and if the coordinates of the central point of the face image and the coordinates of the central point of the user image do not meet the preset alignment condition, judging that the camera is not aligned with the user. The preset alignment condition can be flexibly set according to actual requirements, for example, when the distance between the center point of the face image and the center point of the user image is smaller than or equal to a preset distance threshold value, the camera is judged to be aligned to the user; and when the distance between the center point of the face image and the center point of the user image is larger than a preset distance threshold, judging that the camera is not aligned with the user. The preset distance threshold can be flexibly designed according to actual requirements.
After judging whether the camera is aligned to the user, if the camera is not aligned to the user, determining shooting angle information of the camera and target shooting angle information of the camera.
In some embodiments, the determining the shooting angle information of the camera specifically includes: calculating the area of the user in the user image; determining a first distance between the user and the camera according to the area; and determining shooting angle information of the camera according to the first distance, the center point coordinates of the user image and the center point coordinates of the face area in the user image.
In some embodiments, a contour area of a user in the user image is obtained, and the contour area is taken as an area of the user in the user image. The method for obtaining the contour area can be flexibly set according to actual needs, for example, a user image is input into a pre-trained human body contour recognition model to output the area of the user in the user image, for example, the width of the shoulder of the human body in the user image is used as the width of the user, the user image is used, and the like. The determining, according to the area, a first distance between the user and the camera includes: and determining a first distance corresponding to the area according to a first mapping relation established in advance, wherein the first distance refers to the distance between the user and the camera. The first mapping relation records the areas of the sample human body shot by the camera under different shooting distances in the shot user images.
In other embodiments, the computing the area of the user in the user image comprises: and acquiring the area of the face area of the user in the user image. The method for obtaining the area of the face region of the user in the user image can be flexibly set according to actual needs, for example, the area of the face region of the user in the user image can be output in the face recognition process, that is, the area of the face region of the user in the user image is obtained in the process of determining the face image of the user. The determining, according to the area, a first distance between the user and the camera includes: and determining a first distance corresponding to the area according to a second mapping relation established in advance, wherein the first distance refers to the distance between the user and the camera. And the second mapping relation records the areas of the face areas of the sample human body shot by the cameras under different shooting distances in the shot user images.
In some embodiments, the determining the shooting angle information of the camera according to the first distance, the center point coordinates of the user image, and the center point coordinates of the face region in the user image includes: determining a first relative position of the camera in the horizontal direction and a second relative position of the camera in the vertical direction according to the center point coordinates of the user image and the center point coordinates of the face area in the user image; determining the first shooting angle of the camera in the horizontal direction according to the first distance, the center point coordinates of the user image and the center point coordinates of the face area in the user image; determining the second shooting angle of the camera in the vertical direction according to the center point coordinates of the user image and the center point coordinates of the face area in the user image; and taking the first relative azimuth, the second relative azimuth, the first shooting angle and the second shooting angle as shooting angle information of the camera.
For example, if the coordinates of the center point of the user image are (0, 0), and the coordinates of the center point of the face area in the user image are (1, -2), the first relative orientation of the camera in the horizontal direction is "right", and the second relative orientation of the camera in the vertical direction is "down".
The determining the first shooting angle of the camera in the horizontal direction according to the first distance, the center point coordinates of the user image and the center point coordinates of the face area in the user image specifically includes: calculating a second distance between the center point of the user image and the center point of the face area in the user image according to the center point coordinates of the user image and the center point coordinates of the face area in the user image; and calculating the first shooting angle of the camera in the horizontal direction according to the first distance and the second distance. Specifically, the connecting lines of the user and the camera, and the connecting lines of the central point of the user image and the central point of the face area in the user image are orthogonally arranged, that is, the included angle between the two connecting lines is 90 degrees, so that the first shooting angle of the camera in the horizontal direction can be calculated according to the first distance and the second distance.
In some embodiments, according to the third mapping relationship, a second shooting angle corresponding to the center point coordinates of the user image and the center point coordinates of the face region in the user image is determined. The second shooting angle is the shooting angle of the camera in the vertical direction. And recording shooting angles of the camera in the vertical direction under the coordinates of the central points of the face areas of the sample human body shot by the camera in different user images and the coordinates of the central points of the same user image in the third mapping relation.
Specifically, the target photographing angle information includes a first target photographing angle in the horizontal direction and a second target photographing angle in the vertical direction. The first target shooting angle and the second target shooting angle can be flexibly set according to actual needs. The first target shooting angle is an shooting angle of the camera in a horizontal direction when the camera shoots aiming at a face area of a sample human body. The second target shooting angle is a shooting angle of the camera in the vertical direction when the camera shoots aiming at a face area of a sample human body.
In some embodiments, the driving the camera to rotate in a vertical direction by the power mechanism and driving the camera to rotate in a horizontal direction by the transmission mechanism according to the shooting angle information of the camera and the target shooting angle information specifically includes: driving the camera to rotate in the horizontal direction through the transmission mechanism according to the first shooting angle and the first target shooting angle; and driving the camera to rotate in the vertical direction through the power mechanism according to the second shooting angle and the second target shooting angle.
Wherein, according to first shooting angle with first target shooting angle, through drive mechanism drive the camera rotates in the horizontal direction, include: calculating a first shooting offset angle according to the first shooting angle and the first target shooting angle; and driving the camera to rotate in the horizontal direction by the transmission mechanism for the first shooting offset angle.
For example, the first shooting angle is different from the first target shooting angle, and the obtained difference is the first shooting offset angle. And if the first shooting offset angle is 20 degrees and is larger than 0 degrees, controlling the transmission mechanism to drive the camera to rotate leftwards by 20 degrees in the horizontal direction. And if the first shooting offset angle is-20 degrees and is smaller than 0 degrees, controlling the transmission mechanism to drive the camera to rotate 20 degrees rightwards in the horizontal direction. If the first shooting offset angle is equal to 0 degree, the transmission mechanism stops running, so that the position of the camera in the horizontal direction is kept unchanged.
For another example, the first photographing angle is differenced from the first target photographing angle, and the absolute value of the obtained difference is taken as the first photographing offset angle. The first relative orientation of the camera in the horizontal direction is "right" and the first movement direction is determined to be leftward movement. And controlling the transmission mechanism to drive the camera to rotate in the horizontal direction by the first shooting offset angle.
In some embodiments, the driving, by the power mechanism, the camera to rotate in the vertical direction according to the second shooting angle and the second target shooting angle includes: calculating a second shooting offset angle according to the second shooting angle and the second target shooting angle; the power mechanism drives the bearing mechanism to rotate the second shooting offset angle in the vertical direction, so that the camera rotates the second shooting offset angle in the vertical direction.
For example, the second shooting angle is different from the second target shooting angle, and the obtained difference is the second shooting offset angle. If the second shooting offset angle is 30 degrees and is larger than 0 degrees, the power mechanism drives the bearing mechanism to rotate downwards in the vertical direction, so that the camera rotates downwards in the vertical direction by 30 degrees, namely the camera performs overturning motion outwards along the second axis. If the second shooting offset angle is-30 degrees and is smaller than 0 degree, the power mechanism drives the bearing mechanism to rotate upwards in the vertical direction, so that the camera rotates upwards in the vertical direction by 30 degrees, namely the camera performs overturning movement along the second axial direction. And if the second shooting offset angle is equal to 0 degree, the power mechanism stops driving the bearing mechanism to move, so that the position of the camera in the vertical direction is kept unchanged.
For another example, the second photographing angle is different from the second target photographing angle, and the absolute value of the obtained difference is used as the second photographing offset angle. The second relative orientation of the camera in the horizontal direction is "under" and the second direction of movement is determined to be upward movement. The power mechanism drives the bearing mechanism to rotate upwards in the vertical direction, so that the camera rotates upwards in the vertical direction by a second shooting offset angle, namely the camera turns over the second shooting offset angle inwards along a second axis.
In some embodiments, the camera is driven to move to the retracted position by the driving mechanism under the condition that a preset camera descending condition is met, so that the camera is hidden on the non-display side of the display screen of the television. The preset camera descending condition may be set according to actual requirements, for example, when the user switches from a video call to a voice call, or when the video call ends, etc., which is not limited herein. Therefore, when the user does not need to carry out video call, the camera of the television can not collect the image content related to the user, so that the safety risk of privacy disclosure of the user can be reduced.
According to the camera adjusting method of the display device, after a user receives a video call request, the camera in the television can be controlled to be lifted and opened. Before the user is detected to accept the video call request, the television cannot respond to the request of the video call APP for opening the camera to raise the camera or open the camera, so that the risk of user privacy leakage is reduced, and the use experience of the user in a video call scene is improved. In addition, after the camera rises, can adjust the camera to adapt to different users or the different demands of same user, even the user removes or under the circumstances such as different user height differences are great, need not user's limbs action and can adjust the camera automatically and arrive suitable shooting angle, thereby more comprehensively catch user's image, improved the result of use of camera and improved user's use experience.
Referring to fig. 5, fig. 5 is a schematic block diagram of a display device according to an embodiment of the present application.
As shown in fig. 5, the display device 400 may include a processor 402, a memory 403, and a communication interface 404 connected by a system bus 401, wherein the memory 403 may include a non-volatile computer readable storage medium and an internal memory.
The non-transitory computer readable storage medium may store a computer program. The computer program comprises program instructions that, when executed, cause the processor to perform any of a number of camera adjustment methods for a display device.
The processor 402 is used to store a computer program.
The memory 403 is used for executing the computer program and implementing the camera adjustment method of the display device as described above when executing the computer program.
The communication interface 404 is used for communication. It will be appreciated by those skilled in the art that the structure shown in fig. 5 is merely a block diagram of a portion of the structure associated with the present application and does not constitute a limitation of the display device 400 to which the present application is applied, and that a particular display device 400 may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
It should be appreciated that the bus 301 may be, for example, an I2C (Inter-integrated Circuit) bus, the Memory 403 may be a Flash chip, a Read-Only Memory (ROM) disk, an optical disk, a U-disk or a removable hard disk, etc., the processor 402 may be a central processing unit (Central Processing Unit, CPU), the processor 402 may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field-programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Wherein the general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Wherein, in some embodiments, the display device includes a display screen, a camera, a driving mechanism, a power mechanism and a transmission mechanism, wherein the driving mechanism is used for driving the camera to rise or fall, and the power mechanism and the transmission mechanism are used for driving the camera to rotate; the processor 402 is configured to execute a computer program stored in the memory 403 to perform the steps of:
Receiving a video call request from a target contact; responding to the video call request, and displaying a first user interface on the display screen, wherein the camera is positioned at a retracted position when the first user interface is displayed; when the video call request is detected to be accepted by the user, the camera is driven to move to a lifting position by the driving mechanism; starting the camera and sending a shooting instruction to the camera so that the camera can acquire video data of a video call with the target contact according to the shooting instruction; and adjusting the position of the camera through the power mechanism and/or the transmission mechanism according to the video data so as to enable the camera to be aligned to the user.
In some embodiments, the video data comprises a user image; in said adjusting the position of said camera by said power mechanism and/or said transmission mechanism according to said video data, the processor 402 is configured to perform: performing face recognition on the user image to determine a face image of the user; judging whether the camera is aligned to the user or not according to the face image and the user image; if the camera is not aligned with the user, determining shooting angle information of the camera; according to the shooting angle information of the camera and the target shooting angle information, the camera is driven to rotate in the vertical direction through the power mechanism and/or is driven to rotate in the horizontal direction through the transmission mechanism so as to adjust the position of the camera.
In some embodiments, when determining whether the camera is aimed at the user based on the face image and the user image, the processor 402 is configured to perform: judging whether the camera is aligned to the user according to the center point coordinates of the face image and the center point coordinates of the user image; if the coordinates of the central point of the face image are the same as those of the user image, judging that the camera is aligned to the user; and if the coordinates of the central point of the face image are different from those of the user image, judging that the camera is not aligned with the user.
In some embodiments, in the determining the shooting angle information of the camera, the processor 402 is further configured to perform: calculating the area of the user in the user image; determining a first distance between the user and the camera according to the area; and determining shooting angle information of the camera according to the first distance, the center point coordinates of the user image and the center point coordinates of the face area in the user image.
In some embodiments, the camera shooting angle information includes a first shooting angle in a horizontal direction and a second shooting angle in a vertical direction. In determining the shooting angle information of the camera according to the first distance, the center point coordinates of the user image, and the center point coordinates of the face region in the user image, the processor 402 is configured to perform: determining a first relative position of the camera in the horizontal direction and a second relative position of the camera in the vertical direction according to the center point coordinates of the user image and the center point coordinates of the face area in the user image; determining the first shooting angle of the camera in the horizontal direction according to the first distance, the center point coordinates of the user image and the center point coordinates of the face area in the user image; determining the second shooting angle of the camera in the vertical direction according to the center point coordinates of the user image and the center point coordinates of the face area in the user image; and taking the first relative azimuth, the second relative azimuth, the first shooting angle and the second shooting angle as shooting angle information of the camera.
In some embodiments, in determining the first shooting angle of the camera in the horizontal direction according to the first distance, the center point coordinates of the user image, and the center point coordinates of the face region in the user image, the processor 402 is configured to perform: calculating a second distance between the center point of the user image and the center point of the face region in the user image according to the center point coordinates of the user image and the center point coordinates of the face region in the user image; and calculating the first shooting angle of the camera in the horizontal direction according to the first distance and the second distance.
In some embodiments, the photographing angle information of the camera includes a first photographing angle in a horizontal direction and a second photographing angle in a vertical direction, and the target photographing angle information includes a first target photographing angle in the horizontal direction and a second target photographing angle in the vertical direction. The processor 402 is configured to execute, when the camera is driven to rotate in a vertical direction by the power mechanism and the camera is driven to rotate in a horizontal direction by the transmission mechanism according to the shooting angle information of the camera and the target shooting angle information: driving the camera to rotate in the horizontal direction through the transmission mechanism according to the first shooting angle and the first target shooting angle; and driving the camera to rotate in the vertical direction through the power mechanism according to the second shooting angle and the second target shooting angle.
In some embodiments, when the camera is driven to rotate in a horizontal direction by the transmission mechanism according to the first shooting angle and the first target shooting angle, the processor 402 is configured to perform: driving the camera to rotate in the horizontal direction through the transmission mechanism according to the first shooting angle and the first target shooting angle; and driving the camera to rotate in the vertical direction through the power mechanism according to the second shooting angle and the second target shooting angle.
In some implementations, the processor 402 is further configured to perform: under the condition of lowering a preset camera, driving the camera to move to a retracted position through the driving mechanism; and/or, the display screen presents a second user interface, the second user interface comprising the video data.
In the foregoing embodiments, the descriptions of the embodiments are focused on, and in portions of an embodiment that are not described in detail, reference may be made to the above detailed description of the method for adjusting the camera of the display device, which is not repeated herein.
According to the display device, after a user receives a video call request, the camera in the television can be controlled to be lifted and opened. Before the user is detected to accept the video call request, the television cannot respond to the request of the video call APP for opening the camera to raise the camera or open the camera, so that the risk of user privacy leakage is reduced, and the use experience of the user in a video call scene is improved. In addition, after the camera rises, can adjust the camera to adapt to different users or the different demands of same user, even the user removes or under the circumstances such as different user height differences are great, need not user's limbs action and can adjust the camera automatically and arrive suitable shooting angle, thereby more comprehensively catch user's image, improved the result of use of camera and improved user's use experience.
The embodiment of the application also provides a computer readable storage medium, and the computer readable storage medium stores a computer program, wherein the computer program comprises program instructions, and the processor executes the program instructions to realize the camera adjusting method of any display device provided by the embodiment of the application.
The computer readable storage medium may be an internal storage unit of the display device of the foregoing embodiment, for example, a hard disk or a memory of the display device. The computer readable storage medium may also be an external storage device of the display device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the display device.
Because the computer program stored in the computer readable storage medium can execute any of the methods for adjusting the camera of the display device provided in the embodiments of the present application, the beneficial effects that any of the methods for adjusting the camera of the display device provided in the embodiments of the present application can be achieved, which are detailed in the previous embodiments and are not described herein.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments. While the invention has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (8)
1. The camera adjusting method of the display device is characterized in that the display device comprises a display screen, a camera, a driving mechanism, a power mechanism and a transmission mechanism, wherein the driving mechanism is used for driving the camera to rise or fall, and the power mechanism and the transmission mechanism are used for driving the camera to rotate; the method comprises the following steps:
receiving a video call request from a target contact;
responding to the video call request, and displaying a first user interface on the display screen, wherein the camera is positioned at a retracted position when the first user interface is displayed;
when the video call request is detected to be accepted by the user, the camera is driven to move to a lifting position by the driving mechanism;
starting the camera and sending a shooting instruction to the camera so that the camera can acquire video data of a video call with the target contact according to the shooting instruction;
adjusting the position of the camera through the power mechanism and/or the transmission mechanism according to the video data so as to enable the camera to be aligned to the user;
wherein the adjusting the position of the camera according to the video data through the power mechanism and/or the transmission mechanism so as to align the camera to the user comprises:
Performing face recognition on the user image to determine a face image of the user;
judging whether the camera is aligned to the user or not according to the face image and the user image;
if the camera is not aligned with the user, calculating the area of the user in the user image;
determining a first distance between the user and the camera according to the area;
determining shooting angle information of the camera according to the first distance, the center point coordinates of the user image and the center point coordinates of the face area in the user image;
according to the shooting angle information of the camera and the target shooting angle information, the camera is driven to rotate in the vertical direction through the power mechanism and/or is driven to rotate in the horizontal direction through the transmission mechanism so as to adjust the position of the camera.
2. The method of claim 1, wherein determining whether the camera is aimed at the user based on the face image and the user image comprises:
judging whether the camera is aligned to the user according to the center point coordinates of the face image and the center point coordinates of the user image;
If the coordinates of the central point of the face image are the same as those of the user image, judging that the camera is aligned to the user;
and if the coordinates of the central point of the face image are different from those of the user image, judging that the camera is not aligned with the user.
3. The method according to claim 1, wherein the photographing angle information of the camera includes a first photographing angle in a horizontal direction and a second photographing angle in a vertical direction; the determining the shooting angle information of the camera according to the first distance, the center point coordinates of the user image and the center point coordinates of the face area in the user image includes:
determining a first relative position of the camera in the horizontal direction and a second relative position of the camera in the vertical direction according to the center point coordinates of the user image and the center point coordinates of the face area in the user image;
determining the first shooting angle of the camera in the horizontal direction according to the first distance, the center point coordinates of the user image and the center point coordinates of the face area in the user image;
Determining the second shooting angle of the camera in the vertical direction according to the center point coordinates of the user image and the center point coordinates of the face area in the user image;
and taking the first relative azimuth, the second relative azimuth, the first shooting angle and the second shooting angle as shooting angle information of the camera.
4. A method according to claim 3, wherein said determining the first photographing angle of the camera in the horizontal direction based on the first distance, the center point coordinates of the user image, and the center point coordinates of the face region in the user image comprises:
calculating a second distance between the center point of the user image and the center point of the face region in the user image according to the center point coordinates of the user image and the center point coordinates of the face region in the user image;
and calculating the first shooting angle of the camera in the horizontal direction according to the first distance and the second distance.
5. The method according to claim 1, wherein the photographing angle information of the camera includes a first photographing angle in a horizontal direction and a second photographing angle in a vertical direction, and the target photographing angle information includes a first target photographing angle in the horizontal direction and a second target photographing angle in the vertical direction; according to shooting angle information and target shooting angle information of the camera, the camera is driven to rotate in the vertical direction through the power mechanism and is driven to rotate in the horizontal direction through the transmission mechanism, and the camera comprises:
Driving the camera to rotate in the horizontal direction through the transmission mechanism according to the first shooting angle and the first target shooting angle;
and driving the camera to rotate in the vertical direction through the power mechanism according to the second shooting angle and the second target shooting angle.
6. The method according to claim 1, wherein the method further comprises:
under the condition of lowering a preset camera, driving the camera to move to a retracted position through the driving mechanism; and/or the number of the groups of groups,
the display screen presents a second user interface that includes the video data.
7. A display device, the display device comprising a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and implement the camera adjustment method of the display device according to any one of claims 1 to 6 when the computer program is executed.
8. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, which when executed by a processor causes the processor to implement the camera adjustment method of the display device according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911304253.7A CN112995565B (en) | 2019-12-17 | 2019-12-17 | Camera adjustment method of display device, display device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911304253.7A CN112995565B (en) | 2019-12-17 | 2019-12-17 | Camera adjustment method of display device, display device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112995565A CN112995565A (en) | 2021-06-18 |
| CN112995565B true CN112995565B (en) | 2024-03-08 |
Family
ID=76342516
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911304253.7A Active CN112995565B (en) | 2019-12-17 | 2019-12-17 | Camera adjustment method of display device, display device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112995565B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113824917A (en) * | 2021-09-18 | 2021-12-21 | 厦门网拓科技有限公司 | Convenient video chat method based on third-party video software and terminal thereof |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103475849A (en) * | 2013-09-22 | 2013-12-25 | 广东欧珀移动通信有限公司 | Method and device for adjusting shooting angle of camera during video call |
| CN103841357A (en) * | 2012-11-21 | 2014-06-04 | 中兴通讯股份有限公司 | Microphone array sound source positioning method, device and system based on video tracking |
| KR20140118330A (en) * | 2013-03-29 | 2014-10-08 | 박정윤 | Camera system for video telephony |
| CN105718887A (en) * | 2016-01-21 | 2016-06-29 | 惠州Tcl移动通信有限公司 | Shooting method and shooting system capable of realizing dynamic capturing of human faces based on mobile terminal |
| CN105898136A (en) * | 2015-11-17 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Camera angle adjustment method, system and television |
| KR101802793B1 (en) * | 2016-10-24 | 2017-11-29 | 오세준 | video communication device |
| CN109977770A (en) * | 2019-02-21 | 2019-07-05 | 安克创新科技股份有限公司 | A kind of auto-tracking shooting method, apparatus, system and storage medium |
| CN110086992A (en) * | 2019-04-29 | 2019-08-02 | 努比亚技术有限公司 | Filming control method, mobile terminal and the computer storage medium of mobile terminal |
| CN110087012A (en) * | 2019-04-17 | 2019-08-02 | 华为技术有限公司 | A kind of control method and electronic equipment of camera |
-
2019
- 2019-12-17 CN CN201911304253.7A patent/CN112995565B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103841357A (en) * | 2012-11-21 | 2014-06-04 | 中兴通讯股份有限公司 | Microphone array sound source positioning method, device and system based on video tracking |
| KR20140118330A (en) * | 2013-03-29 | 2014-10-08 | 박정윤 | Camera system for video telephony |
| CN103475849A (en) * | 2013-09-22 | 2013-12-25 | 广东欧珀移动通信有限公司 | Method and device for adjusting shooting angle of camera during video call |
| CN105898136A (en) * | 2015-11-17 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Camera angle adjustment method, system and television |
| CN105718887A (en) * | 2016-01-21 | 2016-06-29 | 惠州Tcl移动通信有限公司 | Shooting method and shooting system capable of realizing dynamic capturing of human faces based on mobile terminal |
| KR101802793B1 (en) * | 2016-10-24 | 2017-11-29 | 오세준 | video communication device |
| CN109977770A (en) * | 2019-02-21 | 2019-07-05 | 安克创新科技股份有限公司 | A kind of auto-tracking shooting method, apparatus, system and storage medium |
| CN110087012A (en) * | 2019-04-17 | 2019-08-02 | 华为技术有限公司 | A kind of control method and electronic equipment of camera |
| CN110086992A (en) * | 2019-04-29 | 2019-08-02 | 努比亚技术有限公司 | Filming control method, mobile terminal and the computer storage medium of mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112995565A (en) | 2021-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11218649B2 (en) | Photographing method, apparatus, and device | |
| WO2022001407A1 (en) | Camera control method and display device | |
| US9307194B2 (en) | System and method for video call | |
| US9024997B2 (en) | Virtual presence via mobile | |
| CN108848294B (en) | Shooting parameter adjusting method, terminal and computer readable storage medium | |
| CN112995566B (en) | Sound source positioning method based on display device, display device and storage medium | |
| US10142578B2 (en) | Method and system for communication | |
| EP2993860B1 (en) | Method, apparatus, and system for presenting communication information in video communication | |
| CN110602401A (en) | Photographing method and terminal | |
| CN108419008B (en) | Shooting method, terminal and computer readable storage medium | |
| CN109639996B (en) | High dynamic scene imaging method, mobile terminal and computer readable storage medium | |
| CN110086993B (en) | Image processing method, image processing device, mobile terminal and computer readable storage medium | |
| CN106254784A (en) | A kind of method and device of Video processing | |
| CN108184052A (en) | A kind of method of video record, mobile terminal and computer readable storage medium | |
| CN112433690B (en) | Data processing method, terminal and computer readable storage medium | |
| CN108093233B (en) | Image processing method, terminal and computer readable storage medium | |
| CN112995565B (en) | Camera adjustment method of display device, display device and storage medium | |
| CN109194916B (en) | Movable shooting system with image processing module | |
| US10447969B2 (en) | Image processing device, image processing method, and picture transmission and reception system | |
| WO2022262134A1 (en) | Image display method, apparatus and device, and storage medium | |
| CN111432154B (en) | Video playing method, video processing method and electronic equipment | |
| US8848885B2 (en) | Device information communication method, video display device, and video display system | |
| CN109218612B (en) | Tracking shooting system and shooting method | |
| CN112235510A (en) | Shooting method, shooting device, electronic equipment and medium | |
| CN112118414B (en) | Video session method, electronic device, and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |