CN114422687A

CN114422687A - Preview image switching method and device, electronic equipment and storage medium

Info

Publication number: CN114422687A
Application number: CN202011176686.1A
Authority: CN
Inventors: 姚海强
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2020-10-28
Filing date: 2020-10-28
Publication date: 2022-04-29
Anticipated expiration: 2040-10-28
Also published as: CN114422687B

Abstract

The disclosure relates to a preview image switching method and device, electronic equipment and a storage medium. The method is applied to the electronic equipment and comprises the following steps: acquiring a first image through a first camera, and displaying an initial preview image generated based on the first image; under the condition that the object distance between the first camera and the shot object is determined to be smaller than the preset distance, the currently used camera is switched from the first camera to the second camera; the focal length of the first camera is larger than that of the second camera, and the size of the image sensor of the first camera is smaller than that of the image sensor of the second camera; acquiring a second image through a second camera, and determining a target area consistent with the image content presented by the initial preview image from the second image; and determining the image content of the target area in the second image as a current preview image, and switching the displayed initial preview image into the current preview image.

Description

Preview image switching method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of image processing, and in particular, to a method and an apparatus for switching preview images, an electronic device, and a storage medium.

Background

With the continuous development of imaging technology, more and more users are added to the shooting and shooting line, and even the heat of civil shooting is brought about.

Electronic equipment in the time, for example cell-phone, flat board etc. in order to all can gather the better image of visual effect under different scenes of shooing, mostly be equipped with a plurality of cameras.

In the related art, when a subject is close to an electronic device, a camera with a larger focal length needs to be switched to a camera with a smaller focal length to obtain a clear image. However, in this switching process, since the focal length becomes sharply small and the size of the image sensor used in cooperation with the camera increases, there is a high possibility that a problem is caused in that only the middle region of the obtained image is sharp and the edge region is blurred.

Disclosure of Invention

The present disclosure provides a preview image switching method and apparatus, an electronic device, and a storage medium, which can avoid the problem of edge blur of a finally obtained preview image in the process of switching from a camera with a larger focal length to a camera with a smaller focal length.

According to a first aspect of the present disclosure, there is provided a preview image switching method applied to an electronic device, including:

acquiring a first image through a first camera, and displaying an initial preview image generated based on the first image;

under the condition that the object distance between the first camera and the shot object is determined to be smaller than the preset distance, the currently used camera is switched from the first camera to the second camera; the focal length of the first camera is larger than that of the second camera, and the size of the image sensor of the first camera is smaller than that of the image sensor of the second camera;

acquiring a second image through a second camera, and determining a target area consistent with the image content presented by the initial preview image from the second image;

and determining the image content of the target area in the second image as a current preview image, and switching the displayed initial preview image into the current preview image.

According to a second aspect of the present disclosure, there is provided a preview image switching apparatus applied to an electronic device, including:

the generating unit is used for acquiring a first image through a first camera and displaying an initial preview image generated based on the first image;

the first switching unit is used for switching the currently used camera from the first camera to the second camera under the condition that the object distance between the first camera and the shot object is determined to be smaller than the preset distance; the focal length of the first camera is larger than that of the second camera, and the size of the image sensor of the first camera is smaller than that of the image sensor of the second camera;

the determining unit is used for acquiring a second image through a second camera and determining a target area consistent with the image content presented by the initial preview image from the second image;

and the second switching unit is used for determining the image content in the second image, which belongs to the target area, as the current preview image and switching the displayed initial preview image into the current preview image.

According to a third aspect of the present disclosure, there is provided an electronic device comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor implements the method of the first aspect by executing the executable instructions.

According to a fourth aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the method according to the first aspect.

In the technical scheme of the disclosure, under the condition that a camera with a large focal length is adopted to collect an image, an initial preview image is displayed based on the image collected by the camera. And when the object distance between the camera and the shot object is determined to be smaller than the preset distance, switching the currently used camera to the camera with the smaller focal length. After the camera is switched, the acquired image is not directly used as a preview image, but a target area consistent with the image content presented by the initial preview image is determined from the acquired image after the camera is switched, and the image content in the target area is determined as the current preview image.

It should be understood that when switching from a camera with a larger focal length to a camera with a smaller focal length, the field angle becomes larger, the image content in the captured image increases, and the increased image content is generally displayed around the captured image because the relative position between the subject and the electronic device does not change. Therefore, the present disclosure determines only the determined target area as the current preview image, which corresponds to clipping the surrounding screen (or the edge area of the image). Therefore, compared with the related art, the method and the device for displaying the preview image have the advantages that the edge area of the image collected after the camera is switched cannot be displayed, and the problem that the displayed preview image is blurred in edge after the camera with the larger focal length is switched to the camera with the smaller focal length is solved.

In addition, in the above process, the target area in the second image is determined based on the initial preview image before the camera is switched. Therefore, the display frames of the current preview image and the initial preview image are consistent, and the jumping of the preview image in the camera switching process is avoided.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a flowchart illustrating a preview image switching method according to an exemplary embodiment of the present disclosure;

fig. 2 is a flowchart illustrating another preview image switching method according to an exemplary embodiment of the present disclosure;

FIG. 3 is a schematic diagram illustrating a distribution of detection areas on an image sensor according to an exemplary embodiment of the present disclosure;

FIG. 4 is a schematic diagram illustrating a relative position between a second image and a target area according to an exemplary embodiment of the present disclosure;

fig. 5 is a block diagram of a preview image switching apparatus shown in an exemplary embodiment of the present disclosure;

fig. 6 is a block diagram illustrating another preview image switching apparatus according to an exemplary embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of an electronic device in an exemplary embodiment of the present disclosure.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

Electronic equipment in the time, for example cell-phone, flat board etc. in order to all can gather the better image of visual effect under different scenes of shooing, mostly be equipped with a plurality of cameras. For example, in a smart phone, it may include: the camera comprises a main camera, a wide-angle camera, a super wide-angle camera, a macro camera and the like.

In the related art, when a subject is close to an electronic device, a camera with a larger focal length needs to be switched to a camera with a smaller focal length to obtain a clear image. Among them, when the switched camera (for example, a camera having a small focal length such as a macro camera or a super wide-angle camera) is used to photograph a close range, the switched photographing mode is also referred to as a close range mode.

However, in this switching process, since the focal length becomes small, there is a high possibility that a problem is caused in which only the middle region of the obtained image is sharp and the edge region is blurred. It is emphasized that in practical applications, the larger the focal length of the camera, the smaller the size of the image sensor used therewith is generally. In other words, in the process of switching from a camera with a larger focal length to a camera with a smaller focal length, the size of the image sensor for capturing an image becomes larger. Therefore, the problem of blurring of the edge area is also referred to as blurring of the edge of an image due to an increase in the size of the image sensor.

In order to solve the above problem, the present disclosure provides a preview image switching method to solve the technical problem that the edge of the preview image is blurred after the camera is switched.

Fig. 1 is a flowchart illustrating a preview image switching method according to an exemplary embodiment of the present disclosure. The method is applied to the electronic device, and as shown in fig. 1, the method may include the following steps:

and 102, acquiring a first image through a first camera, and displaying an initial preview image generated based on the first image.

The electronic device in the present disclosure may be any type of electronic device, for example, the electronic device may be a mobile terminal such as a smart phone or a tablet Computer, or may be a fixed terminal such as a smart television or a PC (Personal Computer). It should be understood that an electronic device equipped with a plurality of cameras and having different focal lengths of the plurality of cameras can be used as the electronic device in the present disclosure, and the specific application of which type of electronic device can be determined by those skilled in the art according to actual needs, and the present disclosure is not limited thereto.

In the related art, an application program with a shooting function is installed in an electronic device to control a plurality of assembled cameras, so that the purpose of shooting is achieved. This type of application is commonly referred to as a camera application. In practical application, after a user opens a camera application in the electronic device, the camera automatically displays an image acquired by the camera, and the image is called a preview image, so that the user can adjust shooting parameters according to the preview image.

Similarly, in the present disclosure, when a camera application in the electronic device is started, an image may be acquired by a currently used first camera, and an initial preview image may be generated based on the acquired first image, so that a user may preview the acquired image. It should be understood that the first camera in the present disclosure may be any type of camera, for example, the first camera may be any of a main camera, a wide-angle camera, a super wide-angle camera, etc. of an electronic device.

104, under the condition that the object distance between the first camera and the shot object is determined to be smaller than the preset distance, switching the currently used camera from the first camera to a second camera; the focal length of the first camera is larger than that of the second camera, and the size of the image sensor of the first camera is smaller than that of the image sensor of the second camera.

In the present disclosure, a preset distance may be preset for determining whether the first camera currently used cannot clearly shoot the subject. In actual operation, the distance between the subject and the first camera, that is, the object distance, may be preferentially detected, and then the object distance is compared with the preset distance, so as to switch the currently used camera to the second camera with a smaller focal length when it is determined that the distance between the first camera and the subject is smaller than the preset distance.

In the present disclosure, a conventional two-way distance measurement technique or a one-way distance measurement technique may be adopted, and a ToF (Time of flight) distance measurement method may also be adopted to measure the distance between the subject and the first camera. It should be noted that any manner capable of measuring the distance between the subject and the first camera can be used in the present disclosure, and the present disclosure is not limited thereto.

As described above, since the focal length of the first camera is greater than that of the second camera, the image sensor used with the first camera is generally smaller in size than the image sensor used with the second camera. This is one of the reasons why the image blur phenomenon occurs at the edge of the preview image in the related art.

And 106, acquiring a second image through a second camera, and determining a target area consistent with the image content presented by the initial preview image from the second image.

In the related art, an image acquired after switching the camera is directly taken as a preview image. It is understood that, due to the switching of the cameras, the focal length of the camera used for acquiring the image and the size of the image sensor are changed, which causes an edge blurring phenomenon of the acquired image, and if the acquired image is directly used as a preview image, the edge blurring phenomenon also occurs in the preview image. Meanwhile, due to the change of the focal length of the camera and the size of the sensor, the field angle of the obtained image must be changed, so that an obvious image jump phenomenon inevitably occurs in the process of switching from the original preview image to the current preview image. From the user perspective, not only does the edge of the preview image blur, but the content contained in the preview image also becomes more and more instantaneously.

In the present disclosure, the image acquired after switching the cameras is not directly used as a preview image as in the related art, but the acquired image is subjected to certain preprocessing. Specifically, the image content presented in the initial preview image displayed before the camera is switched may be preferentially determined, and after the second image is captured by the second camera, the target area consistent with the image content presented in the initial preview image is determined from the captured second image. On the basis, the image content belonging to the target area in the second image can be determined as the current preview image.

It should be understood that, since the present disclosure determines the current preview image from the second image based on the image content of the initial preview image after the second image is obtained, and the image contents of the two images are consistent, it is obvious that the jump phenomenon of the preview image in the related art does not occur. In addition to this, the switching operation of the cameras described above is performed in a case where the electronic apparatus determines that the distance between the subject and the first camera is smaller than the preset distance, in other words, the switching operation is automatically performed by the electronic apparatus. Obviously, the relative position of the second camera and the first camera is not changed at the moment of switching. It can be seen that, in the case that the camera switching causes the angle of field of view to become large, the image content presented by the captured second image contains the image content of the first image, and the image content of the first image resides in a position tending to the center in the second image. In other words, the determined target region is located at a position toward the center in the second image, which is equivalent to the image content of the second image that is excessive relative to the first image being located at the periphery (or edge region) of the second image. Therefore, the target area is determined as the current preview image, which is equivalent to cutting the edge area in the second image and then using the rest part as the current preview image, that is, cutting the blurred area in the related technology and then displaying the blurred area.

In the present disclosure, the target region may be determined from the second image in a variety of ways.

In an embodiment, a plurality of reference objects may be determined from the image content presented in the initial preview image, and a target area that matches the image content presented in the initial preview image may be determined from the second image based on the determined plurality of reference objects. For example, after the plurality of reference objects are determined, the relative positional relationship between the plurality of reference objects may be further determined to determine the target region from the second image based on the determined plurality of reference objects and the relative positional relationship.

In another embodiment, a center point and a field angle of the initial preview image may be preferentially determined, and then a target point corresponding to the center point is determined in the second image to determine a target area from the second image based on the determined target point and the field angle. It should be understood that the field angle determines how much content is contained in the image. It can be seen that, on the basis of determining the center point of the first image, only the corresponding target point needs to be determined in the second image, and an area, i.e., a target area, which is consistent with the content of the image presented in the initial preview image can be determined from the second image based on the field angle.

In practical applications, the edge blurring phenomenon occurs, meaning that the image content of the central part of the image remains sharp, which only occurs when the subject is a planar subject perpendicular to the optical axis of the camera. In an attempt, if the object is not a planar object perpendicular to the optical axis of the camera, it is assumed that the center of the image is the focus point, and the image content near the center is not on the same plane as the center point, it is obvious that a blur phenomenon occurs in a non-edge area, and an area on the same plane as the center point may exist in an edge area, but is clear. As can be seen, in the present disclosure, it is also necessary to determine whether the subject is a planar subject perpendicular to the optical axis of the first camera. Wherein the operation of switching the currently used camera from the first camera to the second camera is performed only in a case where it is determined that the subject is a planar object perpendicular to the optical axis of the first camera; otherwise, no switching operation is performed.

In an ideal situation, when the distances between the subject and the respective detection regions on the image sensor are equal, the subject can be considered as a planar object perpendicular to the optical axis of the camera (for convenience of description, the "planar object perpendicular to the optical axis of the camera" will be simply referred to as "planar object" hereinafter). However, in practical situations, there is an error inevitably, and it is difficult to achieve complete equality, and for this reason, the present disclosure presets an object distance difference for determining whether the subject is a planar subject. It should be understood that, since the actual area of the image sensor is small, the difference between the actual area of the image sensor and the area of the subject is usually large, if the actual distance between the image sensor and the subject is directly detected, it can only be determined whether a region of the subject large in area, such as the area of the image sensor, is a plane, and it cannot be really determined that all the image contents included in the captured image are in the same plane. Therefore, in the disclosure, a phase focusing manner is adopted to determine equivalent object distances between image contents acquired by each detection area of the image sensor and corresponding real objects, and whether the object is a plane object is judged by comparing the equivalent object distances.

In actual operation, at least two detection areas can be preferentially determined in the image sensor corresponding to the first camera, and phase focusing is performed respectively by taking the determined at least two detection areas as a reference, so as to obtain focusing data of each detection area; on the basis, equivalent object distances corresponding to all detection areas can be calculated according to the obtained focusing data, and the object distance difference between any two of at least two equivalent object distances is further determined; if the object distance difference between any two objects is smaller than the preset object distance difference, the shot object can be determined to be a plane object; otherwise, it is determined that the subject is not a planar object.

It should be noted that the above equivalent distance does not refer to a distance between the camera and the object in the conventional sense, but refers to an equivalent distance between the image content collected by a certain detection area on the image sensor and the real object. In other words, the equivalent object distance is a virtual distance obtained by calculation that is used exclusively for determining whether or not the subject is a planar object, not an actual distance. It can be understood that: after the image sensor is subjected to analog amplification to an area equal to the shot object, the distance between each detection area and the corresponding position in the shot object is measured.

To further improve the accuracy of determining whether a subject is a planar subject. The determined at least two detection regions may include: the first camera comprises a first area positioned in the center of an image sensor of the first camera, and at least one pair of detection areas symmetrically arranged by taking the first area as a reference. For example, a square image sensor may include 4 detection regions of equal size at four corners in addition to the first region located at the center of the square. Of course, this example is only illustrative, and the arrangement of the detection area can be determined by those skilled in the art according to actual needs, and the present disclosure does not limit this.

Step 108, determining the image content in the second image, which belongs to the target area, as a current preview image, and switching the displayed initial preview image into the current preview image.

In this disclosure, after the target area is determined from the second image, the image content belonging to the target area in the second image may be determined as the current preview image, and the displayed initial preview image is switched to the current preview image.

In the switching process, because the image contents of the current preview image and the initial preview image are consistent, the situation that the preview image picture jumps in the related art does not occur. Meanwhile, when the object distance between the shot object and the camera is determined to be smaller than the preset distance, the first camera with the larger focal length is switched to the second camera with the smaller focal length, so that the definition of the picture can be obviously improved. Therefore, the method and the device for previewing the image improve the definition of the previewing image while avoiding the jump of the previewing image.

In the related art, when the distance between a subject and a camera is below a certain threshold, a camera application is switched to a macro mode. In the switching process, the camera application needs to be restarted, and the electronic device needs to be equipped with a corresponding macro camera in advance, so that the currently used camera is switched to the macro camera when the camera mode is switched to the macro mode. The process is complex, and the preview image also jumps due to the change of the focal length of the camera.

In one aspect of the present disclosure, the first camera may be a wide-angle camera, and the second camera may be a super wide-angle camera. In this case, when the object distance between the subject and the first camera is smaller than the preset distance, the wide-angle camera may be switched to the ultra-wide-angle camera. The above-described operation of determining the target object, and the switching between preview images are included in this process. It should be understood that, because the image is cut, the advantage of large field angle of the traditional super wide-angle camera is eliminated, and meanwhile, the advantage of small focal length of the super wide-angle camera is utilized, so that close-range shooting is realized. In short, the technical scheme of the disclosure can realize macro photography by using the ultra-wide-angle camera, and avoids the limitation that the macro photography can be carried out only by switching the camera mode in the related art and the limitation that the macro camera must be assembled.

Of course, in the case where it is determined that the subject is not a planar subject perpendicular to the optical axis of the first camera, macro photography cannot be realized by the above-described super wide-angle camera. In this case, the present disclosure may also switch the shooting mode of the electronic device to the macro mode for image acquisition by the macro camera, as in the related art. Specifically, the camera application may be restarted to switch to the macro mode and switch the currently used camera to the macro camera.

According to the technical scheme, under the condition that the object distance between the camera and the shot object is determined to be smaller than the preset distance, the camera used at present is switched from the camera with the larger focal length to the camera with the smaller focal length. After the camera is switched, the acquired image is not directly used as the preview image, but the target area consistent with the image content presented by the initial preview image is determined from the image acquired after the camera is switched, and the image content in the target area is determined as the current preview image.

It should be understood that switching from a camera with a larger focal length to a camera with a smaller focal length increases the field angle, increases the image content in the captured image, and since the relative position between the subject and the electronic device does not change, the increased image content is typically displayed around the captured image. Therefore, the present disclosure determines only the determined target area as the current preview image, which corresponds to clipping the surrounding screen (or the edge area). Therefore, compared with the related art, the method and the device for displaying the preview image have the advantages that the edge area of the image collected after the camera is switched cannot be displayed, and the problem that the edge of the preview image is fuzzy under the condition that the camera with the larger focal length is switched to the camera with the smaller focal length is solved.

It is required to state that the operations of detecting whether the object distance is less than the preset distance and switching the camera are automatically executed by the electronic device. From the user's perspective, only the preview screen in the electronic device becomes clear. The problems of picture jumping and edge blurring do not exist in the process, and the shooting experience of a user is improved.

In the following, a smartphone equipped with multiple cameras is taken as an example to describe the technical solution of the present disclosure.

Fig. 2 shows another preview image switching method according to an exemplary embodiment of the present disclosure, which is applied to a smartphone equipped with multiple cameras, and as shown in fig. 2, the method may include the following steps:

step 201, a first image is collected through a wide-angle camera.

The smart phone may include: a plurality of cameras such as main camera, wide-angle camera, super wide-angle camera. The present embodiment will be described by taking an example of switching from a wide-angle camera to an ultra-wide-angle camera.

The smart phone can use the wide-angle camera in a plurality of scenes. For example, when a user needs to photograph indoor furnishings, the user can photograph the interior with a wide-angle camera in order to make the photographed image contain more articles.

Step 202, an initial preview image is displayed based on the acquired first image.

In connection with the above example, during the process of the user shooting the indoor furnishings using the wide-angle camera, the user may suddenly want to shoot the furnishings at a certain position and then approach the furnishing. At this time, the image can still be acquired by the wide-angle camera and the image sensor used in cooperation with the wide-angle camera, and the acquired image is used as the first image in the step. Further, the initial preview image can be displayed in the screen of the smart phone based on the first image.

Step 203, judging whether the distance between the shot object and the wide-angle camera is smaller than a preset distance; if yes, jumping to step 204; otherwise, go to step 211.

In this embodiment, a preset distance can be set according to the focal lengths of the wide-angle camera and the ultra-wide-angle camera, the preset distance is smaller than the object distance calculated according to the focal length of the wide-angle camera and the imaging formula, and the specific value of the preset distance can be determined by a person skilled in the art according to actual needs.

For example, when the user approaches the display device, the object distance between the object to be measured and the wide-angle camera may be detected by a ToF ranging method, and when the detected object distance is smaller than a predetermined distance, it may be further detected whether the object to be measured is a planar object.

It should be noted that the plane object in the present embodiment is not an absolute plane. It should be understood that, for any object, when the distance difference between each part of the object and the camera is small when the object is close to a certain degree, the object can also be determined as a plane object.

Step 204, judging whether the shot object is a plane object; if yes, go to step 205, otherwise, go to step 211.

In this embodiment, 5 detection regions may be preferentially determined on the image sensor corresponding to the wide-angle camera, and equivalent distances between the 5 detection regions and the corresponding real objects may be respectively determined. And judging whether the subject is a planar object based on the determined distance difference between any two of the 5 equivalent object distances and a preset distance difference.

For example, the detection area on the image sensor may be as shown in fig. 3. Assuming that the image sensor is in the shape of a square with a side length of 1, a square detection area with a side length of 0.3 can be taken at the center of the image sensor, and a square detection area with a side length of 0.2 can be taken at each of the four corners of the image sensor. And may be labeled as detection area a and detection areas B1-B4 as shown in fig. 3. On this basis, it is assumed that the measured equivalent object distance corresponding to the detection region a is X1, and the measured equivalent object distances corresponding to the detection regions B1 to B4 are X2 to X5. In this step, the object distance differences between any two of them may be calculated separately, that is, X1-X2, X1-X3, X1-X4, X1-X5, X2-X3, X2-X4, X2-X5, X3-X4, X3-X5, and X4-X5 are calculated separately, and after the object distance differences are obtained, the object distance differences may be compared with the preset object distance differences separately, and when the object distance differences are all smaller than the preset object distance differences, the object to be photographed may be determined to be a planar object.

And step 205, switching the wide-angle camera to the ultra-wide-angle camera.

And step 206, acquiring a second image through the wide-angle camera.

In step 207, a plurality of reference objects are identified from the initial preview image.

In step 208, a target area consistent with the image content presented by the initial preview image is determined from the second image according to the plurality of reference objects.

After the wide-angle camera is switched to the ultra-wide-angle camera, the focal length of the camera becomes smaller, the collocated image sensor becomes larger, correspondingly, the field angle of the second acquired image is also increased, and the image content is also increased. If the second image is directly used as the preview image, the phenomena of edge area blurring and preview image jumping are likely to occur.

Therefore, the embodiment preferentially determines a plurality of reference objects from the initial preview image, determines a target area which is consistent with the image content presented by the initial preview image from the second image by taking the plurality of reference objects as standards, and takes the image content contained in the target area as the current preview image.

In this process, the relationship between the second image and the target area may be as shown in fig. 4, the target area containing image content that is consistent with the image content presented by the initial preview image.

As is clear from fig. 4, the edge area (shaded area) in the second image will not be displayed as the current preview image, and it is obvious that the situation of blurring the edge area of the image in the related art can be avoided.

In step 209, the image content included in the determined target area is determined as the current preview image.

Step 210, switching the initial preview image to the current preview image.

In step 211, no camera switching operation is performed.

In this embodiment, if the distance between the camera and the subject is not less than the preset distance, or the subject is not a planar object, the camera switching operation is not performed. Of course, when the distance between the camera and the object to be photographed is smaller than the preset distance but the object to be photographed is not a planar object, the smartphone can be switched to the macro mode, so that macro photography of the non-planar object is completed through the macro camera.

According to the technical scheme, the first camera in the disclosure can be a wide-angle camera, and the second camera can be a super wide-angle camera. When detecting that the distance between wide-angle camera and the object of shooing is less than preset distance, can be switched to super wide-angle camera by wide-angle camera. It is understood that the present disclosure utilizes the advantage of the small focal length of the super wide-angle camera to realize the shooting of close range, which is equivalent to the macro photography realized by the super wide-angle camera. Meanwhile, a target area is determined from the second image based on the initial preview image to serve as the current preview image, so that the phenomenon of fuzzy edge areas is avoided, and the jumping condition of the preview image is also prevented.

Fig. 5 is a block diagram of a preview image switching apparatus according to an exemplary embodiment of the present disclosure. Referring to fig. 5, the apparatus includes a generation unit 501, a first switching unit 502, a determination unit 503, and a second switching unit 504.

A generating unit 501, configured to acquire a first image through a first camera and display an initial preview image generated based on the first image;

a first switching unit 502 configured to switch a currently used camera from a first camera to a second camera in a case where it is determined that an object distance between the first camera and a subject is smaller than a preset distance; the focal length of the first camera is larger than that of the second camera, and the size of the image sensor of the first camera is smaller than that of the image sensor of the second camera;

a determining unit 503, configured to capture a second image by a second camera, and determine a target area from the second image, the target area being consistent with the image content presented by the initial preview image;

a second switching unit 504, configured to determine image content in the second image that belongs to the target area as a current preview image, and switch the displayed initial preview image to the current preview image.

Optionally, the determining unit 503 is further configured to:

determining a plurality of reference objects in the image content presented by the initial preview image;

and according to the plurality of reference objects, determining a target area consistent with the image content presented by the initial preview image from the second image.

Optionally, the determining unit 503 is further configured to:

determining a central point and a field angle of the initial preview image;

and determining a target point corresponding to the central point in the second image, and determining a target area consistent with the image content presented by the initial preview image from the second image based on the target point and the field angle.

As shown in fig. 6, fig. 6 is a block diagram of another preview image switching apparatus shown in an exemplary embodiment of the present disclosure, which is based on the foregoing embodiment shown in fig. 5, and further includes: a judging unit 505, an executing unit 506 and a third switching unit 507.

Alternatively to this, the first and second parts may,

a determination unit 505 equipped to determine whether the subject is a planar subject perpendicular to an optical axis of the first camera;

an execution unit 506 configured to execute an operation of switching the currently used camera from the first camera to the second camera in a case where it is determined that the subject is a planar object perpendicular to the optical axis of the first camera.

Optionally, the determining unit 505 is further configured to:

determining at least two detection areas in an image sensor of a first camera, and respectively carrying out phase focusing by taking the at least two detection areas as a reference so as to obtain focusing data of each detection area;

calculating equivalent object distances corresponding to all detection areas respectively according to the obtained focusing data, and determining an object distance difference between any two of at least two equivalent object distances;

under the condition that the object distance difference between any two objects is smaller than the preset object distance difference, determining that the shot object is a plane object perpendicular to the optical axis of the first camera; otherwise, the subject is not a planar subject perpendicular to the optical axis of the first camera.

Optionally, the at least two detection areas include:

the first camera comprises a first area positioned in the center of an image sensor of the first camera, and at least one pair of detection areas symmetrically arranged by taking the first area as a reference.

Alternatively to this, the first and second parts may,

a third switching unit 507 configured to switch the shooting mode of the electronic device to a macro mode for image acquisition by the macro camera if it is determined that the subject is not a planar subject perpendicular to the optical axis of the first camera.

For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. One of ordinary skill in the art can understand and implement it without inventive effort.

Correspondingly, the present disclosure further provides a preview image switching apparatus, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the preview image switching method as in any one of the above embodiments, for example, the method may include: acquiring a first image through a first camera, and displaying an initial preview image generated based on the first image; under the condition that the object distance between the first camera and the shot object is determined to be smaller than the preset distance, the currently used camera is switched from the first camera to the second camera; the focal length of the first camera is larger than that of the second camera, and the size of the image sensor of the first camera is smaller than that of the image sensor of the second camera; acquiring a second image through a second camera, and determining a target area consistent with the image content presented by the initial preview image from the second image; and determining the image content of the target area in the second image as a current preview image, and switching the displayed initial preview image into the current preview image.

Accordingly, the present disclosure also provides an electronic device including a memory, and one or more programs, wherein the one or more programs are stored in the memory, and configured to be executed by the one or more processors, the one or more programs including instructions for implementing the preview image switching method as described in any of the above embodiments, such that the method may include: acquiring a first image through a first camera, and displaying an initial preview image generated based on the first image;

under the condition that the object distance between the first camera and the shot object is determined to be smaller than the preset distance, the currently used camera is switched from the first camera to the second camera; the focal length of the first camera is larger than that of the second camera, and the size of the image sensor of the first camera is smaller than that of the image sensor of the second camera; acquiring a second image through a second camera, and determining a target area consistent with the image content presented by the initial preview image from the second image; and determining the image content of the target area in the second image as a current preview image, and switching the displayed initial preview image into the current preview image.

Fig. 7 is a block diagram illustrating an apparatus 700 for implementing preview image switching according to an exemplary embodiment. For example, the apparatus 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 7, apparatus 700 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, and a communication component 716.

The processing component 702 generally controls overall operation of the device 700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 702 may include one or more processors 720 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 702 may include one or more modules that facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.

The memory 704 is configured to store various types of data to support operations at the apparatus 700. Examples of such data include instructions for any application or method operating on device 700, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 704 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 706 provides power to the various components of the device 700. The power components 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 700.

The multimedia component 708 includes a screen that provides an output interface between the device 700 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 700 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 710 is configured to output and/or input audio signals. For example, audio component 710 includes a Microphone (MIC) configured to receive external audio signals when apparatus 700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 704 or transmitted via the communication component 716. In some embodiments, audio component 710 also includes a speaker for outputting audio signals.

The I/O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 714 includes one or more sensors for providing status assessment of various aspects of the apparatus 700. For example, sensor assembly 714 may detect an open/closed state of device 700, the relative positioning of components, such as a display and keypad of device 700, sensor assembly 714 may also detect a change in position of device 700 or a component of device 700, the presence or absence of user contact with device 700, orientation or acceleration/deceleration of device 700, and a change in temperature of device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 716 is configured to facilitate wired or wireless communication between the apparatus 700 and other devices. The apparatus 700 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 7G NR (New Radio), or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 704 comprising instructions, executable by the processor 720 of the device 700 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

The above description is only exemplary of the present disclosure and should not be taken as limiting the disclosure, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.

Claims

1. A preview image switching method is applied to electronic equipment and comprises the following steps:

2. The method of claim 1, wherein the determining a target area from the second image that is consistent with the image content presented by the initial preview image comprises:

3. The method of claim 1, wherein the determining a target area from the second image that is consistent with the image content presented by the initial preview image comprises:

determining a central point and a field angle of the initial preview image;

4. The method of claim 1, further comprising:

judging whether the shot object is a plane object vertical to the optical axis of the first camera;

and in the case that the object is determined to be a plane object which is perpendicular to the optical axis of the first camera, performing the operation of switching the currently used camera from the first camera to the second camera.

5. The method according to claim 4, wherein the determining whether the subject is a planar subject perpendicular to an optical axis of the first camera comprises:

6. The method of claim 5, wherein the at least two detection regions comprise:

7. The method of claim 5, further comprising:

and in the case that the shot object is determined not to be a plane object perpendicular to the optical axis of the first camera, switching the shooting mode of the electronic equipment to a macro mode for image acquisition through the macro camera.

8. A preview image switching apparatus applied to an electronic device, comprising:

9. An electronic device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor implements the method of any one of claims 1-7 by executing the executable instructions.

10. A computer-readable storage medium having stored thereon computer instructions, which when executed by a processor, perform the steps of the method according to any one of claims 1-7.