CN107682639A - A kind of image processing method, device and mobile terminal - Google Patents
A kind of image processing method, device and mobile terminal Download PDFInfo
- Publication number
- CN107682639A CN107682639A CN201711135534.5A CN201711135534A CN107682639A CN 107682639 A CN107682639 A CN 107682639A CN 201711135534 A CN201711135534 A CN 201711135534A CN 107682639 A CN107682639 A CN 107682639A
- Authority
- CN
- China
- Prior art keywords
- field picture
- displacement
- images
- image
- image processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 21
- 238000006073 displacement reaction Methods 0.000 claims abstract description 61
- 238000000034 method Methods 0.000 claims abstract description 22
- 238000004590 computer program Methods 0.000 claims description 10
- 230000000694 effects Effects 0.000 abstract description 19
- 230000009977 dual effect Effects 0.000 abstract description 13
- 230000006870 function Effects 0.000 description 11
- 230000008569 process Effects 0.000 description 6
- 230000006854 communication Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000033001 locomotion Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 239000011800 void material Substances 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002146 bilateral effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000001404 mediated effect Effects 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Processing Or Creating Images (AREA)
- Image Processing (AREA)
Abstract
The present invention provides a kind of image processing method, device and mobile terminal, and this method includes：Obtain the first two field picture and the second two field picture with parallax；Second two field picture is calculated relative to first two field picture, displacement caused by target pixel points, the relative depth relationships figure of object in scene is obtained, wherein, the target pixel points are existing pixel in first two field picture and second two field picture；Virtualization processing is carried out to the target pixel points according to the displacement, incidence relation be present between the degree of the virtualization processing and the size of the displacement.The present invention can handle to obtain the image with virtualization effect, improve quality of image processing, and need not assemble dual camera, reduce image procossing cost.
Description
Technical field
The present invention relates to communication technical field, more particularly to a kind of image processing method, device and mobile terminal.
Background technology
With developing rapidly for mobile terminal, mobile terminal has become a kind of instrument essential in people's life,
And it is greatly convenient to be brought for the various aspects that user lives.Existing mobile terminal is substantially all the function of taking pictures,
User can shoot various photos using mobile terminal.Such as user can use the photograph of mobile terminal shooting personage
Piece, or the photo of mobile terminal shooting landscape can also be used etc..
Prior art is when shooting is with the image for blurring effect, it is necessary to which mobile terminal configuration dual camera, causes to shoot
Cost is higher.
The content of the invention
The embodiment of the present invention provides a kind of image processing method, device and mobile terminal, higher to solve shooting cost
Problem.
In order to solve the above-mentioned technical problem, the present invention is realized in：A kind of image processing method, including：
Obtain the first two field picture and the second two field picture with parallax；
Second two field picture is calculated relative to first two field picture, displacement caused by target pixel points, must be shown up
The relative depth relationships figure of object in scape, wherein, the target pixel points are first two field picture and second two field picture
In existing pixel；
Virtualization processing, the degree of the virtualization processing and the displacement are carried out to the target pixel points according to the displacement
Size between incidence relation be present.
In a first aspect, the embodiments of the invention provide a kind of image processing method, including：
Obtain the first two field picture and the second two field picture with parallax；
Second two field picture is calculated relative to first two field picture, displacement caused by target pixel points, must be shown up
The relative depth relationships figure of object in scape, wherein, the target pixel points are first two field picture and second two field picture
In existing pixel；
Virtualization processing, the degree of the virtualization processing and the displacement are carried out to the target pixel points according to the displacement
Size between incidence relation be present.
Second aspect, the embodiment of the present invention also provide a kind of image processing apparatus, including：
Acquisition module, for obtaining the first two field picture and the second two field picture with parallax；
Computing module, second two field picture is calculated relative to first two field picture, position caused by target pixel points
Move, obtain the relative depth relationships figure of object in scene, wherein, the target pixel points are first two field picture and described the
Existing pixel in two two field pictures；
Processing module, for the target pixel points to be carried out with virtualization processing according to the displacement, the virtualization processing
Incidence relation be present between degree and the size of the displacement.
The third aspect, the embodiment of the present invention also provide a kind of mobile terminal, including processor, memory and are stored in described
On memory and the computer program that can run on the processor, the computer program is by real during the computing device
The step of existing above-mentioned image processing method.
Fourth aspect, the embodiment of the present invention also provide a kind of computer-readable recording medium, the computer-readable storage
Computer program is stored on medium, the step of computer program realizes above-mentioned image processing method when being executed by processor.
The embodiment of the present invention can handle to obtain the image with virtualization effect, improve quality of image processing, and need not
Dual camera is assembled, reduces image procossing cost.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, needed for being described below to the embodiment of the present invention
The accompanying drawing to be used is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention,
For those of ordinary skill in the art, without having to pay creative labor, can also be obtained according to these accompanying drawings
Obtain other accompanying drawings.
Fig. 1 is the flow chart for the image processing method that one embodiment of the invention provides；
Fig. 2 is the flow chart for the image processing method that further embodiment of this invention provides；
Fig. 3 is the structure chart for the image processing apparatus that one embodiment of the invention provides；
Fig. 4 is the structure chart of the acquisition module for the image processing apparatus that one embodiment of the invention provides；
Fig. 5 is the structure chart of the judging submodule for the image processing apparatus that one embodiment of the invention provides；
Fig. 6 is the structure chart of the processing module for the image processing apparatus that one embodiment of the invention provides；
Fig. 7 is the structure chart for the mobile terminal that further embodiment of this invention provides.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is part of the embodiment of the present invention, rather than whole embodiments.Based on this hair
Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example, belongs to the scope of protection of the invention.
Referring to Fig. 1, Fig. 1 is the flow chart of image processing method provided in an embodiment of the present invention, as shown in figure 1, including with
Lower step：
Step 101, obtain the first two field picture and the second two field picture with parallax.
In the embodiment of the present invention, above-mentioned parallax is exactly from two points for having certain distance produced by same target
Direction difference.For image processing apparatus, image processing apparatus can shoot an object a position, obtain
First two field picture；Then this object is shot again in another position, obtain the second two field picture, such first two field picture and second
Two field picture is exactly the image for having parallax.
Step 102, second two field picture is calculated relative to first two field picture, position caused by target pixel points
Move, obtain the relative depth relationships figure of object in scene, wherein, the target pixel points are first two field picture and described the
Existing pixel in two two field pictures.
In the embodiment of the present invention, such as a shared bicycle in the first two field picture be present, there is also this in the second two field picture
Shared bicycle, then pixel included by this shared bicycle is exactly target pixel points.Certainly, the first two field picture and second
There can also be some other common objects in two field picture, this embodiment of the present invention is not construed as limiting.Object in above-mentioned scene
Relative depth relationships figure, it is possible to for representing caused displacement between target pixel points.
In the embodiment of the present invention, above-mentioned second two field picture can produce displacement relative to the first two field picture, target pixel points,
Caused by essence is due to the movement of image processing apparatus.Image processing apparatus shoots same target, shape from different perspectives
Into image between there may be some differences, so from different images, it is believed that target pixel points generate position
Move.
Step 103, according to the displacement target pixel points are carried out with virtualization processing, the degree of the virtualization processing with
Incidence relation be present between the size of the displacement.
In the embodiment of the present invention, above-mentioned virtualization processing is a kind of common mode in image procossing, is handled by virtualization
Image in general can become comparison and obscure.When shooting the photo of some personages, often the background after personage is carried out
Virtualization is handled, and can so make the image of personage distincter in the picture.Above-mentioned depth map is it can be understood that for by virtualization
Handle obtained image.
In the embodiment of the present invention, some objects closer from image processing apparatus, in image processing apparatus follow shot
Multiple images in, there may be bigger displacement for the object between image by contrast；And compare from image processing apparatus
Some remote objects, in multiple images of image processing apparatus follow shot, the object may produce between image by contrast
Raw smaller displacement.Pixel so bigger to some displacements, the virtualization processing of small degree is carried out, or without void
Change is handled；To the less pixel of some Displacement Ratios, the virtualization processing of big degree is carried out.Certainly, before virtualization processing is carried out,
These pixels can also be normalized etc., this embodiment of the present invention is not construed as limiting.
In this manner it is possible to make the object closer from image processing apparatus (can be personage), retain as far as possible original
Display, and the object (can regard background) distant from image processing apparatus carry out some virtualization processing.Pass through image
The mode of processing, the shooting effect of dual camera can also be simulated, in the condition of the unassembled dual camera of image processing apparatus
Under, the image with virtualization effect can also be shot.And the cost of dual camera is in general all costly, thus for
Image of the shooting with virtualization effect saves cost.
In the embodiment of the present invention, above-mentioned image processing apparatus can be mobile phone, tablet personal computer (Tablet Personal
Computer), laptop computer (Laptop Computer), personal digital assistant (personal digital
Assistant, abbreviation PDA), mobile Internet access device (Mobile Internet Device, MID) or wearable device
(Wearable Device) etc..
A kind of image processing method of the embodiment of the present invention, it can handle to obtain the image with virtualization effect, improve
Quality of image processing, and dual camera need not be assembled, reduce image procossing cost.
Referring to Fig. 2, Fig. 2 is the flow chart of image processing method provided in an embodiment of the present invention.The present embodiment and last reality
Apply the pixel that the displacement in the target pixel points can be obtained in this method of the main distinction of example is less than pre-determined distance；To institute
State the pixel progress virtualization processing that displacement in target pixel points is less than the pre-determined distance.As shown in Fig. 2 including following
Step：
Step 201, obtain the first two field picture and the second two field picture with parallax.
In the embodiment of the present invention, above-mentioned parallax is exactly from two points for having certain distance produced by same target
Direction difference.For image processing apparatus, image processing apparatus can shoot an object a position, obtain
First two field picture；Then this object is shot again in another position, obtain the second two field picture, such first two field picture and second
Two field picture is exactly the image for having parallax.
Step 202, second two field picture is calculated relative to first two field picture, position caused by target pixel points
Move, obtain the relative depth relationships figure of object in scene, wherein, the target pixel points are first two field picture and described the
Existing pixel in two two field pictures.
In the embodiment of the present invention, such as a shared bicycle in the first two field picture be present, there is also this in the second two field picture
Shared bicycle, then pixel included by this shared bicycle is exactly target pixel points.Certainly, the first two field picture and second
There can also be some other common objects in two field picture, this embodiment of the present invention is not construed as limiting.Object in above-mentioned scene
Relative depth relationships figure, it is possible to for representing caused displacement between target pixel points.
In the embodiment of the present invention, above-mentioned second two field picture can produce displacement relative to the first two field picture, target pixel points,
Caused by essence is due to the movement of image processing apparatus.Image processing apparatus shoots same target, shape from different perspectives
Into image between there may be some differences, so from different images, it is believed that target pixel points generate position
Move.
Step 203, obtain the pixel that displacement in the target pixel points is less than pre-determined distance.
In the embodiment of the present invention, the pixel less than pre-determined distance in target pixel points is screened by setting pre-determined distance
Point, can thus some processing be carried out to these pixels.
Step 204, displacement in the target pixel points is less than at the pixel progress virtualization of the pre-determined distance
Reason, incidence relation be present between the degree of the virtualization processing and the size of the displacement.
In the embodiment of the present invention, above-mentioned virtualization processing is a kind of common mode in image procossing, is handled by virtualization
Image in general can become comparison and obscure.When shooting the photo of some personages, often the background after personage is carried out
Virtualization is handled, and can so make the image of personage distincter in the picture.Above-mentioned depth map is it can be understood that for by virtualization
Handle obtained image.
In the embodiment of the present invention, some objects closer from image processing apparatus, in image processing apparatus follow shot
Multiple images in, there may be bigger displacement for the object between image by contrast；And compare from image processing apparatus
Some remote objects, in multiple images of image processing apparatus follow shot, the object may produce between image by contrast
Raw smaller displacement.
By setting a pre-determined distance, the pixel that pre-determined distance is less than to displacement in target pixel points carries out the void
Change is handled, in target pixel points displacement handled not less than the pixel of pre-determined distance without virtualization.Certainly, carrying out at virtualization
Before reason, these pixels can also be normalized etc., this embodiment of the present invention is not construed as limiting.Thus etc.
It is same as being provided with a focal plane, what displacement was more than focal plane is then image background less than focal plane for display foreground, displacement.
Some objects closer from image processing apparatus are just handled without virtualization, keep original display mode, and to from image
The distant background of processing unit carries out some virtualization processing, can so make the stereovision of virtualization effect distincter.And protect
The original display mode of some pixels (being handled without virtualization) is stayed, by setting pre-determined distance to ensure that from image
The closer personage of processing unit is not influenceed by virtualization processing, and figure image can is clearly shown, and is used
There is more preferable experience at family when shooting.
Optionally, described the step of obtaining first two field picture and the second two field picture with parallax, including：
The first two field picture is obtained, and obtains other images outside first two field picture；
Judge whether other described images with first two field picture meet default matching condition；
If other described images meet the matching condition with first two field picture, other described images are defined as
Second two field picture.
In present embodiment, above-mentioned default matching condition, can be other images and the first two field picture is to same mesh
Mark the image of shooting, can also be either other images with the first two field picture for the image that is shot in section at the same time or
Can also be that other images and the first two field picture have identical part etc..Certainly in addition to this it is possible to have some other
Matching condition, this embodiment of the present invention is not construed as limiting.
So, by the limitation of default matching condition, some images for more conforming to treatment conditions can be filtered out and made
For the second two field picture, so in the image processing process in later stage, the rational result of comparison can be obtained.
Optionally, whether other images described in the judgement meet the step of default matching condition with first two field picture
Suddenly, including：
Other described images of identification and existing common pixel point in first two field picture；
According to the common pixel point calculate other described images relative to first two field picture horizontal offset with
Vertical offset；
Judge whether the horizontal offset exceedes predetermined threshold value, and whether within a preset range the vertical offset；
If the horizontal offset exceedes the predetermined threshold value, and the vertical offset is in the preset range, then
It is determined that other described images meet the matching condition with first two field picture.
In present embodiment, existing common pixel point, can pass through figure in above-mentioned other images and the first two field picture
It is identified otherwise as knowing.It is above-mentioned that horizontal-shift of other images relative to the first two field picture is calculated according to common pixel point
Amount and vertical offset can be calculated by below equation.
I and J represents two width 2D gray-scale maps, I (x)=I (x；Y), J (x)=J (x；Y) two width figures are at x=[x y]TPoint is relative
2 points answered.Because the width of two images is identical, the height of two images is also identical, nx、nyFor two images width and
It is high.Then the direction vector of upper left is [0 0]T, the direction vector of bottom right is [nx-1 ny-1]T.Characteristic point u=[u on Ix uy
]T, then corresponding point is v=[u on J imagesx+dx uy+dy]T, I (u) and J (v) are corresponding in two images 2 points.d
=[dx,dy]TFor the vector of u points.
For the transition matrix of two images.
wx、wyDetermine (2wx+1)×(2wy+ 1) characteristic point finds the size of scope, and select a pixel here
To find unit.
For the image L=0 ..., Lm on each layer of gaussian pyramid, definitionFor ILU corresponding to upper
Coordinate.
And Jacobian matrix is expressed from the next：
Expression formula is changed down, drawn：
Set up formula (7)：
δ I (x)=I (x)-J (x) (7)
Implementation determines the displacement of the pixel in horizontal direction, if the horizontal displacement of entire image exceedes in advance
If threshold value, then the second two field picture is captured.Certainly, during the second two field picture is captured, the position of vertical direction can also be limited
MoveWhether in preset range etc, ifBeyond the preset range, then crawl failure, user is reminded slightly to retract again.
So, when horizontal offset exceedes predetermined threshold value, and vertical offset is within a preset range, it is determined that other images
Meet the matching condition with first two field picture, so make the image that is matched with the first two field picture more accurate, after being beneficial to
Continuous further processing.
Optionally, it is described according to the common pixel point calculate described in other images relative to first two field picture water
The step of flat offset and vertical offset, including：
Under conditions of other described images are carried out into image alignment with first two field picture, according to the common pixel
Point calculates horizontal offset and vertical offset of other the described images relative to first two field picture.
In present embodiment, image alignment is a kind of common method in image procossing.It can be carried out using optical flow algorithm
Image alignment or some other algorithms carry out image alignment etc., and this present embodiment is not construed as limiting.So in image pair
After neat, it is easy to calculate horizontal offset and vertical shift of other images relative to the first two field picture according to common pixel point
Amount.
In present embodiment, some can also be carried out to image smoothly, or expansion processing etc..And to the side of image
Edge, bilateral filtering can be used, or using blending algorithm, strengthen the accuracy at edge etc..Carried out to image at virtualization
After reason, the image of virtualization can also will be preserved, such user's later stage can also use and arrive these images, make the user to use
It is more convenient.
Optionally, the incidence relation is negative correlativing relation.
In present embodiment, above-mentioned incidence relation is negative correlativing relation, pixel so bigger to some displacements, is entered
The virtualization processing of the small degree of row；To the less pixel of some Displacement Ratios, the virtualization processing of big degree is carried out.In this manner it is possible to
Make the object closer from image processing apparatus (can be personage), retain original display as far as possible, and from image procossing
The distant object of device (can be regarded as background), carry out some virtualization processing., can also mould by way of image procossing
The shooting effect of dual camera is drawn up, under conditions of the unassembled dual camera of image processing apparatus, can also shoot has
Blur the image of effect.It is thus shooting with virtualization effect and the cost of dual camera is in general all costly
Image saves cost.
A kind of image processing method of the embodiment of the present invention, obtain the first two field picture and the second two field picture with parallax；
Second two field picture is calculated relative to first two field picture, displacement caused by target pixel points, obtains object in scene
Relative depth relationships figure, wherein, the target pixel points are to exist in first two field picture and second two field picture
Pixel；Obtain the pixel that displacement in the target pixel points is less than pre-determined distance；To displacement in the target pixel points
Pixel less than the pre-determined distance carries out the virtualization processing, the degree of the virtualization processing and the size of the displacement it
Between incidence relation be present.So, in the case of unassembled dual camera, the image with virtualization effect can also be shot,
Reduce the cost of image of the shooting with virtualization effect.And by setting pre-determined distance to ensure that from image processing apparatus
Closer personage is not influenceed by virtualization processing, and figure image can is clearly shown, when shooting user
There is more preferable experience.
Referring to Fig. 3, Fig. 3 is the structure chart of image processing apparatus provided in an embodiment of the present invention, can realize above-described embodiment
The details of middle image processing method, and reach identical effect.As shown in figure 3, image processing apparatus 300 includes acquisition module
301st, computing module 302 and processing module 303, acquisition module 301 and computing module 302 connect, computing module 302 and processing mould
Block 303 connects, wherein：
Acquisition module 301, for obtaining the first two field picture and the second two field picture with parallax；
Computing module 302, produced for calculating second two field picture relative to first two field picture, target pixel points
Raw displacement, obtain the relative depth relationships figure of object in scene, wherein, the target pixel points be first two field picture and
Existing pixel in second two field picture；
Processing module 303, for the target pixel points to be carried out with virtualization processing, the virtualization processing according to the displacement
Degree and the displacement size between incidence relation be present.
Optionally, as shown in figure 4, the acquisition module 301, including：
First acquisition submodule 3011, for obtaining the first two field picture, and obtain other outside first two field picture
Image；
Judging submodule 3012, for judging whether other described images with first two field picture meet default matching
Condition；
Determination sub-module 3013, if judging other described images and the first frame figure for the judging submodule 3012
As meeting the matching condition, then other described images are defined as second two field picture.
Optionally, as shown in figure 5, the judging submodule 3012, including：
Recognition unit 30121, for identifying other described images and existing common pixel in first two field picture
Point；
Computing unit 30122, for according to the common pixel point calculate described in other images relative to first frame
The horizontal offset and vertical offset of image；
Judging unit 30123, for judging whether the horizontal offset exceedes predetermined threshold value, and the vertical offset
Whether within a preset range；
Determining unit 30124, if judging that the horizontal offset exceedes the default threshold for the judging unit 30123
Value, and the vertical offset is in the preset range, it is determined that other described images meet institute with first two field picture
State matching condition.
Optionally, the computing unit 30122, is specifically used for：
Under conditions of other described images are carried out into image alignment with first two field picture, according to the common pixel
Point calculates horizontal offset and vertical offset of other the described images relative to first two field picture.
Optionally, as shown in fig. 6, the processing module 303, including：
Second acquisition submodule 3031, the pixel of pre-determined distance is less than for obtaining displacement in the target pixel points；
Submodule 3032 is handled, the pixel for being less than the pre-determined distance to displacement in the target pixel points is carried out
The virtualization processing.
Optionally, the incidence relation is negative correlativing relation.
Image processing apparatus 300 can realize each mistake that image processing apparatus is realized in Fig. 1 to Fig. 2 embodiment of the method
Journey, to avoid repeating, repeat no more here.
The image processing apparatus 300 of the embodiment of the present invention, it can handle to obtain the image with virtualization effect, improve figure
As processing quality, and dual camera need not be assembled, reduce image procossing cost.
Referring to Fig. 7, Fig. 7 is a kind of hardware architecture diagram for the mobile terminal for realizing each embodiment of the present invention, the shifting
Dynamic terminal 700 includes but is not limited to：Radio frequency unit 701, mixed-media network modules mixed-media 702, audio output unit 703, input block 704, biography
Sensor 705, display unit 706, user input unit 707, interface unit 708, memory 709, processor 710 and power supply
711 grade parts.It will be understood by those skilled in the art that the mobile terminal structure shown in Fig. 7 is not formed to mobile terminal
Limit, mobile terminal can be included than illustrating more or less parts, either combine some parts or different part cloth
Put.In embodiments of the present invention, mobile terminal includes but is not limited to mobile phone, tablet personal computer, notebook computer, palm PC, car
Mounted terminal, wearable device and pedometer etc..
Wherein, processor 710, for obtaining the first two field picture and the second two field picture with parallax；Calculate described second
Two field picture is relative to first two field picture, displacement caused by target pixel points, and the relative depth for obtaining object in scene is closed
System's figure, wherein, the target pixel points are existing pixel in first two field picture and second two field picture；According to
The displacement carries out virtualization processing to the target pixel points, is deposited between the degree of the virtualization processing and the size of the displacement
In incidence relation.So, in the case of unassembled dual camera, the image with virtualization effect can also be shot, is reduced
The cost of image of the shooting with virtualization effect.
Optionally, processor 710, it is additionally operable to obtain the first two field picture, and obtains other outside first two field picture
Image；Judge whether other described images with first two field picture meet default matching condition；If other described images with
First two field picture meets the matching condition, then other described images is defined as into second two field picture.
Optionally, processor 710, it is additionally operable to existing common in other described images of identification and first two field picture
Pixel；Relative to the horizontal offset of first two field picture and hung down according to other images described in common pixel point calculating
Straight offset；Judge whether the horizontal offset exceedes predetermined threshold value, and whether within a preset range the vertical offset；
If the horizontal offset exceedes the predetermined threshold value, and the vertical offset is in the preset range, it is determined that described
Other images meet the matching condition with first two field picture.
Optionally, processor 710, it is additionally operable to other described images and first two field picture carrying out image alignment
Under the conditions of, relative to the horizontal offset of first two field picture and hung down according to other images described in common pixel point calculating
Straight offset.
Optionally, processor 710, it is additionally operable to obtain the pixel that displacement in the target pixel points is less than pre-determined distance；
The pixel for being less than the pre-determined distance to displacement in the target pixel points carries out the virtualization processing.
Optionally, the incidence relation is negative correlativing relation.
It should be understood that in the embodiment of the present invention, radio frequency unit 701 can be used for receiving and sending messages or communication process in, signal
Reception and transmission, specifically, by from base station downlink data receive after, handled to processor 710；In addition, will be up
Data are sent to base station.Generally, radio frequency unit 701 includes but is not limited to antenna, at least one amplifier, transceiver, coupling
Device, low-noise amplifier, duplexer etc..In addition, radio frequency unit 701 can also by wireless communication system and network and other set
Standby communication.
Mobile terminal has provided the user wireless broadband internet by mixed-media network modules mixed-media 702 and accessed, and such as helps user to receive
Send e-mails, browse webpage and access streaming video etc..
Audio output unit 703 can be receiving by radio frequency unit 701 or mixed-media network modules mixed-media 702 or in memory 709
It is sound that the voice data of storage, which is converted into audio signal and exported,.Moreover, audio output unit 703 can also be provided and moved
The audio output for the specific function correlation that dynamic terminal 700 performs is (for example, call signal receives sound, message sink sound etc.
Deng).Audio output unit 703 includes loudspeaker, buzzer and receiver etc..
Input block 704 is used to receive audio or video signal.Input block 704 can include graphics processor
(Graphics Processing Unit, GPU) 7041 and microphone 7042, graphics processor 7041 is in video acquisition mode
Or the static images or the view data of video obtained in image capture mode by image capture apparatus (such as camera) are carried out
Reason.Picture frame after processing may be displayed on display unit 706.Picture frame after the processing of graphics processor 7041 can be deposited
Storage is transmitted in memory 709 (or other storage mediums) or via radio frequency unit 701 or mixed-media network modules mixed-media 702.Mike
Wind 7042 can receive sound, and can be voice data by such acoustic processing.Voice data after processing can be
The form output of mobile communication base station can be sent to via radio frequency unit 701 by being converted in the case of telephone calling model.
Mobile terminal 700 also includes at least one sensor 705, such as optical sensor, motion sensor and other biographies
Sensor.Specifically, optical sensor includes ambient light sensor and proximity transducer, wherein, ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 7061, and proximity transducer can close when mobile terminal 700 is moved in one's ear
Display panel 7061 and/or backlight.As one kind of motion sensor, accelerometer sensor can detect in all directions (general
For three axles) size of acceleration, size and the direction of gravity are can detect that when static, available for identification mobile terminal posture (ratio
Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap)；Pass
Sensor 705 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, wet
Meter, thermometer, infrared ray sensor etc. are spent, will not be repeated here.
Display unit 706 is used for the information for showing the information inputted by user or being supplied to user.Display unit 706 can wrap
Display panel 7061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used
Forms such as (Organic Light-Emitting Diode, OLED) configures display panel 7061.
User input unit 707 can be used for the numeral or character information for receiving input, and produce the use with mobile terminal
The key signals input that family is set and function control is relevant.Specifically, user input unit 707 include contact panel 7071 and
Other input equipments 7072.Contact panel 7071, also referred to as touch-screen, collect touch operation of the user on or near it
(for example user uses any suitable objects or annex such as finger, stylus on contact panel 7071 or in contact panel 7071
Neighbouring operation).Contact panel 7071 may include both touch detecting apparatus and touch controller.Wherein, touch detection
Device detects the touch orientation of user, and detects the signal that touch operation is brought, and transmits a signal to touch controller；Touch control
Device processed receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 710, receiving area
Manage the order that device 710 is sent and performed.It is furthermore, it is possible to more using resistance-type, condenser type, infrared ray and surface acoustic wave etc.
Type realizes contact panel 7071.Except contact panel 7071, user input unit 707 can also include other input equipments
7072.Specifically, other input equipments 7072 can include but is not limited to physical keyboard, function key (such as volume control button,
Switch key etc.), trace ball, mouse, action bars, will not be repeated here.
Further, contact panel 7071 can be covered on display panel 7061, when contact panel 7071 is detected at it
On or near touch operation after, send processor 710 to determine the type of touch event, be followed by subsequent processing device 710 according to touch
The type for touching event provides corresponding visual output on display panel 7061.Although in the figure 7, contact panel 7071 and display
Panel 7061 is the part independent as two to realize the input of mobile terminal and output function, but in some embodiments
In, can be integrated by contact panel 7071 and display panel 7061 and realize input and the output function of mobile terminal, it is specific this
Place does not limit.
Interface unit 708 is the interface that external device (ED) is connected with mobile terminal 700.For example, external device (ED) can include
Line or wireless head-band earphone port, external power source (or battery charger) port, wired or wireless FPDP, storage card end
Mouth, port, audio input/output (I/O) port, video i/o port, earphone end for connecting the device with identification module
Mouthful etc..Interface unit 708 can be used for receive the input (for example, data message, electric power etc.) from external device (ED) and
One or more elements that the input received is transferred in mobile terminal 700 can be used in the He of mobile terminal 700
Data are transmitted between external device (ED).
Memory 709 can be used for storage software program and various data.Memory 709 can mainly include storing program area
And storage data field, wherein, storing program area can storage program area, application program (such as the sound needed at least one function
Sound playing function, image player function etc.) etc.；Storage data field can store according to mobile phone use created data (such as
Voice data, phone directory etc.) etc..In addition, memory 709 can include high-speed random access memory, can also include non-easy
The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 710 is the control centre of mobile terminal, utilizes each of various interfaces and the whole mobile terminal of connection
Individual part, by running or performing the software program and/or module that are stored in memory 709, and call and be stored in storage
Data in device 709, the various functions and processing data of mobile terminal are performed, so as to carry out integral monitoring to mobile terminal.Place
Reason device 710 may include one or more processing units；Preferably, processor 710 can integrate application processor and modulatedemodulate is mediated
Device is managed, wherein, application processor mainly handles operating system, user interface and application program etc., and modem processor is main
Handle radio communication.It is understood that above-mentioned modem processor can not also be integrated into processor 710.
Mobile terminal 700 can also include the power supply 711 (such as battery) to all parts power supply, it is preferred that power supply 711
Can be logically contiguous by power-supply management system and processor 710, so as to realize management charging by power-supply management system, put
The function such as electricity and power managed.
In addition, mobile terminal 700 includes some unshowned functional modules, will not be repeated here.
Preferably, the embodiment of the present invention also provides a kind of mobile terminal, including processor 710, memory 709, is stored in
On memory 709 and the computer program that can be run on the processor 710, the computer program are performed by processor 710
Each process of the above-mentioned image processing method embodiments of Shi Shixian, and identical technique effect can be reached, to avoid repeating, here
Repeat no more.
The embodiment of the present invention also provides a kind of computer-readable recording medium, and meter is stored with computer-readable recording medium
Calculation machine program, the computer program realize each process of above-mentioned image processing method embodiment, and energy when being executed by processor
Reach identical technique effect, to avoid repeating, repeat no more here.Wherein, described computer-readable recording medium, such as only
Read memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation
RAM), magnetic disc or CD etc..
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row
His property includes, so that process, method, article or device including a series of elements not only include those key elements, and
And also include the other element being not expressly set out, or also include for this process, method, article or device institute inherently
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this
Other identical element also be present in the process of key element, method, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on such understanding, technical scheme is substantially done to prior art in other words
Going out the part of contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions to cause a station terminal (can be mobile phone, computer, service
Device, air conditioner, or network equipment etc.) perform method described in each embodiment of the present invention.
Embodiments of the invention are described above in conjunction with accompanying drawing, but the invention is not limited in above-mentioned specific
Embodiment, above-mentioned embodiment is only schematical, rather than restricted, one of ordinary skill in the art
Under the enlightenment of the present invention, in the case of present inventive concept and scope of the claimed protection is not departed from, it can also make a lot
Form, belong within the protection of the present invention.
Claims (14)
- A kind of 1. image processing method, it is characterised in that including：Obtain the first two field picture and the second two field picture with parallax；Second two field picture is calculated relative to first two field picture, displacement caused by target pixel points, is obtained in scene The relative depth relationships figure of object, wherein, the target pixel points are equal in first two field picture and second two field picture Existing pixel；Virtualization processing is carried out to the target pixel points according to the displacement, the degree that the virtualization is handled is big with the displacement Incidence relation between small be present.
- 2. according to the method for claim 1, it is characterised in that described to obtain the first two field picture and the second frame with parallax The step of image, including：The first two field picture is obtained, and obtains other images outside first two field picture；Judge whether other described images with first two field picture meet default matching condition；If other described images meet the matching condition with first two field picture, other described images are defined as described Second two field picture.
- 3. according to the method for claim 2, it is characterised in that other images described in the judgement whether with first frame Image meets the step of default matching condition, including：Other described images of identification and existing common pixel point in first two field picture；Other described images are calculated relative to the horizontal offset of first two field picture and vertically according to the common pixel point Offset；Judge whether the horizontal offset exceedes predetermined threshold value, and whether within a preset range the vertical offset；If the horizontal offset exceedes the predetermined threshold value, and the vertical offset is in the preset range, it is determined that Other described images meet the matching condition with first two field picture.
- 4. according to the method for claim 3, it is characterised in that described other figures according to calculating the common pixel point As relative to first two field picture horizontal offset and vertical offset the step of, including：Under conditions of other described images are carried out into image alignment with first two field picture, according to the common pixel point meter Calculate horizontal offset and vertical offset of other the described images relative to first two field picture.
- 5. method according to any one of claim 1 to 4, it is characterised in that it is described according to the displacement to the mesh Mark pixel is carried out the step of virtualization processing, including：Obtain the pixel that displacement in the target pixel points is less than pre-determined distance；The pixel for being less than the pre-determined distance to displacement in the target pixel points carries out the virtualization processing.
- 6. according to the method for claim 1, it is characterised in that the incidence relation is negative correlativing relation.
- A kind of 7. image processing apparatus, it is characterised in that including：Acquisition module, for obtaining the first two field picture and the second two field picture with parallax；Computing module, second two field picture is calculated relative to first two field picture, displacement caused by target pixel points, is obtained The relative depth relationships figure of object into scene, wherein, the target pixel points are first two field picture and second frame Existing pixel in image；Processing module, for the target pixel points to be carried out with virtualization processing, the degree of the virtualization processing according to the displacement Incidence relation be present between the size of the displacement.
- 8. image processing apparatus according to claim 7, it is characterised in that the acquisition module, including：First acquisition submodule, for obtaining the first two field picture, and obtain other images outside first two field picture；Judging submodule, for judging whether other described images with first two field picture meet default matching condition；Determination sub-module, if judging that other described images meet described with first two field picture for the judging submodule With condition, then other described images are defined as second two field picture.
- 9. image processing apparatus according to claim 8, it is characterised in that the judging submodule, including：Recognition unit, for identifying other described images and existing common pixel point in first two field picture；Computing unit, for according to the common pixel point calculate described in other images relative to first two field picture level Offset and vertical offset；Judging unit, for judging whether the horizontal offset exceedes predetermined threshold value, and whether the vertical offset is pre- If in scope；Determining unit, if judge that the horizontal offset exceedes the predetermined threshold value for the judging unit, and it is described vertical Offset is in the preset range, it is determined that other described images meet the matching condition with first two field picture.
- 10. image processing apparatus according to claim 9, it is characterised in that the computing unit, be specifically used for：Under conditions of other described images are carried out into image alignment with first two field picture, according to the common pixel point meter Calculate horizontal offset and vertical offset of other the described images relative to first two field picture.
- 11. the image processing apparatus according to any one of claim 7 to 10, it is characterised in that the processing module, bag Include：Second acquisition submodule, the pixel of pre-determined distance is less than for obtaining displacement in the target pixel points；Submodule is handled, the pixel for being less than the pre-determined distance to displacement in the target pixel points carries out the virtualization Processing.
- 12. image processing apparatus according to claim 7, it is characterised in that the incidence relation is negative correlativing relation.
- 13. a kind of mobile terminal, it is characterised in that including processor, memory and be stored on the memory and can be in institute The computer program run on processor is stated, the computer program is realized such as claim 1 to 6 during the computing device Any one of image processing method the step of.
- 14. a kind of computer-readable recording medium, it is characterised in that computer journey is stored on the computer-readable recording medium Sequence, the image processing method as any one of claim 1 to 6 is realized when the computer program is executed by processor Step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711135534.5A CN107682639B (en) | 2017-11-16 | 2017-11-16 | A kind of image processing method, device and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711135534.5A CN107682639B (en) | 2017-11-16 | 2017-11-16 | A kind of image processing method, device and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107682639A true CN107682639A (en) | 2018-02-09 |
| CN107682639B CN107682639B (en) | 2019-09-27 |
Family
ID=61149545
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711135534.5A Active CN107682639B (en) | 2017-11-16 | 2017-11-16 | A kind of image processing method, device and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107682639B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108449589A (en) * | 2018-03-26 | 2018-08-24 | 德淮半导体有限公司 | Handle the method, apparatus and electronic equipment of image |
| CN109087249A (en) * | 2018-08-27 | 2018-12-25 | 深圳艺达文化传媒有限公司 | The weakening method and Related product of promotion video |
| CN109688321A (en) * | 2018-11-21 | 2019-04-26 | 惠州Tcl移动通信有限公司 | Electronic equipment and its image display method, the device with store function |
| CN111385481A (en) * | 2020-03-30 | 2020-07-07 | 北京达佳互联信息技术有限公司 | Image processing method and device, electronic device and storage medium |
| CN112489104A (en) * | 2020-12-03 | 2021-03-12 | 海宁奕斯伟集成电路设计有限公司 | Distance measurement method and device, electronic equipment and readable storage medium |
| CN114827706A (en) * | 2022-03-09 | 2022-07-29 | 北京旷视科技有限公司 | Image processing method, computer program product, electronic device, and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130129233A1 (en) * | 2010-09-21 | 2013-05-23 | Stephen N. Schiller | System and Method for Classifying the Blur State of Digital Image Pixels |
| CN103945118A (en) * | 2014-03-14 | 2014-07-23 | 华为技术有限公司 | Picture blurring method and device and electronic equipment |
| CN105100615A (en) * | 2015-07-24 | 2015-11-25 | 青岛海信移动通信技术股份有限公司 | Image preview method, apparatus and terminal |
| CN105959534A (en) * | 2016-04-28 | 2016-09-21 | 青岛海信移动通信技术股份有限公司 | Image processing method, device and electronic equipment |
| CN107170008A (en) * | 2017-05-19 | 2017-09-15 | 成都通甲优博科技有限责任公司 | A kind of depth map creation method, system and image weakening method, system |
-
2017
- 2017-11-16 CN CN201711135534.5A patent/CN107682639B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130129233A1 (en) * | 2010-09-21 | 2013-05-23 | Stephen N. Schiller | System and Method for Classifying the Blur State of Digital Image Pixels |
| CN103945118A (en) * | 2014-03-14 | 2014-07-23 | 华为技术有限公司 | Picture blurring method and device and electronic equipment |
| CN105100615A (en) * | 2015-07-24 | 2015-11-25 | 青岛海信移动通信技术股份有限公司 | Image preview method, apparatus and terminal |
| CN105959534A (en) * | 2016-04-28 | 2016-09-21 | 青岛海信移动通信技术股份有限公司 | Image processing method, device and electronic equipment |
| CN107170008A (en) * | 2017-05-19 | 2017-09-15 | 成都通甲优博科技有限责任公司 | A kind of depth map creation method, system and image weakening method, system |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108449589A (en) * | 2018-03-26 | 2018-08-24 | 德淮半导体有限公司 | Handle the method, apparatus and electronic equipment of image |
| CN109087249A (en) * | 2018-08-27 | 2018-12-25 | 深圳艺达文化传媒有限公司 | The weakening method and Related product of promotion video |
| CN109087249B (en) * | 2018-08-27 | 2023-06-30 | 嘉兴九州文化传媒有限公司 | Blurring method of recommendation video and related products |
| CN109688321A (en) * | 2018-11-21 | 2019-04-26 | 惠州Tcl移动通信有限公司 | Electronic equipment and its image display method, the device with store function |
| CN111385481A (en) * | 2020-03-30 | 2020-07-07 | 北京达佳互联信息技术有限公司 | Image processing method and device, electronic device and storage medium |
| CN112489104A (en) * | 2020-12-03 | 2021-03-12 | 海宁奕斯伟集成电路设计有限公司 | Distance measurement method and device, electronic equipment and readable storage medium |
| CN114827706A (en) * | 2022-03-09 | 2022-07-29 | 北京旷视科技有限公司 | Image processing method, computer program product, electronic device, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107682639B (en) | 2019-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107682639B (en) | A kind of image processing method, device and mobile terminal | |
| CN107592466A (en) | A kind of photographic method and mobile terminal | |
| CN107835364A (en) | One kind is taken pictures householder method and mobile terminal | |
| CN107580209A (en) | Take pictures imaging method and the device of a kind of mobile terminal | |
| CN107835367A (en) | A kind of image processing method, device and mobile terminal | |
| CN107734260A (en) | A kind of image processing method and mobile terminal | |
| CN107948499A (en) | A kind of image capturing method and mobile terminal | |
| CN107566730A (en) | A kind of panoramic picture image pickup method and mobile terminal | |
| CN107833178A (en) | A kind of image processing method, device and mobile terminal | |
| CN107948498B (en) | A kind of elimination camera Morie fringe method and mobile terminal | |
| CN107846583A (en) | A kind of image shadow compensating method and mobile terminal | |
| CN110213485B (en) | Image processing method and terminal | |
| CN107317963A (en) | A kind of double-camera mobile terminal control method, mobile terminal and storage medium | |
| CN108320263A (en) | A kind of method, device and mobile terminal of image procossing | |
| CN108055402A (en) | A kind of image pickup method and mobile terminal | |
| CN107566749A (en) | Image pickup method and mobile terminal | |
| CN107864336B (en) | A kind of image processing method, mobile terminal | |
| CN107845057A (en) | One kind is taken pictures method for previewing and mobile terminal | |
| CN107592467A (en) | A kind of image pickup method and mobile terminal | |
| CN108234894A (en) | A kind of exposure adjustment method and terminal device | |
| CN108564613A (en) | A kind of depth data acquisition methods and mobile terminal | |
| CN107483836A (en) | A kind of image pickup method and mobile terminal | |
| CN107888833A (en) | A kind of image capturing method and mobile terminal | |
| CN107948516A (en) | A kind of image processing method, device and mobile terminal | |
| CN107682637A (en) | A kind of image pickup method, mobile terminal and computer-readable recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |