CN109191505A - Static state generates the method, apparatus of human face three-dimensional model, electronic equipment - Google Patents
Static state generates the method, apparatus of human face three-dimensional model, electronic equipment Download PDFInfo
- Publication number
- CN109191505A CN109191505A CN201810877942.6A CN201810877942A CN109191505A CN 109191505 A CN109191505 A CN 109191505A CN 201810877942 A CN201810877942 A CN 201810877942A CN 109191505 A CN109191505 A CN 109191505A
- Authority
- CN
- China
- Prior art keywords
- facial image
- human face
- coordinate
- mapping relations
- coordinate system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The disclosure discloses a kind of static method, apparatus, electronic equipment and computer storage medium for generating human face three-dimensional model.Wherein, the method which generates human face three-dimensional model includes obtaining threedimensional model；Facial image is obtained from imaging sensor；According to the coordinate system of the coordinate system of threedimensional model and facial image, mapping relations are generated；According to the mapping relations, the image information in facial image is mapped on threedimensional model, generates human face three-dimensional model.Image information in facial image can be mapped on threedimensional model by the embodiment of the present disclosure by taking the technical solution based on mapping relations, and then generate human face three-dimensional model, it is possible thereby to solve the technical issues of how taking into account operation cost and model validity.
Description
Technical field
This disclosure relates to which a kind of image procossing and computer vision field, three-dimensional more particularly to a kind of static generation face
The method, apparatus and computer readable storage medium of model.
Background technique
As the development and people of computer vision technique are in the demand of field of image processing, face modeling technique obtained
Extensive concern.
For visual angle, the most basic evaluation of face modeling is exactly the sense of reality, and for operation angle, a people
The size of its operand must be taken into consideration in the superiority and inferiority of face model building again.Existing a kind of human face model building, by face figure
Human face three-dimensional model is generated on universal model as cut then fitting to image.Although this method processing speed compared with
Fastly, still, the threedimensional model of reflection personal feature can not be generated for different faces, validity is lower.Existing another kind people
Face model building carries out facial image and model based on the numerous characteristic points of quantity to improve the authenticity of threedimensional model
Matching, this undoubtedly increases data operation quantity, and develop skill application cost.
In this regard, modeling field in face, such as how lower operation cost guarantees higher validity, also just becomes industry
The problem of discussing always with research.
Summary of the invention
The technical issues of disclosure solves is to provide a kind of static method for generating human face three-dimensional model, at least partly
Solve the technical issues of how taking into account operand and validity.In addition, also providing a kind of static dress for generating human face three-dimensional model
It sets, electronic equipment and computer readable storage medium.
To achieve the goals above, according to one aspect of the disclosure, the following technical schemes are provided:
A kind of static method for generating human face three-dimensional model, comprising:
Obtain threedimensional model；
Facial image is obtained from imaging sensor；
According to the coordinate system of the coordinate system of threedimensional model and facial image, mapping relations are generated；
According to the mapping relations, the image information in facial image is mapped on threedimensional model, it is three-dimensional to generate face
Model.
Further, described to be wrapped according to the coordinate system of threedimensional model with the coordinate system of facial image, generation mapping relations
It includes:
The origin of the coordinate system of the threedimensional model is aligned with the origin of the coordinate system of facial image, mapping is generated and closes
System.
It is further, described that the image information in facial image is mapped on threedimensional model according to the mapping relations,
Generate human face three-dimensional model, comprising:
First coordinate is inputted in the mapping relations, is obtained by the first coordinate for obtaining the pixel in threedimensional model
The image information of the pixel of second coordinate is added to described first and sat by the pixel corresponding second coordinate in facial image
In target pixel.
Further, described to be wrapped according to the coordinate system of threedimensional model with the coordinate system of facial image, generation mapping relations
It includes:
Upper 1 coordinate of threedimensional model is corresponded on n coordinate in facial image, generates mapping relations, wherein n
For the positive integer greater than 1.
It is further, described that the image information in facial image is mapped on threedimensional model according to the mapping relations,
Generate human face three-dimensional model, comprising:
The third coordinate is inputted in the mapping relations, is obtained by the third coordinate for obtaining the pixel in threedimensional model
Pixel on third coordinate corresponding n the second coordinates in facial image, by the image of the pixel on the n the second coordinates
Information, which is done to preset, is calculated calculated value, which is added in the pixel of the third coordinate.Wherein, the default calculating
It can be to average.
Further, described after obtaining facial image in imaging sensor, further includes:
Reference point is chosen on threedimensional model, the reference point is the standard feature point on threedimensional model, the face figure
There is features of human face images corresponding with the reference point on picture.
Further, described to be wrapped according to the coordinate system of threedimensional model with the coordinate system of facial image, generation mapping relations
It includes:
According to the coordinate system of threedimensional model, the coordinate system of facial image and reference point, mapping relations are generated.
Further, after the acquisition threedimensional model, further includes:
Select the partial region in threedimensional model；
It is described according to the coordinate system of threedimensional model and the coordinate system of facial image, generate mapping relations, comprising:
According to the coordinate system of the coordinate system of the partial region of the threedimensional model and facial image, mapping relations are generated.
To achieve the goals above, according to another aspect of the disclosure, also the following technical schemes are provided:
A kind of static device for generating human face three-dimensional model, comprising:
Obtaining three-dimensional model module, for obtaining threedimensional model；
Facial image obtains module, for obtaining facial image from imaging sensor；
Mapping relations generation module, for generating mapping according to the coordinate system of threedimensional model and the coordinate system of facial image
Relationship；
Human face three-dimensional model generation module, for according to the mapping relations, the image information in facial image to be mapped
Onto threedimensional model, human face three-dimensional model is generated.
Further, the mapping relations generation module is specifically used for the origin of the coordinate system of the threedimensional model and people
The origin of the coordinate system of face image is aligned, and generates mapping relations.
Further, the human face three-dimensional model generation module is specifically used for obtaining the first seat of the pixel in threedimensional model
First coordinate is inputted in the mapping relations, the pixel corresponding second coordinate in facial image is obtained, by this by mark
The image information of the pixel of second coordinate is added in the pixel of first coordinate.
Further, the mapping relations generation module is specifically used for upper 1 coordinate of threedimensional model corresponding to people
On n coordinate in face image, mapping relations are generated.Further, the human face three-dimensional model generation module is specifically used for obtaining
The third coordinate is inputted in the mapping relations, is obtained on third coordinate by the third coordinate for taking the pixel in threedimensional model
Pixel in facial image corresponding n the second coordinate, the image information of the pixel on the n the second coordinates is done default
Calculated value is calculated, which is added in the pixel of the third coordinate.Further, described preset is calculated as asking flat
Mean value.
Further, described after obtaining facial image in imaging sensor, described device also executes following processing:
Choose reference point on threedimensional model, the reference point is the standard feature point on threedimensional model, have on the facial image with
The corresponding features of human face images of the reference point.
Further, the mapping relations generation module is specifically used for according to the coordinate system of threedimensional model, facial image
Coordinate system and reference point generate mapping relations.
Further, after the acquisition threedimensional model, described device also executes following processing: in selection threedimensional model
Partial region；The mapping relations generation module is specifically used for coordinate system and the people of the partial region according to the threedimensional model
The coordinate system of face image generates mapping relations.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of electronic equipment, comprising:
Memory, for storing non-transitory computer-readable instruction；And
Processor, for running the computer-readable instruction, so that being realized when processor execution any of the above-described quiet
State generates the step of described in the method and technology scheme of human face three-dimensional model.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of computer readable storage medium, for storing non-transitory computer-readable instruction, when the non-transitory
When computer-readable instruction is executed by computer, so that the computer executes any of the above-described static generation human face three-dimensional model
The step of described in method and technology scheme.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
Method, the static state that the embodiment of the present disclosure provides a kind of static generation human face three-dimensional model generate human face three-dimensional model
Device, electronic equipment, computer readable storage medium.Wherein, the method which generates human face three-dimensional model includes: acquisition three
Dimension module；Facial image is obtained, identifies fisrt feature point corresponding with the standard faces characteristic point；According to the fisrt feature
Point is static to generate grid, and the vertex of the grid is the fisrt feature point；Obtain the depth information of the fisrt feature point；Root
According to the grid and the depth information, facial image is fitted on threedimensional model, generates human face three-dimensional model.The disclosure
Embodiment can be fitted to facial image on threedimensional model based on grid and depth information by taking the technical solution, from
And human face three-dimensional model is generated, improve the validity of threedimensional model.
Above description is only the general introduction of disclosed technique scheme, in order to better understand the technological means of the disclosure, and
It can be implemented in accordance with the contents of the specification, and to allow the above and other objects, features and advantages of the disclosure can be brighter
Show understandable, it is special below to lift preferred embodiment, and cooperate attached drawing, detailed description are as follows.
Detailed description of the invention
Fig. 1 is the flow diagram according to the static method for generating human face three-dimensional model of an embodiment of the present disclosure；
Fig. 2 a is the flow diagram according to the method for the generation human face three-dimensional model of an embodiment of the present disclosure；
Fig. 2 b is the flow diagram according to the method for the generation human face three-dimensional model of the disclosure another embodiment；
Fig. 3 is the flow diagram according to the static method for generating human face three-dimensional model of the disclosure another embodiment；
Fig. 4 is the structural schematic diagram according to the static device for generating human face three-dimensional model of an embodiment of the present disclosure；
Fig. 5 is to be shown according to the structure for the static electronic equipment for generating human face three-dimensional model of an embodiment of the present disclosure
It is intended to；
Fig. 6 is the structural schematic diagram according to the computer readable storage medium of an embodiment of the present disclosure；
Fig. 7 is the structural schematic diagram that terminal is modeled according to the face of an embodiment of the present disclosure.
Specific embodiment
Illustrate embodiment of the present disclosure below by way of specific specific example, those skilled in the art can be by this specification
Disclosed content understands other advantages and effect of the disclosure easily.Obviously, described embodiment is only the disclosure
A part of the embodiment, instead of all the embodiments.The disclosure can also be subject to reality by way of a different and different embodiment
It applies or applies, the various details in this specification can also be based on different viewpoints and application, in the spirit without departing from the disclosure
Lower carry out various modifications or alterations.It should be noted that in the absence of conflict, the feature in following embodiment and embodiment can
To be combined with each other.Based on the embodiment in the disclosure, those of ordinary skill in the art are without creative efforts
Every other embodiment obtained belongs to the range of disclosure protection.
It should be noted that the various aspects of embodiment within the scope of the appended claims are described below.Ying Xian
And be clear to, aspect described herein can be embodied in extensive diversified forms, and any specific structure described herein
And/or function is only illustrative.Based on the disclosure, it will be understood by one of ordinary skill in the art that one described herein
Aspect can be independently implemented with any other aspect, and can combine the two or both in these aspects or more in various ways.
For example, carry out facilities and equipments in terms of any number set forth herein can be used and/or practice method.In addition, can make
With other than one or more of aspect set forth herein other structures and/or it is functional implement this equipment and/or
Practice the method.
It should also be noted that, diagram provided in following embodiment only illustrates the basic structure of the disclosure in a schematic way
Think, component count, shape and the size when only display is with component related in the disclosure rather than according to actual implementation in schema are drawn
System, when actual implementation kenel, quantity and the ratio of each component can arbitrarily change for one kind, and its assembly layout kenel can also
It can be increasingly complex.
In addition, in the following description, specific details are provided for a thorough understanding of the examples.However, fields
The skilled person will understand that the aspect can be practiced without these specific details.
In order to solve such as the technical issues of how lower operand realizes the higher validity of human face three-dimensional model, the disclosure
Embodiment provides a kind of static method for generating human face three-dimensional model.As shown in Figure 1, the static state generates the side of human face three-dimensional model
Method mainly includes the following steps S1 to step S4.Wherein:
Step S1: threedimensional model is obtained.
Wherein, the threedimensional model is humanoid model, includes faceform in threedimensional model.Without including it in the model
His image information, only a face contour model.It certainly, can also be by subsequent even if including image information
Image mapping and override.
Step S2: facial image is obtained from imaging sensor.
Wherein, the facial image can be the self-timer image of user, monitoring image etc..
Step S3: according to the coordinate system of the coordinate system of threedimensional model and facial image, mapping relations are generated.
Wherein, threedimensional model itself is in a coordinate system, and facial image is also in a coordinate system.Pass through step
The two coordinate systems are done and are mapped by S3, so that the two be associated.In one application, the coordinate one in two coordinate systems
One mapping, for example, the coordinate origin (0,0) of the coordinate origin (0,0) of threedimensional model and facial image is corresponding, class according to this
It pushes away, forms a mapping relations.Certainly, mapping relations are also possible to other relationships, for example on facial image a point is corresponding
Two points on threedimensional model, for example choose in two points on facial image brighter point and by its information MAP to three-dimensional mould
In type on corresponding two points.In general, pixel and coordinate points can be corresponding, in other words a coordinate points corresponding one
A pixel, coordinate system can be established according to resolution ratio, and such pixel and coordinate points correspond.
Step S4: according to the mapping relations, the image information in facial image being mapped on threedimensional model, generates people
Face three-dimensional model.
Using disclosed technique scheme, the coordinate mapping relations of threedimensional model and facial image are generated based on coordinate system, and
The image information in facial image is mapped on threedimensional model based on the mapping relations, can be obtained with relatively low operand
To the human face three-dimensional model with higher validity, application cost and modeling effect have been had both.Wherein, image information can wrap
Include texture information, colouring information, depth information etc..
Correlation step shown in Fig. 1 is described in detail with specific embodiment below, these explanations are intended to citing so that skill
Art scheme is easier to understand.
In an alternative embodiment, the coordinate mapping relations of threedimensional model and facial image are established using following methods
(that is, realizing step S3): the origin of the coordinate system of the threedimensional model is aligned with the origin of the coordinate system of facial image, is generated
Mapping relations.In this way, as long as coordinate is identical to determine that coordinate is corresponding, mapping relations can quickly be established.
In an alternative embodiment, as shown in Figure 2 a, human face three-dimensional model is generated (that is, realizing using following steps
Step S4):
S41a: the first coordinate of the pixel in threedimensional model is obtained.
S42a: first coordinate is inputted in the mapping relations, obtains the pixel corresponding the in facial image
Two coordinates.
S43a: the image information of the pixel of second coordinate is added in the pixel of first coordinate.
Wherein, the image information of the pixel of the second coordinate can be obtained by tabling look-up.Including texture information, colouring information,
Including depth information etc., corresponding table can establish.For example, establishing corresponding table when obtaining facial image.
Using the present embodiment, it is obtained in facial image by the way that the coordinate of the pixel on threedimensional model is substituted into mapping relations
On respective coordinates, then the image information of the latter is added in the former pixel, human face three-dimensional model can be quickly generated.
In an alternative embodiment, coordinate mapping relations (that is, realizing step S3) is generated in the following ways: by three
(n is positive integer greater than 1, for example, 2,3,4,5,6) a coordinate by n that 1 coordinate on dimension module corresponds in facial image
On, generate mapping relations.
In this embodiment, referring to Fig. 2 b, human face three-dimensional model is generated using following steps:
S41b: the third coordinate of the pixel in threedimensional model is obtained.
S42b: the third coordinate is inputted in the mapping relations, obtains the pixel on third coordinate in facial image
In corresponding n the second coordinates.
S43b: the image information of the pixel on the n the second coordinates is done into default calculate (for example, average value) and is counted
Calculation value.
S44b: the calculated value is added in the pixel of the third coordinate.
By step S43b and S44b it is found that using the present embodiment, the information of the pixel of third coordinate is by face figure
It codetermines, is obtained by a preset calculating logic, for example, seeking absolute average as the value of n upper pixel
Or Gaussian Blur value etc..Using the embodiment, the local feature for capableing of synthetic image is mapped.
In this embodiment, in the hope of Gaussian Blur value, it is assumed that the pixel on third coordinate is corresponding 9 in facial image
A second coordinate calculates the weight of 9 points according to two-dimensional Gaussian function first, obtains weight matrix and carries out normalizing to weight
Change；Then it is weighted according to the pixel value of each point and its weight, cumulative obtained value i.e. Gaussian Blur value.
In an alternative embodiment, after obtaining facial image from imaging sensor, ginseng is chosen on threedimensional model
Examination point, the reference point are the standard feature point on threedimensional model, have people corresponding with the reference point on the facial image
Face image characteristic point.Using the embodiment, it is advantageously implemented following function.It is specifically described below.
In the case where being provided with reference point, for example, can be used in the case where having chosen reference point on threedimensional model
Following manner generates mapping relations: according to the coordinate system of threedimensional model, the coordinate system of facial image and reference point, generating mapping
Relationship.
Wherein, the standard feature point on threedimensional model can be predetermined, for example, true based on face recognition technology
It is fixed.For entirety, face recognition technology can substantially be attributed to following several classes: method based on geometrical characteristic, based on template
Method and method based on model.Wherein, the method based on geometrical characteristic usually requires to combine just have with other algorithms to compare
Good effect；Method based on template can be divided into method, eigenface method, linear discriminant analysis side based on relevant matches
Method, singular value decomposition method, neural network method, Dynamic link library matching process etc.；Method based on model then has based on hidden horse
Er Kefu model, active shape model and method of active appearance models etc..Those skilled in the art are establishing the humanoid mould
When type, it may be considered that these methods, the improvement of these methods or the combination of these methods and other methods.Disclosed technique
Scheme is not intended to limit how the threedimensional model is specifically established.
In this embodiment, it is associated with due to mapping relations with reference point, to be able to achieve following function.For example, in three-dimensional
It is reference point that two characteristic points are chosen on model, the correlation of pixel and two reference points thereon is calculated, in face figure
Picture, the coordinate of corresponding reference point be it is known, pixel can be calculated on facial image using correlation above-mentioned
Corresponding points, the value of pixel is obtained with this.In this way, due to record be correlation, thus when facial image occur it is certain
Distortion when, can be used distortion after pixel value substitute into threedimensional model, to realize certain following function.
In an alternative embodiment, as shown in figure 3, the static method for generating human face three-dimensional model includes:
S1: threedimensional model is obtained.
S1 ': the partial region in selection threedimensional model.
S2: facial image is obtained from imaging sensor.
S3 ': it according to the coordinate system of the coordinate system of the partial region of the threedimensional model and facial image, generates mapping and closes
System.
S4 ': it is generated according to the mapping relations by the parts of images information MAP to threedimensional model in facial image
Human face three-dimensional model.
Using the embodiment, it can support and realize that parts of images maps.For example, user can only map eye portion
Onto threedimensional model.In one application, the area mapped can be selected on facial image by the way of frame choosing
Domain (for example, polygonal region).In another kind application, identical feature is all identified on threedimensional model and facial image
Point, and characteristic point has position attribute, for example, belonging to the characteristic point of eyes, nose or mouth.In this way, when by from position
It is chosen in list to mapping position specified or by selected characteristic point according to the specified needs in the position of this feature point
When, map to the property of can choose required position.Certainly, selection mode is not limited to listed above, and those skilled in the art can
In a manner of being chosen according to practical application scene, user demand etc. flexible setting.
According to being described above it is found that the disclosure is by taking above-mentioned technical proposal, by establishing threedimensional model and face figure
The coordinate mapping relations of picture, and the image information in facial image is mapped on threedimensional model according to the coordinate mapping relations,
To generate human face three-dimensional model, good validity can be realized with lower operand, while saving calculation resources
Improve visual effect.
Those skilled in the art will be understood that on the basis of the embodiment of the higher validity of above-mentioned acquisition, can also be into
Row obvious variant or equivalent replacement, for example, to those skilled in the art, the coordinate system of threedimensional model and faceform
Selection, coordinate mapping relations etc. there is different specific implementations, and in technical solution disclosed in the present application and its technology
Under design, these transformation are within its protection scope.
The embodiment of the present disclosure in the specific implementation, on the basis of the above embodiments, can also increase corresponding step.Example
Such as, it uploaded, evaluated (for example, user gives a mark for validity, alternatively, with known according to the human face three-dimensional model of generation
User's human face three-dimensional model is compared) etc. processing, recognition of face is carried out to threedimensional model and determines standard feature point in order to selecting
Take reference point etc..
It is below embodiment of the present disclosure, embodiment of the present disclosure can be used for executing embodiments of the present disclosure realization
The step of, for ease of description, part relevant to the embodiment of the present disclosure is illustrated only, it is disclosed by specific technical details, it asks
Referring to embodiments of the present disclosure.
In order to solve such as the technical issues of how lower operand realizes the higher validity of human face three-dimensional model, the disclosure
Embodiment provides a kind of static device for generating human face three-dimensional model.Referring to Fig. 4, the static dress for generating human face three-dimensional model
It sets and obtains module 42, mapping relations generation module 43 and human face three-dimensional model including obtaining three-dimensional model module 41, facial image
Generation module 44.It is specifically described below.
In the present embodiment, obtaining three-dimensional model module 41 is for obtaining threedimensional model.
In the present embodiment, facial image obtains module 42 for obtaining facial image from imaging sensor.
In the present embodiment, mapping relations generation module 43 is used for according to the coordinate system of threedimensional model and the seat of facial image
Mark system, generates mapping relations.
In the present embodiment, human face three-dimensional model generation module 44 is used for according to the mapping relations, will be in facial image
Image information be mapped on threedimensional model, generate human face three-dimensional model.
In an alternative embodiment, the mapping relations generation module 43 is specifically used for the coordinate of the threedimensional model
The origin of the coordinate system of the origin and facial image of system is aligned, and generates mapping relations.
In an alternative embodiment, the human face three-dimensional model generation module 44 is specifically used for obtaining in threedimensional model
First coordinate is inputted in the mapping relations, it is corresponding in facial image to obtain the pixel by the first coordinate of pixel
The image information of the pixel of second coordinate is added in the pixel of first coordinate by the second coordinate.
In an alternative embodiment, the mapping relations generation module 43 is specifically used for upper 1 of threedimensional model
Coordinate corresponds on n coordinate in facial image, generates mapping relations.Further, the human face three-dimensional model generates mould
Block 44 is specifically used for obtaining the third coordinate of the pixel in threedimensional model, and the third coordinate is inputted in the mapping relations,
Corresponding n second coordinates in facial image of the pixel on third coordinate are obtained, by the pixel on the n the second coordinates
Image information, which is done to preset, is calculated calculated value, which is added in the pixel of the third coordinate.Further, described
It is default to be calculated as averaging.
In an alternative embodiment, described after obtaining facial image in imaging sensor, the static generation
The device of human face three-dimensional model also executes following processing: reference point is chosen on threedimensional model, the reference point is threedimensional model
On standard feature point, have features of human face images corresponding with the reference point on the facial image.
In an alternative embodiment, the mapping relations generation module 43 is specifically used for the coordinate according to threedimensional model
System, the coordinate system of facial image and reference point generate mapping relations.
In an alternative embodiment, after the acquisition threedimensional model, the static generation human face three-dimensional model
Device also executes following processing: the partial region in selection threedimensional model；The mapping relations generation module 43 is specifically used for root
According to the coordinate system of the partial region of the threedimensional model and the coordinate system of facial image, mapping relations are generated.
Before being referred in relation to detailed descriptions such as static working principle, the technical effects of realization for generating human face three-dimensional model
The related description in the static embodiment of the method for generating human face three-dimensional model is stated, details are not described herein.
Fig. 5 is the diagram hardware according to an embodiment of the present disclosure for the static electronic equipment for generating human face three-dimensional model
Block diagram.As shown in figure 5, including storage for the static electronic equipment 50 for generating human face three-dimensional model according to the embodiment of the present disclosure
Device 51 and processor 52.
The memory 51 is for storing non-transitory computer-readable instruction.Specifically, memory 51 may include one
Or multiple computer program products, the computer program product may include various forms of computer readable storage mediums, example
Such as volatile memory and/or nonvolatile memory.The volatile memory for example may include random access memory
(RAM) and/or cache memory (cache) etc..The nonvolatile memory for example may include read-only memory
(ROM), hard disk, flash memory etc..
The processor 52 can be central processing unit (CPU) or have data-handling capacity and/or instruction execution energy
The processing unit of the other forms of power, and can control other components in the static device 50 for generating human face three-dimensional model with
Execute desired function.In one embodiment of the present disclosure, which is used to run this stored in the memory 51
Computer-readable instruction, so that the hardware device 50 that the static state generates human face three-dimensional model executes each embodiment of the disclosure above-mentioned
The static method for generating human face three-dimensional model all or part of the steps.
Those skilled in the art will be understood that solve the technical issues of how obtaining good user experience effect, this
It also may include structure well known to communication bus, interface etc. in embodiment, these well known structures should also be included in this public affairs
Within the protection scope opened.
Being described in detail in relation to the present embodiment can be with reference to the respective description in foregoing embodiments, and details are not described herein.
Fig. 6 is the schematic diagram for illustrating computer readable storage medium according to an embodiment of the present disclosure.As shown in fig. 6, root
According to the computer readable storage medium 60 of the embodiment of the present disclosure, it is stored thereon with non-transitory computer-readable instruction 61.When this
When non-transitory computer-readable instruction 61 is run by processor, executes the static of each embodiment of the disclosure above-mentioned and generate face
The all or part of the steps of the method for threedimensional model.
Above-mentioned computer readable storage medium 60 includes but is not limited to: and optical storage media (such as: CD-ROM and DVD), magnetic
Optical storage media (such as: MO), magnetic storage medium (such as: tape or mobile hard disk), with built-in rewritable nonvolatile
The media (such as: storage card) of memory and media (such as: ROM box) with built-in ROM.
Being described in detail in relation to the present embodiment can be with reference to the respective description in foregoing embodiments, and details are not described herein.
Fig. 7 is the hardware structural diagram for illustrating the terminal device according to the embodiment of the present disclosure.As shown in fig. 7, this is used for
The face modeling terminal 70 that static state generates human face three-dimensional model includes the above-mentioned static Installation practice for generating human face three-dimensional model.
Face modeling terminal device can be implemented in a variety of manners, and the terminal device in the disclosure may include but not
It is (flat to be limited to such as mobile phone, smart phone, laptop, digit broadcasting receiver, PDA (personal digital assistant), PAD
Plate computer), PMP (portable media player), navigation device, vehicle-mounted terminal equipment, vehicle-mounted display terminal, after vehicle electronics
The fixed terminal equipment of the mobile terminal device of visor etc. and such as number TV, desktop computer etc..
As the embodiment of equivalent replacement, which can also include other assemblies.As shown in fig. 7, the face models
Terminal 70 may include power supply unit 71, wireless communication unit 72, A/V (audio/video) input unit 73, user input unit
74, sensing unit 75, interface unit 76, controller 77, output unit 78 and memory 79 etc..Fig. 7 is shown with various
The terminal of component can also alternatively be implemented more or more it should be understood that be not required for implementing all components shown
Few component.
Wherein, wireless communication unit 72 allows the radio communication between terminal 70 and wireless communication system or network.A/V
Input unit 73 is for receiving audio or video signal.It is defeated that the order that user input unit 74 can be inputted according to user generates key
Enter data with the various operations of controlling terminal equipment.Sensing unit 75 detects the current state of terminal 70, the position of terminal 70, use
Family is mobile for the acceleration or deceleration of the orientation of the presence or absence of touch input of terminal 70, terminal 70, terminal 70 and direction etc., and
And generate order or the signal for the operation for being used for controlling terminal 70.Interface unit 76 is used as at least one external device (ED) and terminal 70
Connection can by interface.Output unit 78 is configured to provide output signal with vision, audio and/or tactile manner.It deposits
Reservoir 79 can store the software program etc. of the processing and control operation that are executed by controller 77, or can temporarily store
Oneself is through output or the data that will be exported.Memory 79 may include the storage medium of at least one type.Moreover, terminal 70 can
To cooperate with the network storage device for the store function for executing memory 79 by network connection.The usual controlling terminal of controller 77
The overall operation of equipment.In addition, controller 77 may include for reproducing or the multi-media module of multimedia playback data.Control
The handwriting input executed on the touchscreen or picture can be drawn input and are identified as word by device 77 with execution pattern identifying processing
Symbol or image.Power supply unit 71 receives external power or internal power under the control of controller 77 and provides operation each element
With electric power appropriate needed for component.
The various embodiments for the static method for generating human face three-dimensional model that the disclosure proposes can be to use in terms of for example
The computer-readable medium of calculation machine software, hardware or any combination thereof is implemented.Hardware is implemented, the static state that the disclosure proposes
The various embodiments for generating the method for human face three-dimensional model can be believed by using application-specific IC (ASIC), number
Number processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array
(FPGA), processor, controller, microcontroller, microprocessor, be designed in the electronic unit for executing function described herein
At least one implement, in some cases, the static method for generating human face three-dimensional model that the disclosure proposes it is various
Embodiment can be implemented in controller 77.For software implementation, the static state that the disclosure proposes generates human face three-dimensional model
The various embodiments of method can be implemented with the individual software module that allows to execute at least one functions or operations.Software
Code can be implemented by the software application (or program) write with any programming language appropriate, and software code can be deposited
Storage executes in memory 79 and by controller 77.
Being described in detail in relation to the present embodiment can be with reference to the respective description in foregoing embodiments, and details are not described herein.
The basic principle of the disclosure is described in conjunction with specific embodiments above, however, it is desirable to, it is noted that in the disclosure
The advantages of referring to, advantage, effect etc. are only exemplary rather than limitation, must not believe that these advantages, advantage, effect etc. are the disclosure
Each embodiment is prerequisite.In addition, detail disclosed above is merely to exemplary effect and the work being easy to understand
With, rather than limit, it is that must be realized using above-mentioned concrete details that above-mentioned details, which is not intended to limit the disclosure,.
Device involved in the disclosure, device, equipment, system block diagram only as illustrative example and be not intended to
It is required that or hint must be attached in such a way that box illustrates, arrange, configure.As those skilled in the art will appreciate that
, it can be connected by any way, arrange, configure these devices, device, equipment, system.Such as "include", "comprise", " tool
" etc. word be open vocabulary, refer to " including but not limited to ", and can be used interchangeably with it.Vocabulary used herein above
"or" and "and" refer to vocabulary "and/or", and can be used interchangeably with it, unless it is not such that context, which is explicitly indicated,.Here made
Vocabulary " such as " refers to phrase " such as, but not limited to ", and can be used interchangeably with it.
In addition, as used herein, the "or" instruction separation used in the enumerating of the item started with "at least one"
It enumerates, so that enumerating for such as " at least one of A, B or C " means A or B or C or AB or AC or BC or ABC (i.e. A and B
And C).In addition, wording " exemplary " does not mean that the example of description is preferred or more preferable than other examples.
It may also be noted that in the system and method for the disclosure, each component or each step are can to decompose and/or again
Combination nova.These decompose and/or reconfigure the equivalent scheme that should be regarded as the disclosure.
The technology instructed defined by the appended claims can not departed from and carried out to the various of technology described herein
Change, replace and changes.In addition, the scope of the claims of the disclosure is not limited to process described above, machine, manufacture, thing
Composition, means, method and the specific aspect of movement of part.Can use carried out to corresponding aspect described herein it is essentially identical
Function or realize essentially identical result there is currently or later to be developed processing, machine, manufacture, event group
At, means, method or movement.Thus, appended claims include such processing, machine, manufacture, event within its scope
Composition, means, method or movement.
The above description of disclosed aspect is provided so that any person skilled in the art can make or use this
It is open.Various modifications in terms of these are readily apparent to those skilled in the art, and are defined herein
General Principle can be applied to other aspect without departing from the scope of the present disclosure.Therefore, the disclosure is not intended to be limited to
Aspect shown in this, but according to principle disclosed herein and the consistent widest range of novel feature.
In order to which purpose of illustration and description has been presented for above description.In addition, this description is not intended to the reality of the disclosure
It applies example and is restricted to form disclosed herein.Although already discussed above multiple exemplary aspects and embodiment, this field skill
Its certain modifications, modification, change, addition and sub-portfolio will be recognized in art personnel.
Claims (11)
1. a kind of static method for generating human face three-dimensional model characterized by comprising
Obtain threedimensional model；
Facial image is obtained from imaging sensor；
According to the coordinate system of the coordinate system of threedimensional model and facial image, mapping relations are generated；
According to the mapping relations, the image information in facial image is mapped on threedimensional model, generates human face three-dimensional model.
2. the static method for generating human face three-dimensional model according to claim 1, which is characterized in that described according to three-dimensional mould
The coordinate system of type and the coordinate system of facial image generate mapping relations, comprising:
The origin of the coordinate system of the threedimensional model is aligned with the origin of the coordinate system of facial image, generates mapping relations.
3. the static method for generating human face three-dimensional model according to claim 1, which is characterized in that described to be reflected according to
Relationship is penetrated, the image information in facial image is mapped on threedimensional model, generates human face three-dimensional model, comprising:
First coordinate is inputted in the mapping relations, obtains the picture by the first coordinate for obtaining the pixel in threedimensional model
The image information of the pixel of second coordinate is added to first coordinate by element corresponding second coordinate in facial image
In pixel.
4. the static method for generating human face three-dimensional model according to claim 1, which is characterized in that described according to three-dimensional mould
The coordinate system of type and the coordinate system of facial image generate mapping relations, comprising:
Upper 1 coordinate of threedimensional model is corresponded on n coordinate in facial image, generates mapping relations, wherein n is big
In 1 positive integer.
5. the static method for generating human face three-dimensional model according to claim 4, which is characterized in that described to be reflected according to
Relationship is penetrated, the image information in facial image is mapped on threedimensional model, generates human face three-dimensional model, comprising:
The third coordinate is inputted in the mapping relations, obtains third by the third coordinate for obtaining the pixel in threedimensional model
Pixel on coordinate corresponding n the second coordinates in facial image, by the image information of the pixel on the n the second coordinates
It does to preset and calculated value is calculated, which is added in the pixel of the third coordinate.
6. the static method for generating human face three-dimensional model according to claim 1, which is characterized in that passed described from image
In sensor after acquisition facial image, further includes:
Choose reference point on threedimensional model, the reference point is the standard feature point on threedimensional model, on the facial image
There is features of human face images corresponding with the reference point.
7. the static method for generating human face three-dimensional model according to claim 1, which is characterized in that described according to three-dimensional mould
The coordinate system of type and the coordinate system of facial image generate mapping relations, comprising:
According to the coordinate system of threedimensional model, the coordinate system of facial image and reference point, mapping relations are generated.
8. the static method for generating human face three-dimensional model according to claim 1, which is characterized in that three-dimensional in the acquisition
After model, further includes:
Select the partial region in threedimensional model；
It is described according to the coordinate system of threedimensional model and the coordinate system of facial image, generate mapping relations, comprising:
According to the coordinate system of the coordinate system of the partial region of the threedimensional model and facial image, mapping relations are generated.
9. a kind of static device for generating human face three-dimensional model characterized by comprising
Obtaining three-dimensional model module, for obtaining threedimensional model；
Facial image obtains module, for obtaining facial image from imaging sensor；
Mapping relations generation module, for generating mapping relations according to the coordinate system of threedimensional model and the coordinate system of facial image；
Human face three-dimensional model generation module, for according to the mapping relations, the image information in facial image to be mapped to three
On dimension module, human face three-dimensional model is generated.
10. a kind of electronic equipment, comprising:
Memory, for storing non-transitory computer-readable instruction；And
Processor, for running the computer-readable instruction, so that realizing according to claim 1-9 when the processor executes
Any one of described in the strain image generation method based on face.
11. a kind of computer readable storage medium, for storing non-transitory computer-readable instruction, when the non-transitory meter
When calculation machine readable instruction is executed by computer, so that the computer perform claim requires static state described in any one of 1-9
The method for generating human face three-dimensional model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810877942.6A CN109191505A (en) | 2018-08-03 | 2018-08-03 | Static state generates the method, apparatus of human face three-dimensional model, electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810877942.6A CN109191505A (en) | 2018-08-03 | 2018-08-03 | Static state generates the method, apparatus of human face three-dimensional model, electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109191505A true CN109191505A (en) | 2019-01-11 |
Family
ID=64920080
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810877942.6A Pending CN109191505A (en) | 2018-08-03 | 2018-08-03 | Static state generates the method, apparatus of human face three-dimensional model, electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109191505A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109857311A (en) * | 2019-02-14 | 2019-06-07 | 北京达佳互联信息技术有限公司 | Generate method, apparatus, terminal and the storage medium of human face three-dimensional model |
| CN109949212A (en) * | 2019-03-13 | 2019-06-28 | 北京达佳互联信息技术有限公司 | Image mapping method, device, electronic equipment and storage medium |
| CN110084883A (en) * | 2019-04-15 | 2019-08-02 | 昆明理工大学 | A method of it inducing brain activity and rebuilds face-image |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1889129A (en) * | 2006-07-20 | 2007-01-03 | 北京中星微电子有限公司 | Fast human face model building method and system based on single-sheet photo |
| CN101452582A (en) * | 2008-12-18 | 2009-06-10 | 北京中星微电子有限公司 | Method and device for implementing three-dimensional video specific action |
| JP2013097588A (en) * | 2011-11-01 | 2013-05-20 | Dainippon Printing Co Ltd | Three-dimensional portrait creation device |
| CN104376594A (en) * | 2014-11-25 | 2015-02-25 | 福建天晴数码有限公司 | Three-dimensional face modeling method and device |
| CN106164979A (en) * | 2015-07-13 | 2016-11-23 | 深圳大学 | A kind of three-dimensional facial reconstruction method and system |
-
2018
- 2018-08-03 CN CN201810877942.6A patent/CN109191505A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1889129A (en) * | 2006-07-20 | 2007-01-03 | 北京中星微电子有限公司 | Fast human face model building method and system based on single-sheet photo |
| CN101452582A (en) * | 2008-12-18 | 2009-06-10 | 北京中星微电子有限公司 | Method and device for implementing three-dimensional video specific action |
| JP2013097588A (en) * | 2011-11-01 | 2013-05-20 | Dainippon Printing Co Ltd | Three-dimensional portrait creation device |
| CN104376594A (en) * | 2014-11-25 | 2015-02-25 | 福建天晴数码有限公司 | Three-dimensional face modeling method and device |
| CN106164979A (en) * | 2015-07-13 | 2016-11-23 | 深圳大学 | A kind of three-dimensional facial reconstruction method and system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109857311A (en) * | 2019-02-14 | 2019-06-07 | 北京达佳互联信息技术有限公司 | Generate method, apparatus, terminal and the storage medium of human face three-dimensional model |
| CN109949212A (en) * | 2019-03-13 | 2019-06-28 | 北京达佳互联信息技术有限公司 | Image mapping method, device, electronic equipment and storage medium |
| CN109949212B (en) * | 2019-03-13 | 2023-05-02 | 北京达佳互联信息技术有限公司 | Image mapping method, device, electronic equipment and storage medium |
| CN110084883A (en) * | 2019-04-15 | 2019-08-02 | 昆明理工大学 | A method of it inducing brain activity and rebuilds face-image |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109118579A (en) | The method, apparatus of dynamic generation human face three-dimensional model, electronic equipment | |
| CN111260764B (en) | Method, device and storage medium for making animation | |
| WO2021120834A1 (en) | Biometrics-based gesture recognition method and apparatus, computer device, and medium | |
| WO2020001013A1 (en) | Image processing method and device, computer readable storage medium, and terminal | |
| Karpenko et al. | Free‐form sketching with variational implicit surfaces | |
| Kim et al. | A haptic-rendering technique based on hybrid surface representation | |
| CN106372051B (en) | A kind of method for visualizing and system of patent map | |
| WO2020134436A1 (en) | Method for generating animated expression and electronic device | |
| CN109191505A (en) | Static state generates the method, apparatus of human face three-dimensional model, electronic equipment | |
| JP2019012526A (en) | Image processing method, computer program, and recording medium | |
| CN109003224A (en) | Strain image generation method and device based on face | |
| WO2023103600A1 (en) | Expression generation method and apparatus, device, medium and computer program product | |
| CN110378947B (en) | 3D model reconstruction method and device and electronic equipment | |
| US20210342496A1 (en) | Geometry-aware interactive design | |
| JP2023549240A (en) | Image generation method, image generation device, computer equipment, and computer program | |
| CN110533527A (en) | A kind of credit risk dynamic assessment method, system, medium and equipment | |
| CN109740511B (en) | Facial expression matching method, device, equipment and storage medium | |
| CN108447032A (en) | A kind of paint imitation and creative method again based on augmented reality | |
| CN118015194A (en) | Model processing method, device and computer readable storage medium | |
| CA2690826A1 (en) | Automatic 3d modeling system and method | |
| CN116385615A (en) | Virtual face generation method, device, computer equipment and storage medium | |
| WO2021192686A1 (en) | Information processing device and information processing method | |
| CN114797109A (en) | Object editing method and device, electronic equipment and storage medium | |
| CN113350792A (en) | Contour processing method and device for virtual model, computer equipment and storage medium | |
| JP6557988B2 (en) | Data output restriction device for 3D object modeling |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |