JP2020537550A - Stencil for intraoral surface scanning - Google Patents

Abstract

An exemplary method and / or device embodiment for intraoral imaging modifies the patient's gingiva with markers spaced across the area of interest. An optical image of the surface contour over the target area is acquired using a plurality of reflection images of the target area including the mark. An exemplary method and / or embodiment of the device forms from a surface contour image a plurality of patch mesh images, each of which characterizes the surface contour of a portion of the area of interest. The patch mesh images are combined to form a mesh representing the area of interest according to the plurality of reflection images of the landmarks. The mesh representing the area of interest can be displayed, stored, or transmitted. [Selection diagram] Fig. 4

Description

The present disclosure relates in general to the field of intraoral imaging and, in particular, to improved total dental arch scanning methods for surface characterization of teeth and other oral features.

Surface contour imaging uses pattern light or structured light and triangulation to acquire surface contour information for a subject. In contour imaging, a pattern of lines or other features is projected from a given angle toward the surface of the subject. The surface projection pattern is then viewed from another angle as a contour image using triangulation to analyze the surface information and characterize the surface contour based on the deformed appearance of the projected lines. A phase shift in which the projected line pattern is stepwise spatially shifted to obtain additional measurements at higher resolution helps to map the surface of the subject more accurately.

Surface contour imaging using structured light has been used in many applications to determine the shape of a solid, highly opaque subject. Contour imaging is also used to characterize the surface shape of some of the anatomical structures and obtain detailed data on the skin structure. However, many technical obstacles make it difficult to effectively use tooth contour projection imaging. Among the perceived problems with tooth surface contour imaging are the translucency of the tooth, the high level of reflection, and the complex structure of the tooth itself.

Many attempts have been made to adapt structured optical surface profiling techniques to the problem of tooth structure imaging. For example, US Pat. No. 5,372,502, entitled "Optical Probe and Method for the Three-Dimensional Surveying of Teeth," to Massen et al., To form a striped pattern for projection onto the tooth surface. Describes the use of LCD matrices. A similar approach is described in US Patent Application Publication No. 2007/00867662 entitled "Front End for 3-D Imaging Camera" by O'Keefe et al. US Pat. No. 7,312,924, entitled "Polarising Multiplexer and Methods for Intra-Oral Scanning" for Trissel, describes a method of profiling the tooth surface using triangulation and polarization. A profiling method that requires the application of a fluorescent paint for the purpose is described. Similarly, US Pat. No. 6,885,464, entitled "3-D Camera for Recording Surface Structures, in Particular for Dental Powders," to Pfeiffer et al., Uses triangulation, but for imaging. Discloses a dental imaging device that requires the application of an opaque powder to the tooth surface. U.S. Pat. No. 6,885,464 to Pfeiffer et al. Describes an intraoral camera that irradiates a group of light beams for imaging. Pamphlet International Publication No. 2011/145799 by Lim describes a 3-D scanner using scanning laser light.

One of the problems with scanning with a handheld device is related to a limited field of view. Typically, the scanner can only retrieve data from a small number of teeth at a time. In order to scan most or all of the dental arch, it is necessary to stitch together a number of separate scans, each scan being a set or point of surface points that covers a small portion of the dental arch. Generate a swarm. Alignment methods that use tooth shape and evaluate structural features for similarity can be used, but these methods are inaccurate, computationally intensive, and can be time consuming.

Therefore, it will be appreciated that there are advantages in optics and methods for intraoral surface contour imaging that facilitate alignment between patches for scanning the entire dental arch and other larger spans. Let's go.

An object of the present invention is to advance the technique of structured optical imaging for characterization of the surface contour in the oral cavity.

Another aspect of the present application is to address at least the aforementioned and other deficiencies of the related art, in whole or in part.

Another aspect of the application is to provide at least the advantages described herein, in whole or in part.

Among the advantages provided by certain exemplary device and / or method embodiments of the present application are improved alignment capabilities for obtaining a wide range of scans of oral features.

These objectives are shown merely as examples for illustration purposes, and these objectives may be exemplary of one or more embodiments of the invention. Other desirable objectives and benefits essentially achieved by the methods of the present disclosure may come to the mind of one of ordinary skill in the art or become apparent to one of ordinary skill in the art. The present invention is defined by the appended claims.

According to one aspect of the present disclosure
(A) A marking step that marks the patient's gingiva with a plurality of markers separated over the target area.
(B) A step of acquiring a structured optical image of the surface contour over the target area, and
(C) A step of acquiring a plurality of reflection images of a target area including a mark, and
(D) A step of forming a plurality of patch mesh images from the surface contour structuring optical image, each of which characterizes the surface contour of a part of the target area.
(E) A step of combining a plurality of patch mesh images to form a mesh representing a target area according to a plurality of reflection images of markers.
An intraoral imaging method is provided that includes (f) displaying, storing, or transmitting a mesh representing the area of interest.

The aforementioned and other objectives, features and advantages of the present invention will become apparent from the following more specific description of exemplary embodiments of the invention, as shown in the accompanying drawings.

The elements of the drawing are not always at the exact scale of each other. Some exaggeration may be needed to emphasize the basic structural relationships or principles of operation. Described exemplary embodiments such as support elements used to supply power, support elements used for packaging, and support elements used to protect the optics. Some conventional components that may be required for implementation are not shown in the drawings for the sake of brevity.

It is a figure which shows the intraoral imaging apparatus for contour imaging of a tooth. It is a schematic diagram which showed the method of using the triangulation to acquire the surface contour data. It is the schematic which showed the method which used the pattern light to acquire the surface contour information. It is a figure which shows the surface image which used the pattern which has a plurality of lines of light. FIG. 6 is a schematic showing how individual scans can be combined to form a larger mesh image. It is a figure which showed the use of the stencil for marking a mark. It is a figure which showed the use of the stamp for engraving one mark on the gingival surface. It is a figure which showed the use of the adhesive tape to give the mark to support the scan alignment. It is a figure which showed the state of marking a tooth or a gingiva using a printing apparatus.

An exemplary embodiment will be described in detail below with reference to the drawings. In the drawings, the same reference number shall refer to the same element of structure in each of the plurality of figures.

As used in the context of the present application, terms such as "first" and "second" do not necessarily indicate an ordering relationship, a continuous relationship, or a priority relationship, and are otherwise specified. Unless otherwise used, it is simply used to more clearly distinguish one step, element, or set of elements from another.

As used herein, the term "energable" refers to a set of devices or components that perform the indicated function when power is received, and optionally when a permit signal is received. It is a related term.

In the context of this application, the terms "structured light illumination" or "pattern illumination" are used to indicate the type of projection illumination used for surface imaging, distance imaging, or "contour" imaging that characterize the shape of teeth. Used for. The structured light pattern itself is characterized by one or more lines, circles, curves, or other geometries that are illuminated and distributed over a region with a given spatial and temporal frequency. Can include. One exemplary type of structured light pattern widely used for contour imaging is the pattern of evenly spaced lines of light projected onto the surface of an object.

In the context of this application, the terms "structured light image" and "contour image" are synonymous and shall refer to images captured during the projection of light patterns used to characterize tooth contours. .. The term "interference fringe image" can also be used for structured optical images. The term "distance image" refers to image content generated using this light pattern that models the surface structure. Structured optical images are typically taken continuously as the camera is moved along the dental arch. An "adjacent structured light image" is a series of adjacent images, and the two adjacent structured light images represent part of the same image content.

Two lines of light, some of the lines of light, or other features in a structured lighting pattern are the same in their line width within a range of only +/- 15 percent in line length. If so, it can be considered to be substantially "dimensionally uniform". As will be described in more detail later, the dimensional uniformity of structured lighting patterns is used to maintain uniform spatial frequencies.

In the context of this application, the term "optics" is commonly used to refer to lenses and other types of refracting, diffractive, and reflective components used to shape light beams. This class of photo-orientation or photoforming elements is called an "optical system".

In the context of this application, the terms "observer," "operator," and "user" are synonymous and observe doctors, technicians who observe and manipulate images, such as dental images, on a display monitor. , Or is considered to refer to another person. An "operator command" or "observer command" is an explicit input entered by the observer, for example, by clicking a button on the camera, by using a computer mouse, or by touch screen or keyboard input. Obtained from the command.

In the context of the present application, the expression "signal communication state" refers to a state in which two or more devices and / or components are capable of communicating with each other via signals traveling in some type of signal path. ing. The signal communication may be wired or wireless. The signal can be a communication signal, a power signal, a data signal, or an energy signal. The signal path is a physical connection, electrical connection, magnetic connection, electromagnetic connection, optical connection, wired connection, between the first device and / or component and the second device and / or component. And / or may include wireless connections. The signal path may further include additional devices and / or components between the first device and / or component and the second device and / or component.

The schematic of FIG. 1 shows an intraoral imaging system 100 having an intraoral camera device 24 that functions as a scanner for projecting structured light onto the tooth surface or other intraoral features. The camera device 24 signals and communicates with a computer 40 that acquires an image from a projected structured light pattern via a wired or wireless data communication channel. The computer 40 processes the image, stores it as a data file, and provides output image data that can be displayed on the display 26. The output image content may show surface contours in the form of sufficiently dense surface points or vertices, commonly referred to as point clouds or meshes. In the mesh representation, interconnect lines may or may not be added to help visually approximate the surface structure in the display, but structured light projection using the camera device 24, It is the vertices themselves that are generated as a result of the acquisition and processing.

The computer 40 may, for example, be separate from the camera device 24 probe, or be separate from the probe, in order to provide some of the image processing and result reporting described herein. Alternatively, it may be partially / completely integrated with the probe. The computer 40 can further store and acquire image data using, for example, a memory 42 that is in signal communication with the computer 40 by wired communication or wireless communication along a network. The camera device 24 may have one or more camera elements, along with an audible or visible indicator 28 for indicating device status or reporting excessive movement.

The schematics of FIGS. 2A and 2B show how triangulation is used to obtain surface contour data. The projector 22 and the camera 34, which are arranged in the housing of the camera device 24 shown in FIG. 1 at a distance d, cooperate to scan the surface contour. According to an exemplary embodiment of the present application, the projector 22 directs a continuous illumination line over a distance l onto a subject O on a reference plane. The camera 34 acquires the image content corresponding to each projection line on the image plane. A control logic processor 36, such as a computer, a dedicated microprocessor, or other logic processing device, synchronizes the actions of the projector 22 and the camera 34 and obtains a structured optical image from the camera 34 to characterize the surface contour of the subject O. Acquire, store, process, or transmit data. The angle α represents the difference in orientation between the camera 34 and the projector 22. The camera 34 also uses full-field illumination to capture a structured light image and thus to capture a dual function used to capture a reflected image, such as interrupted structured light projection and a reflected image of the FOV. It may have an acquisition sequence to do so. Another optional camera 38, which typically has a wider field of view (FOV) than the scanning camera 34, is an alternative patch generated according to a marker in the patient's mouth, as described in more detail later. It can be used to obtain a reflection image that helps align the mesh image.

Embodiments of the exemplary device and / or method of the present application accurately identify or distinguish different regions of the oral surface in conventional structured photoimaging techniques for toothless patients or due to lack of teeth. However, it can be particularly beneficial for areas of the mouth where it can be difficult to characterize surface contours. The reddish-colored gingival tissue tends to absorb blue wavelengths, thus reducing image contrast and increasing noise signal content accordingly. The gingival surface itself appears to be very uniform with little change in curvature and little color change using structured photoimaging. It can be difficult to correlate smaller adjacent patch mesh segments with each other without using an easily identifiable structure for use as a reference. The presence of multiple implant structures with similar surface features can further complicate the difficulty of imaging.

FIG. 2B shows a method of using patterned light to obtain surface contour information using an example of a single line of light L. Mapping is performed when the illumination array 10 directs the pattern of light from the projector 22 (FIG. 2A) toward the surface 20, and a corresponding image of the line L'is formed on the image sensor array 30 of the camera 34. Each pixel 32 (or a plurality of pixels) on the image sensor array 30 maps to the corresponding pixel 12 on the illumination array 10 according to modulation by the surface 20. As shown in FIG. 2B, the pixel position shift produces useful information about the contours of the surface 20. The basic pattern shown in FIG. 2B can be implemented in many ways using different lighting sources and sequences and using one or more different types of sensor arrays 30. The illumination array 10 is Digital, which is one of many types of arrays used for optical modulation, eg, a liquid crystal array, or an integrated array of micromirrors from Texas Instruments (Dallas, Texas). Digital micromirror arrays, such as those provided using Light Processor (DLP) devices, can be utilized.

By projecting and acquiring an image showing a structured light pattern that duplicates the configuration shown in FIG. 2B multiple times, the contour line image on the camera simultaneously positions many surface points of the captured subject. To do. This accelerates the process of collecting many sample points, while the light surface (and usually the light receiving camera as well) "paints" the light surface on some or all of the outer surface of the subject. To be moved laterally.

Multiple structured light patterns can be projected and analyzed together for a number of reasons, including increasing the line density of additional reconstruction points and detecting and / or correcting incompatible line sequences. The use of multiple structured optical patterns is described in US Patent Application Publication No. 2013/0120532 and US Patent Application Publication No. 2013/0120533 by the same applicant, both entitled "3D INTRAORAL MEASUREMENTS USING OPTICAL MULTILINE METHOD". It is described in the specification, and all of these contents are incorporated in the specification.

FIG. 3 shows a surface image using a pattern having a plurality of lines of light. Gradual shifts in line patterns and other techniques compensate for inaccuracies and ambiguities that can result from abrupt transitions along the surface, where it can be difficult to reliably identify the segment corresponding to each projection line. Helps to do. In FIG. 3, for example, it can be difficult on a portion of the surface to determine whether line segment 16 is from the same illumination line as line segment 18 or adjacent line segment 19.

In practice, the structured light sequence projected and simultaneously recorded in the field of view (FOV) as shown for the example of FIG. 3 is rapidly processed to generate surface vertex data for that FOV. Projection, image acquisition, and processing are repeated as the scanner moves to each continuous position in the mouth. The individual vertex mappings of the corresponding FOVs provide point clouds or mesh data that must be stitched together with the corresponding data from adjacent FOV positions. A patch mesh structure can be formed by connecting point clouds or mesh data corresponding to the positions of a plurality of adjacent camera devices 24.

Various types of transformations well known to those skilled in the art of surface contour image reconstruction can be used to accurately stitch together individual point clouds or mesh data image content. One of the well-known methods that can be used is to use a point feature histogram (PFH) or fast point feature histogram (FPFH) descriptor for the matching process. By computing the FPFH descriptors of two adjacent surface segments, for example, histogram generation and comparison techniques can be used to calculate the correspondence. A random sample consensus (RANSAC) algorithm can be used to select the largest set of consistent correspondences and provide initial conversion candidates for stitching. More accurate alignment can be achieved by using the Iterative Nearest Point (ICP) algorithm and using iteratives such as accepting or rejecting placement results according to distance or other suitable criteria.

In the context of the present application, the mesh structure processed and displayed may consist of a set of small adjacent mesh portions spliced together, or a series of patches, or "patch mesh" images, each patch mesh image. It is formed as a partial mesh of the dentition of the dental arch to form a larger mesh that represents the surface contour of the area of interest (ROI) in combination with other patch mesh structures. In the context of the present application, the structured optical image acquired by the scanner and processed by the imaging system 100 is referred to as a "3D mesh image" or simply "mesh" and is also referred to as a 3D "point cloud" or 3D surface contour image. Generates a set of variously called surface points or vertices.

The field of view (FOV) of an intraoral camera device 24 (eg, handheld) used as a scanner in a typical imaging system 100 is typically only about 2 cm ² . Multiple continuous scans are processed to obtain a larger scan, such as a mesh that produces a surface scan representation of the entire dental arch or a fairly large portion of the dental arch, and a series of mesh images in the form of patches or A "patch mesh" image is formed and, as a result, stitched together to form a larger mesh image. This configuration also helps to fill the gap and provide surface data to supplement other scan information.

Embodiments of exemplary devices and / or methods according to the present application, each of which combine these smaller mesh images to form a larger or synthetic mesh image of a larger area of interest (ROI). It addresses the need to improve the alignment of individual scan patch mesh images that occupy a small area. The simplified view of FIG. 4 shows how two smaller patch mesh images 50a, 50b are stitched together to form a larger surface representation or synthetic mesh image 52. Each of the smaller patch mesh images 50a, 50b includes an alignment marker or mark 60. In order to combine the patch mesh images 50a, 50b to form part of the larger mesh image 52, the respective landmarks of the adjacent patch mesh images 50a, 50b are collated with each other and positioned as shown. Matched or mapped. In practice, using the basic principles outlined in the example of FIG. 4, accurate alignment may typically require more than one mark 60.

The landmarks 60 are of a combination of scanned images to be evenly spaced apart to form a mesh for a small area or patch, and to combine two or more patch mesh images to form a larger mesh. May provide metrics for. Alternatively, the landmarks 60 may be separated from each other at arbitrary intervals sufficiently close to each other to allow image alignment, but need not be separated in equal increments. Mark density can be a factor affecting the accuracy of surface contour reconstruction. The close spacing between the landmarks can be useful in some areas of the mouth, for example, for toothless patients.

The shape of the landmark can be changed according to the scan pattern to reduce ambiguity. Thus, an asymmetric marker shape, such as a shape that can be easily distinguished when scanned in any direction, such as the letter "R", may be advantageous.

Embodiments of exemplary devices and / or methods according to the present application are only to support the stitching process used to stitch patch mesh images from multiple smaller mesh images obtained at different scanner positions. In addition, applied markers can be used to assist in the subsequent alignment of adjacent patch mesh images with each other to provide surface contour results for a wider area of the patient's dental arch.
Mark coating device

5, 6A-6C, and 7 show various devices and / or mechanisms for marking the intraoral surface according to an exemplary embodiment of the present application. The stencil 78 provides a pattern 66 for forming a marker 60 on the tissue surface or dentition, as shown in FIG. An applicator 68, such as a stamp, squeegee, inkjet, or spray device, guides ink, dye, pigment, or other colorant through pattern 66 of the stencil 78 to form a marker 60 in place. The stencil 78 can be arched so as to extend to part or all of the dental arch. Alternatively, the stencil 78 may be flat, designed to extend to a very small portion of the gingiva. The stencil 78 can be formed from a plastic sheet or other flexible material.

6A, 6B, and 6C show the use of a stamp 70 for imprinting one mark 60 on the gingival surface. A penetrating applicator or other imprinting device can be placed inside the holder to form the marking 60 at the appropriate point along the scanned dental arch. Both the buccal or lateral and medial or lingual flanks can be marked at the same time. The stamp 70 can be sized to cover a small portion of the dental arch, such as a single tooth, or is formed to mark a larger portion of the patient's dental arch or the entire dental arch at once. Can be done.

FIG. 7 shows the use of adhesive tape 80 to provide marking 60 to assist in scan alignment. The tape 80 is designed to have sufficient adhesive strength to remain on the gingival tissue during imaging and can be removed after imaging is complete.

Alternatively, direct marking on the tooth surface may be proposed, including marking with ink visible only under ultraviolet (UV) light or other wavelength-specific illumination.

According to an exemplary embodiment of the present application, the ink or pigment used for the marker changes the reflectance of the structured light signal obtained from the oral surface. When the reflectance is reduced, the data from that part of the surface is reduced, which can lead to incomplete or ambiguous data results such as "holes" in the detection surface. As the reflectance increases, the amount of 3D data acquired over the corresponding portion of the surface can increase as a result. This density change can be useful for marker detection and alignment, as is the case when using the PFH or FPFH techniques described above.
Types of landmarks

As shown in FIGS. 5, 6A-6C, 7, and 8, various types of markings can be used to align the scanned patches. As described herein, exemplary markings of landmarks may be alphanumeric, symbols, indicators or measurement marks, grayscale or or color patches, or other symbols (eg, preferably distinguished from each other). ), But not limited to, and / or allows patch-to-patch alignment.

FIG. 4 shows a marker 62 indicating the orientation axis of the tooth or other structure. The alignment axis of the individual teeth can be determined in many ways that allow the corresponding alignment of the mesh stitching markers.

FIG. 8 shows the use of the printing apparatus 56 for application of markings for automatic alignment and patch alignment. The printing device 56 may have an arrangement of fittings that accurately seat the device against the teeth for gingival marking.
Imaging sequence

For alignment processing, the sequence for illumination and image capture captures both a structured light image of the field of view (FOV) acquired by the scanner and a periodically acquired reflection image showing a wider camera field of view. can do.

According to another exemplary embodiment of the present application, the structured light image acquired by the scanning camera device 24 is processed to generate a mesh image showing the surface contour or the scanned intraoral surface. In addition to sensing the structured light pattern normally used to characterize the surface contour, the camera 34 of the camera device 24 can also detect markers 60 on the surface of the intraoral structure. The marker 60 may be used to assist in guiding the formation of a patch mesh image from a series of acquired structured optical images by aligning a contiguous structured optical image with the marker. Or, it can be used in a subsequent processing step by marker alignment as a guide for combining a plurality of patch mesh images generated after processing a structured optical image. Detection of the marker 60 may occur at the same time as structured light detection using the camera 34 of FIG. 2A, or another including the marker (using either camera 34 or camera 38 of FIG. 2A), for example. By temporarily interrupting a series of structured light projections and simultaneous structured light image captures to capture the reflected images, it may be necessary to capture the intervening reflected images acquired using all-light illumination. Alignment of structured optical images, or patch mesh images formed from structured optical images and containing landmarks, is directly aligned or mapped by the same landmarks within each different acquired or processed image. Can be done in any way.

According to another alternative exemplary embodiment of the present application, the optional camera 38 (FIG. 2A) is used to perform before, during, or between scans performed with structured light illumination. After, one or more alignment reflection images may be obtained and the alignment reflection image may include marked markings 60 in the field of view. As in the exemplary embodiment described above, the marker 60 can be used to assist in guiding the formation of individual patch mesh images from the acquired series of structured light images, or in FIG. As shown, it is used in subsequent processing steps as a guide for combining multiple patch mesh images generated after processing a structured optical image to form a mesh with dimensions larger than the patch mesh image. obtain. Thus, the reflected image can be associated with a structured light pattern and can provide a marker that allows, assists, or confirms alignment from one image patch to the next.

According to at least one exemplary embodiment, the exemplary method / apparatus can use a computer program in which instructions to be executed on image data accessed from electronic memory are stored. As will be appreciated by those skilled in the art of image processing, the computer programs of the exemplary embodiments herein may be utilized by suitable general purpose computer systems such as personal computers or workstations. However, many other types of computer systems can be used to execute the computer programs of the exemplary embodiments described, including, for example, one processor or network processor deployment.

Computer programs for performing the methods of the particular exemplary embodiments described herein can be stored in computer-readable storage media. This medium may be, for example, a magnetic disk or removable device such as a hard drive or a magnetic storage medium such as a magnetic tape, an optical disk, an optical tape, or an optical storage medium such as a machine-readable optical encoding device, random access. It may include a solid electronic storage device such as memory (RAM) or read-only memory (ROM), or any other physical device or medium used to store computer programs. A computer program for performing the exemplary methods of the described embodiments may also be stored on a computer-readable storage medium connected to the image processor via the Internet or other network or communication medium. Those skilled in the art will more easily recognize that equivalents of such computer program products can also be built in hardware.

The term "memory" corresponds to "computer accessible memory" in the context of this application and is used for storage and manipulation on image data, including databases, and is accessible to computer systems, optionally. It should be noted that it can refer to a temporary or more permanent data storage workspace of the type. The memory can be a non-volatile memory that uses a long-term storage medium such as, for example, a magnetic storage device or an optical storage device. Alternatively, the memory is of a more volatile nature using electronic circuits such as random access memory (RAM) used as a temporary buffer or workspace by a microprocessor or other control logic processor device. Can be. The display data is typically stored, for example, in a temporary storage buffer that may be directly associated with the display device and is periodically refreshed as needed to provide the display data. This temporary storage buffer can also be considered memory as the term is used herein. Memory is also used as a data workspace for performing calculations and other processing and storing intermediate and final results. Computer-accessible memory can be volatile, non-volatile, or a hybrid combination of volatile and non-volatile types.

It will be appreciated that computer program products for exemplary embodiments herein may utilize a variety of well-known image manipulation algorithms and / or processes. Also, embodiments of exemplary computer program products herein may embody algorithms and / or processes that are not specifically shown or described herein but are useful for implementation. Will be understood. Such algorithms and processes may include conventional utilities that fall within the normal art of image processing techniques. Additional aspects of such algorithms and systems, and hardware and / or software for generating images and processing them in other ways, or for working with computer program products of applications, are described herein. It may be selected from such algorithms, systems, hardware, components and elements that are not specifically shown or described and are well known in the art.

An exemplary embodiment according to the present application may include (individually or in combination) various features described herein.

The present invention has been described with respect to one or more embodiments, but without departing from the spirit and scope of the appended claims, making modifications and / or modifications to the described embodiments. be able to. Moreover, specific features of the invention are disclosed with respect to only one of several embodiments / exemplary embodiments, such features for any given or particular function. It can be combined with one or more other features of other embodiments / exemplary embodiments as desired and may be advantageous. The term "one" or "at least one" is used to mean that one or more of the listed items can be selected. The term "about" indicates that the listed values may be slightly modified as long as the modification does not result in a process or structural incompatibility with the exemplary embodiments described. Finally, "exemplary" does not imply that the description is ideal, but indicates that it is used as an example. Other embodiments of the invention will become apparent to those skilled in the art from the discussion herein and the practice of the invention disclosed herein. The present specification and examples are considered to be merely examples, and the true scope and spirit of the present invention shall be indicated by the following claims.

Claims (20)

(A) A marking step that marks the patient's gingiva with a plurality of markers separated over the target area.
(B) A step of acquiring a structured optical image of the surface contour over the target area, and
(C) A step of acquiring a plurality of reflection images of the target area including the mark, and
(D) A step of forming a plurality of patch mesh images from the surface contour structured optical image, each of which characterizes the surface contour of a part of the target area.
(E) A step of combining the plurality of patch mesh images to form a mesh representing the target area according to the plurality of reflection images of the mark.
(F) An intraoral imaging method comprising displaying, storing, or transmitting the mesh representing the target area. The method of claim 1, wherein the structured optical image uses a pattern of parallel lines. The method of claim 1, wherein the marker comprises at least one of alphanumeric and non-alphanumeric. The method of claim 1, wherein the marking step is performed on tape. The method of claim 1, wherein the marking step is performed by a stencil. The method of claim 1, wherein the marking step is performed by stamping. The method of claim 1, wherein the marking step is performed by an inkjet printing apparatus. The method of claim 1, wherein one or more of the landmarks indicate an axis of orientation with respect to the tooth. The method of claim 8, wherein the step of combining the plurality of patch mesh images uses the alignment of detected landmarks on the patient's teeth or gingiva. The method of claim 8, wherein the step of combining the plurality of patch mesh images further comprises the use of markers for one or more orientation axes. The structured optical image further comprises mapping at least one common marker from the reflectance image to two patch mesh images of the patch mesh image, the structured optical image being a 3D mesh image or a 3D point group or 3D surface. The method according to claim 1, which is a contour image. (A) A marking step of marking one or more oral surfaces of a patient with a plurality of printed markers separated over a target area.
b) A plurality of structured light images of the region of interest in the patient's mouth by irradiating the marked oral surface with structured light, including at least a part of the printed mark. And the steps to get
(C) A step of forming a plurality of patch mesh images from the plurality of acquired structured optical images, and
(D) A step of combining the plurality of patch mesh images to form a mesh representing the target area by aligning the print mark from the patch mesh image.
(E) An intraoral imaging method comprising displaying, storing, or transmitting the mesh representing the target area. 12. The method of claim 12, wherein the step of combining the plurality of patch mesh images to form a mesh uses alignment of markers formed on the patch mesh image to indicate an axis of orientation. 12. The method of claim 12, wherein the marked oral surface is the gingiva of the patient. 12. The method of claim 12, wherein the marked oral surface comprises teeth. The method according to claim 12, wherein the printed mark is visible only under ultraviolet light. 12. The method of claim 12, wherein the step of forming the plurality of patch mesh images from the plurality of acquired structured light images includes a step of aligning corresponding print markers from adjacent structured light images. 12. The method of claim 12, wherein the marking step is performed by a stamp configured to simultaneously mark the inner and outer surfaces of the patient's gingiva. The method of claim 12, wherein the structured light image is a 3D mesh image or a 3D point cloud or 3D surface contour image. A projection system configured to irradiate the intraoral surface with multiple print markers separated over the target area, and multiple structured light images of the target area in the patient's mouth. A detection system configured to acquire a structured optical image that includes at least a portion of the plurality of print markers.
An image processor configured to form a plurality of patch mesh images from the plurality of acquired structured optical images, and the plurality of patch mesh images by aligning the print marks from the patch mesh images. An image processor configured to combine to form a mesh representing the area of interest.
An intraoral imaging device comprising a display configured to display the mesh representing the target area.

Images