WO2024163175A1 - Optimal parameter selection for structured light metrology - Google Patents
Optimal parameter selection for structured light metrology Download PDFInfo
- Publication number
- WO2024163175A1 WO2024163175A1 PCT/US2024/011879 US2024011879W WO2024163175A1 WO 2024163175 A1 WO2024163175 A1 WO 2024163175A1 US 2024011879 W US2024011879 W US 2024011879W WO 2024163175 A1 WO2024163175 A1 WO 2024163175A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- test
- scan
- scans
- value
- slm
- Prior art date
Links
- 238000012360 testing method Methods 0.000 claims abstract description 204
- 238000005259 measurement Methods 0.000 claims abstract description 116
- 238000004088 simulation Methods 0.000 claims abstract description 93
- 238000000034 method Methods 0.000 claims abstract description 74
- 238000013442 quality metrics Methods 0.000 claims abstract description 68
- 238000005457 optimization Methods 0.000 claims abstract description 27
- 238000004519 manufacturing process Methods 0.000 claims description 21
- 238000012545 processing Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 24
- 230000015654 memory Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000011960 computer-aided design Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003116 impacting effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000000053 physical method Methods 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000003746 surface roughness Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2504—Calibration devices
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/1734—Sequential different kinds of measurements; Combining two or more methods
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/178—Methods for obtaining spatial resolution of the property being measured
- G01N2021/1785—Three dimensional
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/06—Illumination; Optics
- G01N2201/067—Electro-optic, magneto-optic, acousto-optic elements
- G01N2201/0675—SLM
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/10—Scanning
- G01N2201/11—Monitoring and controlling the scan
Definitions
- the present invention generally pertains to structured light metrology (SLM), and more particularly, to a technique for determining an optimal value for a parameter of an SLM system.
- SLM structured light metrology
- Structured light metrology is a technique in which projected light patterns (structured light) and a camera system are used to precisely and efficiently measure the three-dimensional (3D) shape of an object.
- SLM Structured light metrology
- conducting measurements through SLM systems often requires a time-intensive manual setting of the input measurement parameters, that may not apply to a wide range of objects. Additional complexity is added by the dependance of the quality of measured data obtained from structured light scanners on various factors, such as the object's shape, surface roughness, exposure time, projected fringe pattern, ambient light, temperature, etc.
- Exposure time in particular is a very important parameter in SLM, since under exposure or overexposure of the object to be scanned can cause loss of coverage of the object, resulting in poor measurement quality.
- Figure 1 illustrates an example of an SLM system.
- Figure 2 illustrates how a set of simulation data associated with the SLM system and a target object can be generated.
- Figure 3 illustrates schematically a process of calculation of a coverage quality metric (CQM) for a set of measured data points.
- CQM coverage quality metric
- Figure 4A illustrates an example of a first measured data set and corresponding distance parameter, dn, for a large value of CQM.
- Figure 4B illustrates an example of a second measured data set and corresponding distance parameter, dn, for a small value of CQM.
- Figure 5 is a graph showing an example of the relationship between exposure time and CQM from performing multiple scans of an object with exposure time set to different values.
- Figure 6 is a flow diagram illustrating an example of a process for determining and setting the optimal value of an adjustable parameter of an SLM system.
- Figure 7 is a flow diagram illustrating a process for generating the simulation data.
- Figure 8 is a flow diagram illustrating an example of an overall process in accordance with the technique introduced here.
- FIG. 9 is a block diagram illustrating an example of a processing system in which at least some aspects of the technique introduced here can be implemented.
- references to "an embodiment”, “one embodiment” or the like, mean that the particular feature, function, structure or characteristic being described is included in at least one embodiment of the technique introduced here. Occurrences of such phrases in this specification do not necessarily all refer to the same embodiment. On the other hand, the embodiments referred to also are not necessarily mutually exclusive.
- an optimal value for an adjustable parameter of an SLM system for scanning an object to be measured (the "target object") by the SLM system. This is achieved at least partly by using a defined coverage quality metric to evaluate measurement datasets.
- the parameter can be, for example, the exposure time for scanning the target object. Exposure time is one of the most important input parameters impacting measurement quality in SLM in terms of target object coverage.
- the technique automates a robust search for an optimal value of the parameter (e.g., exposure time) with minimal human intervention and judgement.
- simulation data representing a simulated scan of the object by the SLM system is generated based on a digital model of the target object, such as a computer aided design (CAD) model of the object.
- CAD computer aided design
- the SLM system performs multiple test scans of the object, to acquire sets of measurements of the object, where a different value is used for the parameter for each test scan.
- a value of a quality metric is computed, based on the set of measurements of the object associated with the test scan and the simulation data.
- the test scan that has the best value of the quality metric is identified, and the value of the adjustable parameter that was used for that test scan is selected as the optimal value of the parameter, for scanning the object.
- the object (or a copy of it) can then be scanned by the SLM system during a production phase with the adjustable parameter set to the optimal value, to acquire measurements of the object.
- the target object scanned during the setup phase is an ideal prototype, such as a CAD representation or gold standard version of the object, while the target object scanned during the production phase is a copy that is intended to be, but is not necessarily, identical to the ideal prototype, and the purpose of the production phase is to measure how closely the object being scanned matches the ideal prototype scanned during the setup phase.
- the simulation data includes multiple simulation points, and each set of measurements includes multiple measurement points.
- the quality metric value for any particular test scan can be, for example, (or can be a function of) the average of all of the distances between each simulation point and the measurement point from that particular test scan that is nearest to that simulation point. The best value of the quality metric can therefore be the lowest value, corresponding to the shortest average distance between the associated scan's measurement points and closest simulation points.
- the simulation data can be generated by ray tracing from each camera of the SLM scanner towards the target object, and taking the intersections of the rays with the digital model of the part as the simulation points. More specifically, the simulation data can be generated by a process that includes: 1 ) accessing the digital model of the target object to generate a virtualization of the target object, where the virtualization is a virtual representation of the target object based on the digital model: 2) accessing camera data indicative of physical parameters of the cameras of the SLM system; 3) tracing rays from each camera of the plurality of cameras towards the virtualization of the target object, based on the camera data, where the virtualization is located (virtually) at an expected measurement location relative to the SLM system; 4) identifying intersections of the rays with the virtualization of the target object; and 5) selecting the intersections of the rays with the virtualization of the target object as the simulation data. [0023] In some situations, a combination of two or more scans with
- the adjustable parameter is generally assumed herein to be exposure time, although the technique can also be applied to select the optimal value for essentially any other adjustable parameter, such as parameters relating to texture models, camera angle, lighting, etc. Other details of the technique introduced here will become apparent from the description which follows.
- FIG. 1 illustrates an example of an SLM system in which the technique introduced here can be implemented.
- the SLM system 100 includes a control system 102 and a scanner 104.
- the scanner 104 includes a structured light source 112 to emit structured laser light 116 toward a target object 1 14, and multiple cameras 118 to detect the reflections 120, from the target object 1 14, of light 116 emitted by the structured light source 112.
- the control system 102 includes a scanning and reconstruction module 106, a measurement module 108 and a parameter optimization module 110.
- the scanning and reconstruction module 106 is responsible for controlling operation of the light source 112 and cameras 118 and the relative positioning of the object relative to the light source 112 and cameras 118 (e.g., by rotating a platform on which the object is placed), and for acquiring image data from the cameras 118.
- the measurement module 108 is responsible for computing physical measurements of the target object 114 based on the reconstructed image data.
- the parameter optimization module 110 implements at least some aspects of the technique introduced here, by performing the machine-implemented control and computational operations associated with determining the optimal value of a parameter, such as exposure time.
- a set of simulation data associated with the target object 114 is used in determining the optimal parameter value.
- the simulation data provides insights into how real-world measurements can be conducted for any given orientation of a given target object, relative to a given SLM system.
- the simulation data is generated based on a digital model of the target object and known physical characteristics of the SLM system. Hence, the simulation data will be unique for any particular combination of SLM system and target object.
- the digital model of the target object is data that defines a virtualization of the target object. For purposes of creating the simulation data, the virtualization of the target object is assumed to be located and oriented at the same location and orientation, respectively, at which a real version of the target object would be placed during actual scanning, relative to the scanner.
- the simulation dataset 202 can be generated by ray tracing from each camera 118 of the SLM scanner towards the virtualization 204 of the target object 114, and taking the intersections of the rays 206 from both cameras with the virtualization 204 as the data points (simulation points) of the simulation dataset 202.
- the number of rays traced can be based on the number of pixels for a given camera. For example, for 12 megapixel cameras, 12 million rays can be traced from each camera. The directions of the rays can be limited by the field of view (FOV) of the camera.
- FOV field of view
- the FOV of a camera can be divided into a rectangular grid of the total number of pixels of the camera, where the rays point from the camera to the center of the grid.
- the size of the grid can be proportional to the FOV in each of the two planar directions (x and y).
- the coordinate frames of the scanner 104 and the target object 114 should be aligned for utilization of the simulated data.
- the measured datasets from the actual and simulated environments are collected in distinct coordinate frames, as shown in Figure 2.
- the measurement data is in the scanner's coordinate frame (represented by the subscript 's') and the simulated data is with respect to the target object's coordinate frame (represented by the subscript 'p').
- the transformation relationship (both rotation and translation) between these frames is important to aligning simulated data with the measured data.
- Use of reference markers pasted at some known positions in the part coordinate frame allows for the calculation of this transformation.
- the scanner 104 can scan these reference markers, and hence the positions of these markers are known in the scanner's coordinate frame.
- a transformation matrix can be calculated using the positions of these known references in two coordinate frames. For unique determination of the transformation matrix, at least three reference markers are used. By using this matrix, the simulated data is transformed into the scanner's coordinate frame, and then the measurement data can be evaluated for quality with reference to the simulated data.
- the optimal parameter value is determined by applying a coverage quality metric (CQM) to the simulation data and test measurement data.
- CQM coverage quality metric
- the CQM quantifies the quality of measured datasets by evaluating the datasets against the simulation dataset.
- the quality of a measurement dataset is proportional to the fraction of the object's surface covered by the measured dataset relative to the simulation dataset. Accordingly, in at least some embodiments, measurement quality improves with decreasing values of CQM.
- Figure 3 schematically illustrates the process of calculation of the CQM, according to at least one embodiment. For each simulation point in the simulation dataset, the corresponding nearest measurement point is identified. The separation distance between these two points is then calculated and denoted as dn, where the subscript n denotes the nth simulation point.
- the CQM is calculated as: where N is the total number of simulation points.
- Figures 4A and 4B show the measurement dataset having large and small values of the CQM, respectively, for a simple target object having the shape of a semi- ovoid placed with its flat surface facing downward.
- measurement dataset 1 in Figure 4A is an example of an overexposed measurement, where measurement data towards the base of the object is clearly missing. In this region, the measured points are located farther from the corresponding simulation points, as characterized by a greater value of dn. These large values of dn result in the large value of the CQM.
- measurement dataset 2 in Figure 4B has better part coverage, resulting in smaller values of dn, and hence, a smaller value of the CQM.
- the measurement dataset will be same as the simulation data. In that case, the values of dn will be zero and hence the CQM will be zero.
- one advantageous application of the technique introduced here is to automate substantially the selection of optimal exposure time for the measurements, since exposure time is one of the most important input parameters impacting measurement quality in terms of part coverage.
- multiple scans to acquire test measurements are performed on the object, where exposure time (or any other parameter) is systematically modified so as to be different for each scan.
- the scanned data includes the combined measurement data from each of the cameras. Each separate scan produces multiple measurement points and one corresponding CQM value.
- FIG. 5 is a graph illustrating an example of the resulting relationship between the exposure time and CQM for a series of test scans of a simple object (for example, the semi-ovoid discussed above) after performing these scans.
- an optimal exposure time can be estimated from the CQM, which is an indication of coverage of object's surface area by the measured data.
- the lowest value CQMmin of the computed CQM for the multiple sweeps i.e., multiple sets of test measurements/configurations
- Figure 6 illustrates an example of a process in accordance with the technique introduced here, for determining and setting the optimal value of an adjustable parameter (such as exposure time) of an SLM system.
- the process 600 may be performed by an SLM system, such as SLM system 100 in Figure 1.
- the process 600 includes a set-up phase 620 and a production phase 640.
- the set-up phase 620 includes steps 601 through 605, at least some of which can be performed by the parameter optimization module 110 ( Figure 1 ) of the SLM system, for example.
- the process 600 generates the simulation dataset at step 601 , as described above.
- the SLM system performs multiple test scans of the target object, with the parameter set to a different value for each test scan, to acquire a set of measurements from each test scan.
- the process 600 calculates the value of the CQM, based on the set of measurements associated with that scan and the simulation data. The process then identifies at step 604 the test scan with lowest value of CQM.
- step 605 the process 600 selects the value of the parameter that was used for the test scan with the lowest CQM, as the optimal value for scanning the target object.
- step 605 can be performed manually by a person. In some instances, the person may wish to adjust the optimal value produced by the system before programming the system with it.
- the SLM system scans the target object (or, more likely, a copy of it) at step 606 with the exposure time set to the optimal value.
- Figure 7 illustrates a process 700 representing an example of the details of step 601 in Figure 6, i.e., the generation of simulation data.
- the process ray traces from each of the cameras of the scanner towards a virtualization of the target object that is based on the digital model of the target object.
- the process identifies the intersections of the traced rays with the virtualization of the target object.
- the process defines the intersections of the rays with the virtualization as the set of simulation data.
- Figure 8 illustrates another example of a process that can be performed according to an embodiment of the technique introduced here.
- the process 800 performs, by an SLM system, a plurality of test scans of an object (e.g., the target object) to acquire a plurality of sets of measurements of the object, wherein a different value is used for the adjustable parameter for each of the test scans.
- the process 800 calculates a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system.
- the process 800 identifies a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion (for example, that has the lowest value of the quality metric).
- the process 800 selects the value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
- Figure 9 is a block diagram illustrating an example of a computer system 900 in which at least some aspects of the technique introduced here can be implemented, including, for example, generation of the simulation data set, control of the SLM scanner, calculation of the CQM, and determination of the optimal parameter value.
- the parameter optimization module 110 in Figure 1 can be implemented as hardwired circuitry, or appropriately programmed programmable circuitry, or a combination thereof, in the computer system 900.
- the computer system 900 includes one or more processors 901 , one or more memories 902, one or more input/output (I/O) devices 903, and one or more communication interfaces 904, all connected to each other through an interconnect 905.
- the processor(s) 901 control the overall operation of the computer system 100, including controlling its constituent components.
- the processor(s) 901 may be or include one or more conventional microprocessors, programmable logic devices (PLDs), field programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), etc.
- the one or more memories 902 store data and executable instructions (e.g., software and/or firmware), which may include software and/or firmware for performing the techniques introduced above.
- the one or more memories 902 may be or include any one of various forms of random access memory (RAM), read-only memory (ROM), volatile memory, nonvolatile memory, or any combination thereof.
- the one or more memories 902 may be or include dynamic RAM (DRAM), static RAM (SDRAM), flash memory, one or more disk-based hard drives, etc.
- the I/O devices 903 provide access to the computer system 900 by human user, and may be or include, for example, a display monitor, audio speaker, keyboard, touch screen, mouse, microphone, trackball, etc.
- the communications interface 904 enables the computer system 900 to communicate with one or more external devices (e g., an SLM scanner) via a network connection and/or direct connection.
- the communications interface 904 may be or include, for example, a Wi-Fi adapter, Bluetooth adapter, Ethernet adapter, Universal Serial Bus (USB) adapter, or the like.
- the interconnect 905 may be or include, for example, one or more buses, bridges or adapters, such as a system bus, peripheral component interconnect (PCI) bus, PCI extended (PCI-X) bus, USB, or the like.
- PCI peripheral component interconnect
- PCI-X PCI extended
- a method of selecting an optimal value for an adjustable parameter of a structured light metrology (SLM) system, for scanning an object comprising: performing, by the SLM system, a plurality of test scans of the object to acquire a plurality of sets of measurements of the object, wherein a different value is used for the adjustable parameter for each of the test scans; for each test scan of the plurality of test scans, calculating a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system; identifying a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and selecting a value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
- SLM structured light metrology
- the set of simulation data comprises a plurality of simulation points
- each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points
- the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
- a method as recited in any one of examples 1 through 5, wherein the identifying of the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
- a system comprising: a structured light metrology (SLM) scanner; and one or more processors operatively coupled to the SLM scanner and programmed to cause the system to: cause the SLM scanner to acquire a plurality of sets of measurements of an object using an adjustable parameter of the SLM scanner, wherein a different value is used for the adjustable parameterforeach of the test scans; for each test scan of the plurality of test scans, compute a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system, to produce a plurality of quality metric values; identify a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and select a value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
- SLM structured light metrology
- the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
- a system as recited in any one of examples 8 through 12, wherein the identifying the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
- An article of manufacture comprising instructions, execution of which by at least one processor in a processing system causes performance of operations including: accessing a plurality of sets of measurements of an object, the plurality of sets of measurements having been acquired by a structured light metrology (SLM) system that has an adjustable parameter, wherein a different value was used for the adjustable parameter for each of the plurality of test scans; for each test scan of the plurality of test scans, calculating a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system; identifying a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and selecting a value of the adjustable parameter that was used forthe identified test scan, as the optimal value of the adjustable parameter for scanning the object.
- SLM structured light metrology
- the operations further include: generating the set of simulation data representing the simulated scan of the object by: accessing a digital model of the object; accessing camera data indicative of physical parameters of a plurality of cameras of the SLM system; tracing rays from each camera of the plurality of cameras towards a virtualization of the object, based on the camera data, the virtualization of the object being defined according to the digital model of the object and being located at a measurement location relative to the SLM system; identifying intersections of the rays with the virtualization of the object; and selecting intersections of the rays with the virtualization of the object to be included in the set of simulation data.
- the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
- the identifying of the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
- the operations further include: identifying a plurality of sets of test scans from the plurality of test scans, each set of test scans including at least two test scans; for each set of test scans of the plurality of sets of test scans, calculating a value of the quality metric based on the sets of measurements of the object associated with the set of test scans and the set of simulation data representing the simulated scan of the object by the SLM system, to produce a second plurality of quality metric values; identifying a set of test scans, of the plurality of sets of test scans, that has a second quality metric value that satisfies the specified optimization criterion; and selecting values of the adjustable parameter that were used for the test scans of the identified set of test scans, as a set of optimal values of the adjustable parameter for scanning the object.
- An apparatus for selecting an optimal value for an adjustable parameter of a structured light metrology (SLM) system, for scanning an object comprising: means for performing, by the SLM system, a plurality of test scans of the object to acquire a plurality of sets of measurements of the object, wherein a different value is used for the adjustable parameter for each of the test scans; means for calculating, for each test scan of the plurality of test scans, a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system; means for identifying a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and means for selecting a value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
- SLM structured light metrology
- the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
- An apparatus as recited in any one of examples 22 through 26, wherein the identifying of the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
- the machine-implemented computational and control operations described above can be implemented by programmable circuitry programmed/configured by software and/or firmware, or entirely by special-purpose circuitry, or by a combination of such forms.
- special-purpose circuitry can be in the form of, for example, one or more application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), system-on-a-chip systems (SOCs), etc.
- Machine-readable medium includes any mechanism that can store information in a form accessible by a machine (a machine may be, for example, a computer, network device, cellular phone, personal digital assistant (PDA), manufacturing tool, any device with one or more processors, etc.).
- a machine-accessible medium includes recordable/non-recordable media (e.g., read-only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; etc.), etc.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Biochemistry (AREA)
- Analytical Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
A method is disclosed for selecting an optimal value for an adjustable parameter of a structured light metrology (SLM) system, for scanning an object. The SLM system performs test scans of the object to acquire a plurality of sets of measurements of the object, wherein a different value is used for the parameter for each test scan. For each test scan, a value of a quality metric is calculated, based on the set of measurements of the object associated with the test scan and simulation data representing a simulated scan of the object by the SLM system. A test scan is then identified that has a quality metric value that satisfies a specified optimization criterion; and a value of the adjustable parameter that was used for the identified test scan is selected as the optimal value of the adjustable parameter, for scanning the object.
Description
OPTIMAL PARAMETER SELECTION FOR STRUCTURED
LIGHT METROLOGY
CROSS-REFERENCE TO RELATED APPLICATION(S)
[0001] This application is a continuation of U.S. Application No. 18/104,198, filed on January 31 , 2023, which is hereby incorporated by reference in its entirety.
STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH
[0002] This invention was made with Government support under Contract No. DE- AC52-07NA27344 awarded by the United States Department of Energy. The Government has certain rights in the invention.
TECHNOLOGY FIELD
[0003] The present invention generally pertains to structured light metrology (SLM), and more particularly, to a technique for determining an optimal value for a parameter of an SLM system.
BACKGROUND
[0004] Structured light metrology (SLM) is a technique in which projected light patterns (structured light) and a camera system are used to precisely and efficiently measure the three-dimensional (3D) shape of an object. However, conducting measurements through SLM systems often requires a time-intensive manual setting of the input measurement parameters, that may not apply to a wide range of objects. Additional complexity is added by the dependance of the quality of measured data obtained from structured light scanners on various factors, such as the object's shape, surface roughness, exposure time, projected fringe pattern, ambient light, temperature, etc. Exposure time in particular is a very important parameter in SLM, since under exposure or overexposure of the object to be scanned can cause loss of coverage of the object, resulting in poor measurement quality.
[0005] The current approach to measurement with commercial structured light scanners is a manual process of repeating a sequence of tasks, including changing the exposure time, conducting the scan to obtain a measurement dataset, and then using
a subjective assessment of that dataset to alter the input parameters manually. This process is not only tedious, but also the subjective assessment of the measured dataset may not lead to an optimal measurement dataset.
BRIEF DESCRIPTION OF THE DRAWINGS
[0006] One or more embodiments of the present invention are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements.
[0007] Figure 1 illustrates an example of an SLM system.
[0008] Figure 2 illustrates how a set of simulation data associated with the SLM system and a target object can be generated.
[0009] Figure 3 illustrates schematically a process of calculation of a coverage quality metric (CQM) for a set of measured data points.
[0010] Figure 4A illustrates an example of a first measured data set and corresponding distance parameter, dn, for a large value of CQM.
[0011 ] Figure 4B illustrates an example of a second measured data set and corresponding distance parameter, dn, for a small value of CQM.
[0012] Figure 5 is a graph showing an example of the relationship between exposure time and CQM from performing multiple scans of an object with exposure time set to different values.
[0013] Figure 6 is a flow diagram illustrating an example of a process for determining and setting the optimal value of an adjustable parameter of an SLM system.
[0014] Figure 7 is a flow diagram illustrating a process for generating the simulation data.
[0015] Figure 8 is a flow diagram illustrating an example of an overall process in accordance with the technique introduced here.
[0016] Figure 9 is a block diagram illustrating an example of a processing system in which at least some aspects of the technique introduced here can be implemented.
DETAILED DESCRIPTION
[0017] In this description, references to "an embodiment", "one embodiment" or the like, mean that the particular feature, function, structure or characteristic being described is included in at least one embodiment of the technique introduced here. Occurrences of such phrases in this specification do not necessarily all refer to the same embodiment. On the other hand, the embodiments referred to also are not necessarily mutually exclusive.
[0018] To automate setting of input parameters of an SLM system, such as the exposure time, researchers may rely on correcting saturation and low contrast observed during measurements. Techniques to improve reconstruction accuracy include improved coding, scheme-based techniques, hardware assisted techniques, adaptive fringe projection techniques, and multi-exposure based techniques. All of these techniques rely on modification of the structured light being used, such as changing the coding pattern or shifting the phase. Consequently, these techniques require specific calibration procedures and control of the hardware used for achieving this change. Empirical determination of the exposure times is another shortcoming of these techniques.
[0019] To address these shortcomings, introduced here is a technique to select an optimal value for an adjustable parameter of an SLM system, for scanning an object to be measured (the "target object") by the SLM system. This is achieved at least partly by using a defined coverage quality metric to evaluate measurement datasets. The parameter can be, for example, the exposure time for scanning the target object. Exposure time is one of the most important input parameters impacting measurement quality in SLM in terms of target object coverage. The technique automates a robust search for an optimal value of the parameter (e.g., exposure time) with minimal human intervention and judgement.
[0020] In the technique, simulation data representing a simulated scan of the object by the SLM system is generated based on a digital model of the target object, such as a computer aided design (CAD) model of the object. During a setup phase, the SLM system performs multiple test scans of the object, to acquire sets of measurements of the object, where a different value is used for the parameter for each test scan. For each test scan, a value of a quality metric is computed, based on the set of
measurements of the object associated with the test scan and the simulation data. The test scan that has the best value of the quality metric is identified, and the value of the adjustable parameter that was used for that test scan is selected as the optimal value of the parameter, for scanning the object. The object (or a copy of it) can then be scanned by the SLM system during a production phase with the adjustable parameter set to the optimal value, to acquire measurements of the object. In at least some applications, the target object scanned during the setup phase is an ideal prototype, such as a CAD representation or gold standard version of the object, while the target object scanned during the production phase is a copy that is intended to be, but is not necessarily, identical to the ideal prototype, and the purpose of the production phase is to measure how closely the object being scanned matches the ideal prototype scanned during the setup phase.
[0021] The simulation data includes multiple simulation points, and each set of measurements includes multiple measurement points. The quality metric value for any particular test scan can be, for example, (or can be a function of) the average of all of the distances between each simulation point and the measurement point from that particular test scan that is nearest to that simulation point. The best value of the quality metric can therefore be the lowest value, corresponding to the shortest average distance between the associated scan's measurement points and closest simulation points.
[0022] In at least some embodiments, the simulation data can be generated by ray tracing from each camera of the SLM scanner towards the target object, and taking the intersections of the rays with the digital model of the part as the simulation points. More specifically, the simulation data can be generated by a process that includes: 1 ) accessing the digital model of the target object to generate a virtualization of the target object, where the virtualization is a virtual representation of the target object based on the digital model: 2) accessing camera data indicative of physical parameters of the cameras of the SLM system; 3) tracing rays from each camera of the plurality of cameras towards the virtualization of the target object, based on the camera data, where the virtualization is located (virtually) at an expected measurement location relative to the SLM system; 4) identifying intersections of the rays with the virtualization of the target object; and 5) selecting the intersections of the rays with the virtualization of the target object as the simulation data.
[0023] In some situations, a combination of two or more scans with the parameter set to different values may produce the best result. Accordingly, in some embodiments, the technique identifies two or more test scans that, in combination, produce the best quality metric value.
[0024] To facilitate description, the adjustable parameter is generally assumed herein to be exposure time, although the technique can also be applied to select the optimal value for essentially any other adjustable parameter, such as parameters relating to texture models, camera angle, lighting, etc. Other details of the technique introduced here will become apparent from the description which follows.
[0025] Figure 1 illustrates an example of an SLM system in which the technique introduced here can be implemented. The SLM system 100 includes a control system 102 and a scanner 104. The scanner 104 includes a structured light source 112 to emit structured laser light 116 toward a target object 1 14, and multiple cameras 118 to detect the reflections 120, from the target object 1 14, of light 116 emitted by the structured light source 112.
[0026] The control system 102 includes a scanning and reconstruction module 106, a measurement module 108 and a parameter optimization module 110. The scanning and reconstruction module 106 is responsible for controlling operation of the light source 112 and cameras 118 and the relative positioning of the object relative to the light source 112 and cameras 118 (e.g., by rotating a platform on which the object is placed), and for acquiring image data from the cameras 118. The measurement module 108 is responsible for computing physical measurements of the target object 114 based on the reconstructed image data.
[0027] The parameter optimization module 110 implements at least some aspects of the technique introduced here, by performing the machine-implemented control and computational operations associated with determining the optimal value of a parameter, such as exposure time. As stated above, in the technique introduced here, a set of simulation data associated with the target object 114 is used in determining the optimal parameter value. The simulation data provides insights into how real-world measurements can be conducted for any given orientation of a given target object, relative to a given SLM system. The simulation data is generated based on a digital model of the target object and known physical characteristics of the SLM system.
Hence, the simulation data will be unique for any particular combination of SLM system and target object. The digital model of the target object is data that defines a virtualization of the target object. For purposes of creating the simulation data, the virtualization of the target object is assumed to be located and oriented at the same location and orientation, respectively, at which a real version of the target object would be placed during actual scanning, relative to the scanner.
[0028] In at least some embodiments, as illustrated in Figure 2, the simulation dataset 202 can be generated by ray tracing from each camera 118 of the SLM scanner towards the virtualization 204 of the target object 114, and taking the intersections of the rays 206 from both cameras with the virtualization 204 as the data points (simulation points) of the simulation dataset 202. The number of rays traced can be based on the number of pixels for a given camera. For example, for 12 megapixel cameras, 12 million rays can be traced from each camera. The directions of the rays can be limited by the field of view (FOV) of the camera. The FOV of a camera can be divided into a rectangular grid of the total number of pixels of the camera, where the rays point from the camera to the center of the grid. The size of the grid can be proportional to the FOV in each of the two planar directions (x and y).
[0029] Note that the actual number of points in the simulated data will be less than the resolution of the cameras. This is because of the fact the not all simulated rays from the camera intersect the part, depending upon the size and shape of the part and its orientation relative to the cameras.
[0030] The coordinate frames of the scanner 104 and the target object 114 should be aligned for utilization of the simulated data. The measured datasets from the actual and simulated environments are collected in distinct coordinate frames, as shown in Figure 2. The measurement data is in the scanner's coordinate frame (represented by the subscript 's') and the simulated data is with respect to the target object's coordinate frame (represented by the subscript 'p'). The transformation relationship (both rotation and translation) between these frames is important to aligning simulated data with the measured data. Use of reference markers pasted at some known positions in the part coordinate frame allows for the calculation of this transformation. The scanner 104 can scan these reference markers, and hence the positions of these markers are known in the scanner's coordinate frame. A transformation matrix can be calculated using the
positions of these known references in two coordinate frames. For unique determination of the transformation matrix, at least three reference markers are used. By using this matrix, the simulated data is transformed into the scanner's coordinate frame, and then the measurement data can be evaluated for quality with reference to the simulated data.
[0031] In at least some embodiments, the optimal parameter value is determined by applying a coverage quality metric (CQM) to the simulation data and test measurement data. The CQM quantifies the quality of measured datasets by evaluating the datasets against the simulation dataset. In at least some embodiments, the quality of a measurement dataset is proportional to the fraction of the object's surface covered by the measured dataset relative to the simulation dataset. Accordingly, in at least some embodiments, measurement quality improves with decreasing values of CQM.
[0032] Figure 3 schematically illustrates the process of calculation of the CQM, according to at least one embodiment. For each simulation point in the simulation dataset, the corresponding nearest measurement point is identified. The separation distance between these two points is then calculated and denoted as dn, where the subscript n denotes the nth simulation point. In at least some embodiments, the CQM is calculated as:
where N is the total number of simulation points.
[0033] Figures 4A and 4B show the measurement dataset having large and small values of the CQM, respectively, for a simple target object having the shape of a semi- ovoid placed with its flat surface facing downward. Assuming the parameter to be optimized is exposure time, measurement dataset 1 in Figure 4A is an example of an overexposed measurement, where measurement data towards the base of the object is clearly missing. In this region, the measured points are located farther from the corresponding simulation points, as characterized by a greater value of dn. These large values of dn result in the large value of the CQM. In contrast, measurement dataset 2 in Figure 4B has better part coverage, resulting in smaller values of dn, and hence, a smaller value of the CQM. For an ideal case, where there is no missing measured data,
the measurement dataset will be same as the simulation data. In that case, the values of dn will be zero and hence the CQM will be zero.
[0034] As noted, one advantageous application of the technique introduced here is to automate substantially the selection of optimal exposure time for the measurements, since exposure time is one of the most important input parameters impacting measurement quality in terms of part coverage. To accomplish this, for a given object, multiple scans to acquire test measurements are performed on the object, where exposure time (or any other parameter) is systematically modified so as to be different for each scan. The scanned data includes the combined measurement data from each of the cameras. Each separate scan produces multiple measurement points and one corresponding CQM value.
[0035] Figure 5 is a graph illustrating an example of the resulting relationship between the exposure time and CQM for a series of test scans of a simple object (for example, the semi-ovoid discussed above) after performing these scans. Note the drop in coverage, represented by high CQM values, due to underexposure on the left side of the curve (i.e., due to exposure time being too low) and due to overexposure on the right side of the curve (i.e., due to exposure time being too high). Hence, an optimal exposure time can be estimated from the CQM, which is an indication of coverage of object's surface area by the measured data. The lowest value CQMmin of the computed CQM for the multiple sweeps (i.e., multiple sets of test measurements/configurations) represents the best measurement configuration, including the optimal value Vm of (in this example) exposure time.
[0036] Figure 6 illustrates an example of a process in accordance with the technique introduced here, for determining and setting the optimal value of an adjustable parameter (such as exposure time) of an SLM system. The process 600 may be performed by an SLM system, such as SLM system 100 in Figure 1. The process 600 includes a set-up phase 620 and a production phase 640.
[0037] The set-up phase 620 includes steps 601 through 605, at least some of which can be performed by the parameter optimization module 110 (Figure 1 ) of the SLM system, for example. Initially, in the set-up phase 620, the process 600 generates the simulation dataset at step 601 , as described above. Next, at step 602, the SLM system performs multiple test scans of the target object, with the parameter set to a
different value for each test scan, to acquire a set of measurements from each test scan. In step 603, for each test scan, the process 600 calculates the value of the CQM, based on the set of measurements associated with that scan and the simulation data. The process then identifies at step 604 the test scan with lowest value of CQM. At the end of the set-up phase 620, at step 605 the process 600 selects the value of the parameter that was used for the test scan with the lowest CQM, as the optimal value for scanning the target object. In some implementations, step 605 can be performed manually by a person. In some instances, the person may wish to adjust the optimal value produced by the system before programming the system with it. Subsequently, in the production phase 640, the SLM system scans the target object (or, more likely, a copy of it) at step 606 with the exposure time set to the optimal value.
[0038] Figure 7 illustrates a process 700 representing an example of the details of step 601 in Figure 6, i.e., the generation of simulation data. Initially, at step 701 the process ray traces from each of the cameras of the scanner towards a virtualization of the target object that is based on the digital model of the target object. At step 702 the process identifies the intersections of the traced rays with the virtualization of the target object. Then, at step 703 the process defines the intersections of the rays with the virtualization as the set of simulation data.
[0039] Figure 8 illustrates another example of a process that can be performed according to an embodiment of the technique introduced here. At step 801 , the process 800 performs, by an SLM system, a plurality of test scans of an object (e.g., the target object) to acquire a plurality of sets of measurements of the object, wherein a different value is used for the adjustable parameter for each of the test scans. At step 802, for each test scan of the plurality of test scans, the process 800 calculates a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system. At step 803, the process 800 identifies a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion (for example, that has the lowest value of the quality metric). At step 804, the process 800 selects the value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
[0040] In practical applications, using a single exposure time may not always lead to good measurement data in terms of a particular target object's scan area coverage, especially for multi-material target objects with large surface reflectivity variations. In such cases, a combination of two or even three exposure times can be used during the measurement. The technique introduced here can account for two or more exposure times for a given target object. This can be achieved, for example, by generating a set of measurement data for all pairwise combinations of the exposure times used while scanning and then evaluating the combinations using the CQM. For this particular measurement, the CQM is evaluated for each of the combined datasets. Using this technique, it may be found during the setup phase that the lowest CQM value corresponds to the combination of measurements with, for example, exposure times of 8 milliseconds and 300 milliseconds. Such a result would indicate that the best coverage of the target object (or any physical copy of the target object) during the production phase can be obtained by performing two separate scans -- one with exposure time set to 8 milliseconds and the other with exposure time set to 300 milliseconds - and using the combined measurement data from both scans.
[0041] Figure 9 is a block diagram illustrating an example of a computer system 900 in which at least some aspects of the technique introduced here can be implemented, including, for example, generation of the simulation data set, control of the SLM scanner, calculation of the CQM, and determination of the optimal parameter value. For example, the parameter optimization module 110 in Figure 1 can be implemented as hardwired circuitry, or appropriately programmed programmable circuitry, or a combination thereof, in the computer system 900.
[0042] The computer system 900 includes one or more processors 901 , one or more memories 902, one or more input/output (I/O) devices 903, and one or more communication interfaces 904, all connected to each other through an interconnect 905. The processor(s) 901 control the overall operation of the computer system 100, including controlling its constituent components. The processor(s) 901 may be or include one or more conventional microprocessors, programmable logic devices (PLDs), field programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), etc. The one or more memories 902 store data and executable instructions (e.g., software and/or firmware), which may include software and/or firmware for performing the techniques introduced above. The one or more memories
902 may be or include any one of various forms of random access memory (RAM), read-only memory (ROM), volatile memory, nonvolatile memory, or any combination thereof. For example, the one or more memories 902 may be or include dynamic RAM (DRAM), static RAM (SDRAM), flash memory, one or more disk-based hard drives, etc. The I/O devices 903 provide access to the computer system 900 by human user, and may be or include, for example, a display monitor, audio speaker, keyboard, touch screen, mouse, microphone, trackball, etc. The communications interface 904 enables the computer system 900 to communicate with one or more external devices (e g., an SLM scanner) via a network connection and/or direct connection. The communications interface 904 may be or include, for example, a Wi-Fi adapter, Bluetooth adapter, Ethernet adapter, Universal Serial Bus (USB) adapter, or the like. The interconnect 905 may be or include, for example, one or more buses, bridges or adapters, such as a system bus, peripheral component interconnect (PCI) bus, PCI extended (PCI-X) bus, USB, or the like.
Examples of Embodiments
[0043] Certain embodiments of the technology introduced herein are summarized in the following numbered examples.
[0044] 1 . A method of selecting an optimal value for an adjustable parameter of a structured light metrology (SLM) system, for scanning an object, the method comprising: performing, by the SLM system, a plurality of test scans of the object to acquire a plurality of sets of measurements of the object, wherein a different value is used for the adjustable parameter for each of the test scans; for each test scan of the plurality of test scans, calculating a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system; identifying a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and selecting a value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
[0045] 2. A method as recited in example 1 , wherein the adjustable parameter is an exposure time of the SLM system.
[0046] 3. A method as recited in example 1 or example 2, further comprising scanning a second object, by SLM system, with the adjustable parameter set to the selected value.
[0047] 4. A method as recited in any one of examples 1 through 3, further comprising: generating the set of simulation data representing the simulated scan of the object by: accessing a digital model of the object; accessing camera data indicative of physical parameters of a plurality of cameras of the SLM system; tracing rays from each camera of the plurality of cameras towards a virtualization of the object, based on the camera data, the virtualization of the object being defined according to the digital model of the object and being located at a measurement location relative to the SLM system; identifying intersections of the rays with the virtualization of the object; and selecting intersections of the rays with the virtualization of the object for inclusion in the set of simulation data.
5. A method as recited in any one of examples 1 through 4, wherein: the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
[0048] 6. A method as recited in any one of examples 1 through 5, wherein the identifying of the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
[0049] 7. A method as recited in any one of examples 1 through 6, further comprising: identifying a plurality of sets of test scans from the plurality of test scans, each set of test scans including at least two test scans; for each set of test scans of the plurality of sets of test scans, calculating a value of the quality metric based on the sets of measurements of the object associated with the set of test scans and the set of simulation data representing the simulated scan of the object by the SLM system; identifying a set of test scans, of the plurality of sets of test scans, that has a quality metric value that satisfies the specified optimization criterion; and selecting values of
the adjustable parameter that were used for the test scans of the identified set of test scans, as a set of optimal values of the adjustable parameter for scanning the object.
[0050] 8. A system comprising: a structured light metrology (SLM) scanner; and one or more processors operatively coupled to the SLM scanner and programmed to cause the system to: cause the SLM scanner to acquire a plurality of sets of measurements of an object using an adjustable parameter of the SLM scanner, wherein a different value is used for the adjustable parameterforeach of the test scans; for each test scan of the plurality of test scans, compute a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system, to produce a plurality of quality metric values; identify a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and select a value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
[0051] 9. A system as recited in example 8, wherein the adjustable parameter is an exposure time of the SLM scanner.
[0052] 10. A system as recited in example 8 or example 9, wherein the one or more processors are programmed to cause the SLM scanner to scan a second object with the adjustable parameter set to the selected value.
[0053] 11 . A system as recited in any one of examples 8 through 10, wherein the one or more processors are programmed to cause the system to: generate the set of simulation data representing the simulated scan of the object by: access a digital model of the object; access camera data indicative of physical parameters of a plurality of cameras of the SLM system; trace rays from each camera of the plurality of cameras towards a virtualization of the object, based on the camera data, the virtualization of the object being defined according to the digital model of the object and being located at a measurement location relative to the SLM scanner; identify intersections of the rays with the virtualization of the object; and select intersections of the rays with the virtualization of the object to be included in the set of simulation data.
[0054] 12. A system as recited in any one of examples 8 through 11 , wherein: the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of
measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
[0055] 13. A system as recited in any one of examples 8 through 12, wherein the identifying the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
[0056] 14. A system as recited in any one of examples 8 through 13, wherein the one or more processors are programmed to cause the system to: identify a plurality of sets of test scans from the plurality of test scans, each set of test scans including at least two test scans; for each set of test scans of the plurality of sets of test scans, compute a value of the quality metric based on the sets of measurements of the object associated with the set of test scans and the set of simulation data representing the simulated scan of the object by the SLM scanner, to produce a second plurality of quality metric values; identify a set of test scans, of the plurality of sets of test scans, that has a second quality metric value that satisfies the specified optimization criterion; and select values of the adjustable parameter that were used for the test scans of the identified set of test scans, as a set of optimal values of the adjustable parameter for scanning the object.
[0057] 15. An article of manufacture comprising instructions, execution of which by at least one processor in a processing system causes performance of operations including: accessing a plurality of sets of measurements of an object, the plurality of sets of measurements having been acquired by a structured light metrology (SLM) system that has an adjustable parameter, wherein a different value was used for the adjustable parameter for each of the plurality of test scans; for each test scan of the plurality of test scans, calculating a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system; identifying a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and selecting a value of the adjustable parameter that was used
forthe identified test scan, as the optimal value of the adjustable parameter for scanning the object.
[0058] 16. An article of manufacture as recited in example 15, wherein the adjustable parameter is an exposure time of the SLM system.
[0059] 17. An article of manufacture as recited in example 15 or example 16, further comprising causing scanning of a second object, by SLM system, with the adjustable parameter set to the selected value.
[0060] 18. An article of manufacture as recited in any one of examples 15 through
17, wherein the operations further include: generating the set of simulation data representing the simulated scan of the object by: accessing a digital model of the object; accessing camera data indicative of physical parameters of a plurality of cameras of the SLM system; tracing rays from each camera of the plurality of cameras towards a virtualization of the object, based on the camera data, the virtualization of the object being defined according to the digital model of the object and being located at a measurement location relative to the SLM system; identifying intersections of the rays with the virtualization of the object; and selecting intersections of the rays with the virtualization of the object to be included in the set of simulation data.
[0061] 19. An article of manufacture as recited in any one of examples 15 through
18, wherein: the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
[0062] 20. An article of manufacture as recited in any one of examples 15 through
19, wherein the identifying of the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
[0063] 21 . An article of manufacture as recited in any one of examples 15 through
20, wherein the operations further include: identifying a plurality of sets of test scans from the plurality of test scans, each set of test scans including at least two test scans;
for each set of test scans of the plurality of sets of test scans, calculating a value of the quality metric based on the sets of measurements of the object associated with the set of test scans and the set of simulation data representing the simulated scan of the object by the SLM system, to produce a second plurality of quality metric values; identifying a set of test scans, of the plurality of sets of test scans, that has a second quality metric value that satisfies the specified optimization criterion; and selecting values of the adjustable parameter that were used for the test scans of the identified set of test scans, as a set of optimal values of the adjustable parameter for scanning the object.
[0064] 22. An apparatus for selecting an optimal value for an adjustable parameter of a structured light metrology (SLM) system, for scanning an object, the apparatus comprising: means for performing, by the SLM system, a plurality of test scans of the object to acquire a plurality of sets of measurements of the object, wherein a different value is used for the adjustable parameter for each of the test scans; means for calculating, for each test scan of the plurality of test scans, a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system; means for identifying a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and means for selecting a value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
[0065] 23. An apparatus as recited in example 22, wherein the adjustable parameter is an exposure time of the SLM system.
[0066] 24. An apparatus as recited in example 22 or example 23, further comprising means for scanning a second object, by SLM system, with the adjustable parameter set to the selected value.
[0067] 25. An apparatus as recited in any one of examples 22 through 24, further comprising: means for generating the set of simulation data representing the simulated scan of the object by: accessing a digital model of the object; accessing camera data indicative of physical parameters of a plurality of cameras of the SLM system; tracing rays from each camera of the plurality of cameras towards a virtualization of the object, based on the camera data, the virtualization of the object being defined according to the digital model of the object and being located at a measurement location relative to
the SLM system; identifying intersections of the rays with the virtualization of the object; and selecting intersections of the rays with the virtualization of the object for inclusion in the set of simulation data.
[0068] 26. An apparatus as recited in any one of examples 22 through 25, wherein: the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
[0069] 27. An apparatus as recited in any one of examples 22 through 26, wherein the identifying of the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
[0070] 28. An apparatus as recited in any one of examples 22 through 27, further comprising: means for identifying a plurality of sets of test scans from the plurality of test scans, each set of test scans including at least two test scans; means for calculating, for each set of test scans of the plurality of sets of test scans, a value of the quality metric based on the sets of measurements of the object associated with the set of test scans and the set of simulation data representing the simulated scan of the object by the SLM system; means for identifying a set of test scans, of the plurality of sets of test scans, that has a quality metric value that satisfies the specified optimization criterion; and means for selecting values of the adjustable parameter that were used for the test scans of the identified set of test scans, as a set of optimal values of the adjustable parameter for scanning the object.
[0071] Unless contrary to physical possibility, it is envisioned that (i) the methods/steps described herein may be performed in any sequence and/or in any combination, and that (ii) the components of respective embodiments may be combined in any manner.
[0072] The machine-implemented computational and control operations described above can be implemented by programmable circuitry programmed/configured by software and/or firmware, or entirely by special-purpose circuitry, or by a combination
of such forms. Such special-purpose circuitry (if any) can be in the form of, for example, one or more application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), system-on-a-chip systems (SOCs), etc.
[0073] Software or firmware to implement the techniques introduced here may be stored on a machine-readable storage medium and may be executed by one or more general-purpose or special-purpose programmable microprocessors. A "machine- readable medium", as the term is used herein, includes any mechanism that can store information in a form accessible by a machine (a machine may be, for example, a computer, network device, cellular phone, personal digital assistant (PDA), manufacturing tool, any device with one or more processors, etc.). For example, a machine-accessible medium includes recordable/non-recordable media (e.g., read-only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; etc.), etc.
[0074] Any or all of the features and functions described above can be combined with each other, except to the extent it may be otherwise stated above or to the extent that any such embodiments may be incompatible by virtue of their function or structure, as will be apparent to persons of ordinary skill in the art. Unless contrary to physical possibility, it is envisioned that (i) the methods/steps described herein may be performed in any sequence and/or in any combination, and that (ii) the components of respective embodiments may be combined in any manner.
[0075] Although the subject matter has been described in language specific to structural features and/or acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as examples of implementing the claims and other equivalent features and acts are intended to be within the scope of the claims.
Claims
1 . A method of selecting an optimal value for an adjustable parameter of a structured light metrology (SLM) system, for scanning an object, the method comprising: performing, by the SLM system, a plurality of test scans of the object to acquire a plurality of sets of measurements of the object, wherein a different value is used for the adjustable parameter for each of the test scans; for each test scan of the plurality of test scans, calculating a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system; identifying a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and selecting a value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
2. A method as recited in claim 1 , wherein the adjustable parameter is an exposure time of the SLM system.
3. A method as recited in claim 1 , further comprising scanning a second object, by SLM system, with the adjustable parameter set to the selected value.
4. A method as recited in claim 1 , further comprising: generating the set of simulation data representing the simulated scan of the object by: accessing a digital model of the object; accessing camera data indicative of physical parameters of a plurality of cameras of the SLM system; tracing rays from each camera of the plurality of cameras towards a virtualization of the object, based on the camera data, the
virtualization of the object being defined according to the digital model of the object and being located at a measurement location relative to the SLM system; identifying intersections of the rays with the virtualization of the object; and selecting intersections of the rays with the virtualization of the object for inclusion in the set of simulation data.
5. A method as recited in claim 1 , wherein: the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
6. A method as recited in claim 5, wherein the identifying of the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
7. A method as recited in claim 1 , further comprising: identifying a plurality of sets of test scans from the plurality of test scans, each set of test scans including at least two test scans; for each set of test scans of the plurality of sets of test scans, calculating a value of the quality metric based on the sets of measurements of the object associated with the set of test scans and the set of simulation data representing the simulated scan of the object by the SLM system; identifying a set of test scans, of the plurality of sets of test scans, that has a quality metric value that satisfies the specified optimization criterion; and
selecting values of the adjustable parameter that were used for the test scans of the identified set of test scans, as a set of optimal values of the adjustable parameter for scanning the object.
8. A system comprising: a structured light metrology (SLM) scanner; and one or more processors operatively coupled to the SLM scanner and programmed to cause the system to: cause the SLM scanner to acquire a plurality of sets of measurements of an object using an adjustable parameter of the SLM scanner, wherein a different value is used for the adjustable parameter for each of the test scans; for each test scan of the plurality of test scans, compute a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system, to produce a plurality of quality metric values; identify a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and select a value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
9. A system as recited in claim 8, wherein the adjustable parameter is an exposure time of the SLM scanner.
10. A system as recited in claim 8, wherein the one or more processors are programmed to cause the SLM scanner to scan a second object with the adjustable parameter set to the selected value.
11. A system as recited in claim 8, wherein the one or more processors are programmed to cause the system to: generate the set of simulation data representing the simulated scan of the object by: access a digital model of the object; access camera data indicative of physical parameters of a plurality of cameras of the SLM system; trace rays from each camera of the plurality of cameras towards a virtualization of the object, based on the camera data, the virtualization of the object being defined according to the digital model of the object and being located at a measurement location relative to the SLM scanner; identify intersections of the rays with the virtualization of the object; and select intersections of the rays with the virtualization of the object to be included in the set of simulation data.
12. A system as recited in claim 8, wherein: the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
13. A system as recited in claim 12, wherein the identifying the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
14. A system as recited in claim 8, wherein the one or more processors are programmed to cause the system to: identify a plurality of sets of test scans from the plurality of test scans, each set of test scans including at least two test scans; for each set of test scans of the plurality of sets of test scans, compute a value of the quality metric based on the sets of measurements of the object associated with the set of test scans and the set of simulation data representing the simulated scan of the object by the SLM scanner, to produce a second plurality of quality metric values; identify a set of test scans, of the plurality of sets of test scans, that has a second quality metric value that satisfies the specified optimization criterion; and select values of the adjustable parameter that were used for the test scans of the identified set of test scans, as a set of optimal values of the adjustable parameter for scanning the object.
15. An article of manufacture comprising instructions, execution of which by at least one processor in a processing system causes performance of operations including: accessing a plurality of sets of measurements of an object, the plurality of sets of measurements having been acquired by a structured light metrology (SLM) system that has an adjustable parameter, wherein a different value was used for the adjustable parameter for each of the plurality of test scans; for each test scan of the plurality of test scans, calculating a value of a quality metric, based on the set of measurements of the object associated with the test scan and a set of simulation data representing a simulated scan of the object by the SLM system; identifying a test scan, of the plurality of test scans, that has a quality metric value that satisfies a specified optimization criterion; and selecting a value of the adjustable parameter that was used for the identified test scan, as the optimal value of the adjustable parameter for scanning the object.
16. An article of manufacture as recited in claim 15, wherein the adjustable parameter is an exposure time of the SLM system.
17. An article of manufacture as recited in claim 15, further comprising causing scanning of a second object, by SLM system, with the adjustable parameter set to the selected value.
18. An article of manufacture as recited in claim 15, wherein the operations further include: generating the set of simulation data representing the simulated scan of the object by: accessing a digital model of the object; accessing camera data indicative of physical parameters of a plurality of cameras of the SLM system; tracing rays from each camera of the plurality of cameras towards a virtualization of the object, based on the camera data, the virtualization of the object being defined according to the digital model of the object and being located at a measurement location relative to the SLM system; identifying intersections of the rays with the virtualization of the object; and selecting intersections of the rays with the virtualization of the object to be included in the set of simulation data.
19. An article of manufacture as recited in claim 15, wherein: the set of simulation data comprises a plurality of simulation points; each set of measurements of the plurality of sets of measurements comprises a plurality of measurement points; and the quality metric value for any particular test scan of the plurality of test scans comprises an average of distances between each simulation point of the plurality of simulation points and a nearest measurement point of the plurality of measurement points of the particular test scan.
20. An article of manufacture as recited in claim 19, wherein the identifying of the particular test scan that has a quality metric value that satisfies the specified optimization criterion comprises: identifying the test scan, of the plurality of test scans, that has the lowest quality metric value.
21. An article of manufacture as recited in claim 15, wherein the operations further include: identifying a plurality of sets of test scans from the plurality of test scans, each set of test scans including at least two test scans; for each set of test scans of the plurality of sets of test scans, calculating a value of the quality metric based on the sets of measurements of the object associated with the set of test scans and the set of simulation data representing the simulated scan of the object by the SLM system, to produce a second plurality of quality metric values; identifying a set of test scans, of the plurality of sets of test scans, that has a second quality metric value that satisfies the specified optimization criterion; and selecting values of the adjustable parameter that were used for the test scans of the identified set of test scans, as a set of optimal values of the adjustable parameter for scanning the object.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/104,198 | 2023-01-31 | ||
US18/104,198 US20240255415A1 (en) | 2023-01-31 | 2023-01-31 | Optimal parameter selection for structured light metrology |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2024163175A1 true WO2024163175A1 (en) | 2024-08-08 |
Family
ID=91964390
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2024/011879 WO2024163175A1 (en) | 2023-01-31 | 2024-01-17 | Optimal parameter selection for structured light metrology |
Country Status (2)
Country | Link |
---|---|
US (1) | US20240255415A1 (en) |
WO (1) | WO2024163175A1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6323776B1 (en) * | 1999-12-21 | 2001-11-27 | Snap-On Technologies, Inc. | Method and apparatus of automatically identifying faults in a machine vision measuring system |
US6510244B2 (en) * | 1996-06-13 | 2003-01-21 | K. U. Leuven Research & Development | Method and system for acquiring a three-dimensional shape description |
KR20120000234A (en) * | 2010-06-25 | 2012-01-02 | 이숙윤 | The method of auto-exposure control for white light 3d scanner using an illuminometer |
JP2014032159A (en) * | 2012-08-06 | 2014-02-20 | Canon Inc | Projection and imaging system, and method for controlling projection and imaging system |
WO2014078015A1 (en) * | 2012-11-14 | 2014-05-22 | Qualcomm Incorporated | Structured light active depth sensing systems combining multiple images to compensate for differences in reflectivity and/or absorption |
US20210356259A1 (en) * | 2018-02-07 | 2021-11-18 | Omron Corporation | Three-dimensional measurement apparatus, three-dimensional measurement method, and three-dimensional measurement non-transitory computer readable medium |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8837026B2 (en) * | 2004-07-23 | 2014-09-16 | 3Shape A/S | Adaptive 3D scanning |
WO2006120759A1 (en) * | 2005-05-12 | 2006-11-16 | Techno Dream 21 Co., Ltd. | 3-dimensional shape measuring method and device thereof |
US7826072B1 (en) * | 2007-08-16 | 2010-11-02 | Kla-Tencor Technologies Corporation | Method for optimizing the configuration of a scatterometry measurement system |
US10485425B2 (en) * | 2014-02-04 | 2019-11-26 | The Trustees Of Dartmouth College | Apparatus and methods for structured light scatteroscopy |
US10310922B2 (en) * | 2015-04-13 | 2019-06-04 | University Of Southern California | Systems and methods for predicting and improving scanning geometric accuracy for 3D scanners |
JPWO2018225406A1 (en) * | 2017-06-08 | 2020-04-09 | コニカミノルタ株式会社 | Method for determining arrangement of surface defect inspection apparatus, apparatus, program, and recording medium |
WO2019009664A1 (en) * | 2017-07-07 | 2019-01-10 | Koh Young Technology Inc | Apparatus for optimizing inspection of exterior of target object and method thereof |
SE541493C2 (en) * | 2017-10-26 | 2019-10-15 | Ivisys Aps | System and method for optical inspection of an object |
WO2019173556A1 (en) * | 2018-03-09 | 2019-09-12 | Northwestern University | Adaptive sampling for structured light scanning |
US10964016B2 (en) * | 2018-03-13 | 2021-03-30 | Kla-Tencor Corporation | Combining simulation and optical microscopy to determine inspection mode |
CN108827184B (en) * | 2018-04-28 | 2020-04-28 | 南京航空航天大学 | Structured light self-adaptive three-dimensional measurement method based on camera response curve |
US10867108B2 (en) * | 2018-09-18 | 2020-12-15 | Taiwan Semiconductor Manufacturing Co., Ltd. | Optical mode optimization for wafer inspection |
US11317078B2 (en) * | 2019-05-28 | 2022-04-26 | Purdue Research Foundation | Method and system for automatic exposure determination for high- resolution structured light 3D imaging |
US11788972B2 (en) * | 2021-04-29 | 2023-10-17 | Industrial Technology Research Institute | Method of automatically setting optical parameters and automated optical inspection system using the same |
CN114638795A (en) * | 2022-03-08 | 2022-06-17 | 新拓三维技术(深圳)有限公司 | Multi-structure light measurement unit online measurement method and system |
CN115628701A (en) * | 2022-10-27 | 2023-01-20 | 华中科技大学 | Self-adaptive projection three-dimensional measurement method and system based on virtual image rendering |
-
2023
- 2023-01-31 US US18/104,198 patent/US20240255415A1/en active Pending
-
2024
- 2024-01-17 WO PCT/US2024/011879 patent/WO2024163175A1/en unknown
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6510244B2 (en) * | 1996-06-13 | 2003-01-21 | K. U. Leuven Research & Development | Method and system for acquiring a three-dimensional shape description |
US6323776B1 (en) * | 1999-12-21 | 2001-11-27 | Snap-On Technologies, Inc. | Method and apparatus of automatically identifying faults in a machine vision measuring system |
KR20120000234A (en) * | 2010-06-25 | 2012-01-02 | 이숙윤 | The method of auto-exposure control for white light 3d scanner using an illuminometer |
JP2014032159A (en) * | 2012-08-06 | 2014-02-20 | Canon Inc | Projection and imaging system, and method for controlling projection and imaging system |
WO2014078015A1 (en) * | 2012-11-14 | 2014-05-22 | Qualcomm Incorporated | Structured light active depth sensing systems combining multiple images to compensate for differences in reflectivity and/or absorption |
US20210356259A1 (en) * | 2018-02-07 | 2021-11-18 | Omron Corporation | Three-dimensional measurement apparatus, three-dimensional measurement method, and three-dimensional measurement non-transitory computer readable medium |
Also Published As
Publication number | Publication date |
---|---|
US20240255415A1 (en) | 2024-08-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US12008710B2 (en) | Generating light-source-specific parameters for digital images using a neural network | |
US12067662B2 (en) | Advanced automatic rig creation processes | |
Balcaen et al. | Stereo-DIC calibration and speckle image generator based on FE formulations | |
US6937235B2 (en) | Three-dimensional object surface shape modeling apparatus, method and program | |
US10762704B2 (en) | Method for establishing a deformable 3D model of an element, and associated system | |
CN105847786B (en) | System and method for determining color conversion parameters | |
US20200057831A1 (en) | Real-time generation of synthetic data from multi-shot structured light sensors for three-dimensional object pose estimation | |
CN109584327B (en) | Face aging simulation method, device and equipment | |
CN112907727B (en) | Calibration method, device and system of relative transformation matrix | |
WO2018201677A1 (en) | Bundle adjustment-based calibration method and device for telecentric lens-containing three-dimensional imaging system | |
KR101715325B1 (en) | Method and system for providing Picture lay out drawings by using three dimensional scan technologies | |
US20210254968A1 (en) | Method and System for Automatic Focusing for High-Resolution Structured Light 3D Imaging | |
CN115846890B (en) | Control method of laser engraving equipment, laser engraving equipment and computer readable storage medium | |
Liu et al. | A novel 3D scanning technique for reflective metal surface based on HDR-like image from pseudo exposure image fusion method | |
CN110462688A (en) | System and method is determined using the three-D profile of the peak value selection based on model | |
JP6776004B2 (en) | Image processing equipment, image processing methods and programs | |
US20240255415A1 (en) | Optimal parameter selection for structured light metrology | |
US11143499B2 (en) | Three-dimensional information generating device and method capable of self-calibration | |
CN111696146B (en) | Face model reconstruction method, face model reconstruction system, image processing system and storage medium | |
Rohe | An Optical Test Simulator Based on the Open-Source Blender Software. | |
Ojal et al. | Optimizing exposure times of structured light metrology systems using a digital twin | |
Georgiev et al. | Investigation possibilities for the use of free software for data processing used for accurate measurement details through photogrammetry | |
WO2022072372A1 (en) | Additional developments to the automatic rig creation process | |
JP2018077168A (en) | Simulator, simulation method and simulation program | |
CN109579765B (en) | Three-dimensional point cloud data matching method and system based on servo motor and controller |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24750699 Country of ref document: EP Kind code of ref document: A1 |