EP2255173B1 - Optical method for determining morphological parameters and physiological properties of skin tissue - Google Patents
Optical method for determining morphological parameters and physiological properties of skin tissue Download PDFInfo
- Publication number
- EP2255173B1 EP2255173B1 EP09722309.3A EP09722309A EP2255173B1 EP 2255173 B1 EP2255173 B1 EP 2255173B1 EP 09722309 A EP09722309 A EP 09722309A EP 2255173 B1 EP2255173 B1 EP 2255173B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- tissue
- lesion
- skin tissue
- skin
- morphological parameters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 48
- 230000003287 optical effect Effects 0.000 title claims description 31
- 230000000877 morphologic effect Effects 0.000 title claims description 16
- 230000001766 physiological effect Effects 0.000 title claims description 14
- 210000001519 tissue Anatomy 0.000 claims description 74
- 230000003902 lesion Effects 0.000 claims description 68
- 238000005259 measurement Methods 0.000 claims description 48
- 210000003491 skin Anatomy 0.000 claims description 46
- 210000002615 epidermis Anatomy 0.000 claims description 33
- 210000002780 melanosome Anatomy 0.000 claims description 26
- 210000004369 blood Anatomy 0.000 claims description 25
- 239000008280 blood Substances 0.000 claims description 25
- 230000003595 spectral effect Effects 0.000 claims description 24
- 238000000985 reflectance spectrum Methods 0.000 claims description 19
- 238000012546 transfer Methods 0.000 claims description 19
- 201000001441 melanoma Diseases 0.000 claims description 11
- 102000011782 Keratins Human genes 0.000 claims description 8
- 108010076876 Keratins Proteins 0.000 claims description 8
- 238000006213 oxygenation reaction Methods 0.000 claims description 8
- 238000005286 illumination Methods 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 6
- 230000002500 effect on skin Effects 0.000 claims description 6
- 239000003814 drug Substances 0.000 claims description 3
- 238000000862 absorption spectrum Methods 0.000 claims description 2
- 208000035250 cutaneous malignant susceptibility to 1 melanoma Diseases 0.000 claims description 2
- 238000000411 transmission spectrum Methods 0.000 claims description 2
- 206010004146 Basal cell carcinoma Diseases 0.000 claims 1
- 230000003796 beauty Effects 0.000 claims 1
- 206010041823 squamous cell carcinoma Diseases 0.000 claims 1
- 230000006870 function Effects 0.000 description 32
- 238000002428 photodynamic therapy Methods 0.000 description 26
- 238000012360 testing method Methods 0.000 description 14
- 239000013598 vector Substances 0.000 description 11
- 238000009826 distribution Methods 0.000 description 10
- 239000011159 matrix material Substances 0.000 description 10
- XUMBMVFBXHLACL-UHFFFAOYSA-N Melanin Chemical compound O=C1C(=O)C(C2=CNC3=C(C(C(=O)C4=C32)=O)C)=C2C4=CNC2=C1C XUMBMVFBXHLACL-UHFFFAOYSA-N 0.000 description 8
- 238000010521 absorption reaction Methods 0.000 description 7
- 230000019612 pigmentation Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000005855 radiation Effects 0.000 description 7
- 206010015150 Erythema Diseases 0.000 description 6
- 231100000321 erythema Toxicity 0.000 description 6
- 230000003211 malignant effect Effects 0.000 description 6
- 239000006071 cream Substances 0.000 description 5
- 230000036564 melanin content Effects 0.000 description 5
- 239000002245 particle Substances 0.000 description 5
- 230000035790 physiological processes and functions Effects 0.000 description 5
- 239000000049 pigment Substances 0.000 description 5
- 239000000523 sample Substances 0.000 description 5
- 238000004088 simulation Methods 0.000 description 5
- 101100228469 Caenorhabditis elegans exp-1 gene Proteins 0.000 description 4
- 238000002474 experimental method Methods 0.000 description 4
- 206010028980 Neoplasm Diseases 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 210000004207 dermis Anatomy 0.000 description 3
- 238000003745 diagnosis Methods 0.000 description 3
- 239000000835 fiber Substances 0.000 description 3
- 238000001727 in vivo Methods 0.000 description 3
- 125000006850 spacer group Chemical group 0.000 description 3
- 238000013334 tissue model Methods 0.000 description 3
- 102000001554 Hemoglobins Human genes 0.000 description 2
- 108010054147 Hemoglobins Proteins 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 229940079593 drug Drugs 0.000 description 2
- 230000005284 excitation Effects 0.000 description 2
- 210000000245 forearm Anatomy 0.000 description 2
- 230000002068 genetic effect Effects 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000000258 photobiological effect Effects 0.000 description 2
- 230000036555 skin type Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 230000000699 topical effect Effects 0.000 description 2
- ZGXJTSGNIOSYLO-UHFFFAOYSA-N 88755TAZ87 Chemical compound NCC(=O)CCC(O)=O ZGXJTSGNIOSYLO-UHFFFAOYSA-N 0.000 description 1
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 description 1
- 208000001126 Keratosis Diseases 0.000 description 1
- 238000000342 Monte Carlo simulation Methods 0.000 description 1
- 208000007256 Nevus Diseases 0.000 description 1
- 208000009077 Pigmented Nevus Diseases 0.000 description 1
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 1
- 206010042496 Sunburn Diseases 0.000 description 1
- 230000037338 UVA radiation Effects 0.000 description 1
- 239000000853 adhesive Substances 0.000 description 1
- 230000001070 adhesive effect Effects 0.000 description 1
- 229910052782 aluminium Inorganic materials 0.000 description 1
- 229960002749 aminolevulinic acid Drugs 0.000 description 1
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000017531 blood circulation Effects 0.000 description 1
- 210000005013 brain tissue Anatomy 0.000 description 1
- 201000011510 cancer Diseases 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000034994 death Effects 0.000 description 1
- 231100000517 death Toxicity 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 238000005315 distribution function Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 238000009472 formulation Methods 0.000 description 1
- 239000005350 fused silica glass Substances 0.000 description 1
- 239000008309 hydrophilic cream Substances 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000000338 in vitro Methods 0.000 description 1
- 239000004615 ingredient Substances 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000012804 iterative process Methods 0.000 description 1
- 210000002510 keratinocyte Anatomy 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 210000002752 melanocyte Anatomy 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 239000002674 ointment Substances 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 238000010238 partial least squares regression Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000000886 photobiology Effects 0.000 description 1
- 239000003504 photosensitizing agent Substances 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 229910052594 sapphire Inorganic materials 0.000 description 1
- 239000010980 sapphire Substances 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 231100000444 skin lesion Toxicity 0.000 description 1
- 206010040882 skin lesion Diseases 0.000 description 1
- 230000000391 smoking effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000007920 subcutaneous administration Methods 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 230000017105 transposition Effects 0.000 description 1
- 238000009827 uniform distribution Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 229910052724 xenon Inorganic materials 0.000 description 1
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/47—Scattering, i.e. diffuse reflection
- G01N21/4738—Diffuse reflection, e.g. also for testing fluids, fibrous materials
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/44—Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
- A61B5/441—Skin evaluation, e.g. for skin disorder diagnosis
- A61B5/444—Evaluating skin marks, e.g. mole, nevi, tumour, scar
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/66—Analysis of geometric attributes of image moments or centre of gravity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
- G06V20/693—Acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
Definitions
- the present disclosure relates to an optical method for determining several morphological parameters and physiological properties (hereafter abbreviated MP&PPs) of skin tissue.
- MP&PPs morphological parameters and physiological properties
- the present disclosure is directed to a method to determine MP&PPs of malignant as well as benign skin tissue lesions.
- Malignant melanoma is one of the most rapidly increasing cancers in the world. In the United States alone, the estimated incidence for 2008 is 62,480, which leads to an estimated total of 8,420 deaths per year. Successful treatment of melanoma depends on early detection by clinicians with subsequent surgical removal of tumors. Visual detection has its limitations, even when augmented with dermoscopy, especially with less experienced users. Attempts have thus been made to develop automated devices to assist in the screening of pigmented skin lesions for likelihood of melanoma. Several of these devices have digitalized dermoscopy-related features analyzed by artificial neural networks or support vector machine learning systems.
- a well-known application is blood-oxymetry, by which a relative blood-oxygenation index can be determined non-invasively from the scattered reflectance or transmittance of light at red and near-infrared (NIR) wavelengths [see e.g. Yaroslavsky AN, Schulze PC, et al. Optical properties of selected native and human brain tissues in vitro in the visible and near infrared spectral range. Physics in Medicine and Biology. 2002 47(12):2059-2073 ]. The reflectance in that spectral region has also been used to determine other physiological properties. For example, the gradient of the reflectance spectrum between 620 nm and 720 nm depends on the total melanin content of the skin [ Kollias N, Baqer AN.
- this invention makes use of a nonlinear inversion scheme based on e.g. optimal estimation theory [ Tikhonov, A.N., and Arsenin, V.Y., Tikhonov, A. N.; V. Y. Arsenin (1977). Solution of III-posed Problems. Washington: Winston & Sons. ISBN 0-470-99124-01 ; Twomey, S, Introduction to the Mathematics of Inversion in Remote Sensing and Indirect Measurement Developments in Geomathematics, Vol.
- WO 2006/076810 A1 discloses a method and device for disease detection, more particularly, cancer detection, from the analysis of diffuse reflectance spectra measured in vivo during endoscopic imaging.
- the measured diffuse reflectance spectra are analyzed using a light-transport model and numerical method to derive quantitative parameters related to tissue physiology and morphology.
- US 2006/247532 A1 discloses an iterative process that calculates the absorption and scattering coefficients of tissue from a set of diffuse reflectance measurements made with an optical spectrometer operating in the UV-VIS spectral range. The relationship between measured diffuse reflectance and the absorption and scattering coefficients is modeled using a Monte Carlo simulation.
- NIELSEN KRISTIAN P. ET AL "Reflectance Spectra of Pigmented and Nonpigmented Skin in the UV Spectral Region", PHOTOCHEMISTRY AND PHOTOBIOLOGY, vol. 80, no. 3, 1 January 2004 relates to measurements of reflectance spectra from human skin in vivo in the spectral range from 250 to 700 nm. The measured results are simulated using a new radiative transfer model developed to study light propagation in skin tissue.
- NIELSEN KRISTIAN P. ET AL "The optics of human skin: aspects important for human health", SOLAR RADIATION AND HUMAN HEALTH, 1 January 2008 relates to combining a bio-optical model of human skin with advanced radiative transfer theory to simulate the transport of solar radiation through the skin.
- the claimed invention is directed to a method of determining morphological parameters and physiological properties of tissue only insofar as the tissue is skin tissue. Other types of tissue do not fall within the scope of the invention as defined by the claims.
- the present invention relates to a novel method for determining morphological parameters and physiological properties of the tissue (MP&PPs) of different types of tissue lesions.
- the present invention is directed to a method for determining MP&PPs for malignant as well as benign tissue lesions.
- the method of the present invention is applicable to, but not limited to, benign and malignant tissue lesions in general, and uses spectral reflectance measurements of tissue lesions, which may be generated by a spectrophotometer or by an Optical Transfer Diagnosis (OTD) method.
- spectral reflectance measurements of tissue lesions which may be generated by a spectrophotometer or by an Optical Transfer Diagnosis (OTD) method.
- the OTD device currently used records 30 spectral reflectance images of a lesion under examination. These 30 reflectance images, which constitute one image set, are recorded at 10 different wavelengths (365-1000 nm) from multiple angles of illumination and detection.
- the OTD device is a spectral reflectance meter consisting of a measurement head with 12 fixed light-emitting diode (LED) lamps and 3 IEEE (Institute of Electrical and Electronics Engineers) 1394 FireWire cameras. Each LED is placed at a different angle relative to the skin to enhance the ability to retrieve information about the depth of the lesion.
- the polar angles of the LEDs vary between 30 and 45 degrees, and the relative azimuth angles between 34 and 145 degrees.
- the polar angles of the detectors vary between 0 and 45 degrees, and the relative azimuth angles between 0 and 180 degrees,
- an alcohol-based gel is used as an interface between the measurement probe and the skin, and a selected area of the skin is illuminated and imaged through a 2.2 cm diameter circular sapphire plate.
- the imaging time is approximately 5 seconds.
- the present invention provides through the use of a non-linear inversion procedure, a method for deriving MP&PPs as well as additional MPs of a lesion from a set of spectral reflectance measurements.
- MP&PPs can be determined including (i) percentage of hemoglobin; (ii) percentage of hemoglobin oxygenation; (iii) upper epidermal thickness; (iv) lower epidermal thickness; (v) percentage of upper melanosome concentration; (vi) percentage of lower melanosome concentration; and (vii) percentage of keratin concentration.
- the third and fourth of these entities are MPs, while the remaining five entities are physiological properties (PPs) describing the physiological state of the tissue. Each of these seven entities varies and is different for normal and malignant tissues. Also, the present invention provides a method for deriving a set of additional MPs of diagnostic value directly from the reflectance measurements.
- a description of how a lesion can be defined directly from measured reflectance spectra and how such measurements can be used to characterize the lesion in terms of a set of MPs follows.
- an aim is to differentiate between benign pigmented nevi and malignant melanomas, but the method is applicable in general to differentiate between benign and malignant tissue.
- a lesion border is defined from measured reflectance spectra by using the reflected intensity from one of the channels in the visible spectral range, for example the green channel.
- 10 different MPs are descriptive of the lesion and can be used as an aid to make a definitive diagnosis.
- Lesion border The border of a lesion is defined from the reflected intensity of the image from one of the visible channels, for example the green channel, looking straight down at the lesion, by identifying the regions in which the gradient of the reflected intensity has its largest values.
- the size parameter p M 1 is defined as the number of pixels comprising the lesion, i.e. p M 1 is the number of pixels inside the lesion border defined above.
- Histogram width For a given combination of illumination and observation directions, the histogram-width parameter p M 2 gives a measure of the inhomogeneity of the reflected intensity of a lesion. Usually this parameter is small for benign nevi, but large for melanomas. Sebhorreic keratoses can also have relatively large inhomogeneities of the reflected intensity.
- the parameter p M 3 provides information about another aspect of the inhomogeneity of the reflected intensity of a lesion.
- the spatial light absorptance distribution in a lesion be defined as its "mass distribution” and calculate its "center of mass” and “total mass”, the latter being defined as the average light absorptance of the lesion.
- the parameter p M 3 gives the moment of inertia of the lesion relative to that of a homogeneous circular disk having the same "total mass" as the lesion and a diameter equal to the average diameter of the lesion.
- the center distance p M 4 which provides additional information about the asymmetry of the lesion, represents the physical distance between the "geometrical center of a lesion" and the "center of mass" of the absorptance, as defined above.
- the "geometrical center of a lesion” means its center with respect to its border, irrespective of how the pigment is distributed within it. Thus, if a lesion has an asymmetrical pigment distribution, the distance between the "geometrical center” and the "center of mass” will be significant.
- the darkness parameter p M 5 is defined as the average value of the reflected intensity of a lesion.
- Fractal dimension The fractal-dimension parameter p M 6 describes the complexity of the border of a lesion. It is defined such that the border of a lesion has a fractal dimension of 1 if the lesion border is perfectly smooth, independent of magnification, while the fractal dimension of the lesion border will tend towards 2 if it is highly irregular.
- the aspericity parameter p M 7 is defined as the ratio between the long and short axes of a lesion. It is 1 for a circular lesion, and increases as a lesion gets more elongated. Just as p M 6 and p M 8 , this parameter depends only on the border of the lesion, and does not contain any information about its internal structure.
- the relative border length p M 8 is defined as the ratio of the border length of a circle with the same area as the lesion to the border length of the lesion.
- Multi-spectral reflectance measurements combined with bio-optical models and accurate radiative transfer simulations of light propagation inside tissue and backscattering from it, provide a basis for obtaining estimates of MP&PPs.
- tissue MP&PPs the following ingredients are needed: 1.
- a bio-optical model that relates tissue MP&PPs to tissue lOPs, the latter being the absorption and scattering coefficients as well as the scattering phase function, each as function of wavelength and depth in the tissue; 2.
- An accurate radiative transfer model for coupled air-tissue systems. which for a given set of lOPs computes various apparent optical properties (AOPs). such as the diffuse reflectance spectrum; 3.
- AOPs apparent optical properties
- An iterative inversion scheme that accounts for the nonlinear dependence of the AOPs on the lOPs.
- DISORT discrete ordinate radiative transfer
- Chromophores such as the epidermal melanosome concentration and the dermal blood concentration, were considered as retrievable entities, since their variability strongly influences the apparent optical properties of the tissue, such as the spectral tissue reflectance. But entities describing the optical properties of the cellular matrix into which the chromophores are embedded, were kept fixed because variations in these entities have little impact on the apparent optical properties of the tissue.
- Reflectance spectra in the wavelength region from 300 nm to 600 nm were measured daily from three test areas and three control areas on a volunteer with skin type III for two weeks during which the skin in the test areas went through erythema and pigmentation.
- the volunteer who had given his written permission to participate in the study, was healthy and did not use any medical drugs. Erythema and pigmentation were induced after 24-hour topical application of a photosensitizer followed by illumination with red light (632 nm) for 2 minutes on the first day ('day 0') of the experiment.
- red light 632 nm
- Cream was prepared using 10% (w/w) of the hexylester of 5-aminolevulinic acid (ALA-Hex) in a standard oil-in-water cream base (Unguentum, Merck, Darmstad, Germany).
- ALA-Hex 5-aminolevulinic acid
- Freshly prepared cream with approximately (75 ⁇ 10) mg/cm 2 of ALA-Hex was topically applied on each of the three test areas, which were subsequently covered with transparent adhesive dressings (OpSite Flexifix, Smith & Nephew Medical Ltd., Hull, UK), in which three openings (1 cm x 1 cm) had been cut out precisely in the places where the test areas were located.
- the dressings were intended to prevent the cream from diffusing to adjacent areas.
- the creams and the dressings were kept for 24 hours on the test areas, which were then illuminated with red light (632 nm) for 2 minutes.
- control areas similar to the test areas, were also marked on the volunteer.
- ALA-Hex was applied but it was not illuminated; the second of the control areas (E) was illuminated with red light, but no ALA-Hex was applied; on the third control area (F) a base cream, without ALA-Hex was applied, and it was illuminated with red light.
- a luminescence spectrometer was employed to record reflectance spectra from each of the test areas and each of the control areas.
- the spectrometer was equipped with two scanning grating monochromators, one in front of the light source (a pulsed Xenon lamp) and another in front of the detector.
- a fiber-optic probe was coupled to the spectrometer.
- the probe was a commercially available fiber accessory (Perkin-Elmer), consisting of two 1 m fused silica fiber bundles joined in parallel at the measuring tip. It was connected to a cylindrically shaped aluminum spacer with an inner diameter of 4 mm. The spacer was painted black inside in order to minimize stray light.
- the spacer was pressed lightly against the skin to keep the probe at a fixed distance of 10 mm above the skin surface. This arrangement ensured a relatively uniform distribution of the excitation light over the area to be examined. Reflectance spectra were measured in synchronous scans in which both gratings were set at the same wavelength and band pass (5 nm) to avoid fluorescence artifacts. The area exposed to the excitation light of the spectrometer was the same as the area from which the reflected light was detected. The geometry of the fiber probe was such that both the directly (Fresnel) reflected and the diffusely reflected irradiances from the skin were collected and recorded. Care was taken not to press the spacer too hard against the skin surface in order to minimize artifacts from pressure-induced reductions in the blood flow.
- a coupled air-tissue system can be represented by a layered medium with constant inherent optical properties (lOPs) in each layer.
- the tissue is assumed to be a turbid layered medium so that radiative transfer theory can be used to compute the diffuse light inside it and reflected from it.
- Each tissue layer can be described in terms of its lOPs, which are the absorption coefficient ⁇ ([mm -1 ]), the scattering coefficient ⁇ ([mm -1 ]), the (normalized) scattering phase function p (cos ⁇ ), and the physical thickness ⁇ z ([mm]).
- the scattering phase function gives the distribution of the scattered light as a function of the scattering angle ⁇ .
- Skin tissue is a complex medium with many different kinds of scattering 'particles' in each layer, and the scattering phase function for a particular layer represents a weighted mean of scattering phase functions for several types of particles.
- Different descriptions of the scattering phase function p (cos ⁇ ) may be used in different physical and practical applications.
- two such functions namely the Henyey-Greenstein scattering phase function p HG (cos ⁇ ) and the Rayleigh scattering phase function p Ray (cos ⁇ ) are used.
- the average cosine g is called the asymmetry factor of the scattering phase function.
- This Henyey-Greenstein scattering phase function has no physical basis, but is useful for describing scattering by large particles in a medium, such as tissue, for which the actual scattering phase function is unknown.
- the term 'large particles' implies that their sizes are comparable to or larger than the wavelength.
- the Rayleigh scattering phase function gives a good description of the angular distribution of the scattered light.
- a bio-optical model was used to calculate the lOPs for a given set of MP&PPs that describe the physiological state of the tissue.
- the CAT-DISORT was employed to solve the radiative transfer equation for a slab of biological tissue stratified into a number of layers, thereby accounting for the reflection and refraction of the incident radiance at the air-tissue interface (caused by the change in the refractive index), which affect the radiation field significantly.
- An integral part of the forward-inverse modeling procedure was to couple the bio-optical model to CAT-DISORT in such a way that the MP&PPs could be determined directly from the measured AOPs.
- the other MP&PPs were fixed.
- each of the scattering coefficients associated with the non-pigmented constituents of the epidermis and the dermis, the optical thickness of the dermis, and the optical properties of the subcutaneous layer were assumed to be fixed.
- Figure 1 shows an example of the agreement between measured and simulated reflectance values obtained when using the retrieved values for the 7 MP&PP entities listed above as inputs to CAT-DISORT simulations.
- Figure 1 measured (+) and simulated (x) reflectance spectra for test area A on the seventh day after the photodynamic exposure is shown. The figure shows that good agreement was obtained between measured and simulated spectra when the 7 retrieved MP&PPs for this day were used as inputs to CAT-DISORT simulations.
- Figures 2-8 show the retrieved values of the blood content in the dermis ( Fig. 2 ), the percentage of oxygenated blood ( Fig 3 ), the melanosome concentration in the lower layer of the epidermis ( Fig. 4 ), the melanosome concentration in the upper layer of the epidermis ( Fig. 5 ), the thickness of the lower epidermis ( Fig. 6 ), the thickness of the upper epidermis ( Fig. 7 ), and the keratin concentration in the upper epidermis ( Fig. 8 ), respectively.
- the three panels in the left column of each figure represent the test areas (A-C), while the three panels in the right column represent the control areas (D-F).
- the epidermis was divided into five layers and the melanosome concentration was allowed to vary from one layer to another.
- the epidermis is divided into two layers and the melanosome concentration and the thickness for each of them are retrieved.
- Fig. 3 shows the percentage of oxygenated blood immediately after the photodynamic treatment and during the following two weeks for the six measurement areas.
- Photodynamic therapy is known to be an oxygen consuming process. Thus, it must be emphasized that 'immediately after' means several seconds or may be even a minute after the exposure.
- the marked increase in oxygenation measured at the beginning of the experiment, at all the three test areas, is likely to be a reaction to the photodynamic treatment, rather than a direct effect of the treatment itself.
- the variation in blood oxygenation at the three control areas is of a stochastic nature.
- the retrieval of the melanosome content was less uncertain for the upper epidermis ( Fig. 5 ) than for the lower epidermis ( Fig. 4 ).
- the standard deviations for the lower epidermal melanosome content were about twice as large as for the upper epidermal melanosome content.
- the melanosome content in the lower epidermis decreased during the two weeks ( Fig. 4 ), while the melanosome content in the upper epidermal layer increased, in particular during the first week ( Fig. 5 ).
- This behaviour is similar to that caused by pigmentation induced by UVB radiation (with wavelengths shorter than 320 nm).
- the melanosome pigment particles tend to be transferred from the melanocytes in the basal layer of the epidermis to the keratinocytes in the upper layer.
- there was no sign of immediate pigment darkening a process primarily induced by UVA radiation (with wavelengths longer than 320 nm). Had immediate pigment darkening occurred, it would have been seen in the measurements taken immediately after the photodynamic treatment.
- the retrieved thickness of the total epidermis is close to what would be expected.
- Sandby-M ⁇ ller et al., Epidermal Thickness at Different Body Sites: Relationship to Age, Gender, Pigmentation, Blood Content, Skin Type and Smoking Habits, Acta Derm Venereol 2003; 83: 410-413 (2003 ) performed measurements on the dorsal forearm of 71 volunteers and found the average epidermal thickness to be 76 ⁇ m ⁇ 15 ⁇ m.
- a total epidermal thickness of approximately 70 ⁇ m for both the test sites and the control sites was retrieved.
- the epidermal thickness appears to be retrieved well from the measurements.
- tissue may be modeled as a turbid, plane-parallel, vertically inhomogeneous, layered medium with specified optical properties.
- the inherent optical properties i.e., the absorption coefficient ⁇ ( z ), the scattering coefficient ⁇ ( z ) and the normalized scattering phase function p ( z , ⁇ ) were allowed to vary with depth z in the tissue.
- ⁇ is the scattering angle
- Lateral variations in the IOPs may be ignored, keeping in mind that every measured value corresponds to the radiance reflected by the tissue into the upper hemisphere and then gathered by the finite aperture of an optical system.
- u dI ⁇ , u , ⁇ d ⁇ I ⁇ , u , ⁇ ⁇ J ⁇ , u , ⁇
- I ( ⁇ ,u, ⁇ ) stands for the diffuse radiance
- u is the cosine of the polar angle ⁇
- ⁇ is the azimuth angle.
- the angles ( ⁇ ', ⁇ ' ) denote the direction of a beam of light before a scattering event and the angles ( ⁇ , ⁇ ) denote the observation direction.
- the first term in the source function J ( ⁇ ,u, ⁇ ) represents multiple scattering
- the CAT-DISORT C oupled A ir- T issue DIS crete- O rdinate R adiative T ransfer
- the lOPs were used as input to the CAT-DISORT model to compute the reflected radiances (AOPs) in directions ( ⁇ a , ⁇ a ) inside the detector aperture.
- the computed radiances were integrated over the solid angle ( ⁇ u a , ⁇ ⁇ a ) of the optical system aperture.
- f ⁇ n ( n 1,2,...
- N corresponds to the reflected radiance at N different wavelengths
- the covariance matrix of the noise C ⁇ E ⁇ ⁇ ⁇ ⁇ T is estimated, where E is the mathematical expectation operator.
- the superscript ⁇ means transposition, so that if ⁇ denotes a column vector, ⁇ T is the corresponding row vector, and thus ⁇ ⁇ ⁇ ⁇ T is a symmetric matrix of dimension N ⁇ N .
- tissue model parameters are assembled in a vector s.
- MP&PP components such as the contents of melanosomes, blood, keratin, etc. in the tissue layers.
- F F s + ⁇ ⁇ .
- the inverse problem is still underdetermined (ill-posed).
- the reason for the ill-posedness is the smoothness of most of the spectral signatures of the MP&PP tissue components, implying that the spectral signature of one MP&PP component can be mimicked by a certain combination of others. This makes it hard if not impossible to find the proper impact of an individual MP&PP component, if the parameterization of the tissue model in terms of MP&PP components is done without proper analysis of the information content.
- a regularization procedure may be invoked.
- Bayesian inference provides a natural way of regularization through the introduction of a probabilistic measure in the space of unknown parameters. From Bayes' theorem on conditional probabilities p f
- s p s p s
- Eq. (10) objective function
- Eq. (10) is the weighted least mean squares difference between simulated and measured radiances, with an extra regularization term (penalty function), represented by the second term in Eq. (10), which is strictly convex and defines the set of admissible tissue component parameters.
- L i is used for the Frèchet derivatives evaluated at state s i .
- the linear approximation in Eq. (12) corresponds to approximating the conditional probability (9) with a Gaussian distribution of unknowns s : p s
- f ⁇ exp ⁇ 1 2 L 0 s ⁇ ⁇ ⁇ f T C ⁇ ⁇ 1 L 0 s ⁇ ⁇ ⁇ f + s ⁇ T C s ⁇ 1 s ⁇ with ⁇ f f - F (s 0 ).
- the computed morphological parameters are defined as follows:
- M z is defined in Eq. (23).
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- General Physics & Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- Surgery (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- Heart & Thoracic Surgery (AREA)
- Biophysics (AREA)
- Theoretical Computer Science (AREA)
- Geometry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Chemical & Material Sciences (AREA)
- Dermatology (AREA)
- Immunology (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Optics & Photonics (AREA)
- Multimedia (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Description
- The present disclosure relates to an optical method for determining several morphological parameters and physiological properties (hereafter abbreviated MP&PPs) of skin tissue. In particular, the present disclosure is directed to a method to determine MP&PPs of malignant as well as benign skin tissue lesions.
- Malignant melanoma is one of the most rapidly increasing cancers in the world. In the United States alone, the estimated incidence for 2008 is 62,480, which leads to an estimated total of 8,420 deaths per year. Successful treatment of melanoma depends on early detection by clinicians with subsequent surgical removal of tumors. Visual detection has its limitations, even when augmented with dermoscopy, especially with less experienced users. Attempts have thus been made to develop automated devices to assist in the screening of pigmented skin lesions for likelihood of melanoma. Several of these devices have digitalized dermoscopy-related features analyzed by artificial neural networks or support vector machine learning systems.
- The optical properties of human skin in the ultraviolet spectral region have been studied for almost one hundred years [Hasselbalch, KA: Quantitative Untersuchungen Uber die Absorption der menschlichen Haut von ultravioletten Strahlen. Skand Arch Physiol 1911 25: 5-68, 1911; Everett, MA, Yeargers, E, Sayre, RM, Olson, RL: Penetration of epidermis by ultraviolet rays. Photochem Photobiol 1966 5: 533-542], and non-invasive optical methods have been applied to study the physiological state of human skin for at least twenty years [Diffey, BL, Oliver, RJ, Farr, PM: A portable instrument for quantifying erythema induced by ultraviolet radiation. Br J Dermatol 1984 111: 663-672]. A well-known application is blood-oxymetry, by which a relative blood-oxygenation index can be determined non-invasively from the scattered reflectance or transmittance of light at red and near-infrared (NIR) wavelengths [see e.g. Yaroslavsky AN, Schulze PC, et al. Optical properties of selected native and human brain tissues in vitro in the visible and near infrared spectral range. Physics in Medicine and Biology. 2002 47(12):2059-2073]. The reflectance in that spectral region has also been used to determine other physiological properties. For example, the gradient of the reflectance spectrum between 620 nm and 720 nm depends on the total melanin content of the skin [Kollias N, Baqer AN. Spectroscopic characteristics of human melanin in vivo. J Invest Dermatol, 1985 ;85:38-42], However, variations in the blood concentration, the thicknesses of the skin layers, and the scattering phase function of skin tissue, also affect the reflectance spectrum, and thereby the accuracy of the determination of blood oxygenation and total melanin content. Therefore, it is essential to perform a simultaneous determination of all optically important MP&PPs.
- In order to determine tissue optical properties (as opposed to MP&PPs) from spectral reflectance measurements several different inversion schemes have been used, including partial least squares regression [Berger et al., An enhanced algorithm for linear multivariate calibration, Anal. Chem. 1998, 70: 623-627], neural networks [Kienle et al., Spatially resolved absolute diffuse reflectance measurements for noninvasive determination of the optical scattering and absorption coefficients of biological tissue, Appl. Opt. 35 2304-2314 1996], fuzzy logic [Dam et al., Determination of tissue optical properties from diffuse reflectance profiles by multivariate calibration. Appl Opt. 1998;37:772-778], and genetic algorithms [Zhang et al., "Neural vs. statistical classifier in conjunction with genetic algorithm based feature selection" Pattern recognition letters 26.7 (2005): 909-919]. In contrast, this invention makes use of a nonlinear inversion scheme based on e.g. optimal estimation theory [Tikhonov, A.N., and Arsenin, V.Y., Tikhonov, A. N.; V. Y. Arsenin (1977). Solution of III-posed Problems. Washington: Winston & Sons. ISBN 0-470-99124-01; Twomey, S, Introduction to the Mathematics of Inversion in Remote Sensing and Indirect Measurement Developments in Geomathematics, Vol. 3 Elsevier, Amsterdam (1977); Tarantola, A., Inverse Problem Theory: Methods for Data Fitting and Model Parameter Estimation , Elsevier, New York 1987; Rodgers, Clive D., Inverse Methods for Atmospheric Sounding: Theory and Practice. World Scientific 2000], combined with bio- optical models [which provide a link between MP&PPs and inherent optical properties (IOPs)] and accurate radiative-transfer modeling in coupled air-tissue systems. There is also disclosed, a method for deriving a set of additional morphological parameters (MPs) of tissue from reflectance measurements.
-
WO 2006/076810 A1 discloses a method and device for disease detection, more particularly, cancer detection, from the analysis of diffuse reflectance spectra measured in vivo during endoscopic imaging. The measured diffuse reflectance spectra are analyzed using a light-transport model and numerical method to derive quantitative parameters related to tissue physiology and morphology. -
US 2006/247532 A1 discloses an iterative process that calculates the absorption and scattering coefficients of tissue from a set of diffuse reflectance measurements made with an optical spectrometer operating in the UV-VIS spectral range. The relationship between measured diffuse reflectance and the absorption and scattering coefficients is modeled using a Monte Carlo simulation. - NIELSEN KRISTIAN P. ET AL: "Reflectance Spectra of Pigmented and Nonpigmented Skin in the UV Spectral Region", PHOTOCHEMISTRY AND PHOTOBIOLOGY, vol. 80, no. 3, 1 January 2004 relates to measurements of reflectance spectra from human skin in vivo in the spectral range from 250 to 700 nm. The measured results are simulated using a new radiative transfer model developed to study light propagation in skin tissue.
- NIELSEN KRISTIAN P. ET AL: "The optics of human skin: aspects important for human health", SOLAR RADIATION AND HUMAN HEALTH, 1 January 2008 relates to combining a bio-optical model of human skin with advanced radiative transfer theory to simulate the transport of solar radiation through the skin.
- The present teaching provides a method as detailed in
claim 1. Advantageous features are provided in dependent claims. - The objects and features of the present disclosure, which are believed to be novel, are set forth with particularity in the appended claims. The present disclosure, both as to its organization and manner of operation, together with further objectives and advantages, may be best understood by reference to the
following description, taken in connection with the accompanying drawings as set forth below: -
Figure 1 shows an example of the agreement between measured and simulated reflectance values obtained when using the retrieved values for morphological parameters and physiological properties of the tissue; -
Figure 2 shows the retrieved dermal blood concentration for each of the measurement areas; -
Figure 3 shows the retrieved percentage of oxygenated blood for each of the measurement areas; -
Figure 4 shows retrieved melanosome content in the lower epidermis for each of the measurement areas; -
Figure 5 shows retrieved melanosome content in the upper epidermis for each of the measurement areas; -
Figure 6 shows retrieved lower epidermis thickness for each of the measurement areas; -
Figure 7 shows retrieved upper epidermis thickness for each of the measurement areas; and -
Figure 8 shows retrieved epidermal keratin content for each of the measurement areas. - The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. In addition, the following detailed description does not limit the present disclosure. The claimed invention is directed to a method of determining morphological parameters and physiological properties of tissue only insofar as the tissue is skin tissue. Other types of tissue do not fall within the scope of the invention as defined by the claims. The present invention relates to a novel method for determining morphological parameters and physiological properties of the tissue (MP&PPs) of different types of tissue lesions. In particular, the present invention is directed to a method for determining MP&PPs for malignant as well as benign tissue lesions. The method of the present invention is applicable to, but not limited to, benign and malignant tissue lesions in general, and uses spectral reflectance measurements of tissue lesions, which may be generated by a spectrophotometer or by an Optical Transfer Diagnosis (OTD) method.
- The OTD device currently used
records 30 spectral reflectance images of a lesion under examination. These 30 reflectance images, which constitute one image set, are recorded at 10 different wavelengths (365-1000 nm) from multiple angles of illumination and detection. According to the invention the OTD device is a spectral reflectance meter consisting of a measurement head with 12 fixed light-emitting diode (LED) lamps and 3 IEEE (Institute of Electrical and Electronics Engineers) 1394 FireWire cameras. Each LED is placed at a different angle relative to the skin to enhance the ability to retrieve information about the depth of the lesion. The polar angles of the LEDs vary between 30 and 45 degrees, and the relative azimuth angles between 34 and 145 degrees. The polar angles of the detectors vary between 0 and 45 degrees, and the relative azimuth angles between 0 and 180 degrees, In the current OTD practice, an alcohol-based gel is used as an interface between the measurement probe and the skin, and a selected area of the skin is illuminated and imaged through a 2.2 cm diameter circular sapphire plate. The imaging time is approximately 5 seconds. - On the basis of established absorption and transmission spectra for known tissue chromophores and mathematical modeling of spectral tissue reflectance using a bio-optical model in combination with radiative transfer modeling in coupled air-tissue systems, the present invention provides through the use of a non-linear inversion procedure, a method for deriving MP&PPs as well as additional MPs of a lesion from a set of spectral reflectance measurements. By this method, several MP&PPs can be determined including (i) percentage of hemoglobin; (ii) percentage of hemoglobin oxygenation; (iii) upper epidermal thickness; (iv) lower epidermal thickness; (v) percentage of upper melanosome concentration; (vi) percentage of lower melanosome concentration; and (vii) percentage of keratin concentration. The third and fourth of these entities are MPs, while the remaining five entities are physiological properties (PPs) describing the physiological state of the tissue. Each of these seven entities varies and is different for normal and malignant tissues. Also, the present invention provides a method for deriving a set of additional MPs of diagnostic value directly from the reflectance measurements.
- It is important to combine information about parameters that characterize the physiological state of the skin tissue with information of diagnostic value obtained from MPs other than the thicknesses of the upper and lower epidermis layers. For example, an unusually high melanin content would not suffice to make a definitive melanoma diagnosis, but if a lesion with high melanin content also had an irregular spatial distribution of the reflected intensity, then the high melanin content could indicate with a higher probability that the lesion might be a melanoma.
- To aid the differentiation between benign and malignant tissue, a description of how a lesion can be defined directly from measured reflectance spectra and how such measurements can be used to characterize the lesion in terms of a set of MPs follows. As an example, an aim is to differentiate between benign pigmented nevi and malignant melanomas, but the method is applicable in general to differentiate between benign and malignant tissue.
- A lesion border is defined from measured reflectance spectra by using the reflected intensity from one of the channels in the visible spectral range, for example the green channel. As an example, 10 different MPs are descriptive of the lesion and can be used as an aid to make a definitive diagnosis.
- Lesion border. The border of a lesion is defined from the reflected intensity of the image from one of the visible channels, for example the green channel, looking straight down at the lesion, by identifying the regions in which the gradient of the reflected intensity has its largest values.
- Size: The size parameter p M1 is defined as the number of pixels comprising the lesion, i.e. p M1 is the number of pixels inside the lesion border defined above.
- Histogram width: For a given combination of illumination and observation directions, the histogram-width parameter p M2 gives a measure of the inhomogeneity of the reflected intensity of a lesion. Usually this parameter is small for benign nevi, but large for melanomas. Sebhorreic keratoses can also have relatively large inhomogeneities of the reflected intensity.
- Relative moment of inertia: For a given combination of illumination and observation directions, the parameter p M3 provides information about another aspect of the inhomogeneity of the reflected intensity of a lesion. Let the spatial light absorptance distribution in a lesion be defined as its "mass distribution" and calculate its "center of mass" and "total mass", the latter being defined as the average light absorptance of the lesion. Then the parameter p M3 gives the moment of inertia of the lesion relative to that of a homogeneous circular disk having the same "total mass" as the lesion and a diameter equal to the average diameter of the lesion. If there is a high melanin concentration towards the center of a lesion, this parameter will be small, while it will be large if there is a high melanin concentration towards its border. For the melanomas examined so far, the p M3 values were small, in particular for well-developed melanomas.
- Center distance: The center distance p M4, which provides additional information about the asymmetry of the lesion, represents the physical distance between the "geometrical center of a lesion" and the "center of mass" of the absorptance, as defined above. The "geometrical center of a lesion" means its center with respect to its border, irrespective of how the pigment is distributed within it. Thus, if a lesion has an asymmetrical pigment distribution, the distance between the "geometrical center" and the "center of mass" will be significant.
- Darkness: The darkness parameter p M5 is defined as the average value of the reflected intensity of a lesion.
- Fractal dimension: The fractal-dimension parameter p M6 describes the complexity of the border of a lesion. It is defined such that the border of a lesion has a fractal dimension of 1 if the lesion border is perfectly smooth, independent of magnification, while the fractal dimension of the lesion border will tend towards 2 if it is highly irregular.
- Asphericity: The aspericity parameter p M7 is defined as the ratio between the long and short axes of a lesion. It is 1 for a circular lesion, and increases as a lesion gets more elongated. Just as p M6 and p M8, this parameter depends only on the border of the lesion, and does not contain any information about its internal structure.
- Relative border length: The relative border length p M8 is defined as the ratio of the border length of a circle with the same area as the lesion to the border length of the lesion.
- Size vs. fractal dimension: The parameter p M9 is defined as the size divided by the fractal dimension, i.e. p M9 = p M1 / p M6 .
- Border length vs. fractal dimension: The parameter p M10 is defined as the relative border length divided by the fractal dimension, i.e. p M10 = p M8 / p M6.
- Multi-spectral reflectance measurements combined with bio-optical models and accurate radiative transfer simulations of light propagation inside tissue and backscattering from it, provide a basis for obtaining estimates of MP&PPs. In order to determine important tissue MP&PPs the following ingredients are needed: 1. A bio-optical model that relates tissue MP&PPs to tissue lOPs, the latter being the absorption and scattering coefficients as well as the scattering phase function, each as function of wavelength and depth in the tissue; 2. An accurate radiative transfer model for coupled air-tissue systems. which for a given set of lOPs computes various apparent optical properties (AOPs). such as the diffuse reflectance spectrum; 3. An iterative inversion scheme that accounts for the nonlinear dependence of the AOPs on the lOPs.
- Commonly used radiative transfer models include one based on the diffusion approximation and another based on Monte Carlo (MC) simulations. The first method is not accurate enough for our purpose, and the MC method is too slow. The numerically stable discrete ordinate radiative transfer (DISORT) model provides accurate results for coupled air-tissue systems in an efficient manner. Thus, the DISORT code for coupled air tissue systems (CAT-DISORT) is several orders of magnitude faster than the MC method and provides results that are just as precise. It includes a bio-optical model that has been applied also to provide estimates of the efficiency of various photobiological processes and photodynamic therapy in the UV and visible spectral regions.
- To illustrate the potential of our method for determining tissue MP&PPs, a study was carried out that aimed at evaluating the feasibility of employing the biooptical model together with CAT-DISORT forward simulations and inversion based on Bayesian optimal estimation to determine important MP&PPs of skin tissue from diffuse reflectance spectra measured by Zhao, Y. and Berns, R. S. (2007), Image-based spectral reflectance reconstruction using the matrix R method. Color Res. Appl., 32: 343-351. The biooptical model contains a large number of variable MP&PPs that in principle could be retrieved, but most of them were kept fixed while only a few were treated as
retrievable entities. Chromophores, such as the epidermal melanosome concentration and the dermal blood concentration, were considered as retrievable entities, since their variability strongly influences the apparent optical properties of the tissue, such as the spectral tissue reflectance. But entities describing the optical properties of the cellular matrix into which the chromophores are embedded, were kept fixed because variations in these entities have little impact on the apparent optical properties of the tissue. - Reflectance spectra in the wavelength region from 300 nm to 600 nm were measured daily from three test areas and three control areas on a volunteer with skin type III for two weeks during which the skin in the test areas went through erythema and pigmentation. The volunteer, who had given his written permission to participate in the study, was healthy and did not use any medical drugs. Erythema and pigmentation were induced after 24-hour topical application of a photosensitizer followed by illumination with red light (632 nm) for 2 minutes on the first day ('day 0') of the experiment. A brief summary of the design of the photodynamic experiment is given below.
- Three test areas (A, B & C), each 1 cm x 1 cm with approximately 1.5 cm distance between adjacent areas, were marked on the inner part of the right forearm of the volunteer. Cream was prepared using 10% (w/w) of the hexylester of 5-aminolevulinic acid (ALA-Hex) in a standard oil-in-water cream base (Unguentum, Merck, Darmstad, Germany). Freshly prepared cream with approximately (75± 10) mg/cm2 of ALA-Hex was topically applied on each of the three test areas, which were subsequently covered with transparent adhesive dressings (OpSite Flexifix, Smith & Nephew Medical Ltd., Hull, UK), in which three openings (1 cm x 1 cm) had been cut out precisely in the places where the test areas were located. The dressings were intended to prevent the cream from diffusing to adjacent areas. The creams and the dressings were kept for 24 hours on the test areas, which were then illuminated with red light (632 nm) for 2 minutes.
- Three control areas, similar to the test areas, were also marked on the volunteer. On the first of these control areas (D) ALA-Hex was applied but it was not illuminated; the second of the control areas (E) was illuminated with red light, but no ALA-Hex was applied; on the third control area (F) a base cream, without ALA-Hex was applied, and it was illuminated with red light.
- A luminescence spectrometer was employed to record reflectance spectra from each of the test areas and each of the control areas. The spectrometer was equipped with two scanning grating monochromators, one in front of the light source (a pulsed Xenon lamp) and another in front of the detector. A fiber-optic probe was coupled to the spectrometer. The probe was a commercially available fiber accessory (Perkin-Elmer), consisting of two 1 m fused silica fiber bundles joined in parallel at the measuring tip. It was connected to a cylindrically shaped aluminum spacer with an inner diameter of 4 mm. The spacer was painted black inside in order to minimize stray light. The spacer was pressed lightly against the skin to keep the probe at a fixed distance of 10 mm above the skin surface. This arrangement ensured a relatively uniform distribution of the excitation light over the area to be examined. Reflectance spectra were measured in synchronous scans in which both gratings were set at the same wavelength and band pass (5 nm) to avoid fluorescence artifacts. The area exposed to the excitation light of the spectrometer was the same as the area from which the reflected light was detected. The geometry of the fiber probe was such that both the directly (Fresnel) reflected and the diffusely reflected irradiances from the skin were collected and recorded. Care was taken not to press the spacer too hard against the skin surface in order to minimize artifacts from pressure-induced reductions in the blood flow.
- A coupled air-tissue system can be represented by a layered medium with constant inherent optical properties (lOPs) in each layer. The tissue is assumed to be a turbid layered medium so that radiative transfer theory can be used to compute the diffuse light inside it and reflected from it. Each tissue layer can be described in terms of its lOPs, which are the absorption coefficient α([mm-1]), the scattering coefficient σ([mm-1]), the (normalized) scattering phase function p(cosΘ), and the physical thickness Δz ([mm]). In terms of α, σ, and Δz, one may define two non-dimensional lOPs given by τ=(α+σ)Δz (optical thickness) and a = σ/(α + σ) (single-scattering albedo), so that the lOPs in each layer of the tissue can be adequately described by the two variables τ and a, as well as a third parameter g, related to the scattering phase function.
- The scattering phase function gives the distribution of the scattered light as a function of the scattering angle Θ. Skin tissue is a complex medium with many different kinds of scattering 'particles' in each layer, and the scattering phase function for a particular layer represents a weighted mean of scattering phase functions for several types of particles. Different descriptions of the scattering phase function p(cosΘ) may be used in different physical and practical applications. Here, two such functions, namely the Henyey-Greenstein scattering phase function pHG (cosΘ) and the Rayleigh scattering phase function pRay (cosΘ) are used. A convenient measure of the angular distribution of the scattering is the average over all scattering directions (weighted by p(cosΘ)) of the cosine of the scattering angle Θ, i.e. (µ = cosΘ)
- In 1941 Henyey and Greenstein proposed the one-parameter scattering phase function given by
- A bio-optical model was used to calculate the lOPs for a given set of MP&PPs that describe the physiological state of the tissue. In order to calculate the AOPs (in this case the diffuse reflectance spectrum from the tissue), the CAT-DISORT was employed to solve the radiative transfer equation for a slab of biological tissue stratified into a number of layers, thereby accounting for the reflection and refraction of the incident radiance at the air-tissue interface (caused by the change in the refractive index), which affect the radiation field significantly. An integral part of the forward-inverse modeling procedure was to couple the bio-optical model to CAT-DISORT in such a way that the MP&PPs could be determined directly from the measured AOPs.
- In order to obtain a unique solution of our inverse or retrieval problem, most MP&PPs are kept fixed, while other MP&PPs are considered to be retrievable, and therefore allowed to vary. The following 7 retrievable MP&PPs varied:
- The dermal blood content
- The percentage of oxygenated blood
- The melanosome concentration in the lower epidermis
- The thickness of the lower epidermis
- The melanosome concentration in the upper epidermis
- The thickness of the upper epidermis
- The keratin concentration in the upper epidermis.
- The other MP&PPs were fixed. Thus, each of the scattering coefficients associated with the non-pigmented constituents of the epidermis and the dermis, the optical thickness of the dermis, and the optical properties of the subcutaneous layer were assumed to be fixed.
-
Figure 1 shows an example of the agreement between measured and simulated reflectance values obtained when using the retrieved values for the 7 MP&PP entities listed above as inputs to CAT-DISORT simulations. InFigure 1 , measured (+) and simulated (x) reflectance spectra for test area A on the seventh day after the photodynamic exposure is shown. The figure shows that good agreement was obtained between measured and simulated spectra when the 7 retrieved MP&PPs for this day were used as inputs to CAT-DISORT simulations. -
Figures 2-8 show the retrieved values of the blood content in the dermis (Fig. 2 ), the percentage of oxygenated blood (Fig 3 ), the melanosome concentration in the lower layer of the epidermis (Fig. 4 ), the melanosome concentration in the upper layer of the epidermis (Fig. 5 ), the thickness of the lower epidermis (Fig. 6 ), the thickness of the upper epidermis (Fig. 7 ), and the keratin concentration in the upper epidermis (Fig. 8 ), respectively. The three panels in the left column of each figure represent the test areas (A-C), while the three panels in the right column represent the control areas (D-F). In the bio-optical model for tissue the epidermis was divided into five layers and the melanosome concentration was allowed to vary from one layer to another. Here, the epidermis is divided into two layers and the melanosome concentration and the thickness for each of them are retrieved. - In
Figure 2 , retrieved dermal blood concentration for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment. - In
Figure 3 , retrieved percentage of oxygenated blood for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment. - In
Figure 4 , retrieved melanosome content in the lower epidermis for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment. - In
Figure 5 , retrieved melanosome content in the upper epidermis for each of the measurement areas for the 15 days of measuremen is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment. - In
Figure 6 , retrieved lower epidermis thickness for each of the measurement areas for the 15 days of measuremen is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment. - In
Figure 7 , retrieved upper epidermis thickness for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment. - In
Figure 8 , retrieved epidermal keratin content for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment. - The standard deviations or the error bars that are shown in
Figs. 2-8 were calculated during the retrieval procedure from the diagonal elements of the covariance matrix [Φ final ]-1 as defined in Eq. (19) below and explained in the discussion that follows Eq. (19). In general, the temporal variation in the blood content of the tissue (Fig. 2 ) was in good agreement with expectations. A maximum was reached after 1-2 days, the so-called erythema reaction, typical for sunburn, after which the blood content slowly decayed. This pattern is similar for the three test areas. For the three control areas the variations are within the range of the calculated standard deviations. -
Fig. 3 shows the percentage of oxygenated blood immediately after the photodynamic treatment and during the following two weeks for the six measurement areas. Photodynamic therapy is known to be an oxygen consuming process. Thus, it must be emphasized that 'immediately after' means several seconds or may be even a minute after the exposure. The marked increase in oxygenation measured at the beginning of the experiment, at all the three test areas, is likely to be a reaction to the photodynamic treatment, rather than a direct effect of the treatment itself. The variation in blood oxygenation at the three control areas is of a stochastic nature. - The relative change of the percentage of oxygenated blood during the two weeks of measurements seems reasonable. However, the absolute values, which are in the range between 40% and 80%, may be too low (
Fig. 3 ). These low oxygenation percentages could be caused by the bandpass of the spectrometer (5 nm) being insufficiently narrow to resolve the spectral fine structure in the 540 nm - 580 nm spectral region. The skin reflectance in this spectral region is very sensitive to the percentage of oxygenated blood. Therefore, the percentage of oxygenated blood could be underestimated from these measurements. - The retrieval of the melanosome content was less uncertain for the upper epidermis (
Fig. 5 ) than for the lower epidermis (Fig. 4 ). Thus, the standard deviations for the lower epidermal melanosome content were about twice as large as for the upper epidermal melanosome content. - For the three test areas, the melanosome content in the lower epidermis decreased during the two weeks (
Fig. 4 ), while the melanosome content in the upper epidermal layer increased, in particular during the first week (Fig. 5 ). This behaviour is similar to that caused by pigmentation induced by UVB radiation (with wavelengths shorter than 320 nm). Thus, as a reaction to UVB exposure the melanosome pigment particles tend to be transferred from the melanocytes in the basal layer of the epidermis to the keratinocytes in the upper layer. In the experiment discussed here, there was no sign of immediate pigment darkening, a process primarily induced by UVA radiation (with wavelengths longer than 320 nm). Had immediate pigment darkening occurred, it would have been seen in the measurements taken immediately after the photodynamic treatment. - Hence, the photodynamic process induced by topical application of ALA-Hex followed by illumination with red light (632 nm wavelength) bears similarities with the photobiological pigmentation process induced by UVB radiation, but immediate melanin darkening does not take place during PDT.
- The decrease in the retrieved lower melanosome concentration occurs simultaneously with an increase in the retrieved lower epidermal thickness. Thus, the total retrieved lower epidermal melanosome content turned out to b∼ fairly constant during the two weeks of measurements. No significant temporal variations were found in the control areas in either the retrieved lower or upper epidermal melanosome concentrations (
Figs. 4 &5 ) or in the retrieved lower or upper epidermal thickness (Figs. 6 &7 ). - The retrieved thickness of the total epidermis is close to what would be expected. Thus, Sandby-Møller et al., Epidermal Thickness at Different Body Sites: Relationship to Age, Gender, Pigmentation, Blood Content, Skin Type and Smoking Habits, Acta Derm Venereol 2003; 83: 410-413 (2003) performed measurements on the dorsal forearm of 71 volunteers and found the average epidermal thickness to be 76 µm ± 15 µm. As can be seen from
Figs. 6 &7 , a total epidermal thickness of approximately 70 µm for both the test sites and the control sites was retrieved. Thus, the epidermal thickness appears to be retrieved well from the measurements. - It is feasible to perform accurate retrievals of several key MP&PPs describing the physiological state of human skin tissue by using an accurate radiative transfer model for the coupled air-tissue system as a forward model in conjunction with a bio-optical model and a nonlinear inversion scheme.
- Retrievals made from analyses of diffuse reflectance spectra measured before and after the exposure of the skin to ALA-Hex photodynamic treatment (PDT) with red light, and on each day for two weeks after that PDT exposure provided results in good agreement with those obtained in previous investigations of UVB-induced erythema and pigmentation in human skin:
- The erythema maximizes 1-2 days after the ALA-Hex PDT exposure and then subsides;
- There is a strong increase in the pigmentation of the upper epidermal layers, in particularly during the first 7 days after the ALA-Hex PDT exposure;
- The blood oxygenation is found to increase immediately after the exposure and then return to pre-exposure values more than seven days later.
- The process induced in the skin by ALA-Hex PDT with red light thus appears to be similar to the process induced by UVB radiation.
- These results represent the first simultaneous quantitative retrievals of the melanosome concentrations in the upper and the lower epidermis, the epidermal keratin concentration, the dermal blood concentration, and the percentage of oxygenated blood.
- In a forward model, an assumption may be made that tissue may be modeled as a turbid, plane-parallel, vertically inhomogeneous, layered medium with specified optical properties. Thus, the inherent optical properties (IOPs), i.e., the absorption coefficient α(z), the scattering coefficient σ(z) and the normalized scattering phase function p(z,Θ) were allowed to vary with depth z in the tissue. Here, Θ is the scattering angle, and the differential optical depth for a thin layer of thickness dz is dτ = -(α(z) + σ(z))dz. Lateral variations in the IOPs may be ignored, keeping in mind that every measured value corresponds to the radiance reflected by the tissue into the upper hemisphere and then gathered by the finite aperture of an optical system.
-
- Here I(τ,u,φ) stands for the diffuse radiance, u is the cosine of the polar angle θ, and φ is the azimuth angle. The angles (θ',φ') denote the direction of a beam of light before a scattering event and the angles (θ,φ) denote the observation direction. The scattering angle Θ between these two directions is given by
cosΘ = cosθcosθ' +sinθsinθ'cos(θ' - φ). - The first term in the source function J(τ,u,φ) represents multiple scattering, a(τ) = σ(τ)/[α(τ) + σ(τ)] denotes the single-scattering albedo, and
4 dφa ∫Δu6 duaIn (0,ua,φa ). -
-
- In formulation of an inverse problem, note that the tissue lOPs assembled in the vector g depend on the wavelength of the incident light. Second, tissue model parameters are assembled in a vector s. Thus:
-
- Note that the operator F is defined implicitly. It returns a solution of the radiative transfer Eq. (4) for the layered medium with lOPs g, induced by tissue parameters s : g = g(s) and known incident beam S b.
-
- Even though the number of measurements N is much greater than the number of unknowns M, the inverse problem is still underdetermined (ill-posed). The reason for the ill-posedness is the smoothness of most of the spectral signatures of the MP&PP tissue components, implying that the spectral signature of one MP&PP component can be mimicked by a certain combination of others. This makes it hard if not impossible to find the proper impact of an individual MP&PP component, if the parameterization of the tissue model in terms of MP&PP components is done without proper analysis of the information content.
- To alleviate this problem, a regularization procedure may be invoked. Because the data for the inverse problem contain stochastic noise, Bayesian inference provides a natural way of regularization through the introduction of a probabilistic measure in the space of unknown parameters. From Bayes' theorem on conditional probabilities
- If a set of admissible functions {s} is defined by the mean value s0 = E{s}, and the covariance matrix C s = E{(s - s0 )(s - s0 ) T }, then the conditional probability can be represented by the product of two Gaussian distributions. The first one is Gaussian with respect to the noise
- If we define the solution s* as the vector of most probable tissue components, given the vector of measurement f, i.e. p(s*|f) = maxsp(s|f), then the solution to the inverse problem can be formulated as an optimization: find the vector s* from a set of admissible vectors {s} that yields the optimum (minimum) value of the functional
- Thus, the functional in Eq. (10) (objective function) is the weighted least mean squares difference between simulated and measured radiances, with an extra regularization term (penalty function), represented by the second term in Eq. (10), which is strictly convex and defines the set of admissible tissue component parameters.
-
-
-
-
-
- Hence, Eq. (16) provides an explicit form of the solution s*. Thus, no matter which specific algorithms one applies to solve the linearized version of the optimization problem (11), one should arrive at the solution given by Eq. (16) with uncertainties given by Eq. (19).
-
- The uncertainties in the final solution are given by covariance matrix [Φ final ]-1, and the diagonal elements of this matrix give us an estimate of the dispersions of the corresponding tissue model components.
-
- The computed morphological parameters are defined as follows:
- Lesion border: The border of a lesion is defined from the reflected intensity of the image from one of the visible channels, for example the green channel, looking straight down on the lesion, by identifying the regions in which the gradient of the reflected intensity has its largest values.
- Size: The size parameter p M1 is defined as the number of pixels comprising the lesion, i.e. p M1 the number of pixels inside the lesion border defined above.
- Histogram width: Let h(ρ) be the number of pixels having reflectance values between ρ and ρ+Δρ. We then define the width parameter p M2 of the lesion histogram as
- Moment of inertia: The "center of mass" of a lesion is
-
-
-
-
- Fractal dimension: The fractal dimension parameter p M6 is defined as
-
-
-
- Size vs. fractal dimension: The parameter p M9 is defined as the size dived by the fractal dimension, i.e. p M9 = p M1 / p M6.
- Border length vs. fractal dimension: The parameter p M10 is defined as the relative border length dived by the fractal dimension, i.e. p M10 = p M8 / p M6.
-
- No element, act, or instruction used in the present disclosure should be construed as critical or essential unless explicitly described as such. In addition, as used herein, the article "a" is intended to include one or more items. Where only one item is intended, the term "one" or similar language is used.
- It will be understood that various modifications may be made to the embodiments disclosed herein. Therefore, the above description should not be construed as limiting, but merely as exemplifications of the various embodiments of the present disclosure. Those skilled in the art will envision other modifications within the spirit of the claims appended hereto.
Claims (6)
- An optical method for determining morphological parameters and physiological properties of skin tissue, the method comprising the steps of:generating reflectance measurements of a skin tissue area from reflectance images obtained for a plurality of wavelengths from multiple angles of illumination and detection using a spectral reflectance meter consisting of a measurement head with 12 fixed light-emitting diode (LED) lamps and 3 cameras, wherein each LED lamp is placed at a different angle relative to the skin, providing a bio-optical model, a radiative transfer model, and a non-linear inversion procedure;systematically varying input values of the morphological parameters and physiological properties of the skin tissue and simultaneously varying inherent optical properties of the skin tissue, wherein the inherent optical properties are linked to the morphological parameters and the physiological properties of the skin tissue by the bio-optical model, and computing reflectances by the radiative transfer model for the varying inherent optical properties until an agreement between the reflectance measurements and the reflectances computed by the radiative transfer model reaches a predetermined level of accuracy; andobtaining the morphological parameters and the physiological properties returned by the non-linear inversion procedure.
- The method of claim 1, wherein the bio-optical model is based on established absorption and transmission spectra for known skin tissue chromophores and relates morphological parameters and physiological properties of tissue to inherent optical properties of tissue.
- The method of claim 1, wherein the radiative transfer model is used in coupled air-tissue systems to compute synthetic reflectance spectra for a plurality of different wavelengths and a plurality of different measurement configurations, each with specified directions of illumination and observation.
- The method of claim 1, wherein the non-linear inversion procedure is based on an optimal estimation theory to solve the inverse problem of quantifying specified morphological parameters and physiological properties of skin tissue, the morphological parameters and physiological properties of skin tissue optionally including, dermal blood content, percentage blood oxygenation, upper epidermis thickness, lower epidermis thickness, percentage of upper melanosome concentration, percentage of lower melanosome concentration, and percentage of keratin concentration.
- The method of claim 1, wherein the method is used to discriminate between one of:benign pigmented lesions and malignant melanoma;benign tissue and basal cell carcinoma; andbenign tissue and squamous cell carcinoma.
- The method of claim 1, wherein the method is used for beauty care, forensic medicine, or to monitor efficacies of different kinds of treatment.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP15186132.5A EP2992818B1 (en) | 2008-03-18 | 2009-03-18 | Optical method for determining morphological parameters of skin tissue lesions |
DK15186132.5T DK2992818T3 (en) | 2008-03-18 | 2009-03-18 | Optical method for determining morphological parameters of skin tissue lesions |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US3750308P | 2008-03-18 | 2008-03-18 | |
PCT/US2009/037511 WO2009117485A2 (en) | 2008-03-18 | 2009-03-18 | Optical method for determining morphological parameters and physiological properties of tissue |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15186132.5A Division EP2992818B1 (en) | 2008-03-18 | 2009-03-18 | Optical method for determining morphological parameters of skin tissue lesions |
EP15186132.5A Division-Into EP2992818B1 (en) | 2008-03-18 | 2009-03-18 | Optical method for determining morphological parameters of skin tissue lesions |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2255173A2 EP2255173A2 (en) | 2010-12-01 |
EP2255173A4 EP2255173A4 (en) | 2012-10-17 |
EP2255173B1 true EP2255173B1 (en) | 2018-01-24 |
Family
ID=41091515
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP09722309.3A Active EP2255173B1 (en) | 2008-03-18 | 2009-03-18 | Optical method for determining morphological parameters and physiological properties of skin tissue |
EP15186132.5A Active EP2992818B1 (en) | 2008-03-18 | 2009-03-18 | Optical method for determining morphological parameters of skin tissue lesions |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15186132.5A Active EP2992818B1 (en) | 2008-03-18 | 2009-03-18 | Optical method for determining morphological parameters of skin tissue lesions |
Country Status (10)
Country | Link |
---|---|
US (1) | US9823189B2 (en) |
EP (2) | EP2255173B1 (en) |
JP (2) | JP5580809B2 (en) |
AU (1) | AU2009225617B2 (en) |
CA (1) | CA2718906C (en) |
DK (2) | DK2992818T3 (en) |
NO (1) | NO2255173T3 (en) |
NZ (1) | NZ588545A (en) |
WO (1) | WO2009117485A2 (en) |
ZA (1) | ZA201006943B (en) |
Families Citing this family (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007133710A2 (en) | 2006-05-11 | 2007-11-22 | Raindance Technologies, Inc. | Microfluidic devices and methods of use thereof |
US9562837B2 (en) | 2006-05-11 | 2017-02-07 | Raindance Technologies, Inc. | Systems for handling microfludic droplets |
US20100091104A1 (en) * | 2006-09-27 | 2010-04-15 | Georgia Tech Research Corporation | Systems and methods for the measurement of surfaces |
WO2008097559A2 (en) | 2007-02-06 | 2008-08-14 | Brandeis University | Manipulation of fluids and reactions in microfluidic systems |
US8592221B2 (en) | 2007-04-19 | 2013-11-26 | Brandeis University | Manipulation of fluids, fluid components and reactions in microfluidic systems |
EP2238449B1 (en) | 2008-01-24 | 2018-06-06 | Balter, Inc. | Method for discriminating between malignant and benign tissue lesions |
NZ588545A (en) | 2008-03-18 | 2013-05-31 | Balter Inc | Optical method for determining morphological parameters and physiological properties of a lesion |
US12038438B2 (en) | 2008-07-18 | 2024-07-16 | Bio-Rad Laboratories, Inc. | Enzyme quantification |
WO2010009365A1 (en) | 2008-07-18 | 2010-01-21 | Raindance Technologies, Inc. | Droplet libraries |
US9399797B2 (en) | 2010-02-12 | 2016-07-26 | Raindance Technologies, Inc. | Digital analyte analysis |
WO2011100604A2 (en) | 2010-02-12 | 2011-08-18 | Raindance Technologies, Inc. | Digital analyte analysis |
WO2012112804A1 (en) | 2011-02-18 | 2012-08-23 | Raindance Technoligies, Inc. | Compositions and methods for molecular labeling |
DE202012013668U1 (en) | 2011-06-02 | 2019-04-18 | Raindance Technologies, Inc. | enzyme quantification |
US8658430B2 (en) | 2011-07-20 | 2014-02-25 | Raindance Technologies, Inc. | Manipulating droplet size |
US10200655B2 (en) | 2011-11-08 | 2019-02-05 | The Trustees Of Columbia University In The City Of New York | Tomographic imaging methods, devices, and systems |
US20140213909A1 (en) * | 2013-01-31 | 2014-07-31 | Xerox Corporation | Control-based inversion for estimating a biological parameter vector for a biophysics model from diffused reflectance data |
FR3011170B1 (en) * | 2013-09-30 | 2017-03-31 | Apd Advanced Perfusion Diagnostics | NON-INVASIVE MEASUREMENT DEVICE AND METHOD FOR ESTIMATING LOCAL METABOLIC PARAMETERS |
US11901041B2 (en) | 2013-10-04 | 2024-02-13 | Bio-Rad Laboratories, Inc. | Digital analysis of nucleic acid modification |
KR101536693B1 (en) * | 2013-11-25 | 2015-07-14 | 한국광기술원 | Method and system for determantion of melanoma by the multi-wavelength imaging and image processing |
US9944977B2 (en) | 2013-12-12 | 2018-04-17 | Raindance Technologies, Inc. | Distinguishing rare variations in a nucleic acid sequence from a sample |
JP6504913B2 (en) * | 2015-05-20 | 2019-04-24 | 花王株式会社 | Method of observing skin capillaries |
US10413232B2 (en) | 2016-02-10 | 2019-09-17 | Balter Medical, As. | Optical transfer diagnosis for detection and monitoring of tissue disorders |
US10460150B2 (en) | 2018-03-16 | 2019-10-29 | Proscia Inc. | Deep learning automated dermatopathology |
KR102411108B1 (en) | 2019-03-20 | 2022-06-22 | 가부시키가이샤 코세 | Estimation method, method of generating an estimation model, program, and estimation apparatus |
CN110208211B (en) * | 2019-07-03 | 2021-10-22 | 南京林业大学 | Near infrared spectrum noise reduction method for pesticide residue detection |
CN112683816B (en) * | 2020-12-25 | 2021-08-06 | 中船重工安谱(湖北)仪器有限公司 | Spectrum identification method for spectrum model transmission |
WO2023235414A1 (en) * | 2022-05-31 | 2023-12-07 | DeepX Diagnostics, Inc. | Multilayer environment scanning |
Family Cites Families (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5813988A (en) | 1995-02-03 | 1998-09-29 | Research Foundation | Time-resolved diffusion tomographic imaging in highly scattering turbid media |
US7054674B2 (en) * | 1996-11-19 | 2006-05-30 | Astron Clinica Limited | Method of and apparatus for investigating tissue histology |
GB9624003D0 (en) | 1996-11-19 | 1997-01-08 | Univ Birmingham | Method and apparatus for measurement of skin histology |
EP1011446A1 (en) | 1997-02-28 | 2000-06-28 | Electro-Optical Sciences, Inc. | Systems and methods for the multispectral imaging and characterization of skin tissue |
US6307957B1 (en) | 1997-02-28 | 2001-10-23 | Electro-Optical Sciences Inc | Multispectral imaging and characterization of biological tissue |
US6081612A (en) | 1997-02-28 | 2000-06-27 | Electro Optical Sciences Inc. | Systems and methods for the multispectral imaging and characterization of skin tissue |
US6205353B1 (en) | 1998-12-22 | 2001-03-20 | Research Foundation Of Cuny | Time-resolved optical backscattering tomographic image reconstruction in scattering turbid media |
US6993167B1 (en) * | 1999-11-12 | 2006-01-31 | Polartechnics Limited | System and method for examining, recording and analyzing dermatological conditions |
US20010032053A1 (en) * | 2000-01-24 | 2001-10-18 | Hielscher Andreas H. | Imaging of a scattering medium using the equation of radiative transfer |
US6775405B1 (en) | 2000-09-29 | 2004-08-10 | Koninklijke Philips Electronics, N.V. | Image registration system and method using cross-entropy optimization |
NO325061B1 (en) * | 2001-03-06 | 2008-01-28 | Photosense As | Method and arrangement for determining the optical property of a multilayer tissue |
US7756558B2 (en) * | 2004-05-24 | 2010-07-13 | Trutouch Technologies, Inc. | Apparatus and methods for mitigating the effects of foreign interferents on analyte measurements in spectroscopy |
JP2003149136A (en) | 2001-11-13 | 2003-05-21 | Shimadzu Corp | Optical image measuring method |
US7769424B2 (en) * | 2001-12-28 | 2010-08-03 | Japan Science And Technology Agency | Intercerebral current source estimation method intercerebral current source estimation program recording medium containing the intercerebral current source estimation program and intercerebral current source estimation apparatus |
JP3884294B2 (en) * | 2002-01-18 | 2007-02-21 | 株式会社東芝 | Design support apparatus and program |
US7218959B2 (en) * | 2002-06-05 | 2007-05-15 | Research Foundation Of City University | Hybrid-dual-fourier tomographic algorithm for a fast three-dimensionial optical image reconstruction in turbid media |
CN101259010B (en) * | 2002-07-26 | 2010-08-25 | 奥林巴斯株式会社 | Image processing system |
JP4437202B2 (en) | 2004-01-09 | 2010-03-24 | 学校法人慶應義塾 | Telemedicine system for pigmentation site |
WO2006009910A2 (en) * | 2004-06-17 | 2006-01-26 | The Regents Of The University Of California | Time-resolved optometric fluorescence detection for skin diagnostics |
US7991557B2 (en) | 2004-06-19 | 2011-08-02 | Genenews Corporation | Computer system and methods for constructing biological classifiers and uses thereof |
US20070016078A1 (en) * | 2004-12-06 | 2007-01-18 | Hoyt Clifford C | Systems and methods for in-vivo optical imaging and measurement |
CA2595213C (en) * | 2005-01-21 | 2014-10-28 | Perceptronix Medical Inc. | Method and apparatus for measuring cancerous changes from reflectance spectral measurements obtained during endoscopic imaging |
US7319467B2 (en) * | 2005-03-29 | 2008-01-15 | Mitsubishi Electric Research Laboratories, Inc. | Skin reflectance model for representing and rendering faces |
US7570988B2 (en) | 2005-05-02 | 2009-08-04 | Wisconsin Alumni Research Foundation | Method for extraction of optical properties from diffuse reflectance spectra |
RU2367577C1 (en) * | 2005-08-12 | 2009-09-20 | Рик Б. ЙЕГЕР | System and method for application of substance that varies its reflecting property in order to improve visual attractiveness of human skin |
US7820972B2 (en) * | 2005-09-02 | 2010-10-26 | Pola Chemical Industries Inc. | Method of evaluating skin conditions and method of estimating skin thickness |
GB2429385C (en) | 2005-09-23 | 2008-04-24 | Astron Clinica Ltd | Image processing method and apparatus. |
EP2238449B1 (en) | 2008-01-24 | 2018-06-06 | Balter, Inc. | Method for discriminating between malignant and benign tissue lesions |
NZ588545A (en) | 2008-03-18 | 2013-05-31 | Balter Inc | Optical method for determining morphological parameters and physiological properties of a lesion |
-
2009
- 2009-03-18 NZ NZ588545A patent/NZ588545A/en not_active IP Right Cessation
- 2009-03-18 WO PCT/US2009/037511 patent/WO2009117485A2/en active Application Filing
- 2009-03-18 AU AU2009225617A patent/AU2009225617B2/en active Active
- 2009-03-18 CA CA2718906A patent/CA2718906C/en active Active
- 2009-03-18 NO NO09722309A patent/NO2255173T3/no unknown
- 2009-03-18 JP JP2011500922A patent/JP5580809B2/en active Active
- 2009-03-18 DK DK15186132.5T patent/DK2992818T3/en active
- 2009-03-18 EP EP09722309.3A patent/EP2255173B1/en active Active
- 2009-03-18 EP EP15186132.5A patent/EP2992818B1/en active Active
- 2009-03-18 DK DK09722309.3T patent/DK2255173T3/en active
- 2009-03-18 US US12/933,037 patent/US9823189B2/en active Active
-
2010
- 2010-09-29 ZA ZA2010/06943A patent/ZA201006943B/en unknown
-
2014
- 2014-03-13 JP JP2014049729A patent/JP6035268B2/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
NO2255173T3 (en) | 2018-06-23 |
DK2992818T3 (en) | 2019-10-21 |
US20110054298A1 (en) | 2011-03-03 |
JP2011517416A (en) | 2011-06-09 |
AU2009225617A1 (en) | 2009-09-24 |
JP5580809B2 (en) | 2014-08-27 |
ZA201006943B (en) | 2014-03-26 |
AU2009225617B2 (en) | 2014-07-10 |
DK2255173T3 (en) | 2018-03-26 |
EP2992818A1 (en) | 2016-03-09 |
US9823189B2 (en) | 2017-11-21 |
WO2009117485A3 (en) | 2010-03-04 |
EP2992818B1 (en) | 2019-09-04 |
EP2255173A2 (en) | 2010-12-01 |
CA2718906A1 (en) | 2009-09-24 |
EP2255173A4 (en) | 2012-10-17 |
JP6035268B2 (en) | 2016-11-30 |
WO2009117485A2 (en) | 2009-09-24 |
NZ588545A (en) | 2013-05-31 |
CA2718906C (en) | 2018-09-11 |
JP2014144355A (en) | 2014-08-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2255173B1 (en) | Optical method for determining morphological parameters and physiological properties of skin tissue | |
US10201281B2 (en) | System, method and article for normalization and enhancement of tissue images | |
US9706929B2 (en) | Method and apparatus for imaging tissue topography | |
Vogel et al. | Using noninvasive multispectral imaging to quantitatively assess tissue vasculature | |
Abdlaty et al. | Skin erythema and pigmentation: a review of optical assessment techniques | |
Milanic et al. | Hyperspectral imaging for detection of arthritis: feasibility and prospects | |
Abdlaty et al. | Skin erythema assessment techniques | |
Kanellis | A review of melanin sensor devices | |
Jakovels et al. | Noncontact monitoring of vascular lesion phototherapy efficiency by RGB multispectral imaging | |
Das et al. | Simple detection of absorption change in skin tissue using simulated spectral reflectance database | |
Bae et al. | Multimodal facial color imaging modality for objective analysis of skin lesions | |
Nielsen et al. | Retrieval of the physiological state of human skin from UV–Vis reflectance spectra–a feasibility study | |
Huang et al. | Second derivative multispectral algorithm for quantitative assessment of cutaneous tissue oxygenation | |
Das et al. | Simulated reflectance spectra and point spread functions in database constructed by moderate grouping of nine layers in skin model | |
Lisenko et al. | Method for determining skin pigment concentrations from multispectral images of the skin | |
Verkruysse et al. | Remittance at a single wavelength of 390 nm to quantify epidermal melanin concentration | |
Kang et al. | Methods to Study Vitiligo: Noninvasive Techniques and In Vivo Reflectance Confocal Microscopy | |
Confocal | 21 Methods to Study Vitiligo: Noninvasive Techniques | |
Harrison | NOVEL NONINVASIVE OPTICAL DIAGNOSTIC TECHNOLOGIES FOR THE MANAGEMENT OF NEONATAL JAUNDICE | |
Harrison-Smith | Novel Noninvasive Optical Diagnostic Technologies for the Management of Neonatal Jaundice | |
Maganti et al. | Optical nevoscope reconstructions using photon diffusion theory | |
Borisova et al. | Influence of measurement geometry on the human skin reflectance spectra detection | |
Ramakrishnan | Reflectance spectroscopy of skin and application in skin biometry |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20100922 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA RS |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: MOAN, JOHAN, E. Inventor name: NIELSEN, KRISTIAN, P. Inventor name: SOMMERSTEN, ENDRE, R. Inventor name: HAMRE, BOERGE Inventor name: STAMNES, JAKOB, J. Inventor name: STAMNES, KNUT Inventor name: RYZHIKOV, GENNADY Inventor name: BIRYULINA, MARINA Inventor name: ZHAO, LU |
|
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20120913 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01N 33/483 20060101ALI20120907BHEP Ipc: G01N 21/31 20060101ALI20120907BHEP Ipc: G06T 7/60 20060101ALI20120907BHEP Ipc: A61B 5/1455 20060101ALI20120907BHEP Ipc: G01N 21/47 20060101AFI20120907BHEP |
|
17Q | First examination report despatched |
Effective date: 20140606 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: STAMNES, JAKOB, J. Inventor name: MOAN, JOHAN, E. Inventor name: SOMMERSTEN, ENDRE, R. Inventor name: ZHAO, LU Inventor name: STAMNES, KNUT Inventor name: HAMRE, BOERGE Inventor name: BIRYULINA, MARINA Inventor name: NIELSEN, KRISTIAN, P. Inventor name: RYZHIKOV, GENNADY |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602009050532 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G01N0021310000 Ipc: A61B0005145500 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: A61B 5/1455 20060101AFI20170626BHEP Ipc: G06K 9/00 20060101ALI20170626BHEP Ipc: G01N 21/31 20060101ALI20170626BHEP Ipc: A61B 5/00 20060101ALI20170626BHEP Ipc: G06T 7/62 20170101ALI20170626BHEP Ipc: G06T 7/66 20170101ALI20170626BHEP Ipc: G01N 21/47 20060101ALI20170626BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20170818 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: STAMNES, JAKOB, J. Inventor name: HAMRE, BOERGE Inventor name: SOMMERSTEN, ENDRE, R. Inventor name: RYZHIKOV, GENNADY Inventor name: NIELSEN, KRISTIAN, P. Inventor name: MOAN, JOHAN, E. Inventor name: BIRYULINA, MARINA Inventor name: STAMNES, KNUT Inventor name: ZHAO, LU |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 965302 Country of ref document: AT Kind code of ref document: T Effective date: 20180215 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602009050532 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20180320 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: IP PARTNERS J. WENGER, CH |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180124 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 965302 Country of ref document: AT Kind code of ref document: T Effective date: 20180124 |
|
REG | Reference to a national code |
Ref country code: NO Ref legal event code: T2 Effective date: 20180124 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180425 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180524 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180424 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602009050532 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20180331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180318 |
|
26N | No opposition filed |
Effective date: 20181025 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180318 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180124 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20090318 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180124 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NO Payment date: 20230329 Year of fee payment: 15 Ref country code: IE Payment date: 20230327 Year of fee payment: 15 Ref country code: FR Payment date: 20230327 Year of fee payment: 15 Ref country code: DK Payment date: 20230329 Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20230315 Year of fee payment: 15 Ref country code: DE Payment date: 20230329 Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20230402 Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240910 Year of fee payment: 16 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20240331 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: EUG |