Nothing Special   »   [go: up one dir, main page]

EP2255173B1 - Optical method for determining morphological parameters and physiological properties of skin tissue - Google Patents

Optical method for determining morphological parameters and physiological properties of skin tissue Download PDF

Info

Publication number
EP2255173B1
EP2255173B1 EP09722309.3A EP09722309A EP2255173B1 EP 2255173 B1 EP2255173 B1 EP 2255173B1 EP 09722309 A EP09722309 A EP 09722309A EP 2255173 B1 EP2255173 B1 EP 2255173B1
Authority
EP
European Patent Office
Prior art keywords
tissue
lesion
skin tissue
skin
morphological parameters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP09722309.3A
Other languages
German (de)
French (fr)
Other versions
EP2255173A2 (en
EP2255173A4 (en
Inventor
Jakob J. Stamnes
Knut Stamnes
Lu Zhao
Boerge Hamre
Gennady Ryzhikov
Marina Biryulina
Endre R. Sommersten
Kristian P. Nielsen
Johan E. Moan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Balter Inc
Original Assignee
Balter Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Balter Inc filed Critical Balter Inc
Priority to EP15186132.5A priority Critical patent/EP2992818B1/en
Priority to DK15186132.5T priority patent/DK2992818T3/en
Publication of EP2255173A2 publication Critical patent/EP2255173A2/en
Publication of EP2255173A4 publication Critical patent/EP2255173A4/en
Application granted granted Critical
Publication of EP2255173B1 publication Critical patent/EP2255173B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/47Scattering, i.e. diffuse reflection
    • G01N21/4738Diffuse reflection, e.g. also for testing fluids, fibrous materials
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/44Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
    • A61B5/441Skin evaluation, e.g. for skin disorder diagnosis
    • A61B5/444Evaluating skin marks, e.g. mole, nevi, tumour, scar
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/62Analysis of geometric attributes of area, perimeter, diameter or volume
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/66Analysis of geometric attributes of image moments or centre of gravity
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/693Acquisition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30024Cell structures in vitro; Tissue sections in vitro

Definitions

  • the present disclosure relates to an optical method for determining several morphological parameters and physiological properties (hereafter abbreviated MP&PPs) of skin tissue.
  • MP&PPs morphological parameters and physiological properties
  • the present disclosure is directed to a method to determine MP&PPs of malignant as well as benign skin tissue lesions.
  • Malignant melanoma is one of the most rapidly increasing cancers in the world. In the United States alone, the estimated incidence for 2008 is 62,480, which leads to an estimated total of 8,420 deaths per year. Successful treatment of melanoma depends on early detection by clinicians with subsequent surgical removal of tumors. Visual detection has its limitations, even when augmented with dermoscopy, especially with less experienced users. Attempts have thus been made to develop automated devices to assist in the screening of pigmented skin lesions for likelihood of melanoma. Several of these devices have digitalized dermoscopy-related features analyzed by artificial neural networks or support vector machine learning systems.
  • a well-known application is blood-oxymetry, by which a relative blood-oxygenation index can be determined non-invasively from the scattered reflectance or transmittance of light at red and near-infrared (NIR) wavelengths [see e.g. Yaroslavsky AN, Schulze PC, et al. Optical properties of selected native and human brain tissues in vitro in the visible and near infrared spectral range. Physics in Medicine and Biology. 2002 47(12):2059-2073 ]. The reflectance in that spectral region has also been used to determine other physiological properties. For example, the gradient of the reflectance spectrum between 620 nm and 720 nm depends on the total melanin content of the skin [ Kollias N, Baqer AN.
  • this invention makes use of a nonlinear inversion scheme based on e.g. optimal estimation theory [ Tikhonov, A.N., and Arsenin, V.Y., Tikhonov, A. N.; V. Y. Arsenin (1977). Solution of III-posed Problems. Washington: Winston & Sons. ISBN 0-470-99124-01 ; Twomey, S, Introduction to the Mathematics of Inversion in Remote Sensing and Indirect Measurement Developments in Geomathematics, Vol.
  • WO 2006/076810 A1 discloses a method and device for disease detection, more particularly, cancer detection, from the analysis of diffuse reflectance spectra measured in vivo during endoscopic imaging.
  • the measured diffuse reflectance spectra are analyzed using a light-transport model and numerical method to derive quantitative parameters related to tissue physiology and morphology.
  • US 2006/247532 A1 discloses an iterative process that calculates the absorption and scattering coefficients of tissue from a set of diffuse reflectance measurements made with an optical spectrometer operating in the UV-VIS spectral range. The relationship between measured diffuse reflectance and the absorption and scattering coefficients is modeled using a Monte Carlo simulation.
  • NIELSEN KRISTIAN P. ET AL "Reflectance Spectra of Pigmented and Nonpigmented Skin in the UV Spectral Region", PHOTOCHEMISTRY AND PHOTOBIOLOGY, vol. 80, no. 3, 1 January 2004 relates to measurements of reflectance spectra from human skin in vivo in the spectral range from 250 to 700 nm. The measured results are simulated using a new radiative transfer model developed to study light propagation in skin tissue.
  • NIELSEN KRISTIAN P. ET AL "The optics of human skin: aspects important for human health", SOLAR RADIATION AND HUMAN HEALTH, 1 January 2008 relates to combining a bio-optical model of human skin with advanced radiative transfer theory to simulate the transport of solar radiation through the skin.
  • the claimed invention is directed to a method of determining morphological parameters and physiological properties of tissue only insofar as the tissue is skin tissue. Other types of tissue do not fall within the scope of the invention as defined by the claims.
  • the present invention relates to a novel method for determining morphological parameters and physiological properties of the tissue (MP&PPs) of different types of tissue lesions.
  • the present invention is directed to a method for determining MP&PPs for malignant as well as benign tissue lesions.
  • the method of the present invention is applicable to, but not limited to, benign and malignant tissue lesions in general, and uses spectral reflectance measurements of tissue lesions, which may be generated by a spectrophotometer or by an Optical Transfer Diagnosis (OTD) method.
  • spectral reflectance measurements of tissue lesions which may be generated by a spectrophotometer or by an Optical Transfer Diagnosis (OTD) method.
  • the OTD device currently used records 30 spectral reflectance images of a lesion under examination. These 30 reflectance images, which constitute one image set, are recorded at 10 different wavelengths (365-1000 nm) from multiple angles of illumination and detection.
  • the OTD device is a spectral reflectance meter consisting of a measurement head with 12 fixed light-emitting diode (LED) lamps and 3 IEEE (Institute of Electrical and Electronics Engineers) 1394 FireWire cameras. Each LED is placed at a different angle relative to the skin to enhance the ability to retrieve information about the depth of the lesion.
  • the polar angles of the LEDs vary between 30 and 45 degrees, and the relative azimuth angles between 34 and 145 degrees.
  • the polar angles of the detectors vary between 0 and 45 degrees, and the relative azimuth angles between 0 and 180 degrees,
  • an alcohol-based gel is used as an interface between the measurement probe and the skin, and a selected area of the skin is illuminated and imaged through a 2.2 cm diameter circular sapphire plate.
  • the imaging time is approximately 5 seconds.
  • the present invention provides through the use of a non-linear inversion procedure, a method for deriving MP&PPs as well as additional MPs of a lesion from a set of spectral reflectance measurements.
  • MP&PPs can be determined including (i) percentage of hemoglobin; (ii) percentage of hemoglobin oxygenation; (iii) upper epidermal thickness; (iv) lower epidermal thickness; (v) percentage of upper melanosome concentration; (vi) percentage of lower melanosome concentration; and (vii) percentage of keratin concentration.
  • the third and fourth of these entities are MPs, while the remaining five entities are physiological properties (PPs) describing the physiological state of the tissue. Each of these seven entities varies and is different for normal and malignant tissues. Also, the present invention provides a method for deriving a set of additional MPs of diagnostic value directly from the reflectance measurements.
  • a description of how a lesion can be defined directly from measured reflectance spectra and how such measurements can be used to characterize the lesion in terms of a set of MPs follows.
  • an aim is to differentiate between benign pigmented nevi and malignant melanomas, but the method is applicable in general to differentiate between benign and malignant tissue.
  • a lesion border is defined from measured reflectance spectra by using the reflected intensity from one of the channels in the visible spectral range, for example the green channel.
  • 10 different MPs are descriptive of the lesion and can be used as an aid to make a definitive diagnosis.
  • Lesion border The border of a lesion is defined from the reflected intensity of the image from one of the visible channels, for example the green channel, looking straight down at the lesion, by identifying the regions in which the gradient of the reflected intensity has its largest values.
  • the size parameter p M 1 is defined as the number of pixels comprising the lesion, i.e. p M 1 is the number of pixels inside the lesion border defined above.
  • Histogram width For a given combination of illumination and observation directions, the histogram-width parameter p M 2 gives a measure of the inhomogeneity of the reflected intensity of a lesion. Usually this parameter is small for benign nevi, but large for melanomas. Sebhorreic keratoses can also have relatively large inhomogeneities of the reflected intensity.
  • the parameter p M 3 provides information about another aspect of the inhomogeneity of the reflected intensity of a lesion.
  • the spatial light absorptance distribution in a lesion be defined as its "mass distribution” and calculate its "center of mass” and “total mass”, the latter being defined as the average light absorptance of the lesion.
  • the parameter p M 3 gives the moment of inertia of the lesion relative to that of a homogeneous circular disk having the same "total mass" as the lesion and a diameter equal to the average diameter of the lesion.
  • the center distance p M 4 which provides additional information about the asymmetry of the lesion, represents the physical distance between the "geometrical center of a lesion" and the "center of mass" of the absorptance, as defined above.
  • the "geometrical center of a lesion” means its center with respect to its border, irrespective of how the pigment is distributed within it. Thus, if a lesion has an asymmetrical pigment distribution, the distance between the "geometrical center” and the "center of mass” will be significant.
  • the darkness parameter p M 5 is defined as the average value of the reflected intensity of a lesion.
  • Fractal dimension The fractal-dimension parameter p M 6 describes the complexity of the border of a lesion. It is defined such that the border of a lesion has a fractal dimension of 1 if the lesion border is perfectly smooth, independent of magnification, while the fractal dimension of the lesion border will tend towards 2 if it is highly irregular.
  • the aspericity parameter p M 7 is defined as the ratio between the long and short axes of a lesion. It is 1 for a circular lesion, and increases as a lesion gets more elongated. Just as p M 6 and p M 8 , this parameter depends only on the border of the lesion, and does not contain any information about its internal structure.
  • the relative border length p M 8 is defined as the ratio of the border length of a circle with the same area as the lesion to the border length of the lesion.
  • Multi-spectral reflectance measurements combined with bio-optical models and accurate radiative transfer simulations of light propagation inside tissue and backscattering from it, provide a basis for obtaining estimates of MP&PPs.
  • tissue MP&PPs the following ingredients are needed: 1.
  • a bio-optical model that relates tissue MP&PPs to tissue lOPs, the latter being the absorption and scattering coefficients as well as the scattering phase function, each as function of wavelength and depth in the tissue; 2.
  • An accurate radiative transfer model for coupled air-tissue systems. which for a given set of lOPs computes various apparent optical properties (AOPs). such as the diffuse reflectance spectrum; 3.
  • AOPs apparent optical properties
  • An iterative inversion scheme that accounts for the nonlinear dependence of the AOPs on the lOPs.
  • DISORT discrete ordinate radiative transfer
  • Chromophores such as the epidermal melanosome concentration and the dermal blood concentration, were considered as retrievable entities, since their variability strongly influences the apparent optical properties of the tissue, such as the spectral tissue reflectance. But entities describing the optical properties of the cellular matrix into which the chromophores are embedded, were kept fixed because variations in these entities have little impact on the apparent optical properties of the tissue.
  • Reflectance spectra in the wavelength region from 300 nm to 600 nm were measured daily from three test areas and three control areas on a volunteer with skin type III for two weeks during which the skin in the test areas went through erythema and pigmentation.
  • the volunteer who had given his written permission to participate in the study, was healthy and did not use any medical drugs. Erythema and pigmentation were induced after 24-hour topical application of a photosensitizer followed by illumination with red light (632 nm) for 2 minutes on the first day ('day 0') of the experiment.
  • red light 632 nm
  • Cream was prepared using 10% (w/w) of the hexylester of 5-aminolevulinic acid (ALA-Hex) in a standard oil-in-water cream base (Unguentum, Merck, Darmstad, Germany).
  • ALA-Hex 5-aminolevulinic acid
  • Freshly prepared cream with approximately (75 ⁇ 10) mg/cm 2 of ALA-Hex was topically applied on each of the three test areas, which were subsequently covered with transparent adhesive dressings (OpSite Flexifix, Smith & Nephew Medical Ltd., Hull, UK), in which three openings (1 cm x 1 cm) had been cut out precisely in the places where the test areas were located.
  • the dressings were intended to prevent the cream from diffusing to adjacent areas.
  • the creams and the dressings were kept for 24 hours on the test areas, which were then illuminated with red light (632 nm) for 2 minutes.
  • control areas similar to the test areas, were also marked on the volunteer.
  • ALA-Hex was applied but it was not illuminated; the second of the control areas (E) was illuminated with red light, but no ALA-Hex was applied; on the third control area (F) a base cream, without ALA-Hex was applied, and it was illuminated with red light.
  • a luminescence spectrometer was employed to record reflectance spectra from each of the test areas and each of the control areas.
  • the spectrometer was equipped with two scanning grating monochromators, one in front of the light source (a pulsed Xenon lamp) and another in front of the detector.
  • a fiber-optic probe was coupled to the spectrometer.
  • the probe was a commercially available fiber accessory (Perkin-Elmer), consisting of two 1 m fused silica fiber bundles joined in parallel at the measuring tip. It was connected to a cylindrically shaped aluminum spacer with an inner diameter of 4 mm. The spacer was painted black inside in order to minimize stray light.
  • the spacer was pressed lightly against the skin to keep the probe at a fixed distance of 10 mm above the skin surface. This arrangement ensured a relatively uniform distribution of the excitation light over the area to be examined. Reflectance spectra were measured in synchronous scans in which both gratings were set at the same wavelength and band pass (5 nm) to avoid fluorescence artifacts. The area exposed to the excitation light of the spectrometer was the same as the area from which the reflected light was detected. The geometry of the fiber probe was such that both the directly (Fresnel) reflected and the diffusely reflected irradiances from the skin were collected and recorded. Care was taken not to press the spacer too hard against the skin surface in order to minimize artifacts from pressure-induced reductions in the blood flow.
  • a coupled air-tissue system can be represented by a layered medium with constant inherent optical properties (lOPs) in each layer.
  • the tissue is assumed to be a turbid layered medium so that radiative transfer theory can be used to compute the diffuse light inside it and reflected from it.
  • Each tissue layer can be described in terms of its lOPs, which are the absorption coefficient ⁇ ([mm -1 ]), the scattering coefficient ⁇ ([mm -1 ]), the (normalized) scattering phase function p (cos ⁇ ), and the physical thickness ⁇ z ([mm]).
  • the scattering phase function gives the distribution of the scattered light as a function of the scattering angle ⁇ .
  • Skin tissue is a complex medium with many different kinds of scattering 'particles' in each layer, and the scattering phase function for a particular layer represents a weighted mean of scattering phase functions for several types of particles.
  • Different descriptions of the scattering phase function p (cos ⁇ ) may be used in different physical and practical applications.
  • two such functions namely the Henyey-Greenstein scattering phase function p HG (cos ⁇ ) and the Rayleigh scattering phase function p Ray (cos ⁇ ) are used.
  • the average cosine g is called the asymmetry factor of the scattering phase function.
  • This Henyey-Greenstein scattering phase function has no physical basis, but is useful for describing scattering by large particles in a medium, such as tissue, for which the actual scattering phase function is unknown.
  • the term 'large particles' implies that their sizes are comparable to or larger than the wavelength.
  • the Rayleigh scattering phase function gives a good description of the angular distribution of the scattered light.
  • a bio-optical model was used to calculate the lOPs for a given set of MP&PPs that describe the physiological state of the tissue.
  • the CAT-DISORT was employed to solve the radiative transfer equation for a slab of biological tissue stratified into a number of layers, thereby accounting for the reflection and refraction of the incident radiance at the air-tissue interface (caused by the change in the refractive index), which affect the radiation field significantly.
  • An integral part of the forward-inverse modeling procedure was to couple the bio-optical model to CAT-DISORT in such a way that the MP&PPs could be determined directly from the measured AOPs.
  • the other MP&PPs were fixed.
  • each of the scattering coefficients associated with the non-pigmented constituents of the epidermis and the dermis, the optical thickness of the dermis, and the optical properties of the subcutaneous layer were assumed to be fixed.
  • Figure 1 shows an example of the agreement between measured and simulated reflectance values obtained when using the retrieved values for the 7 MP&PP entities listed above as inputs to CAT-DISORT simulations.
  • Figure 1 measured (+) and simulated (x) reflectance spectra for test area A on the seventh day after the photodynamic exposure is shown. The figure shows that good agreement was obtained between measured and simulated spectra when the 7 retrieved MP&PPs for this day were used as inputs to CAT-DISORT simulations.
  • Figures 2-8 show the retrieved values of the blood content in the dermis ( Fig. 2 ), the percentage of oxygenated blood ( Fig 3 ), the melanosome concentration in the lower layer of the epidermis ( Fig. 4 ), the melanosome concentration in the upper layer of the epidermis ( Fig. 5 ), the thickness of the lower epidermis ( Fig. 6 ), the thickness of the upper epidermis ( Fig. 7 ), and the keratin concentration in the upper epidermis ( Fig. 8 ), respectively.
  • the three panels in the left column of each figure represent the test areas (A-C), while the three panels in the right column represent the control areas (D-F).
  • the epidermis was divided into five layers and the melanosome concentration was allowed to vary from one layer to another.
  • the epidermis is divided into two layers and the melanosome concentration and the thickness for each of them are retrieved.
  • Fig. 3 shows the percentage of oxygenated blood immediately after the photodynamic treatment and during the following two weeks for the six measurement areas.
  • Photodynamic therapy is known to be an oxygen consuming process. Thus, it must be emphasized that 'immediately after' means several seconds or may be even a minute after the exposure.
  • the marked increase in oxygenation measured at the beginning of the experiment, at all the three test areas, is likely to be a reaction to the photodynamic treatment, rather than a direct effect of the treatment itself.
  • the variation in blood oxygenation at the three control areas is of a stochastic nature.
  • the retrieval of the melanosome content was less uncertain for the upper epidermis ( Fig. 5 ) than for the lower epidermis ( Fig. 4 ).
  • the standard deviations for the lower epidermal melanosome content were about twice as large as for the upper epidermal melanosome content.
  • the melanosome content in the lower epidermis decreased during the two weeks ( Fig. 4 ), while the melanosome content in the upper epidermal layer increased, in particular during the first week ( Fig. 5 ).
  • This behaviour is similar to that caused by pigmentation induced by UVB radiation (with wavelengths shorter than 320 nm).
  • the melanosome pigment particles tend to be transferred from the melanocytes in the basal layer of the epidermis to the keratinocytes in the upper layer.
  • there was no sign of immediate pigment darkening a process primarily induced by UVA radiation (with wavelengths longer than 320 nm). Had immediate pigment darkening occurred, it would have been seen in the measurements taken immediately after the photodynamic treatment.
  • the retrieved thickness of the total epidermis is close to what would be expected.
  • Sandby-M ⁇ ller et al., Epidermal Thickness at Different Body Sites: Relationship to Age, Gender, Pigmentation, Blood Content, Skin Type and Smoking Habits, Acta Derm Venereol 2003; 83: 410-413 (2003 ) performed measurements on the dorsal forearm of 71 volunteers and found the average epidermal thickness to be 76 ⁇ m ⁇ 15 ⁇ m.
  • a total epidermal thickness of approximately 70 ⁇ m for both the test sites and the control sites was retrieved.
  • the epidermal thickness appears to be retrieved well from the measurements.
  • tissue may be modeled as a turbid, plane-parallel, vertically inhomogeneous, layered medium with specified optical properties.
  • the inherent optical properties i.e., the absorption coefficient ⁇ ( z ), the scattering coefficient ⁇ ( z ) and the normalized scattering phase function p ( z , ⁇ ) were allowed to vary with depth z in the tissue.
  • is the scattering angle
  • Lateral variations in the IOPs may be ignored, keeping in mind that every measured value corresponds to the radiance reflected by the tissue into the upper hemisphere and then gathered by the finite aperture of an optical system.
  • u dI ⁇ , u , ⁇ d ⁇ I ⁇ , u , ⁇ ⁇ J ⁇ , u , ⁇
  • I ( ⁇ ,u, ⁇ ) stands for the diffuse radiance
  • u is the cosine of the polar angle ⁇
  • is the azimuth angle.
  • the angles ( ⁇ ', ⁇ ' ) denote the direction of a beam of light before a scattering event and the angles ( ⁇ , ⁇ ) denote the observation direction.
  • the first term in the source function J ( ⁇ ,u, ⁇ ) represents multiple scattering
  • the CAT-DISORT C oupled A ir- T issue DIS crete- O rdinate R adiative T ransfer
  • the lOPs were used as input to the CAT-DISORT model to compute the reflected radiances (AOPs) in directions ( ⁇ a , ⁇ a ) inside the detector aperture.
  • the computed radiances were integrated over the solid angle ( ⁇ u a , ⁇ ⁇ a ) of the optical system aperture.
  • f ⁇ n ( n 1,2,...
  • N corresponds to the reflected radiance at N different wavelengths
  • the covariance matrix of the noise C ⁇ E ⁇ ⁇ ⁇ ⁇ T is estimated, where E is the mathematical expectation operator.
  • the superscript ⁇ means transposition, so that if ⁇ denotes a column vector, ⁇ T is the corresponding row vector, and thus ⁇ ⁇ ⁇ ⁇ T is a symmetric matrix of dimension N ⁇ N .
  • tissue model parameters are assembled in a vector s.
  • MP&PP components such as the contents of melanosomes, blood, keratin, etc. in the tissue layers.
  • F F s + ⁇ ⁇ .
  • the inverse problem is still underdetermined (ill-posed).
  • the reason for the ill-posedness is the smoothness of most of the spectral signatures of the MP&PP tissue components, implying that the spectral signature of one MP&PP component can be mimicked by a certain combination of others. This makes it hard if not impossible to find the proper impact of an individual MP&PP component, if the parameterization of the tissue model in terms of MP&PP components is done without proper analysis of the information content.
  • a regularization procedure may be invoked.
  • Bayesian inference provides a natural way of regularization through the introduction of a probabilistic measure in the space of unknown parameters. From Bayes' theorem on conditional probabilities p f
  • s p s p s
  • Eq. (10) objective function
  • Eq. (10) is the weighted least mean squares difference between simulated and measured radiances, with an extra regularization term (penalty function), represented by the second term in Eq. (10), which is strictly convex and defines the set of admissible tissue component parameters.
  • L i is used for the Frèchet derivatives evaluated at state s i .
  • the linear approximation in Eq. (12) corresponds to approximating the conditional probability (9) with a Gaussian distribution of unknowns s : p s
  • f ⁇ exp ⁇ 1 2 L 0 s ⁇ ⁇ ⁇ f T C ⁇ ⁇ 1 L 0 s ⁇ ⁇ ⁇ f + s ⁇ T C s ⁇ 1 s ⁇ with ⁇ f f - F (s 0 ).
  • the computed morphological parameters are defined as follows:
  • M z is defined in Eq. (23).

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Dermatology (AREA)
  • Immunology (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Description

    BACKGROUND 1. Technical Field
  • The present disclosure relates to an optical method for determining several morphological parameters and physiological properties (hereafter abbreviated MP&PPs) of skin tissue. In particular, the present disclosure is directed to a method to determine MP&PPs of malignant as well as benign skin tissue lesions.
  • 2. Description of the Related Art
  • Malignant melanoma is one of the most rapidly increasing cancers in the world. In the United States alone, the estimated incidence for 2008 is 62,480, which leads to an estimated total of 8,420 deaths per year. Successful treatment of melanoma depends on early detection by clinicians with subsequent surgical removal of tumors. Visual detection has its limitations, even when augmented with dermoscopy, especially with less experienced users. Attempts have thus been made to develop automated devices to assist in the screening of pigmented skin lesions for likelihood of melanoma. Several of these devices have digitalized dermoscopy-related features analyzed by artificial neural networks or support vector machine learning systems.
  • The optical properties of human skin in the ultraviolet spectral region have been studied for almost one hundred years [Hasselbalch, KA: Quantitative Untersuchungen Uber die Absorption der menschlichen Haut von ultravioletten Strahlen. Skand Arch Physiol 1911 25: 5-68, 1911; Everett, MA, Yeargers, E, Sayre, RM, Olson, RL: Penetration of epidermis by ultraviolet rays. Photochem Photobiol 1966 5: 533-542], and non-invasive optical methods have been applied to study the physiological state of human skin for at least twenty years [Diffey, BL, Oliver, RJ, Farr, PM: A portable instrument for quantifying erythema induced by ultraviolet radiation. Br J Dermatol 1984 111: 663-672]. A well-known application is blood-oxymetry, by which a relative blood-oxygenation index can be determined non-invasively from the scattered reflectance or transmittance of light at red and near-infrared (NIR) wavelengths [see e.g. Yaroslavsky AN, Schulze PC, et al. Optical properties of selected native and human brain tissues in vitro in the visible and near infrared spectral range. Physics in Medicine and Biology. 2002 47(12):2059-2073]. The reflectance in that spectral region has also been used to determine other physiological properties. For example, the gradient of the reflectance spectrum between 620 nm and 720 nm depends on the total melanin content of the skin [Kollias N, Baqer AN. Spectroscopic characteristics of human melanin in vivo. J Invest Dermatol, 1985 ;85:38-42], However, variations in the blood concentration, the thicknesses of the skin layers, and the scattering phase function of skin tissue, also affect the reflectance spectrum, and thereby the accuracy of the determination of blood oxygenation and total melanin content. Therefore, it is essential to perform a simultaneous determination of all optically important MP&PPs.
  • In order to determine tissue optical properties (as opposed to MP&PPs) from spectral reflectance measurements several different inversion schemes have been used, including partial least squares regression [Berger et al., An enhanced algorithm for linear multivariate calibration, Anal. Chem. 1998, 70: 623-627], neural networks [Kienle et al., Spatially resolved absolute diffuse reflectance measurements for noninvasive determination of the optical scattering and absorption coefficients of biological tissue, Appl. Opt. 35 2304-2314 1996], fuzzy logic [Dam et al., Determination of tissue optical properties from diffuse reflectance profiles by multivariate calibration. Appl Opt. 1998;37:772-778], and genetic algorithms [Zhang et al., "Neural vs. statistical classifier in conjunction with genetic algorithm based feature selection" Pattern recognition letters 26.7 (2005): 909-919]. In contrast, this invention makes use of a nonlinear inversion scheme based on e.g. optimal estimation theory [Tikhonov, A.N., and Arsenin, V.Y., Tikhonov, A. N.; V. Y. Arsenin (1977). Solution of III-posed Problems. Washington: Winston & Sons. ISBN 0-470-99124-01; Twomey, S, Introduction to the Mathematics of Inversion in Remote Sensing and Indirect Measurement Developments in Geomathematics, Vol. 3 Elsevier, Amsterdam (1977); Tarantola, A., Inverse Problem Theory: Methods for Data Fitting and Model Parameter Estimation , Elsevier, New York 1987; Rodgers, Clive D., Inverse Methods for Atmospheric Sounding: Theory and Practice. World Scientific 2000], combined with bio- optical models [which provide a link between MP&PPs and inherent optical properties (IOPs)] and accurate radiative-transfer modeling in coupled air-tissue systems. There is also disclosed, a method for deriving a set of additional morphological parameters (MPs) of tissue from reflectance measurements.
  • WO 2006/076810 A1 discloses a method and device for disease detection, more particularly, cancer detection, from the analysis of diffuse reflectance spectra measured in vivo during endoscopic imaging. The measured diffuse reflectance spectra are analyzed using a light-transport model and numerical method to derive quantitative parameters related to tissue physiology and morphology.
  • US 2006/247532 A1 discloses an iterative process that calculates the absorption and scattering coefficients of tissue from a set of diffuse reflectance measurements made with an optical spectrometer operating in the UV-VIS spectral range. The relationship between measured diffuse reflectance and the absorption and scattering coefficients is modeled using a Monte Carlo simulation.
  • NIELSEN KRISTIAN P. ET AL: "Reflectance Spectra of Pigmented and Nonpigmented Skin in the UV Spectral Region", PHOTOCHEMISTRY AND PHOTOBIOLOGY, vol. 80, no. 3, 1 January 2004 relates to measurements of reflectance spectra from human skin in vivo in the spectral range from 250 to 700 nm. The measured results are simulated using a new radiative transfer model developed to study light propagation in skin tissue.
  • NIELSEN KRISTIAN P. ET AL: "The optics of human skin: aspects important for human health", SOLAR RADIATION AND HUMAN HEALTH, 1 January 2008 relates to combining a bio-optical model of human skin with advanced radiative transfer theory to simulate the transport of solar radiation through the skin.
  • SUMMARY
  • The present teaching provides a method as detailed in claim 1. Advantageous features are provided in dependent claims.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The objects and features of the present disclosure, which are believed to be novel, are set forth with particularity in the appended claims. The present disclosure, both as to its organization and manner of operation, together with further objectives and advantages, may be best understood by reference to the
    following description, taken in connection with the accompanying drawings as set forth below:
    • Figure 1 shows an example of the agreement between measured and simulated reflectance values obtained when using the retrieved values for morphological parameters and physiological properties of the tissue;
    • Figure 2 shows the retrieved dermal blood concentration for each of the measurement areas;
    • Figure 3 shows the retrieved percentage of oxygenated blood for each of the measurement areas;
    • Figure 4 shows retrieved melanosome content in the lower epidermis for each of the measurement areas;
    • Figure 5 shows retrieved melanosome content in the upper epidermis for each of the measurement areas;
    • Figure 6 shows retrieved lower epidermis thickness for each of the measurement areas;
    • Figure 7 shows retrieved upper epidermis thickness for each of the measurement areas; and
    • Figure 8 shows retrieved epidermal keratin content for each of the measurement areas.
    DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS
  • The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. In addition, the following detailed description does not limit the present disclosure. The claimed invention is directed to a method of determining morphological parameters and physiological properties of tissue only insofar as the tissue is skin tissue. Other types of tissue do not fall within the scope of the invention as defined by the claims. The present invention relates to a novel method for determining morphological parameters and physiological properties of the tissue (MP&PPs) of different types of tissue lesions. In particular, the present invention is directed to a method for determining MP&PPs for malignant as well as benign tissue lesions. The method of the present invention is applicable to, but not limited to, benign and malignant tissue lesions in general, and uses spectral reflectance measurements of tissue lesions, which may be generated by a spectrophotometer or by an Optical Transfer Diagnosis (OTD) method.
  • The OTD device currently used records 30 spectral reflectance images of a lesion under examination. These 30 reflectance images, which constitute one image set, are recorded at 10 different wavelengths (365-1000 nm) from multiple angles of illumination and detection. According to the invention the OTD device is a spectral reflectance meter consisting of a measurement head with 12 fixed light-emitting diode (LED) lamps and 3 IEEE (Institute of Electrical and Electronics Engineers) 1394 FireWire cameras. Each LED is placed at a different angle relative to the skin to enhance the ability to retrieve information about the depth of the lesion. The polar angles of the LEDs vary between 30 and 45 degrees, and the relative azimuth angles between 34 and 145 degrees. The polar angles of the detectors vary between 0 and 45 degrees, and the relative azimuth angles between 0 and 180 degrees, In the current OTD practice, an alcohol-based gel is used as an interface between the measurement probe and the skin, and a selected area of the skin is illuminated and imaged through a 2.2 cm diameter circular sapphire plate. The imaging time is approximately 5 seconds.
  • On the basis of established absorption and transmission spectra for known tissue chromophores and mathematical modeling of spectral tissue reflectance using a bio-optical model in combination with radiative transfer modeling in coupled air-tissue systems, the present invention provides through the use of a non-linear inversion procedure, a method for deriving MP&PPs as well as additional MPs of a lesion from a set of spectral reflectance measurements. By this method, several MP&PPs can be determined including (i) percentage of hemoglobin; (ii) percentage of hemoglobin oxygenation; (iii) upper epidermal thickness; (iv) lower epidermal thickness; (v) percentage of upper melanosome concentration; (vi) percentage of lower melanosome concentration; and (vii) percentage of keratin concentration. The third and fourth of these entities are MPs, while the remaining five entities are physiological properties (PPs) describing the physiological state of the tissue. Each of these seven entities varies and is different for normal and malignant tissues. Also, the present invention provides a method for deriving a set of additional MPs of diagnostic value directly from the reflectance measurements.
  • It is important to combine information about parameters that characterize the physiological state of the skin tissue with information of diagnostic value obtained from MPs other than the thicknesses of the upper and lower epidermis layers. For example, an unusually high melanin content would not suffice to make a definitive melanoma diagnosis, but if a lesion with high melanin content also had an irregular spatial distribution of the reflected intensity, then the high melanin content could indicate with a higher probability that the lesion might be a melanoma.
  • To aid the differentiation between benign and malignant tissue, a description of how a lesion can be defined directly from measured reflectance spectra and how such measurements can be used to characterize the lesion in terms of a set of MPs follows. As an example, an aim is to differentiate between benign pigmented nevi and malignant melanomas, but the method is applicable in general to differentiate between benign and malignant tissue.
  • A lesion border is defined from measured reflectance spectra by using the reflected intensity from one of the channels in the visible spectral range, for example the green channel. As an example, 10 different MPs are descriptive of the lesion and can be used as an aid to make a definitive diagnosis.
  • Lesion border. The border of a lesion is defined from the reflected intensity of the image from one of the visible channels, for example the green channel, looking straight down at the lesion, by identifying the regions in which the gradient of the reflected intensity has its largest values.
  • Size: The size parameter p M1 is defined as the number of pixels comprising the lesion, i.e. p M1 is the number of pixels inside the lesion border defined above.
  • Histogram width: For a given combination of illumination and observation directions, the histogram-width parameter p M2 gives a measure of the inhomogeneity of the reflected intensity of a lesion. Usually this parameter is small for benign nevi, but large for melanomas. Sebhorreic keratoses can also have relatively large inhomogeneities of the reflected intensity.
  • Relative moment of inertia: For a given combination of illumination and observation directions, the parameter p M3 provides information about another aspect of the inhomogeneity of the reflected intensity of a lesion. Let the spatial light absorptance distribution in a lesion be defined as its "mass distribution" and calculate its "center of mass" and "total mass", the latter being defined as the average light absorptance of the lesion. Then the parameter p M3 gives the moment of inertia of the lesion relative to that of a homogeneous circular disk having the same "total mass" as the lesion and a diameter equal to the average diameter of the lesion. If there is a high melanin concentration towards the center of a lesion, this parameter will be small, while it will be large if there is a high melanin concentration towards its border. For the melanomas examined so far, the p M3 values were small, in particular for well-developed melanomas.
  • Center distance: The center distance p M4, which provides additional information about the asymmetry of the lesion, represents the physical distance between the "geometrical center of a lesion" and the "center of mass" of the absorptance, as defined above. The "geometrical center of a lesion" means its center with respect to its border, irrespective of how the pigment is distributed within it. Thus, if a lesion has an asymmetrical pigment distribution, the distance between the "geometrical center" and the "center of mass" will be significant.
  • Darkness: The darkness parameter p M5 is defined as the average value of the reflected intensity of a lesion.
  • Fractal dimension: The fractal-dimension parameter p M6 describes the complexity of the border of a lesion. It is defined such that the border of a lesion has a fractal dimension of 1 if the lesion border is perfectly smooth, independent of magnification, while the fractal dimension of the lesion border will tend towards 2 if it is highly irregular.
  • Asphericity: The aspericity parameter p M7 is defined as the ratio between the long and short axes of a lesion. It is 1 for a circular lesion, and increases as a lesion gets more elongated. Just as p M6 and p M8, this parameter depends only on the border of the lesion, and does not contain any information about its internal structure.
  • Relative border length: The relative border length p M8 is defined as the ratio of the border length of a circle with the same area as the lesion to the border length of the lesion.
  • Size vs. fractal dimension: The parameter p M9 is defined as the size divided by the fractal dimension, i.e. p M9 = p M1 / p M6 .
  • Border length vs. fractal dimension: The parameter p M10 is defined as the relative border length divided by the fractal dimension, i.e. p M10 = p M8 / p M6.
  • Multi-spectral reflectance measurements combined with bio-optical models and accurate radiative transfer simulations of light propagation inside tissue and backscattering from it, provide a basis for obtaining estimates of MP&PPs. In order to determine important tissue MP&PPs the following ingredients are needed: 1. A bio-optical model that relates tissue MP&PPs to tissue lOPs, the latter being the absorption and scattering coefficients as well as the scattering phase function, each as function of wavelength and depth in the tissue; 2. An accurate radiative transfer model for coupled air-tissue systems. which for a given set of lOPs computes various apparent optical properties (AOPs). such as the diffuse reflectance spectrum; 3. An iterative inversion scheme that accounts for the nonlinear dependence of the AOPs on the lOPs.
  • Commonly used radiative transfer models include one based on the diffusion approximation and another based on Monte Carlo (MC) simulations. The first method is not accurate enough for our purpose, and the MC method is too slow. The numerically stable discrete ordinate radiative transfer (DISORT) model provides accurate results for coupled air-tissue systems in an efficient manner. Thus, the DISORT code for coupled air tissue systems (CAT-DISORT) is several orders of magnitude faster than the MC method and provides results that are just as precise. It includes a bio-optical model that has been applied also to provide estimates of the efficiency of various photobiological processes and photodynamic therapy in the UV and visible spectral regions.
  • To illustrate the potential of our method for determining tissue MP&PPs, a study was carried out that aimed at evaluating the feasibility of employing the biooptical model together with CAT-DISORT forward simulations and inversion based on Bayesian optimal estimation to determine important MP&PPs of skin tissue from diffuse reflectance spectra measured by Zhao, Y. and Berns, R. S. (2007), Image-based spectral reflectance reconstruction using the matrix R method. Color Res. Appl., 32: 343-351. The biooptical model contains a large number of variable MP&PPs that in principle could be retrieved, but most of them were kept fixed while only a few were treated as
    retrievable entities. Chromophores, such as the epidermal melanosome concentration and the dermal blood concentration, were considered as retrievable entities, since their variability strongly influences the apparent optical properties of the tissue, such as the spectral tissue reflectance. But entities describing the optical properties of the cellular matrix into which the chromophores are embedded, were kept fixed because variations in these entities have little impact on the apparent optical properties of the tissue.
  • Reflectance spectra in the wavelength region from 300 nm to 600 nm were measured daily from three test areas and three control areas on a volunteer with skin type III for two weeks during which the skin in the test areas went through erythema and pigmentation. The volunteer, who had given his written permission to participate in the study, was healthy and did not use any medical drugs. Erythema and pigmentation were induced after 24-hour topical application of a photosensitizer followed by illumination with red light (632 nm) for 2 minutes on the first day ('day 0') of the experiment. A brief summary of the design of the photodynamic experiment is given below.
  • Three test areas (A, B & C), each 1 cm x 1 cm with approximately 1.5 cm distance between adjacent areas, were marked on the inner part of the right forearm of the volunteer. Cream was prepared using 10% (w/w) of the hexylester of 5-aminolevulinic acid (ALA-Hex) in a standard oil-in-water cream base (Unguentum, Merck, Darmstad, Germany). Freshly prepared cream with approximately (75± 10) mg/cm2 of ALA-Hex was topically applied on each of the three test areas, which were subsequently covered with transparent adhesive dressings (OpSite Flexifix, Smith & Nephew Medical Ltd., Hull, UK), in which three openings (1 cm x 1 cm) had been cut out precisely in the places where the test areas were located. The dressings were intended to prevent the cream from diffusing to adjacent areas. The creams and the dressings were kept for 24 hours on the test areas, which were then illuminated with red light (632 nm) for 2 minutes.
  • Three control areas, similar to the test areas, were also marked on the volunteer. On the first of these control areas (D) ALA-Hex was applied but it was not illuminated; the second of the control areas (E) was illuminated with red light, but no ALA-Hex was applied; on the third control area (F) a base cream, without ALA-Hex was applied, and it was illuminated with red light.
  • A luminescence spectrometer was employed to record reflectance spectra from each of the test areas and each of the control areas. The spectrometer was equipped with two scanning grating monochromators, one in front of the light source (a pulsed Xenon lamp) and another in front of the detector. A fiber-optic probe was coupled to the spectrometer. The probe was a commercially available fiber accessory (Perkin-Elmer), consisting of two 1 m fused silica fiber bundles joined in parallel at the measuring tip. It was connected to a cylindrically shaped aluminum spacer with an inner diameter of 4 mm. The spacer was painted black inside in order to minimize stray light. The spacer was pressed lightly against the skin to keep the probe at a fixed distance of 10 mm above the skin surface. This arrangement ensured a relatively uniform distribution of the excitation light over the area to be examined. Reflectance spectra were measured in synchronous scans in which both gratings were set at the same wavelength and band pass (5 nm) to avoid fluorescence artifacts. The area exposed to the excitation light of the spectrometer was the same as the area from which the reflected light was detected. The geometry of the fiber probe was such that both the directly (Fresnel) reflected and the diffusely reflected irradiances from the skin were collected and recorded. Care was taken not to press the spacer too hard against the skin surface in order to minimize artifacts from pressure-induced reductions in the blood flow.
  • A coupled air-tissue system can be represented by a layered medium with constant inherent optical properties (lOPs) in each layer. The tissue is assumed to be a turbid layered medium so that radiative transfer theory can be used to compute the diffuse light inside it and reflected from it. Each tissue layer can be described in terms of its lOPs, which are the absorption coefficient α([mm-1]), the scattering coefficient σ([mm-1]), the (normalized) scattering phase function p(cosΘ), and the physical thickness Δz ([mm]). In terms of α, σ, and Δz, one may define two non-dimensional lOPs given by τ=(α+σz (optical thickness) and a = σ/(α + σ) (single-scattering albedo), so that the lOPs in each layer of the tissue can be adequately described by the two variables τ and a, as well as a third parameter g, related to the scattering phase function.
  • The scattering phase function gives the distribution of the scattered light as a function of the scattering angle Θ. Skin tissue is a complex medium with many different kinds of scattering 'particles' in each layer, and the scattering phase function for a particular layer represents a weighted mean of scattering phase functions for several types of particles. Different descriptions of the scattering phase function p(cosΘ) may be used in different physical and practical applications. Here, two such functions, namely the Henyey-Greenstein scattering phase function pHG (cosΘ) and the Rayleigh scattering phase function pRay (cosΘ) are used. A convenient measure of the angular distribution of the scattering is the average over all scattering directions (weighted by p(cosΘ)) of the cosine of the scattering angle Θ, i.e. (µ = cosΘ) cos Θ = g = 1 2 0 π p cos Θ cos Θ sin ΘdΘ = 1 2 1 1 p μ μdμ .
    Figure imgb0001
    The average cosine g is called the asymmetry factor of the scattering phase function.
  • In 1941 Henyey and Greenstein proposed the one-parameter scattering phase function given by p HG cos Θ = 1 g 2 1 + g 2 2 g cos Θ 3 / 2
    Figure imgb0002
    where g is the asymmetry factor [see Eq. (1)]. This Henyey-Greenstein scattering phase function has no physical basis, but is useful for describing scattering by large particles in a medium, such as tissue, for which the actual scattering phase function is unknown. Here, the term 'large particles' implies that their sizes are comparable to or larger than the wavelength. When the size d of the scatterers is small compared with the wavelength of light d < 1 10 λ ,
    Figure imgb0003
    the Rayleigh scattering phase function gives a good description of the angular distribution of the scattered light. The Rayleigh scattering phase function for unpolarized light is given by p cos Θ = 3 4 + f 1 + f cos 2 Θ
    Figure imgb0004
    where f is a polarization factor. Originally, the Rayleigh scattering phase function was derived for scattering of light by an electric dipole. Since the Rayleigh scattering phase function is symmetric about Θ = 90°, the asymmetry factor is g = 0. However, unlike the Heney-Greenstein scattering phase function [Eq. (2)], which gives isotropic scattering for g = 0, the Rayleigh scattering phase function does not represent isotropic scattering.
  • A bio-optical model was used to calculate the lOPs for a given set of MP&PPs that describe the physiological state of the tissue. In order to calculate the AOPs (in this case the diffuse reflectance spectrum from the tissue), the CAT-DISORT was employed to solve the radiative transfer equation for a slab of biological tissue stratified into a number of layers, thereby accounting for the reflection and refraction of the incident radiance at the air-tissue interface (caused by the change in the refractive index), which affect the radiation field significantly. An integral part of the forward-inverse modeling procedure was to couple the bio-optical model to CAT-DISORT in such a way that the MP&PPs could be determined directly from the measured AOPs.
  • In order to obtain a unique solution of our inverse or retrieval problem, most MP&PPs are kept fixed, while other MP&PPs are considered to be retrievable, and therefore allowed to vary. The following 7 retrievable MP&PPs varied:
    • The dermal blood content
    • The percentage of oxygenated blood
    • The melanosome concentration in the lower epidermis
    • The thickness of the lower epidermis
    • The melanosome concentration in the upper epidermis
    • The thickness of the upper epidermis
    • The keratin concentration in the upper epidermis.
  • The other MP&PPs were fixed. Thus, each of the scattering coefficients associated with the non-pigmented constituents of the epidermis and the dermis, the optical thickness of the dermis, and the optical properties of the subcutaneous layer were assumed to be fixed.
  • Figure 1 shows an example of the agreement between measured and simulated reflectance values obtained when using the retrieved values for the 7 MP&PP entities listed above as inputs to CAT-DISORT simulations. In Figure 1, measured (+) and simulated (x) reflectance spectra for test area A on the seventh day after the photodynamic exposure is shown. The figure shows that good agreement was obtained between measured and simulated spectra when the 7 retrieved MP&PPs for this day were used as inputs to CAT-DISORT simulations.
  • Figures 2-8 show the retrieved values of the blood content in the dermis (Fig. 2), the percentage of oxygenated blood (Fig 3), the melanosome concentration in the lower layer of the epidermis (Fig. 4), the melanosome concentration in the upper layer of the epidermis (Fig. 5), the thickness of the lower epidermis (Fig. 6), the thickness of the upper epidermis (Fig. 7), and the keratin concentration in the upper epidermis (Fig. 8), respectively. The three panels in the left column of each figure represent the test areas (A-C), while the three panels in the right column represent the control areas (D-F). In the bio-optical model for tissue the epidermis was divided into five layers and the melanosome concentration was allowed to vary from one layer to another. Here, the epidermis is divided into two layers and the melanosome concentration and the thickness for each of them are retrieved.
  • In Figure 2, retrieved dermal blood concentration for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment.
  • In Figure 3, retrieved percentage of oxygenated blood for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment.
  • In Figure 4, retrieved melanosome content in the lower epidermis for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment.
  • In Figure 5, retrieved melanosome content in the upper epidermis for each of the measurement areas for the 15 days of measuremen is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment.
  • In Figure 6, retrieved lower epidermis thickness for each of the measurement areas for the 15 days of measuremen is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment.
  • In Figure 7, retrieved upper epidermis thickness for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment.
  • In Figure 8, retrieved epidermal keratin content for each of the measurement areas for the 15 days of measurement is shown. 'Initial' refers to the situation prior to the photodynamic treatment of the skin, while the next tick mark refers to the situation immediately after the photodynamic treatment.
  • The standard deviations or the error bars that are shown in Figs. 2-8 were calculated during the retrieval procedure from the diagonal elements of the covariance matrix [Φ final ]-1 as defined in Eq. (19) below and explained in the discussion that follows Eq. (19). In general, the temporal variation in the blood content of the tissue (Fig. 2) was in good agreement with expectations. A maximum was reached after 1-2 days, the so-called erythema reaction, typical for sunburn, after which the blood content slowly decayed. This pattern is similar for the three test areas. For the three control areas the variations are within the range of the calculated standard deviations.
  • Fig. 3 shows the percentage of oxygenated blood immediately after the photodynamic treatment and during the following two weeks for the six measurement areas. Photodynamic therapy is known to be an oxygen consuming process. Thus, it must be emphasized that 'immediately after' means several seconds or may be even a minute after the exposure. The marked increase in oxygenation measured at the beginning of the experiment, at all the three test areas, is likely to be a reaction to the photodynamic treatment, rather than a direct effect of the treatment itself. The variation in blood oxygenation at the three control areas is of a stochastic nature.
  • The relative change of the percentage of oxygenated blood during the two weeks of measurements seems reasonable. However, the absolute values, which are in the range between 40% and 80%, may be too low (Fig. 3). These low oxygenation percentages could be caused by the bandpass of the spectrometer (5 nm) being insufficiently narrow to resolve the spectral fine structure in the 540 nm - 580 nm spectral region. The skin reflectance in this spectral region is very sensitive to the percentage of oxygenated blood. Therefore, the percentage of oxygenated blood could be underestimated from these measurements.
  • The retrieval of the melanosome content was less uncertain for the upper epidermis (Fig. 5) than for the lower epidermis (Fig. 4). Thus, the standard deviations for the lower epidermal melanosome content were about twice as large as for the upper epidermal melanosome content.
  • For the three test areas, the melanosome content in the lower epidermis decreased during the two weeks (Fig. 4), while the melanosome content in the upper epidermal layer increased, in particular during the first week (Fig. 5). This behaviour is similar to that caused by pigmentation induced by UVB radiation (with wavelengths shorter than 320 nm). Thus, as a reaction to UVB exposure the melanosome pigment particles tend to be transferred from the melanocytes in the basal layer of the epidermis to the keratinocytes in the upper layer. In the experiment discussed here, there was no sign of immediate pigment darkening, a process primarily induced by UVA radiation (with wavelengths longer than 320 nm). Had immediate pigment darkening occurred, it would have been seen in the measurements taken immediately after the photodynamic treatment.
  • Hence, the photodynamic process induced by topical application of ALA-Hex followed by illumination with red light (632 nm wavelength) bears similarities with the photobiological pigmentation process induced by UVB radiation, but immediate melanin darkening does not take place during PDT.
  • The decrease in the retrieved lower melanosome concentration occurs simultaneously with an increase in the retrieved lower epidermal thickness. Thus, the total retrieved lower epidermal melanosome content turned out to b∼ fairly constant during the two weeks of measurements. No significant temporal variations were found in the control areas in either the retrieved lower or upper epidermal melanosome concentrations (Figs. 4 & 5) or in the retrieved lower or upper epidermal thickness (Figs. 6 & 7).
  • The retrieved thickness of the total epidermis is close to what would be expected. Thus, Sandby-Møller et al., Epidermal Thickness at Different Body Sites: Relationship to Age, Gender, Pigmentation, Blood Content, Skin Type and Smoking Habits, Acta Derm Venereol 2003; 83: 410-413 (2003) performed measurements on the dorsal forearm of 71 volunteers and found the average epidermal thickness to be 76 µm ± 15 µm. As can be seen from Figs. 6 & 7, a total epidermal thickness of approximately 70 µm for both the test sites and the control sites was retrieved. Thus, the epidermal thickness appears to be retrieved well from the measurements.
  • It is feasible to perform accurate retrievals of several key MP&PPs describing the physiological state of human skin tissue by using an accurate radiative transfer model for the coupled air-tissue system as a forward model in conjunction with a bio-optical model and a nonlinear inversion scheme.
  • Retrievals made from analyses of diffuse reflectance spectra measured before and after the exposure of the skin to ALA-Hex photodynamic treatment (PDT) with red light, and on each day for two weeks after that PDT exposure provided results in good agreement with those obtained in previous investigations of UVB-induced erythema and pigmentation in human skin:
    • The erythema maximizes 1-2 days after the ALA-Hex PDT exposure and then subsides;
    • There is a strong increase in the pigmentation of the upper epidermal layers, in particularly during the first 7 days after the ALA-Hex PDT exposure;
    • The blood oxygenation is found to increase immediately after the exposure and then return to pre-exposure values more than seven days later.
  • The process induced in the skin by ALA-Hex PDT with red light thus appears to be similar to the process induced by UVB radiation.
  • These results represent the first simultaneous quantitative retrievals of the melanosome concentrations in the upper and the lower epidermis, the epidermal keratin concentration, the dermal blood concentration, and the percentage of oxygenated blood.
  • In a forward model, an assumption may be made that tissue may be modeled as a turbid, plane-parallel, vertically inhomogeneous, layered medium with specified optical properties. Thus, the inherent optical properties (IOPs), i.e., the absorption coefficient α(z), the scattering coefficient σ(z) and the normalized scattering phase function p(z,Θ) were allowed to vary with depth z in the tissue. Here, Θ is the scattering angle, and the differential optical depth for a thin layer of thickness dz is = -(α(z) + σ(z))dz. Lateral variations in the IOPs may be ignored, keeping in mind that every measured value corresponds to the radiance reflected by the tissue into the upper hemisphere and then gathered by the finite aperture of an optical system.
  • The integro-differential equation of radiative transfer describing light propagation in such a medium can be written in the form: u dI τ , u , ϕ = I τ , u , ϕ J τ , u , ϕ
    Figure imgb0005
    where the source function is given by J τ , u , ϕ = a τ 4 π 0 2 π d ϕ ' 1 1 d u ' p τ , u , ϕ ; u ' , ϕ ' I τ , u ' , ϕ ' + Q τ , u , ϕ .
    Figure imgb0006
  • Here I(τ,u,φ) stands for the diffuse radiance, u is the cosine of the polar angle θ, and φ is the azimuth angle. The angles (θ',φ') denote the direction of a beam of light before a scattering event and the angles (θ,φ) denote the observation direction. The scattering angle Θ between these two directions is given by
    cosΘ = cosθcosθ' +sinθsinθ'cos(θ' - φ).
  • The first term in the source function J(τ,u,φ) represents multiple scattering, a(τ) = σ(τ)/[α(τ) + σ(τ)] denotes the single-scattering albedo, and Q τ , u , ϕ = a τ 4 π p τ , u , ϕ ; μ 0 , ϕ 0 S b τ exp τ / μ 0
    Figure imgb0007
    describes the incident beam of irradiance Sb in direction (-µ 0,φ 0) with μ 0 602 δ i 0 ° δ ° δ cos θ 1 ° i ,
    Figure imgb0008
    where θ 0 is the polar angle of the incident beam. The probability of scattering an angle Θ from the direction (θ',φ') into the direction (θ,φ) is described by the scattering phase function p(τ,cosΘ)= p(τ,u,φ;u',φ'), whose first moment or asymmetry parameter, is given by (µ = cosΘ) g τ = 1 2 1 1 μp τ , μ ,
    Figure imgb0009
    as ih Eq. (1). To quantify the propagation of UV and visible light in a turbid layered medium with known lOPs, as well as the diffuse reflectance spectra (apparent optical properties: AOPs), the CAT-DISORT (Coupled Air-Tissue DIScrete- Ordinate Radiative Transfer) model is used to solve Eq. (4). Thus, the lOPs were used as input to the CAT-DISORT model to compute the reflected radiances (AOPs) in directions (θaa ) inside the detector aperture. To simulate measurement values the computed radiances were integrated over the solid angle (Δua φa ) of the optical system aperture. In other words, CAT-DISORT was used to solve the forward problem: for given lOPs of the layered tissue: g(τ) = {α(τ),σ(τ),g(τ)}, predict (simulate) values for the diffuse reflectance spectra (AOPs): = { 1, 2,...,n ,...N }. where n (n = 1,2,...N) corresponds to the reflected radiance at N different wavelengths, and n = n (g) = ∫Δφ 4 a Δu 6 duaIn (0,uaa ).
  • Simulated data f̃ differ from measured data f because the latter contain a stochastic component ε, i.e. noise, so that f = f ˜ g + ε .
    Figure imgb0010
  • The covariance matrix of the noise C ε = E ε ε T
    Figure imgb0011
    is estimated, where E is the mathematical expectation operator. The superscript τ means transposition, so that if ε denotes a column vector, ε T is the corresponding row vector, and thus ε ε T
    Figure imgb0012
    is a symmetric matrix of dimension N × N.
  • In formulation of an inverse problem, note that the tissue lOPs assembled in the vector g depend on the wavelength of the incident light. Second, tissue model parameters are assembled in a vector s. Thus: s = s 1 , s 2 , , s m , , s M
    Figure imgb0013
    represents M issue MP&PP components (such as the contents of melanosomes, blood, keratin, etc. in the tissue layers). Provided that the spectral signatures of all MP&PP components are known, they can be used to define the lOPs of the tissue: g = g s .
    Figure imgb0014
  • Letting F denote a nonlinear operator that maps a vector of MP&PP tissue components into a vector of simulated measurements, i.e. f̃(g) = F(s), the model can be rewritten f = F s + ε .
    Figure imgb0015
  • Note that the operator F is defined implicitly. It returns a solution of the radiative transfer Eq. (4) for the layered medium with lOPs g, induced by tissue parameters s : g = g(s) and known incident beam S b.
  • Now, an inverse problem is presented: given N spectral reflectance measurements with a certain level of noise ε : f = F s + ε ,
    Figure imgb0016
    find M parameters s, which describe the optically important MP&PP components of the tissue.
  • Even though the number of measurements N is much greater than the number of unknowns M, the inverse problem is still underdetermined (ill-posed). The reason for the ill-posedness is the smoothness of most of the spectral signatures of the MP&PP tissue components, implying that the spectral signature of one MP&PP component can be mimicked by a certain combination of others. This makes it hard if not impossible to find the proper impact of an individual MP&PP component, if the parameterization of the tissue model in terms of MP&PP components is done without proper analysis of the information content.
  • To alleviate this problem, a regularization procedure may be invoked. Because the data for the inverse problem contain stochastic noise, Bayesian inference provides a natural way of regularization through the introduction of a probabilistic measure in the space of unknown parameters. From Bayes' theorem on conditional probabilities p f | s p s = p s | f p f
    Figure imgb0017
    it follows that the conditional probability p(s|f) to get a specific value s, when f is given, can be written as p s | f p f | s p s .
    Figure imgb0018
  • If a set of admissible functions {s} is defined by the mean value s0 = E{s}, and the covariance matrix C s = E{(s - s0 )(s - s0 ) T }, then the conditional probability can be represented by the product of two Gaussian distributions. The first one is Gaussian with respect to the noise ε = f ˜ f ,
    Figure imgb0019
    but not with respect to the MP&PP components s, because ε = f F s
    Figure imgb0020
    contains the nonlinear function F(s). Thus:
    Figure imgb0021
  • If we define the solution s* as the vector of most probable tissue components, given the vector of measurement f, i.e. p(s*|f) = maxsp(s|f), then the solution to the inverse problem can be formulated as an optimization: find the vector s* from a set of admissible vectors {s} that yields the optimum (minimum) value of the functional J = J s = f F s T C ε 1 F s s } f F s + s s 0 T C s 1 s s 0 .
    Figure imgb0022
  • Thus, the functional in Eq. (10) (objective function) is the weighted least mean squares difference between simulated and measured radiances, with an extra regularization term (penalty function), represented by the second term in Eq. (10), which is strictly convex and defines the set of admissible tissue component parameters.
  • An outline of the Gauss-Newton algorithm for nonlinear inversion is now presented. The objective function in Eq. (10) near the reference model s0 in terms of s = s - s0 : J s = J s 0 + s ˜ = J s 0 + ΔJ s ˜ = const + ΔJ s ˜ .
    Figure imgb0023
  • Assuming that | s |≪|s0 |, an approximate the term ΔJ(s) in Eq. (10) by a quadratic form with respect to s. Thus, keeping just the constant and the linear term of F(s), is F s = F s 0 + F s I s 0 s ˜ + F s 0 + L 0 s ˜ + F s 0 + L 0 s ˜ .
    Figure imgb0024
  • Here the linear operator L o stands for the Jacobian L o = F s I s 0 = f ˜ g g s I s 0
    Figure imgb0025
    where the subscript indicates that the reference state s0 is used to evaluate the Jacobian (Frèchet derivative). Similarly, L i is used for the Frèchet derivatives evaluated at state s i .
  • The linear approximation in Eq. (12) corresponds to approximating the conditional probability (9) with a Gaussian distribution of unknowns s : p s | f exp 1 2 J s 0 exp 1 2 ΔJ s ˜ exp 1 2 ΔJ s ˜
    Figure imgb0026
    which can be approximated as p s | f exp 1 2 L 0 s ˜ δf T C ε 1 L 0 s ˜ δf + s T C s 1 s ˜
    Figure imgb0027
    with δ f = f - F(s0). It is easy to check that L o s ˜ δ f T C ε 1 L o s ˜ δ f + s ˜ T C s 1 s ˜ s ˜ s * ˜ T Φ o s ˜ s * ˜ + Δ f
    Figure imgb0028
    where Δ(f) is a term that depends only on the data (f), s * = Φ o 1 L o T C ε 1 f F s 0
    Figure imgb0029
    and Φ o = L o T C ε 1 L o + C s 1 .
    Figure imgb0030
  • Using Eq. (15), we get for the conditional probability in Eq. (14): p s ˜ | f exp [ 1 2 s ˜ s * ˜ T Φ o s ˜ s * ˜
    Figure imgb0031
    which now has the standard form of a Gaussian distribution with the following parameters: the mean value E s ˜ = s * ˜
    Figure imgb0032
    (which is the same as the most probable one: max p s ˜ | f = p s * ˜ | f ,
    Figure imgb0033
    and the covariance matrix E s s ˜ * s s ˜ * T = Φ 0 1 = L 0 T C ε 1 L 0 + C s 1 1 .
    Figure imgb0034
  • Hence, Eq. (16) provides an explicit form of the solution s*. Thus, no matter which specific algorithms one applies to solve the linearized version of the optimization problem (11), one should arrive at the solution given by Eq. (16) with uncertainties given by Eq. (19).
  • As soon as s* is obtained, the corrected reference model becomes s 1 = s 0 + s *
    Figure imgb0035
    and the procedure can be repeated with models s1, s2, ..., until the misfit between simulated and measured data reaches the level of the noise in the data.
  • The uncertainties in the final solution are given by covariance matrix [Φ final ]-1, and the diagonal elements of this matrix give us an estimate of the dispersions of the corresponding tissue model components.
  • In defining a lesion, the morphological image analysis is based on the logarithm of the measured bidirectional reflectance distribution function ρ, defined as: ρ = ln L r F i
    Figure imgb0036
    where Lr is the reflected intensity or radiance and Fi is the incident lamp flux or irradiance.
  • The computed morphological parameters are defined as follows:
    • Lesion border: The border of a lesion is defined from the reflected intensity of the image from one of the visible channels, for example the green channel, looking straight down on the lesion, by identifying the regions in which the gradient of the reflected intensity has its largest values.
    • Size: The size parameter p M1 is defined as the number of pixels comprising the lesion, i.e. p M1 the number of pixels inside the lesion border defined above.
    • Histogram width: Let h(ρ) be the number of pixels having reflectance values between ρ and ρρ. We then define the width parameter p M2 of the lesion histogram as p M 2 = 1 H ρ t h ρ ρ ρ 2
      Figure imgb0037
    where ρ, defines the lesion border, H = ρ t h ρ .
    Figure imgb0038
    and ρ = 1 H ρ t ρh ρ .
    Figure imgb0039
  • Moment of inertia: The "center of mass" of a lesion is r M = ij ρ ij r ij ij ρ ij
    Figure imgb0040
    where the subscripts i and j denote pixel number i in the x direction and number j in the y direction, and r ij is the vector r ij = i ê x + j ê y . The moment of inertia for rotation around the z axis is given by M z = 1 N ij ρ ij r ij r M T r ij r M ,
    Figure imgb0041
    where N is the number of pixels and the superscript T denotes the transpose. Let hc and rc be defined as respectively the height and radius of a cylinder with the same "volume" V = ∫ A ρda and area A as the lesion, so that h c = V π r c 2 r c = A π .
    Figure imgb0042
  • Then, the moment of inertia parameter is defined as p M 3 = M 1 1 2 π h c r c 4
    Figure imgb0043
    where the denominator is the moment of inertia of the cylinder of radius rc and height hc for rotation around its axis. Mz is defined in Eq. (23).
  • Center distance: Let aij = 1 for all ρij < 0 and aij = 0 for all ρij = 0 (Note that ρ is zero outside the lesion.). "Geometrical center" of the lesion as r A = ij a ij r ij ij a ij .
    Figure imgb0044
  • The center distance of the lesion is defined as the distance between the "center of mass" of the lesion [Eq. (22)] and the "geometrical center" of the lesion divided by the radius rc of the cylinder, i.e. p M 4 = | r M r A | r c .
    Figure imgb0045
  • Darkness: The darkness parameter is defined as the average value of ρ p M 5 = ij ρ ij ij a ij
    Figure imgb0046
    where aij is equal to 1 inside the lesion and equal to 0 outside it.
  • Fractal dimension: The fractal dimension parameter p M6 is defined as p M 6 = ln α ln N b ln s
    Figure imgb0047
    where Nb is the number of lesion border pixels and s is the pixel size, and α is found by a linear fit to the varying values of lnNb and lns obtained from successive runs with varying resolution. p M6 takes values between 1 and 2 depending on the curliness of the lesion border.
  • Asphericity: The eigenvalues λ 1 and λ 2 of the following matrix give the moment of inertia around the two principal axes of the lesion. M = 1 N ij ρ ij r ij r V r ij r V T .
    Figure imgb0048
  • Asphericity of the lesion is p M 7 = λ 1 λ 2 .
    Figure imgb0049
  • Border length: The border length of a lesion is defined as the ratio of the border length of a circle with the same area as the lesion to the border length of the lesion: p M 8 = 2 π p M 1 N b
    Figure imgb0050
    where p M1 is the size of the lesion and Nb is the number of border pixels.
  • Size vs. fractal dimension: The parameter p M9 is defined as the size dived by the fractal dimension, i.e. p M9 = p M1 / p M6.
  • Border length vs. fractal dimension: The parameter p M10 is defined as the relative border length dived by the fractal dimension, i.e. p M10 = p M8 / p M6.
  • Morphology Diagnostic Index for Melanoma: a diagnostic index IMk for each of the morphological parameters pMk is I Mk = ln p Mk μ Mk σ Mk
    Figure imgb0051
    where µMk and σMk are the mean value and the standard deviation of lnpMk for all lesions under consideration.
  • No element, act, or instruction used in the present disclosure should be construed as critical or essential unless explicitly described as such. In addition, as used herein, the article "a" is intended to include one or more items. Where only one item is intended, the term "one" or similar language is used.
  • It will be understood that various modifications may be made to the embodiments disclosed herein. Therefore, the above description should not be construed as limiting, but merely as exemplifications of the various embodiments of the present disclosure. Those skilled in the art will envision other modifications within the spirit of the claims appended hereto.

Claims (6)

  1. An optical method for determining morphological parameters and physiological properties of skin tissue, the method comprising the steps of:
    generating reflectance measurements of a skin tissue area from reflectance images obtained for a plurality of wavelengths from multiple angles of illumination and detection using a spectral reflectance meter consisting of a measurement head with 12 fixed light-emitting diode (LED) lamps and 3 cameras, wherein each LED lamp is placed at a different angle relative to the skin, providing a bio-optical model, a radiative transfer model, and a non-linear inversion procedure;
    systematically varying input values of the morphological parameters and physiological properties of the skin tissue and simultaneously varying inherent optical properties of the skin tissue, wherein the inherent optical properties are linked to the morphological parameters and the physiological properties of the skin tissue by the bio-optical model, and computing reflectances by the radiative transfer model for the varying inherent optical properties until an agreement between the reflectance measurements and the reflectances computed by the radiative transfer model reaches a predetermined level of accuracy; and
    obtaining the morphological parameters and the physiological properties returned by the non-linear inversion procedure.
  2. The method of claim 1, wherein the bio-optical model is based on established absorption and transmission spectra for known skin tissue chromophores and relates morphological parameters and physiological properties of tissue to inherent optical properties of tissue.
  3. The method of claim 1, wherein the radiative transfer model is used in coupled air-tissue systems to compute synthetic reflectance spectra for a plurality of different wavelengths and a plurality of different measurement configurations, each with specified directions of illumination and observation.
  4. The method of claim 1, wherein the non-linear inversion procedure is based on an optimal estimation theory to solve the inverse problem of quantifying specified morphological parameters and physiological properties of skin tissue, the morphological parameters and physiological properties of skin tissue optionally including, dermal blood content, percentage blood oxygenation, upper epidermis thickness, lower epidermis thickness, percentage of upper melanosome concentration, percentage of lower melanosome concentration, and percentage of keratin concentration.
  5. The method of claim 1, wherein the method is used to discriminate between one of:
    benign pigmented lesions and malignant melanoma;
    benign tissue and basal cell carcinoma; and
    benign tissue and squamous cell carcinoma.
  6. The method of claim 1, wherein the method is used for beauty care, forensic medicine, or to monitor efficacies of different kinds of treatment.
EP09722309.3A 2008-03-18 2009-03-18 Optical method for determining morphological parameters and physiological properties of skin tissue Active EP2255173B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP15186132.5A EP2992818B1 (en) 2008-03-18 2009-03-18 Optical method for determining morphological parameters of skin tissue lesions
DK15186132.5T DK2992818T3 (en) 2008-03-18 2009-03-18 Optical method for determining morphological parameters of skin tissue lesions

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US3750308P 2008-03-18 2008-03-18
PCT/US2009/037511 WO2009117485A2 (en) 2008-03-18 2009-03-18 Optical method for determining morphological parameters and physiological properties of tissue

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP15186132.5A Division EP2992818B1 (en) 2008-03-18 2009-03-18 Optical method for determining morphological parameters of skin tissue lesions
EP15186132.5A Division-Into EP2992818B1 (en) 2008-03-18 2009-03-18 Optical method for determining morphological parameters of skin tissue lesions

Publications (3)

Publication Number Publication Date
EP2255173A2 EP2255173A2 (en) 2010-12-01
EP2255173A4 EP2255173A4 (en) 2012-10-17
EP2255173B1 true EP2255173B1 (en) 2018-01-24

Family

ID=41091515

Family Applications (2)

Application Number Title Priority Date Filing Date
EP09722309.3A Active EP2255173B1 (en) 2008-03-18 2009-03-18 Optical method for determining morphological parameters and physiological properties of skin tissue
EP15186132.5A Active EP2992818B1 (en) 2008-03-18 2009-03-18 Optical method for determining morphological parameters of skin tissue lesions

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP15186132.5A Active EP2992818B1 (en) 2008-03-18 2009-03-18 Optical method for determining morphological parameters of skin tissue lesions

Country Status (10)

Country Link
US (1) US9823189B2 (en)
EP (2) EP2255173B1 (en)
JP (2) JP5580809B2 (en)
AU (1) AU2009225617B2 (en)
CA (1) CA2718906C (en)
DK (2) DK2992818T3 (en)
NO (1) NO2255173T3 (en)
NZ (1) NZ588545A (en)
WO (1) WO2009117485A2 (en)
ZA (1) ZA201006943B (en)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007133710A2 (en) 2006-05-11 2007-11-22 Raindance Technologies, Inc. Microfluidic devices and methods of use thereof
US9562837B2 (en) 2006-05-11 2017-02-07 Raindance Technologies, Inc. Systems for handling microfludic droplets
US20100091104A1 (en) * 2006-09-27 2010-04-15 Georgia Tech Research Corporation Systems and methods for the measurement of surfaces
WO2008097559A2 (en) 2007-02-06 2008-08-14 Brandeis University Manipulation of fluids and reactions in microfluidic systems
US8592221B2 (en) 2007-04-19 2013-11-26 Brandeis University Manipulation of fluids, fluid components and reactions in microfluidic systems
EP2238449B1 (en) 2008-01-24 2018-06-06 Balter, Inc. Method for discriminating between malignant and benign tissue lesions
NZ588545A (en) 2008-03-18 2013-05-31 Balter Inc Optical method for determining morphological parameters and physiological properties of a lesion
US12038438B2 (en) 2008-07-18 2024-07-16 Bio-Rad Laboratories, Inc. Enzyme quantification
WO2010009365A1 (en) 2008-07-18 2010-01-21 Raindance Technologies, Inc. Droplet libraries
US9399797B2 (en) 2010-02-12 2016-07-26 Raindance Technologies, Inc. Digital analyte analysis
WO2011100604A2 (en) 2010-02-12 2011-08-18 Raindance Technologies, Inc. Digital analyte analysis
WO2012112804A1 (en) 2011-02-18 2012-08-23 Raindance Technoligies, Inc. Compositions and methods for molecular labeling
DE202012013668U1 (en) 2011-06-02 2019-04-18 Raindance Technologies, Inc. enzyme quantification
US8658430B2 (en) 2011-07-20 2014-02-25 Raindance Technologies, Inc. Manipulating droplet size
US10200655B2 (en) 2011-11-08 2019-02-05 The Trustees Of Columbia University In The City Of New York Tomographic imaging methods, devices, and systems
US20140213909A1 (en) * 2013-01-31 2014-07-31 Xerox Corporation Control-based inversion for estimating a biological parameter vector for a biophysics model from diffused reflectance data
FR3011170B1 (en) * 2013-09-30 2017-03-31 Apd Advanced Perfusion Diagnostics NON-INVASIVE MEASUREMENT DEVICE AND METHOD FOR ESTIMATING LOCAL METABOLIC PARAMETERS
US11901041B2 (en) 2013-10-04 2024-02-13 Bio-Rad Laboratories, Inc. Digital analysis of nucleic acid modification
KR101536693B1 (en) * 2013-11-25 2015-07-14 한국광기술원 Method and system for determantion of melanoma by the multi-wavelength imaging and image processing
US9944977B2 (en) 2013-12-12 2018-04-17 Raindance Technologies, Inc. Distinguishing rare variations in a nucleic acid sequence from a sample
JP6504913B2 (en) * 2015-05-20 2019-04-24 花王株式会社 Method of observing skin capillaries
US10413232B2 (en) 2016-02-10 2019-09-17 Balter Medical, As. Optical transfer diagnosis for detection and monitoring of tissue disorders
US10460150B2 (en) 2018-03-16 2019-10-29 Proscia Inc. Deep learning automated dermatopathology
KR102411108B1 (en) 2019-03-20 2022-06-22 가부시키가이샤 코세 Estimation method, method of generating an estimation model, program, and estimation apparatus
CN110208211B (en) * 2019-07-03 2021-10-22 南京林业大学 Near infrared spectrum noise reduction method for pesticide residue detection
CN112683816B (en) * 2020-12-25 2021-08-06 中船重工安谱(湖北)仪器有限公司 Spectrum identification method for spectrum model transmission
WO2023235414A1 (en) * 2022-05-31 2023-12-07 DeepX Diagnostics, Inc. Multilayer environment scanning

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5813988A (en) 1995-02-03 1998-09-29 Research Foundation Time-resolved diffusion tomographic imaging in highly scattering turbid media
US7054674B2 (en) * 1996-11-19 2006-05-30 Astron Clinica Limited Method of and apparatus for investigating tissue histology
GB9624003D0 (en) 1996-11-19 1997-01-08 Univ Birmingham Method and apparatus for measurement of skin histology
EP1011446A1 (en) 1997-02-28 2000-06-28 Electro-Optical Sciences, Inc. Systems and methods for the multispectral imaging and characterization of skin tissue
US6307957B1 (en) 1997-02-28 2001-10-23 Electro-Optical Sciences Inc Multispectral imaging and characterization of biological tissue
US6081612A (en) 1997-02-28 2000-06-27 Electro Optical Sciences Inc. Systems and methods for the multispectral imaging and characterization of skin tissue
US6205353B1 (en) 1998-12-22 2001-03-20 Research Foundation Of Cuny Time-resolved optical backscattering tomographic image reconstruction in scattering turbid media
US6993167B1 (en) * 1999-11-12 2006-01-31 Polartechnics Limited System and method for examining, recording and analyzing dermatological conditions
US20010032053A1 (en) * 2000-01-24 2001-10-18 Hielscher Andreas H. Imaging of a scattering medium using the equation of radiative transfer
US6775405B1 (en) 2000-09-29 2004-08-10 Koninklijke Philips Electronics, N.V. Image registration system and method using cross-entropy optimization
NO325061B1 (en) * 2001-03-06 2008-01-28 Photosense As Method and arrangement for determining the optical property of a multilayer tissue
US7756558B2 (en) * 2004-05-24 2010-07-13 Trutouch Technologies, Inc. Apparatus and methods for mitigating the effects of foreign interferents on analyte measurements in spectroscopy
JP2003149136A (en) 2001-11-13 2003-05-21 Shimadzu Corp Optical image measuring method
US7769424B2 (en) * 2001-12-28 2010-08-03 Japan Science And Technology Agency Intercerebral current source estimation method intercerebral current source estimation program recording medium containing the intercerebral current source estimation program and intercerebral current source estimation apparatus
JP3884294B2 (en) * 2002-01-18 2007-02-21 株式会社東芝 Design support apparatus and program
US7218959B2 (en) * 2002-06-05 2007-05-15 Research Foundation Of City University Hybrid-dual-fourier tomographic algorithm for a fast three-dimensionial optical image reconstruction in turbid media
CN101259010B (en) * 2002-07-26 2010-08-25 奥林巴斯株式会社 Image processing system
JP4437202B2 (en) 2004-01-09 2010-03-24 学校法人慶應義塾 Telemedicine system for pigmentation site
WO2006009910A2 (en) * 2004-06-17 2006-01-26 The Regents Of The University Of California Time-resolved optometric fluorescence detection for skin diagnostics
US7991557B2 (en) 2004-06-19 2011-08-02 Genenews Corporation Computer system and methods for constructing biological classifiers and uses thereof
US20070016078A1 (en) * 2004-12-06 2007-01-18 Hoyt Clifford C Systems and methods for in-vivo optical imaging and measurement
CA2595213C (en) * 2005-01-21 2014-10-28 Perceptronix Medical Inc. Method and apparatus for measuring cancerous changes from reflectance spectral measurements obtained during endoscopic imaging
US7319467B2 (en) * 2005-03-29 2008-01-15 Mitsubishi Electric Research Laboratories, Inc. Skin reflectance model for representing and rendering faces
US7570988B2 (en) 2005-05-02 2009-08-04 Wisconsin Alumni Research Foundation Method for extraction of optical properties from diffuse reflectance spectra
RU2367577C1 (en) * 2005-08-12 2009-09-20 Рик Б. ЙЕГЕР System and method for application of substance that varies its reflecting property in order to improve visual attractiveness of human skin
US7820972B2 (en) * 2005-09-02 2010-10-26 Pola Chemical Industries Inc. Method of evaluating skin conditions and method of estimating skin thickness
GB2429385C (en) 2005-09-23 2008-04-24 Astron Clinica Ltd Image processing method and apparatus.
EP2238449B1 (en) 2008-01-24 2018-06-06 Balter, Inc. Method for discriminating between malignant and benign tissue lesions
NZ588545A (en) 2008-03-18 2013-05-31 Balter Inc Optical method for determining morphological parameters and physiological properties of a lesion

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
NO2255173T3 (en) 2018-06-23
DK2992818T3 (en) 2019-10-21
US20110054298A1 (en) 2011-03-03
JP2011517416A (en) 2011-06-09
AU2009225617A1 (en) 2009-09-24
JP5580809B2 (en) 2014-08-27
ZA201006943B (en) 2014-03-26
AU2009225617B2 (en) 2014-07-10
DK2255173T3 (en) 2018-03-26
EP2992818A1 (en) 2016-03-09
US9823189B2 (en) 2017-11-21
WO2009117485A3 (en) 2010-03-04
EP2992818B1 (en) 2019-09-04
EP2255173A2 (en) 2010-12-01
CA2718906A1 (en) 2009-09-24
EP2255173A4 (en) 2012-10-17
JP6035268B2 (en) 2016-11-30
WO2009117485A2 (en) 2009-09-24
NZ588545A (en) 2013-05-31
CA2718906C (en) 2018-09-11
JP2014144355A (en) 2014-08-14

Similar Documents

Publication Publication Date Title
EP2255173B1 (en) Optical method for determining morphological parameters and physiological properties of skin tissue
US10201281B2 (en) System, method and article for normalization and enhancement of tissue images
US9706929B2 (en) Method and apparatus for imaging tissue topography
Vogel et al. Using noninvasive multispectral imaging to quantitatively assess tissue vasculature
Abdlaty et al. Skin erythema and pigmentation: a review of optical assessment techniques
Milanic et al. Hyperspectral imaging for detection of arthritis: feasibility and prospects
Abdlaty et al. Skin erythema assessment techniques
Kanellis A review of melanin sensor devices
Jakovels et al. Noncontact monitoring of vascular lesion phototherapy efficiency by RGB multispectral imaging
Das et al. Simple detection of absorption change in skin tissue using simulated spectral reflectance database
Bae et al. Multimodal facial color imaging modality for objective analysis of skin lesions
Nielsen et al. Retrieval of the physiological state of human skin from UV–Vis reflectance spectra–a feasibility study
Huang et al. Second derivative multispectral algorithm for quantitative assessment of cutaneous tissue oxygenation
Das et al. Simulated reflectance spectra and point spread functions in database constructed by moderate grouping of nine layers in skin model
Lisenko et al. Method for determining skin pigment concentrations from multispectral images of the skin
Verkruysse et al. Remittance at a single wavelength of 390 nm to quantify epidermal melanin concentration
Kang et al. Methods to Study Vitiligo: Noninvasive Techniques and In Vivo Reflectance Confocal Microscopy
Confocal 21 Methods to Study Vitiligo: Noninvasive Techniques
Harrison NOVEL NONINVASIVE OPTICAL DIAGNOSTIC TECHNOLOGIES FOR THE MANAGEMENT OF NEONATAL JAUNDICE
Harrison-Smith Novel Noninvasive Optical Diagnostic Technologies for the Management of Neonatal Jaundice
Maganti et al. Optical nevoscope reconstructions using photon diffusion theory
Borisova et al. Influence of measurement geometry on the human skin reflectance spectra detection
Ramakrishnan Reflectance spectroscopy of skin and application in skin biometry

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100922

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

RIN1 Information on inventor provided before grant (corrected)

Inventor name: MOAN, JOHAN, E.

Inventor name: NIELSEN, KRISTIAN, P.

Inventor name: SOMMERSTEN, ENDRE, R.

Inventor name: HAMRE, BOERGE

Inventor name: STAMNES, JAKOB, J.

Inventor name: STAMNES, KNUT

Inventor name: RYZHIKOV, GENNADY

Inventor name: BIRYULINA, MARINA

Inventor name: ZHAO, LU

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20120913

RIC1 Information provided on ipc code assigned before grant

Ipc: G01N 33/483 20060101ALI20120907BHEP

Ipc: G01N 21/31 20060101ALI20120907BHEP

Ipc: G06T 7/60 20060101ALI20120907BHEP

Ipc: A61B 5/1455 20060101ALI20120907BHEP

Ipc: G01N 21/47 20060101AFI20120907BHEP

17Q First examination report despatched

Effective date: 20140606

RIN1 Information on inventor provided before grant (corrected)

Inventor name: STAMNES, JAKOB, J.

Inventor name: MOAN, JOHAN, E.

Inventor name: SOMMERSTEN, ENDRE, R.

Inventor name: ZHAO, LU

Inventor name: STAMNES, KNUT

Inventor name: HAMRE, BOERGE

Inventor name: BIRYULINA, MARINA

Inventor name: NIELSEN, KRISTIAN, P.

Inventor name: RYZHIKOV, GENNADY

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602009050532

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G01N0021310000

Ipc: A61B0005145500

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 5/1455 20060101AFI20170626BHEP

Ipc: G06K 9/00 20060101ALI20170626BHEP

Ipc: G01N 21/31 20060101ALI20170626BHEP

Ipc: A61B 5/00 20060101ALI20170626BHEP

Ipc: G06T 7/62 20170101ALI20170626BHEP

Ipc: G06T 7/66 20170101ALI20170626BHEP

Ipc: G01N 21/47 20060101ALI20170626BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20170818

RIN1 Information on inventor provided before grant (corrected)

Inventor name: STAMNES, JAKOB, J.

Inventor name: HAMRE, BOERGE

Inventor name: SOMMERSTEN, ENDRE, R.

Inventor name: RYZHIKOV, GENNADY

Inventor name: NIELSEN, KRISTIAN, P.

Inventor name: MOAN, JOHAN, E.

Inventor name: BIRYULINA, MARINA

Inventor name: STAMNES, KNUT

Inventor name: ZHAO, LU

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 965302

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180215

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602009050532

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20180320

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: IP PARTNERS J. WENGER, CH

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20180124

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 965302

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180124

REG Reference to a national code

Ref country code: NO

Ref legal event code: T2

Effective date: 20180124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180425

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180524

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180424

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602009050532

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20180331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180318

26N No opposition filed

Effective date: 20181025

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180318

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180124

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20090318

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180124

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NO

Payment date: 20230329

Year of fee payment: 15

Ref country code: IE

Payment date: 20230327

Year of fee payment: 15

Ref country code: FR

Payment date: 20230327

Year of fee payment: 15

Ref country code: DK

Payment date: 20230329

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20230315

Year of fee payment: 15

Ref country code: DE

Payment date: 20230329

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20230402

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240910

Year of fee payment: 16

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20240331

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG