EP2732756B1 - Object information acquisition apparatus - Google Patents
Object information acquisition apparatus Download PDFInfo
- Publication number
- EP2732756B1 EP2732756B1 EP13190007.8A EP13190007A EP2732756B1 EP 2732756 B1 EP2732756 B1 EP 2732756B1 EP 13190007 A EP13190007 A EP 13190007A EP 2732756 B1 EP2732756 B1 EP 2732756B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- unit
- light intensity
- minimum block
- characteristic value
- object information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Not-in-force
Links
- 238000009826 distribution Methods 0.000 claims description 87
- 230000003287 optical effect Effects 0.000 claims description 60
- 238000010521 absorption reaction Methods 0.000 claims description 40
- 238000005259 measurement Methods 0.000 claims description 36
- 230000001678 irradiating effect Effects 0.000 claims description 4
- 230000000644 propagated effect Effects 0.000 claims description 4
- 238000000034 method Methods 0.000 description 23
- 238000004364 calculation method Methods 0.000 description 20
- 238000010586 diagram Methods 0.000 description 18
- 238000003384 imaging method Methods 0.000 description 17
- 238000001514 detection method Methods 0.000 description 14
- 206010028980 Neoplasm Diseases 0.000 description 7
- 239000000523 sample Substances 0.000 description 7
- 238000010895 photoacoustic effect Methods 0.000 description 5
- 102000001554 Hemoglobins Human genes 0.000 description 3
- 108010054147 Hemoglobins Proteins 0.000 description 3
- 239000006096 absorbing agent Substances 0.000 description 3
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 239000001301 oxygen Substances 0.000 description 3
- 229910052760 oxygen Inorganic materials 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000000342 Monte Carlo simulation Methods 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000009792 diffusion process Methods 0.000 description 2
- 238000001727 in vivo Methods 0.000 description 2
- 230000031700 light absorption Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 238000003325 tomography Methods 0.000 description 2
- 238000002604 ultrasonography Methods 0.000 description 2
- 206010006187 Breast cancer Diseases 0.000 description 1
- 208000026310 Breast neoplasm Diseases 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000007789 gas Substances 0.000 description 1
- 238000011503 in vivo imaging Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000021715 photosynthesis, light harvesting Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0093—Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy
- A61B5/0095—Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy by applying light and detecting acoustic waves, i.e. photoacoustic measurements
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/14542—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring blood gases
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/43—Detecting, measuring or recording for evaluating the reproductive systems
- A61B5/4306—Detecting, measuring or recording for evaluating the reproductive systems for evaluating the female reproductive systems, e.g. gynaecological evaluations
- A61B5/4312—Breast evaluation or disorder diagnosis
Definitions
- the present invention relates to an object information acquisition apparatus.
- PAT photoacoustic tomography
- an object such as a biological body is irradiated with pulsed light generated from a light source, whereby light propagated and diffused within the object is absorbed by a light absorber to generate an elastic wave.
- This mechanism of elastic wave generation is called a photoacoustic effect. Since a tumor has a higher light energy absorption rate for near-infrared light than surrounding tissues, the tumor absorbs more light than the surrounding tissues. Thus, the tumor momentarily expands and generates an elastic wave.
- the elastic wave is detected with a detection element and converted to a received signal.
- signal processing reconstruction
- object information such as the space distribution of initial sound pressure of the elastic wave generated upon absorption of light energy within the object can be imaged. Since the space distribution of generated sound pressure relates to the absorption coefficient of light, diagnosis of an object using space distribution relating to the absorption coefficient of light has been studied.
- the present invention in its one aspect provides an object information acquisition apparatus as specified in claims 1 to 15. Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
- an acoustic wave includes an elastic wave called a sound wave, ultrasound wave, photoacoustic wave, or light-induced ultrasound wave.
- An object information acquisition apparatus of the present invention is an apparatus utilizing a photoacoustic effect in which an acoustic wave generated within an object by irradiating the object with light (electromagnetic wave) is received and characteristic information within the object is acquired.
- Object information in the object information acquisition apparatus is the characteristic information reflecting the initial sound pressure of an acoustic wave caused by light irradiation, light energy absorption density derived from the initial sound pressure, absorption coefficient, concentration of a substance forming a tissue, or the like.
- the concentration of a substance is, for example, the concentration of oxygenated hemoglobin and reduced hemoglobin or oxygen saturation.
- the characteristic information may be distribution information of each position within an object instead of numerical data. That is, initial sound pressure distribution, absorption coefficient distribution, oxygen saturation distribution, or the like may be generated into image data.
- the present invention can be understood as a control method upon receiving an acoustic wave with the object information acquisition apparatus.
- a photoacoustic imaging apparatus will be described as a specific example of the object information acquisition apparatus.
- the same components are basically denoted by the same reference numerals, and descriptions will be omitted.
- a sound pressure p 0 (Pa) of the elastic wave caused by the photoacoustic effect is represented by Formula (1).
- p 0 ⁇ a ⁇ ⁇ ⁇ ⁇
- ⁇ a the absorption coefficient (mm -1 ) of a light absorber (tumor or the like)
- ⁇ is the Gruneisen coefficient
- ⁇ the light intensity (J/mm 2 ) at a position of the light absorber.
- the Gruneisen coefficient ⁇ is a value for which a value of the volume expansion coefficient multiplied by the square of the speed of sound is divided by the constant pressure specific heat, and takes an approximately constant value in vivo.
- the generated sound pressure is proportional to light intensity.
- the light intensity ⁇ decays exponentially in accordance with the distance from the position irradiated with light. Therefore, the light intensity decreases due to decay, and a domain where an elastic wave with sufficient sound pressure to be detected is not generated exists. Since it is difficult to acquire the object information with high precision even if reconstruction is performed with respect to such a domain where the light intensity is low, the inventor of the present invention has found that the significance of performing the reconstruction is small.
- an optical characteristic value of the object is input to an apparatus, and a domain for which the object information is acquired is limited based on the light intensity distribution calculated from the optical characteristic value to shorten the time required for acquisition of the object information.
- the optical characteristic value the absorption coefficient that is an absorption characteristic value and the reduced scattering coefficient that is a scattering characteristic value are used.
- Fig. 1 is a diagram showing an overview of a photoacoustic imaging apparatus in this embodiment. The configuration for acquiring information of an object will be described below.
- a light source of the present invention includes at least one coherent or incoherent pulsed light source.
- the pulse width is preferably several hundred nanoseconds or less.
- a specific constituent for example, hemoglobin
- Laser with which a large output can be obtained is preferable as the light source, but it is also possible to use a light-emitting diode or the like instead of the laser.
- various lasers such as solid-state laser, gas laser, dye laser, or semiconductor laser may be used.
- An irradiation unit 101 that is irradiating unit irradiates an object 100 with irradiation light from the light source with a method suitable for photoacoustic measurement.
- the irradiation unit 101 may be provided not only on the side opposing a probe 103 with respect to the object but also on the same side.
- the irradiation unit 101 includes a mirror, a lens that collects, magnifies, or changes the shape of light, a prism that disperses, refracts, or reflects light, or an optical fiber. Any such optical part aside from those mentioned above may also be used as long as an object can be irradiated with light emitted from a light source with a desired method (irradiation direction, shape, or the like).
- a transducer 102 that is detecting unit, an elastic wave generated by the object 100 being irradiated with light is received and converted to an electrical signal that is the received signal.
- the transducer 102 is configured of a transducer using a piezoelectric phenomenon, a transducer using optical resonance, a transducer using capacity change, or the like. Any transducer with which an elastic wave can be received and converted to an electrical signal may be used.
- a plurality of the transducers 102 are present in order to receive elastic waves in different positions.
- the plurality of transducers 102 are, for example, arranged one-dimensionally or two-dimensionally to form the probe 103.
- the probe 103 outputs the electrical signal generated by the plurality of transducers 102 to a reconstruction unit 109.
- An optical characteristic value input unit 106 that is characteristic input unit includes an interface that accepts an input of the optical characteristic value (absorption coefficient and reduced scattering coefficient) of the object 100 performed by an operator.
- a characteristic e.g., age
- an optical characteristic value input unit 106 that is characteristic input unit includes an interface that accepts an input of the optical characteristic value (absorption coefficient and reduced scattering coefficient) of the object 100 performed by an operator.
- a characteristic e.g., age
- An optical characteristic value setting unit 105 that is characteristic setting unit sets the absorption coefficient and the reduced scattering coefficient input to the optical characteristic value input unit 106 in a light intensity distribution calculation unit 107.
- the light intensity distribution calculation unit 107 uses the absorption coefficient and the equivalent scattering coefficient set by the optical characteristic value setting unit 105 to calculate the light intensity distribution inside the object 100.
- the light intensity distribution calculation unit is distribution acquiring unit of the present invention.
- a calculation method for the light intensity distribution a numerical solution method of transport equations, a numerical solution method of diffusion approximation equations, a numerical solution method using a Monte Carlo method, or the like may be used. It is desirable that an intensity distribution pattern of irradiation light be reflected in the calculation of the light intensity distribution. Accordingly, the precision of calculation of the light intensity distribution can be improved. For example, it is recommended that the irradiation unit 101 be able to monitor the intensity distribution pattern of irradiation light and that the intensity distribution pattern be input to the light intensity distribution calculation unit.
- a minimum block unit within a light intensity domain that is a domain having a light intensity of a predetermined threshold value or greater is extracted and set in the reconstruction unit 109.
- the threshold value of light intensity light intensity with which a minimum sound pressure detectable by the transducer 102 is generated can be utilized, for example.
- the predetermined threshold value may differ for each minimum block unit. A calculation method therefor will be described below.
- Formula (2) represents a decay compensation noise equivalent sound pressure value p NEP_c (r) described later.
- a threshold value ⁇ th (r) of light intensity of the minimum block unit of a position vector r is represented by Formula (3) that is a deformation of Formula (1).
- p NEP _ c r p NEP A ⁇ , max i d i ⁇ r [Math.
- p NEP is the noise equivalent sound pressure for which the intensity of noise included in the electrical signal that is the received signal is divided by the conversion efficiency in the conversion of the sound pressure to the electrical signal by the transducer 102.
- the unit for the conversion efficiency is V/Pa in the case where the electrical signal is a voltage.
- )) is the decay ratio of sound pressure upon propagation of an elastic wave between the transducer 102 of a position vector d i (where i is a number showing each of the plurality of transducers 102) and the minimum block unit.
- of the i-th transducer 102 and the minimum block unit determine A.
- the decay of sound pressure includes distance-dependent decay by a decay coefficient ⁇ and distance-dependent decay due to energy dissipation in spherical wave propagation, cylindrical wave propagation, or the like.
- the noise equivalent sound pressure p NEP is divided and corrected by the decay ratio A for p NEP_c (r) that is the decay compensation noise equivalent sound pressure value. That is, if the minimum block unit of the position vector r has generated an elastic wave of a sound pressure of p NEP_c (r), the elastic wave is detected by the transducer 102. Thus, through correction using the decay ratio in the greatest distance max
- the absorption coefficient of the object 100 set in the light intensity distribution calculation unit 107 by the optical characteristic value setting unit 105 is ⁇ a_BG .
- the absorption coefficient of tumor presumably has a value greater with respect to ⁇ a_BG that is an average coefficient of the object 100. This is because a tumor is rich in blood of a large absorption coefficient since new blood vessels are drawn in. From Formula (1), the sound pressure of the generated elastic wave is small when the absorption coefficient is small. Therefore, at least when ⁇ th (r) obtained using ⁇ a_BG is the threshold value, an elastic wave caused by the tumor that is a target for imaging can be detected.
- ⁇ is the Gruneisen coefficient, and it is recommended that a value typical for a biological body be input in the case where the object 100 is a biological body, for example.
- the light intensity domain setting unit 108 calculates the threshold value of light intensity for each minimum block unit in a manner described above.
- Fig. 2 is a diagram showing the details of the light intensity domain setting unit 108.
- Reference numeral 202 in the upper left in the drawing shows the light intensity distribution calculated by the light intensity distribution calculation unit 107. The intensity of the light is stronger when nearer the irradiation unit 101.
- the light intensity distribution 202 is output to the light intensity domain setting unit 108 as a light intensity distribution 203 for each minimum block unit 201.
- ⁇ i shown in the light intensity distribution 203 for each minimum block unit shows the light intensity of the minimum block unit of the number i.
- ⁇ i ⁇ (r i ) (where ⁇ (r i ) is the light intensity of the minimum block unit of the position vector r i ).
- Reference numeral 204 denotes a threshold value of light intensity for each minimum block unit that is calculated for each minimum block unit by Formula (2) and Formula (3).
- the threshold value of light intensity of the minimum block unit of the number i is shown by ⁇ ti shown in the threshold value 204 of light intensity for each minimum block unit.
- ⁇ ti ⁇ th (r i ).
- the light intensity domain setting unit 108 further includes a light intensity domain storage unit 205 that stores a value corresponding to each minimum block unit forming the object 100.
- the light intensity domain setting unit 108 compares ⁇ i and ⁇ ti of the same number i, and sets 1 in a storage area for the corresponding minimum block unit in the light intensity domain storage unit 205 if ⁇ i ⁇ ⁇ ti .
- the light intensity domain setting unit 108 sets 0 in a storage area other than for the corresponding minimum block unit.
- a domain of black minimum block units shown in the light intensity domain storage unit 205 is a light intensity domain.
- the light intensity domain setting unit 108 sets the minimum block unit within the light intensity domain in the reconstruction unit 109 by outputting a value in the light intensity domain storage unit 205 to the reconstruction unit 109.
- the reconstruction unit 109 as generating unit generates (reconstructs) photoacoustic image data using a plurality of the electrical signals output from the probe 103.
- a back projection method or the like with time domain or Fourier domain that is normally used in a tomography technique may be used.
- the photoacoustic image data in the present invention whether in two dimension or three dimension, refers to data showing information (biological information such as in vivo initial sound pressure distribution, light absorption coefficient distribution, or oxygen saturation) inside the object.
- the photoacoustic image data is configured as an arrangement of a plurality of pixels that are the minimum block units in a two-dimensional case, and is configured as an arrangement of a plurality of voxels that are the minimum block units in a three-dimensional case.
- the reconstruction unit 109 selectively reconstructs the minimum block unit within the light intensity domain set by the light intensity domain setting unit 108 that is the setting unit out of the minimum block units forming the object 100, and generates data with which the inside of the object 100 is imaged.
- the data with which the inside of the object 100 is imaged is transferred to a display unit 110 and displayed with respect to the operator.
- the light intensity distribution calculation unit 107, the light intensity domain setting unit 108, and the reconstruction unit 109 described above may be a program installed in a computer or may be an electronic circuit.
- step S301 the measurement is started.
- step S302 that is a characteristic setting step, the operator executes a characteristic inputting step of inputting the optical characteristic value (the absorption coefficient and the equivalent scattering coefficient) of the object 100 from the optical characteristic value input unit 106.
- the input absorption coefficient and equivalent scattering coefficient are set in the light intensity distribution calculation unit 107 and the light intensity domain setting unit 108.
- step S303 that is a detecting step, the object 100 irradiated with light from the irradiation unit 101, and the elastic wave generated in the object 100 by light irradiation is detected by the transducer 102.
- the detected elastic wave is output as the received signal from the probe 103.
- step S304 that is a distribution acquiring step, the light intensity distribution inside the object 100 is calculated in the light intensity distribution calculation unit 107 using the absorption coefficient and the equivalent scattering coefficient input in step S302.
- step S305 that is a setting step, the light intensity domain is calculated and the minimum block unit inside the light intensity domain is extracted by the light intensity domain setting unit 108 using the absorption coefficient input in step S302 and the light intensity distribution obtained in step S304.
- the extracted minimum block unit is set in the reconstruction unit 109.
- step S306 that is a generating step, the minimum block unit extracted and set in step S305 is reconstructed in the reconstruction unit 109 using the received signal obtained in step S303. Accordingly, image data of the inside of the object is obtained.
- step S307 the image data of the inside of the object obtained in step S306 is displayed in the display unit 110.
- step S308 the measurement is terminated.
- the minimum block units to be reconstructed can be reduced and the time until acquisition of the object information can be shortened by selectively reconstructing the minimum block unit included in a domain having sufficient light intensity obtained from the input optical characteristic value of the object.
- an optical characteristic value of an object is actually measured and acquired, and a domain for which object information is acquired is limited based on the light intensity distribution calculated from the optical characteristic value to shorten the time required for the acquisition of the object information.
- the optical characteristic value the absorption coefficient that is an absorption characteristic value and the equivalent scattering coefficient that is a scattering characteristic value are measured.
- Fig. 4 is a diagram showing an overview of a photoacoustic imaging apparatus in a second embodiment of the present invention.
- the optical characteristic value input unit is replaced with an optical characteristic value measurement unit 403, and a light source 401 and a light detection unit 402 are added. Since other components are the same as in the first embodiment, description is omitted regarding terms that are the same. Only configurations that differ from the first embodiment will be described below.
- the light source 401 that is unit of light irradiation for optical characteristic value measurement irradiates the object 100 with light (optical characteristic value measurement light) for measuring the optical characteristic value (the absorption coefficient that is the absorption characteristic value and the equivalent scattering coefficient that is the scattering characteristic value) of the object 100. It is desirable that the wavelength of radiated light be close to the wavelength of light radiated by the irradiation unit 101.
- a light source that generates either pulsed light or intensity-modulated light may be used.
- a laser diode may be used.
- the pulse width be several to several hundreds of picoseconds (ps).
- intensity-modulated light it is desirable that the frequency of intensity modulation be several to several hundreds of megahertz.
- the light detection unit 402 that is unit of detecting light for optical characteristic value measurement detects the optical characteristic value measurement light that is radiated by the light source 401 and has propagated inside the object 100.
- a detector that responds quickly with respect to at least the pulse width or the frequency of intensity modulation is desirable.
- a photomultiplier, an avalanche photodiode, a photodiode, or the like may be used.
- a detection light signal obtained through detection of the optical characteristic value measurement light is output to the optical characteristic value measurement unit 403 that is characteristic measuring unit.
- the optical characteristic value measurement unit 403 calculates the absorption coefficient and the reduced scattering coefficient of the object 100 using the detection light signal output from the light detection unit 402. For calculation, an analytical solution or numerical solution method of transport equations, an analytical solution or numerical solution method of diffusion approximation equations, a numerical solution method using a Monte Carlo method, or the like may be used.
- the absorption coefficient and the reduced scattering coefficient are changed such that an analytical solution and the time waveform of the detection light signal match, and the absorption coefficient and the equivalent scattering coefficient at the time of a sufficient match is assumed as the absorption coefficient and the equivalent scattering coefficient of the object.
- a numerical solution of the time waveform using a numerical solution method and the time waveform of the detection light signal may be caused to match.
- an analytical solution and the detection light signal are caused to match in the decay rate of intensity modulation amplitude (amplitude decay rate) of the detection light signal with respect to the intensity modulation amplitude at the time of incidence upon the object 100 and the phase delay of the intensity modulation of the detection light signal.
- the amplitude decay rate and the phase delay using a numerical solution method may also be used.
- the absorption coefficient and the equivalent scattering coefficient of the object measured by the optical characteristic value measurement unit 403 in this manner is set in the light intensity distribution calculation unit 107 and the light intensity domain setting unit 108 by the optical characteristic value setting unit 404.
- Fig. 5 The flow of measurement in the second embodiment is shown in Fig. 5 .
- description of steps in which the same processes as in Fig. 3 are performed will be omitted.
- Step S501 is the same as step S301 in the first embodiment.
- step S502 the object 100 is irradiated with the optical characteristic value measurement light from an optical characteristic value measurement light irradiation light source 401.
- step S503 the optical characteristic value measurement light having propagated in the object 100 is detected by an optical characteristic value measurement light detector 402 to obtain the detection light signal.
- step S504 the absorption coefficient and the reduced scattering coefficient of the object 100 are calculated in the optical characteristic value measurement unit 403 using the detection light signal obtained in step S503.
- Step S505 is the same as step S303 in the first embodiment.
- step S506 that is a distribution acquiring step
- the light intensity distribution inside the object 100 is calculated in the light intensity distribution calculation unit 107 using the absorption coefficient and the reduced scattering coefficient obtained through measurement in step S503.
- step S507 that is a setting step, a light intensity domain is calculated and a minimum block unit inside the light intensity domain is extracted by the light intensity domain setting unit 108 using the absorption coefficient obtained through measurement in step S503 and the light intensity distribution obtained in step S506.
- the extracted minimum block unit is set in the reconstruction unit 109.
- Step S508 is the same as step S306 in the first embodiment.
- Step S509 is the same as step S307 in the first embodiment.
- step S510 the measurement is terminated.
- the minimum block units to be reconstructed can be reduced and the time until acquisition of the object information can be shortened by selectively reconstructing the minimum block unit included in a domain having sufficient light intensity obtained from the optical characteristic value of the object obtained through measurement.
- the domain with sufficient light intensity can be designated with higher precision.
- a domain to be imaged is limited based on the light intensity distribution inside an object prepared in advance. Accordingly, since the time of acquiring the light intensity distribution can be shortened compared to other embodiments, the time required for acquisition of object information can be shortened further.
- Fig. 6 is a diagram showing an overview of a photoacoustic imaging apparatus in the third embodiment of the present invention.
- the light intensity distribution calculation unit 107 is replaced with a light intensity distribution storage unit 601 when compared to the first embodiment. Since other components are the same as in the first embodiment, description is omitted regarding terms that are the same. Only configurations that differ from the first embodiment will be described below.
- the light intensity distribution storage unit 601 stores the light intensity distribution calculated in advance.
- the light intensity distribution can be stored as volume data showing the inside of the object 100.
- a hard disk, a non-volatile memory, or the like may be used as the light intensity distribution storage unit 601.
- the light intensity distribution to be stored can be calculated using a general optical characteristic value for a biological body. In calculating in advance the light intensity distribution to be stored, the intensity distribution pattern of irradiation light measured in advance can be reflected.
- the light intensity distribution storage unit 601 preferably can store a plurality of light intensity distributions. That is, a light intensity distribution corresponding to the optical characteristic value of the object set by the optical characteristic value setting unit 105 can be selected. Since there are endless patterns to the optical characteristic value and it is difficult to store all of the corresponding light intensity distributions at this time, it is recommended that light intensity distributions for a limited number of patterns of the optical characteristic value be stored. In the case where a certain optical characteristic value is input, one that is closest to the optical characteristic value among the limited number of optical characteristic values is selected, and a light intensity distribution corresponding to the selected optical characteristic value is used.
- the light intensity distribution is stored in the light intensity distribution storage unit 601 in this embodiment, the light intensity domain setting unit 108 may be included in the light intensity distribution storage unit 601 to store the light intensity distribution.
- Fig. 7 The flow of measurement in this embodiment is shown in Fig. 7 .
- description of steps in which the same processes as in Fig. 3 are performed will be omitted.
- Step S701 is the same as step S301.
- step S702 that is a characteristic setting step, an operator executes a characteristic inputting step of inputting an optical characteristic value (the absorption coefficient and the reduced scattering coefficient) of the object 100 from the optical characteristic value input unit 105.
- the input absorption coefficient and equivalent scattering coefficient are set in the light intensity distribution storage unit 601 and the light intensity domain setting unit 108.
- the optical characteristic value obtained through measurement of the object 100 is set in the light intensity distribution storage unit 601 and the light intensity distribution calculation unit 107.
- step S704 that is a distribution acquiring step
- the light intensity distribution corresponding to the optical characteristic value set in step S703 is read from the light intensity distribution storage unit 601 to obtain the light intensity distribution inside the object 100.
- the light intensity domain is read in the case where the light intensity domain is stored in the light intensity distribution storage unit 601. In this case, calculation of the light intensity domain in step S705 is omitted.
- Steps S705 to S708 are respectively the same as steps S305 to S308.
- a minimum block unit included in a domain having sufficient light intensity acquired from the light intensity distribution calculated in advance is selectively reconstructed. Accordingly, since the number of minimum block units to be reconstructed can be reduced and the time required for acquisition of the light intensity distribution can be shortened, the time until acquisition of the object information can be shortened further.
- the number of minimum block units to be reconstructed can be reduced and the time until acquisition of object information can be shortened compared to other embodiments by selectively reconstructing the minimum block unit included in both a domain of the directivity range of a transducer and a domain having sufficient light intensity.
- Fig. 8 is a diagram showing an overview of a photoacoustic imaging apparatus in the fourth embodiment of the present invention.
- a directivity range domain setting unit 801 is added and the behavior of the reconstruction unit 109 differs when compared to the first embodiment. Since other components are the same as in the first embodiment, description is omitted regarding terms that are the same. Only configurations that differ from the first embodiment will be described below.
- a directivity range is a domain determined by a directivity angle that is the angle in which the transducer 102 can receive an elastic wave. The directivity range will be described using Fig. 9 .
- reference numeral 901 denotes the directivity angle of one transducer 102.
- a case where the directivity angle is 20° is shown.
- An elastic wave generated in a range inside the directivity angle 901 can be detected by the transducer 102.
- an elastic wave generated in a range inside the directivity angle of any one of the plurality of transducers 102 forming the probe 103 can be output from the probe 103 as a received signal. That is, a portion shown in black in Fig. 2 among the minimum block units 201 can be reconstructed from the received signal.
- the domain shown in black is the directivity range.
- the directivity angle can be specified in various ways according to the precision desired in the measurement or the characteristic of the transducer. For example, in the case where the receiving sensitivity is maximum in the normal direction of the transducer, the directivity angle may be a range of a half width that enables reception with intensity half the maximum sensitivity.
- the directivity range domain setting unit 801 includes a directivity range storage unit 1001 that stores a value corresponding to each minimum block unit forming the object 100.
- a storage area corresponding to the minimum block units within the directivity range is set to 1, and a storage area corresponding to other minimum block units is set to 0.
- the directivity range domain setting unit 801 sets, in the reconstruction unit 109, the minimum block unit that is present inside the directivity range by outputting a value of the directivity range storage unit 1001 to the reconstruction unit 109.
- the reconstruction unit 109 selectively reconstructs the minimum block unit set in both the light intensity domain setting unit 108 that is setting unit and the directivity range domain setting unit 801 that is the directivity setting unit among the minimum block units forming the object 100. The details will be described below.
- Fig. 11 is a diagram showing the details of the reconstruction unit 109.
- Reference numeral 1101 denotes data showing the minimum block unit within the light intensity domain set by the light intensity distribution calculation unit 107
- reference numeral 1102 denotes data showing the minimum block unit within the directivity range domain set by the directivity range domain setting unit 801.
- the reconstruction unit 109 performs a multiplication operation for each minimum block unit corresponding to reference numeral 1101 and reference numeral 1102.
- the result of the multiplication operation is stored in a storage area of the corresponding minimum block unit in a reconstruction domain storage unit 1103.
- a reconstruction processing unit 1104 performs reconstruction of the minimum block unit that is set to 1 by the reconstruction domain storage unit and generates data with which the inside of the object is imaged.
- Fig. 12 The flow of measurement in this embodiment is shown in Fig. 12 .
- description of steps in which the same processes as in Fig. 3 are performed will be omitted.
- Step S1201 to step S1205 are respectively the same as step S301 to step S305.
- step S1206 that is a directivity setting step, the minimum block unit included in the domain within the directivity range of the transducer 102 is extracted.
- the extracted minimum block unit is set in the reconstruction unit 109.
- step S1207 that is a generating step
- the minimum block unit extracted and set in both step S1205 and step 1206 is reconstructed in the reconstruction unit 109 using the received signal obtained in step S1203. Accordingly, image data of the inside of the object is obtained.
- Step S1208 and step S1209 are respectively the same as step S307 and step S308.
- the number of minimum block units to be reconstructed can be reduced and the time until acquisition of the object information can be shortened compared to other embodiments by selectively reconstructing the minimum block unit included in both the domain of the directivity range of the transducer and the domain having sufficient light intensity.
- the minimum block unit included in the domain of the directivity range of the transducer may be selectively reconstructed. That is, the minimum block unit not included in the domain of the range of the directivity of the transducer may be not reconstructed. Accordingly, the time until acquisition of the object information can be shortened.
- a domain within an object to be reconstructed is set in consideration of the light intensity distribution within the object in photoacoustic imaging. Since a domain with light intensity that generates an elastic wave of sufficient sound pressure is selected and reconstructed as a result, the time until acquisition of object information can be shortened.
Landscapes
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Acoustics & Sound (AREA)
- Optics & Photonics (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
- Investigating Or Analyzing Materials By The Use Of Ultrasonic Waves (AREA)
Description
- The present invention relates to an object information acquisition apparatus.
- As one in vivo imaging technique using near-infrared light, there is photoacoustic tomography (PAT). In PAT, an object such as a biological body is irradiated with pulsed light generated from a light source, whereby light propagated and diffused within the object is absorbed by a light absorber to generate an elastic wave. This mechanism of elastic wave generation is called a photoacoustic effect. Since a tumor has a higher light energy absorption rate for near-infrared light than surrounding tissues, the tumor absorbs more light than the surrounding tissues. Thus, the tumor momentarily expands and generates an elastic wave.
- In an apparatus described in Japanese Patent Application Laid-open No.
2011-245277 - Prior art which is related to this field of technology can be found e.g. in document
JP 2012 061055 A WO 2012/144395 A1 disclosing photoacoustic imaging apparatus and method therefor, in documentJP 2012 085965 A document EP 2 345 364 A1 disclosing subject information obtaining apparatus, subject information obtaining method, and program, in documentWO 2012/086842 A1 disclosing subject information acquiring device and subject information acquiring method, in documentWO 2011/125468 A1 disclosing photoacoustic imaging apparatus, photoacoustic imaging method, and program, in documentUS 2011/0245652 A1 disclosing imaging apparatus and imaging method, and in documentWO 2011/096551 A1 disclosing photoacoustic apparatus and a method for its use to acquire biofunctional information. - The present invention in its one aspect provides an object information acquisition apparatus as specified in
claims 1 to 15. Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. -
-
Fig. 1 is a diagram showing an overview of a photoacoustic imaging apparatus in a first embodiment; -
Fig. 2 is a diagram showing the details of a light intensity domain setting unit in the first embodiment; -
Fig. 3 is a diagram showing the flow of measurement in the first embodiment; -
Fig. 4 is a diagram showing an overview of a photoacoustic imaging apparatus in a second embodiment; -
Fig. 5 is a diagram showing the flow of measurement in the second embodiment; -
Fig. 6 is a diagram showing an overview of a photoacoustic imaging apparatus in a third embodiment; -
Fig. 7 is a diagram showing the flow of measurement in the third embodiment; -
Fig. 8 is a diagram showing an overview of a photoacoustic imaging apparatus in a fourth embodiment; -
Fig. 9 is a diagram showing the directivity range in the fourth embodiment; -
Fig. 10 is a diagram showing the details of a directivity range domain setting unit in the fourth embodiment; -
Fig. 11 is a diagram showing the details of a reconstruction unit in the fourth embodiment; and -
Fig. 12 is a diagram showing the flow of measurement in the fourth embodiment. - A preferred embodiment of the present invention will be described below with reference to the drawings. Note that the dimension, material, and shape of components, the relative arrangement thereof, and the like described below should be changed appropriately depending on the configuration of an apparatus or various conditions to which the invention is applied and are not intended to limit the scope of this invention to the description below.
- In the present invention, an acoustic wave includes an elastic wave called a sound wave, ultrasound wave, photoacoustic wave, or light-induced ultrasound wave. An object information acquisition apparatus of the present invention is an apparatus utilizing a photoacoustic effect in which an acoustic wave generated within an object by irradiating the object with light (electromagnetic wave) is received and characteristic information within the object is acquired.
- Object information in the object information acquisition apparatus is the characteristic information reflecting the initial sound pressure of an acoustic wave caused by light irradiation, light energy absorption density derived from the initial sound pressure, absorption coefficient, concentration of a substance forming a tissue, or the like. The concentration of a substance is, for example, the concentration of oxygenated hemoglobin and reduced hemoglobin or oxygen saturation. The characteristic information may be distribution information of each position within an object instead of numerical data. That is, initial sound pressure distribution, absorption coefficient distribution, oxygen saturation distribution, or the like may be generated into image data.
- The present invention can be understood as a control method upon receiving an acoustic wave with the object information acquisition apparatus. In the embodiments below, a photoacoustic imaging apparatus will be described as a specific example of the object information acquisition apparatus. In the respective drawings, the same components are basically denoted by the same reference numerals, and descriptions will be omitted.
- First, the relationship of sound pressure of an elastic wave caused by a photoacoustic effect and light intensity within an object will be described. A sound pressure p0 (Pa) of the elastic wave caused by the photoacoustic effect is represented by Formula (1).
[Math. 1]
In Formula (1), µa is the absorption coefficient (mm-1) of a light absorber (tumor or the like), Γ is the Gruneisen coefficient, and Φ is the light intensity (J/mm2) at a position of the light absorber. The Gruneisen coefficient Γ is a value for which a value of the volume expansion coefficient multiplied by the square of the speed of sound is divided by the constant pressure specific heat, and takes an approximately constant value in vivo. - As can be seen from Formula (1), the generated sound pressure is proportional to light intensity. In the case where a strong light scatterer such as a biological body is the object, the light intensity Φ decays exponentially in accordance with the distance from the position irradiated with light. Therefore, the light intensity decreases due to decay, and a domain where an elastic wave with sufficient sound pressure to be detected is not generated exists. Since it is difficult to acquire the object information with high precision even if reconstruction is performed with respect to such a domain where the light intensity is low, the inventor of the present invention has found that the significance of performing the reconstruction is small.
- In a first embodiment, an optical characteristic value of the object is input to an apparatus, and a domain for which the object information is acquired is limited based on the light intensity distribution calculated from the optical characteristic value to shorten the time required for acquisition of the object information. As the optical characteristic value, the absorption coefficient that is an absorption characteristic value and the reduced scattering coefficient that is a scattering characteristic value are used.
-
Fig. 1 is a diagram showing an overview of a photoacoustic imaging apparatus in this embodiment. The configuration for acquiring information of an object will be described below. - A light source of the present invention includes at least one coherent or incoherent pulsed light source. In order to generate a photoacoustic effect, the pulse width is preferably several hundred nanoseconds or less. In the case of measurement of a breast cancer or the like, light of a specific wavelength that is absorbed by a specific constituent (for example, hemoglobin) out of constituents forming a biological body is generated. Laser with which a large output can be obtained is preferable as the light source, but it is also possible to use a light-emitting diode or the like instead of the laser. As the laser, various lasers such as solid-state laser, gas laser, dye laser, or semiconductor laser may be used.
- An
irradiation unit 101 that is irradiating unit irradiates anobject 100 with irradiation light from the light source with a method suitable for photoacoustic measurement. In order to increase the SN ratio of a received signal, not only a part of surfaces but also a plurality of surfaces of the object may be irradiated with light. For example, theirradiation unit 101 may be provided not only on the side opposing aprobe 103 with respect to the object but also on the same side. Theirradiation unit 101 includes a mirror, a lens that collects, magnifies, or changes the shape of light, a prism that disperses, refracts, or reflects light, or an optical fiber. Any such optical part aside from those mentioned above may also be used as long as an object can be irradiated with light emitted from a light source with a desired method (irradiation direction, shape, or the like). - With a
transducer 102 that is detecting unit, an elastic wave generated by theobject 100 being irradiated with light is received and converted to an electrical signal that is the received signal. Thetransducer 102 is configured of a transducer using a piezoelectric phenomenon, a transducer using optical resonance, a transducer using capacity change, or the like. Any transducer with which an elastic wave can be received and converted to an electrical signal may be used. In this embodiment, a plurality of thetransducers 102 are present in order to receive elastic waves in different positions. The plurality oftransducers 102 are, for example, arranged one-dimensionally or two-dimensionally to form theprobe 103. Theprobe 103 outputs the electrical signal generated by the plurality oftransducers 102 to areconstruction unit 109. - An optical characteristic
value input unit 106 that is characteristic input unit includes an interface that accepts an input of the optical characteristic value (absorption coefficient and reduced scattering coefficient) of theobject 100 performed by an operator. For example, in the case where theobject 100 is a biological body, a general value for a biological body may be input or a known statistical value according to a characteristic, e.g., age, of theobject 100 may be input as the absorption coefficient and the reduced scattering coefficient. Alternatively, it may be such that, when an input of age or sex is received, a value according thereto is set automatically. - An optical characteristic
value setting unit 105 that is characteristic setting unit sets the absorption coefficient and the reduced scattering coefficient input to the optical characteristicvalue input unit 106 in a light intensitydistribution calculation unit 107. - The light intensity
distribution calculation unit 107 uses the absorption coefficient and the equivalent scattering coefficient set by the optical characteristicvalue setting unit 105 to calculate the light intensity distribution inside theobject 100. The light intensity distribution calculation unit is distribution acquiring unit of the present invention. As a calculation method for the light intensity distribution, a numerical solution method of transport equations, a numerical solution method of diffusion approximation equations, a numerical solution method using a Monte Carlo method, or the like may be used. It is desirable that an intensity distribution pattern of irradiation light be reflected in the calculation of the light intensity distribution. Accordingly, the precision of calculation of the light intensity distribution can be improved. For example, it is recommended that theirradiation unit 101 be able to monitor the intensity distribution pattern of irradiation light and that the intensity distribution pattern be input to the light intensity distribution calculation unit. - With a light intensity
domain setting unit 108 that is setting unit, a minimum block unit within a light intensity domain that is a domain having a light intensity of a predetermined threshold value or greater is extracted and set in thereconstruction unit 109. As the threshold value of light intensity, light intensity with which a minimum sound pressure detectable by thetransducer 102 is generated can be utilized, for example. - The predetermined threshold value may differ for each minimum block unit. A calculation method therefor will be described below.
- Formula (2) represents a decay compensation noise equivalent sound pressure value pNEP_c(r) described later. A threshold value Φth(r) of light intensity of the minimum block unit of a position vector r is represented by Formula (3) that is a deformation of Formula (1).
[Math. 2]
In Formula (2), pNEP is the noise equivalent sound pressure for which the intensity of noise included in the electrical signal that is the received signal is divided by the conversion efficiency in the conversion of the sound pressure to the electrical signal by thetransducer 102. The unit for the conversion efficiency is V/Pa in the case where the electrical signal is a voltage. In Formula (2), A(α, max(|di-r|)) is the decay ratio of sound pressure upon propagation of an elastic wave between thetransducer 102 of a position vector di (where i is a number showing each of the plurality of transducers 102) and the minimum block unit. The decay coefficient (mm-1) of theobject 100 and max|d--r| that is the greatest among distances |di-r| of the i-th transducer 102 and the minimum block unit determine A. The decay of sound pressure includes distance-dependent decay by a decay coefficient α and distance-dependent decay due to energy dissipation in spherical wave propagation, cylindrical wave propagation, or the like. - The noise equivalent sound pressure pNEP is divided and corrected by the decay ratio A for pNEP_c(r) that is the decay compensation noise equivalent sound pressure value. That is, if the minimum block unit of the position vector r has generated an elastic wave of a sound pressure of pNEP_c(r), the elastic wave is detected by the
transducer 102. Thus, through correction using the decay ratio in the greatest distance max|di-r| in which the sound pressure decays most, it can be guaranteed that a transducer in a distance nearer than max|di-r| can detect the elastic wave. - The absorption coefficient of the
object 100 set in the light intensitydistribution calculation unit 107 by the optical characteristicvalue setting unit 105 is µa_BG. The absorption coefficient of tumor presumably has a value greater with respect to µa_BG that is an average coefficient of theobject 100. This is because a tumor is rich in blood of a large absorption coefficient since new blood vessels are drawn in. From Formula (1), the sound pressure of the generated elastic wave is small when the absorption coefficient is small. Therefore, at least when Φth(r) obtained using µa_BG is the threshold value, an elastic wave caused by the tumor that is a target for imaging can be detected. In Formula (3), Γ is the Gruneisen coefficient, and it is recommended that a value typical for a biological body be input in the case where theobject 100 is a biological body, for example. - The light intensity
domain setting unit 108 calculates the threshold value of light intensity for each minimum block unit in a manner described above. - Next, the light intensity domain will be described.
Fig. 2 is a diagram showing the details of the light intensitydomain setting unit 108.Reference numeral 202 in the upper left in the drawing shows the light intensity distribution calculated by the light intensitydistribution calculation unit 107. The intensity of the light is stronger when nearer theirradiation unit 101. Thelight intensity distribution 202 is output to the light intensitydomain setting unit 108 as alight intensity distribution 203 for eachminimum block unit 201. - In the light intensity
domain setting unit 108 on the right side in the drawing, Φi shown in thelight intensity distribution 203 for each minimum block unit shows the light intensity of the minimum block unit of the number i. When the position vector of the i-th minimum block unit is ri, Φi = Φ(ri) (where Φ(ri) is the light intensity of the minimum block unit of the position vector ri).Reference numeral 204 denotes a threshold value of light intensity for each minimum block unit that is calculated for each minimum block unit by Formula (2) and Formula (3). The threshold value of light intensity of the minimum block unit of the number i is shown by Φti shown in thethreshold value 204 of light intensity for each minimum block unit. In a similar manner to reference numeral 203, Φti = Φth(ri). - The light intensity
domain setting unit 108 further includes a light intensitydomain storage unit 205 that stores a value corresponding to each minimum block unit forming theobject 100. The light intensitydomain setting unit 108 compares Φi and Φti of the same number i, and sets 1 in a storage area for the corresponding minimum block unit in the light intensitydomain storage unit 205 if Φi ≥ Φti. The light intensitydomain setting unit 108sets 0 in a storage area other than for the corresponding minimum block unit. A domain of black minimum block units shown in the light intensitydomain storage unit 205 is a light intensity domain. The light intensitydomain setting unit 108 sets the minimum block unit within the light intensity domain in thereconstruction unit 109 by outputting a value in the light intensitydomain storage unit 205 to thereconstruction unit 109. - The
reconstruction unit 109 as generating unit generates (reconstructs) photoacoustic image data using a plurality of the electrical signals output from theprobe 103. As a method of reconstruction, a back projection method or the like with time domain or Fourier domain that is normally used in a tomography technique may be used. The photoacoustic image data in the present invention, whether in two dimension or three dimension, refers to data showing information (biological information such as in vivo initial sound pressure distribution, light absorption coefficient distribution, or oxygen saturation) inside the object. The photoacoustic image data is configured as an arrangement of a plurality of pixels that are the minimum block units in a two-dimensional case, and is configured as an arrangement of a plurality of voxels that are the minimum block units in a three-dimensional case. - The
reconstruction unit 109 selectively reconstructs the minimum block unit within the light intensity domain set by the light intensitydomain setting unit 108 that is the setting unit out of the minimum block units forming theobject 100, and generates data with which the inside of theobject 100 is imaged. - The data with which the inside of the
object 100 is imaged is transferred to adisplay unit 110 and displayed with respect to the operator. - The light intensity
distribution calculation unit 107, the light intensitydomain setting unit 108, and thereconstruction unit 109 described above may be a program installed in a computer or may be an electronic circuit. - The flow of measurement in this embodiment is shown in
Fig. 3 . - In step S301, the measurement is started.
- In step S302 that is a characteristic setting step, the operator executes a characteristic inputting step of inputting the optical characteristic value (the absorption coefficient and the equivalent scattering coefficient) of the
object 100 from the optical characteristicvalue input unit 106. The input absorption coefficient and equivalent scattering coefficient are set in the light intensitydistribution calculation unit 107 and the light intensitydomain setting unit 108. - In step S303 that is a detecting step, the
object 100 irradiated with light from theirradiation unit 101, and the elastic wave generated in theobject 100 by light irradiation is detected by thetransducer 102. The detected elastic wave is output as the received signal from theprobe 103. - In step S304 that is a distribution acquiring step, the light intensity distribution inside the
object 100 is calculated in the light intensitydistribution calculation unit 107 using the absorption coefficient and the equivalent scattering coefficient input in step S302. - In step S305 that is a setting step, the light intensity domain is calculated and the minimum block unit inside the light intensity domain is extracted by the light intensity
domain setting unit 108 using the absorption coefficient input in step S302 and the light intensity distribution obtained in step S304. The extracted minimum block unit is set in thereconstruction unit 109. - In step S306 that is a generating step, the minimum block unit extracted and set in step S305 is reconstructed in the
reconstruction unit 109 using the received signal obtained in step S303. Accordingly, image data of the inside of the object is obtained. - In step S307, the image data of the inside of the object obtained in step S306 is displayed in the
display unit 110. - In step S308, the measurement is terminated.
- In the first embodiment, the minimum block units to be reconstructed can be reduced and the time until acquisition of the object information can be shortened by selectively reconstructing the minimum block unit included in a domain having sufficient light intensity obtained from the input optical characteristic value of the object.
- In a second embodiment, an optical characteristic value of an object is actually measured and acquired, and a domain for which object information is acquired is limited based on the light intensity distribution calculated from the optical characteristic value to shorten the time required for the acquisition of the object information. As the optical characteristic value, the absorption coefficient that is an absorption characteristic value and the equivalent scattering coefficient that is a scattering characteristic value are measured.
-
Fig. 4 is a diagram showing an overview of a photoacoustic imaging apparatus in a second embodiment of the present invention. In the second embodiment, when compared to the first embodiment, the optical characteristic value input unit is replaced with an optical characteristicvalue measurement unit 403, and alight source 401 and alight detection unit 402 are added. Since other components are the same as in the first embodiment, description is omitted regarding terms that are the same. Only configurations that differ from the first embodiment will be described below. - The
light source 401 that is unit of light irradiation for optical characteristic value measurement irradiates theobject 100 with light (optical characteristic value measurement light) for measuring the optical characteristic value (the absorption coefficient that is the absorption characteristic value and the equivalent scattering coefficient that is the scattering characteristic value) of theobject 100. It is desirable that the wavelength of radiated light be close to the wavelength of light radiated by theirradiation unit 101. For thelight source 401, a light source that generates either pulsed light or intensity-modulated light may be used. For example, a laser diode may be used. In the case of pulsed light, it is desirable that the pulse width be several to several hundreds of picoseconds (ps). In the case of intensity-modulated light, it is desirable that the frequency of intensity modulation be several to several hundreds of megahertz. - The
light detection unit 402 that is unit of detecting light for optical characteristic value measurement detects the optical characteristic value measurement light that is radiated by thelight source 401 and has propagated inside theobject 100. A detector that responds quickly with respect to at least the pulse width or the frequency of intensity modulation is desirable. For example, a photomultiplier, an avalanche photodiode, a photodiode, or the like may be used. A detection light signal obtained through detection of the optical characteristic value measurement light is output to the optical characteristicvalue measurement unit 403 that is characteristic measuring unit. - The optical characteristic
value measurement unit 403 calculates the absorption coefficient and the reduced scattering coefficient of theobject 100 using the detection light signal output from thelight detection unit 402. For calculation, an analytical solution or numerical solution method of transport equations, an analytical solution or numerical solution method of diffusion approximation equations, a numerical solution method using a Monte Carlo method, or the like may be used. - In the case where the
light source 401 generates pulsed light, the absorption coefficient and the reduced scattering coefficient are changed such that an analytical solution and the time waveform of the detection light signal match, and the absorption coefficient and the equivalent scattering coefficient at the time of a sufficient match is assumed as the absorption coefficient and the equivalent scattering coefficient of the object. In a similar manner, a numerical solution of the time waveform using a numerical solution method and the time waveform of the detection light signal may be caused to match. - In the case where the
light source 401 generates intensity-modulated light, an analytical solution and the detection light signal are caused to match in the decay rate of intensity modulation amplitude (amplitude decay rate) of the detection light signal with respect to the intensity modulation amplitude at the time of incidence upon theobject 100 and the phase delay of the intensity modulation of the detection light signal. The amplitude decay rate and the phase delay using a numerical solution method may also be used. - The absorption coefficient and the equivalent scattering coefficient of the object measured by the optical characteristic
value measurement unit 403 in this manner is set in the light intensitydistribution calculation unit 107 and the light intensitydomain setting unit 108 by the optical characteristicvalue setting unit 404. - The flow of measurement in the second embodiment is shown in
Fig. 5 . ForFig. 5 , description of steps in which the same processes as inFig. 3 are performed will be omitted. - Step S501 is the same as step S301 in the first embodiment.
- In step S502, the
object 100 is irradiated with the optical characteristic value measurement light from an optical characteristic value measurement lightirradiation light source 401. - In step S503, the optical characteristic value measurement light having propagated in the
object 100 is detected by an optical characteristic valuemeasurement light detector 402 to obtain the detection light signal. - In step S504, the absorption coefficient and the reduced scattering coefficient of the
object 100 are calculated in the optical characteristicvalue measurement unit 403 using the detection light signal obtained in step S503. - Step S505 is the same as step S303 in the first embodiment.
- In step S506 that is a distribution acquiring step, the light intensity distribution inside the
object 100 is calculated in the light intensitydistribution calculation unit 107 using the absorption coefficient and the reduced scattering coefficient obtained through measurement in step S503. - In step S507 that is a setting step, a light intensity domain is calculated and a minimum block unit inside the light intensity domain is extracted by the light intensity
domain setting unit 108 using the absorption coefficient obtained through measurement in step S503 and the light intensity distribution obtained in step S506. The extracted minimum block unit is set in thereconstruction unit 109. - Step S508 is the same as step S306 in the first embodiment.
- Step S509 is the same as step S307 in the first embodiment.
- In step S510, the measurement is terminated.
- In the second embodiment, the minimum block units to be reconstructed can be reduced and the time until acquisition of the object information can be shortened by selectively reconstructing the minimum block unit included in a domain having sufficient light intensity obtained from the optical characteristic value of the object obtained through measurement. By using the absorption coefficient and the reduced scattering coefficient of the object obtained through measurement, the domain with sufficient light intensity can be designated with higher precision.
- In a third embodiment, a domain to be imaged is limited based on the light intensity distribution inside an object prepared in advance. Accordingly, since the time of acquiring the light intensity distribution can be shortened compared to other embodiments, the time required for acquisition of object information can be shortened further.
-
Fig. 6 is a diagram showing an overview of a photoacoustic imaging apparatus in the third embodiment of the present invention. In the third embodiment, the light intensitydistribution calculation unit 107 is replaced with a light intensitydistribution storage unit 601 when compared to the first embodiment. Since other components are the same as in the first embodiment, description is omitted regarding terms that are the same. Only configurations that differ from the first embodiment will be described below. - The light intensity
distribution storage unit 601 stores the light intensity distribution calculated in advance. For example, the light intensity distribution can be stored as volume data showing the inside of theobject 100. As the light intensitydistribution storage unit 601, a hard disk, a non-volatile memory, or the like may be used. The light intensity distribution to be stored can be calculated using a general optical characteristic value for a biological body. In calculating in advance the light intensity distribution to be stored, the intensity distribution pattern of irradiation light measured in advance can be reflected. - Note that the light intensity
distribution storage unit 601 preferably can store a plurality of light intensity distributions. That is, a light intensity distribution corresponding to the optical characteristic value of the object set by the optical characteristicvalue setting unit 105 can be selected. Since there are endless patterns to the optical characteristic value and it is difficult to store all of the corresponding light intensity distributions at this time, it is recommended that light intensity distributions for a limited number of patterns of the optical characteristic value be stored. In the case where a certain optical characteristic value is input, one that is closest to the optical characteristic value among the limited number of optical characteristic values is selected, and a light intensity distribution corresponding to the selected optical characteristic value is used. - Note that a general value for a biological body, a statistical value according to the characteristic of the
object 100, a measured value obtained through measurement of theobject 100, or the like may be used for the optical characteristic value to be set. Although the light intensity distribution is stored in the light intensitydistribution storage unit 601 in this embodiment, the light intensitydomain setting unit 108 may be included in the light intensitydistribution storage unit 601 to store the light intensity distribution. - The flow of measurement in this embodiment is shown in
Fig. 7 . ForFig. 7 , description of steps in which the same processes as inFig. 3 are performed will be omitted. - Step S701 is the same as step S301.
- In step S702 that is a characteristic setting step, an operator executes a characteristic inputting step of inputting an optical characteristic value (the absorption coefficient and the reduced scattering coefficient) of the
object 100 from the optical characteristicvalue input unit 105. The input absorption coefficient and equivalent scattering coefficient are set in the light intensitydistribution storage unit 601 and the light intensitydomain setting unit 108. Alternatively, the optical characteristic value obtained through measurement of theobject 100 is set in the light intensitydistribution storage unit 601 and the light intensitydistribution calculation unit 107. - In step S704 that is a distribution acquiring step, the light intensity distribution corresponding to the optical characteristic value set in step S703 is read from the light intensity
distribution storage unit 601 to obtain the light intensity distribution inside theobject 100. Alternatively, the light intensity domain is read in the case where the light intensity domain is stored in the light intensitydistribution storage unit 601. In this case, calculation of the light intensity domain in step S705 is omitted. - Steps S705 to S708 are respectively the same as steps S305 to S308.
- In the third embodiment, a minimum block unit included in a domain having sufficient light intensity acquired from the light intensity distribution calculated in advance is selectively reconstructed. Accordingly, since the number of minimum block units to be reconstructed can be reduced and the time required for acquisition of the light intensity distribution can be shortened, the time until acquisition of the object information can be shortened further.
- In a fourth embodiment, the number of minimum block units to be reconstructed can be reduced and the time until acquisition of object information can be shortened compared to other embodiments by selectively reconstructing the minimum block unit included in both a domain of the directivity range of a transducer and a domain having sufficient light intensity.
-
Fig. 8 is a diagram showing an overview of a photoacoustic imaging apparatus in the fourth embodiment of the present invention. In the fourth embodiment, a directivity rangedomain setting unit 801 is added and the behavior of thereconstruction unit 109 differs when compared to the first embodiment. Since other components are the same as in the first embodiment, description is omitted regarding terms that are the same. Only configurations that differ from the first embodiment will be described below. - With the directivity range
domain setting unit 801 that is directivity setting unit, the minimum block unit within the directivity range of thetransducer 102 among the minimum block units forming theobject 100 is extracted and set in thereconstruction unit 109. A directivity range is a domain determined by a directivity angle that is the angle in which thetransducer 102 can receive an elastic wave. The directivity range will be described usingFig. 9 . - In
Fig. 9 ,reference numeral 901 denotes the directivity angle of onetransducer 102. Herein, a case where the directivity angle is 20° is shown. An elastic wave generated in a range inside thedirectivity angle 901 can be detected by thetransducer 102. Thus, an elastic wave generated in a range inside the directivity angle of any one of the plurality oftransducers 102 forming theprobe 103 can be output from theprobe 103 as a received signal. That is, a portion shown in black inFig. 2 among theminimum block units 201 can be reconstructed from the received signal. The domain shown in black is the directivity range. Note that the directivity angle can be specified in various ways according to the precision desired in the measurement or the characteristic of the transducer. For example, in the case where the receiving sensitivity is maximum in the normal direction of the transducer, the directivity angle may be a range of a half width that enables reception with intensity half the maximum sensitivity. - As shown in
Fig. 10 , the directivity rangedomain setting unit 801 includes a directivityrange storage unit 1001 that stores a value corresponding to each minimum block unit forming theobject 100. In the directivityrange storage unit 1001, a storage area corresponding to the minimum block units within the directivity range is set to 1, and a storage area corresponding to other minimum block units is set to 0. The directivity rangedomain setting unit 801 sets, in thereconstruction unit 109, the minimum block unit that is present inside the directivity range by outputting a value of the directivityrange storage unit 1001 to thereconstruction unit 109. - The
reconstruction unit 109 selectively reconstructs the minimum block unit set in both the light intensitydomain setting unit 108 that is setting unit and the directivity rangedomain setting unit 801 that is the directivity setting unit among the minimum block units forming theobject 100. The details will be described below. -
Fig. 11 is a diagram showing the details of thereconstruction unit 109.Reference numeral 1101 denotes data showing the minimum block unit within the light intensity domain set by the light intensitydistribution calculation unit 107, andreference numeral 1102 denotes data showing the minimum block unit within the directivity range domain set by the directivity rangedomain setting unit 801. Thereconstruction unit 109 performs a multiplication operation for each minimum block unit corresponding to reference numeral 1101 andreference numeral 1102. The result of the multiplication operation is stored in a storage area of the corresponding minimum block unit in a reconstructiondomain storage unit 1103. Areconstruction processing unit 1104 performs reconstruction of the minimum block unit that is set to 1 by the reconstruction domain storage unit and generates data with which the inside of the object is imaged. - The flow of measurement in this embodiment is shown in
Fig. 12 . ForFig. 12 , description of steps in which the same processes as inFig. 3 are performed will be omitted. - Step S1201 to step S1205 are respectively the same as step S301 to step S305.
- In step S1206 that is a directivity setting step, the minimum block unit included in the domain within the directivity range of the
transducer 102 is extracted. The extracted minimum block unit is set in thereconstruction unit 109. - In step S1207 that is a generating step, the minimum block unit extracted and set in both step S1205 and step 1206 is reconstructed in the
reconstruction unit 109 using the received signal obtained in step S1203. Accordingly, image data of the inside of the object is obtained. - Step S1208 and step S1209 are respectively the same as step S307 and step S308.
- In the fourth embodiment above, the number of minimum block units to be reconstructed can be reduced and the time until acquisition of the object information can be shortened compared to other embodiments by selectively reconstructing the minimum block unit included in both the domain of the directivity range of the transducer and the domain having sufficient light intensity.
- Note that the minimum block unit included in the domain of the directivity range of the transducer may be selectively reconstructed. That is, the minimum block unit not included in the domain of the range of the directivity of the transducer may be not reconstructed. Accordingly, the time until acquisition of the object information can be shortened.
- With the present invention, as described above, a domain within an object to be reconstructed is set in consideration of the light intensity distribution within the object in photoacoustic imaging. Since a domain with light intensity that generates an elastic wave of sufficient sound pressure is selected and reconstructed as a result, the time until acquisition of object information can be shortened.
- While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
Claims (15)
- An object information acquisition apparatus comprising:an irradiating unit (101) configured to irradiate an object (100) with light;a plurality of detecting units (102) configured to receive an elastic wave generated by irradiating the object (100) with light and convert the elastic wave to a signal;a distribution acquiring unit (107, 601) configured to acquire a light intensity distribution within the object (100);characterized bya setting unit (108) configured to select a minimum block unit within a light intensity domain in which light intensity is greater than or equal to a predetermined threshold value, using the light intensity distribution; anda generating unit (109) configured to generate image data representing object information in the object by selectively reconstructing the minimum block unit selected by the setting unit (108), using the signal.
- The object information acquisition apparatus according to claim 1, further comprising a characteristic setting unit configured to set an optical characteristic value of the object, wherein the distribution acquiring unit is configured to acquire the light intensity distribution using the optical characteristic value set by the characteristic setting unit.
- The object information acquisition apparatus according to claim 2, wherein the optical characteristic value is an absorption characteristic value showing an absorption characteristic of the object and a scattering characteristic value showing a scattering characteristic.
- The object information acquisition apparatus according to claim 3, wherein the setting unit is configured to assume a value obtained by dividing a noise equivalent sound pressure of the signal by the absorption characteristic value and a Gruneisen coefficient of the object as the predetermined threshold value.
- The object information acquisition apparatus according to claim 4, wherein the setting unit is configured to correct, upon calculating the predetermined threshold value for each of the minimum block units, the noise equivalent sound pressure with a decay ratio of sound pressure upon propagation of the elastic wave between that minimum block unit and the detecting unit.
- The object information acquisition apparatus according to claim 3, wherein the setting unit is configured to set the predetermined threshold value such that an elastic wave generated from a minimum block unit of which the absorption characteristic value is greater than an average value of the object can be detected.
- The object information acquisition apparatus according to claim 2, wherein the characteristic setting unit includes a characteristic input unit configured to input the optical characteristic value.
- The object information acquisition apparatus according to claim 7, wherein the characteristic input unit is configured to accept an input of the optical characteristic value performed by an operator.
- The object information acquisition apparatus according to claim 2, wherein the characteristic setting unit includes a characteristic measuring unit configured to measure the optical characteristic value.
- The object information acquisition apparatus according to claim 9, wherein the characteristic measuring unit includes a unit configured to irradiate the object with optical characteristic value measurement light for measuring the optical characteristic value, and a unit configured to detect light resulting from the optical characteristic value measurement light having propagated through the object.
- The object information acquisition apparatus according to claim 1, further comprising a distribution storage unit configured to store a light intensity distribution acquired in advance, wherein the distribution acquiring unit is configured to acquire the light intensity distribution from the distribution storage unit.
- The object information acquisition apparatus according to claim 11, further comprising a characteristic setting unit configured to set an optical characteristic value of the object, wherein the distribution acquiring unit is configured to select a light intensity distribution corresponding to the optical characteristic value set by the characteristic setting unit from a plurality of the light intensity distributions stored in the distribution storage unit.
- The object information acquisition apparatus according to any one of claims 1 to 12, further comprising a directivity setting unit configured to select a minimum block unit included in a directivity range domain determined by a directivity angle of the detecting unit, wherein the generating unit is configured to reconstruct a minimum block unit included in both the minimum block unit selected by the setting unit and the minimum block unit selected by the directivity setting unit.
- The object information acquisition apparatus according to any one of claims 1 to 12, wherein the generating unit is configured not to reconstruct a minimum block other than the minimum block unit selected by the setting unit.
- The object information acquisition apparatus according to claim 13, wherein the generating unit is configured not to reconstruct a minimum block unit other than the minimum block unit included in both the minimum block unit selected by the setting unit and the minimum block unit selected by the directivity setting unit.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012251317 | 2012-11-15 |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2732756A1 EP2732756A1 (en) | 2014-05-21 |
EP2732756B1 true EP2732756B1 (en) | 2019-09-11 |
Family
ID=49515199
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13190007.8A Not-in-force EP2732756B1 (en) | 2012-11-15 | 2013-10-24 | Object information acquisition apparatus |
Country Status (4)
Country | Link |
---|---|
US (1) | US9566006B2 (en) |
EP (1) | EP2732756B1 (en) |
JP (1) | JP6296759B2 (en) |
CN (1) | CN103815929B (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6366367B2 (en) | 2013-06-21 | 2018-08-01 | キヤノン株式会社 | SUBJECT INFORMATION ACQUISITION DEVICE, CONTROL METHOD FOR SUBJECT INFORMATION ACQUISITION DEVICE, AND PROGRAM |
JP6422330B2 (en) * | 2014-12-22 | 2018-11-14 | キヤノン株式会社 | Subject information acquisition apparatus, information processing apparatus, and processing method |
US20170325693A1 (en) * | 2016-05-10 | 2017-11-16 | Canon Kabushiki Kaisha | Photoacoustic apparatus and control method of photoacoustic apparatus |
JP6946307B2 (en) | 2016-08-30 | 2021-10-06 | キヤノン株式会社 | Information acquisition device and signal processing method |
CN113456067B (en) * | 2021-06-24 | 2023-06-23 | 江西科莱富健康科技有限公司 | Method, system and computer equipment for measuring in-vitro hemoglobin concentration |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4739363B2 (en) * | 2007-05-15 | 2011-08-03 | キヤノン株式会社 | Biological information imaging apparatus, biological information analysis method, and biological information imaging method |
JP5496098B2 (en) * | 2008-08-27 | 2014-05-21 | キヤノン株式会社 | Subject information acquisition apparatus and control method thereof |
JP4900979B2 (en) | 2008-08-27 | 2012-03-21 | キヤノン株式会社 | Photoacoustic apparatus and probe for receiving photoacoustic waves |
JP5541662B2 (en) * | 2008-09-12 | 2014-07-09 | キヤノン株式会社 | Subject information acquisition apparatus and control method thereof |
JP2010068885A (en) * | 2008-09-17 | 2010-04-02 | Canon Inc | Measurement apparatus |
JP5235586B2 (en) * | 2008-10-03 | 2013-07-10 | キヤノン株式会社 | Biological information processing apparatus and biological information processing method |
JP5566456B2 (en) * | 2009-06-29 | 2014-08-06 | ヘルムホルツ・ツェントルム・ミュンヒェン・ドイチェス・フォルシュンクスツェントルム・フューア・ゲズントハイト・ウント・ウムベルト(ゲーエムベーハー) | Imaging apparatus and imaging method, computer program, and computer readable storage medium for thermoacoustic imaging of a subject |
JP5538855B2 (en) * | 2009-12-11 | 2014-07-02 | キヤノン株式会社 | Photoacoustic apparatus and method for controlling the apparatus |
JP5451414B2 (en) * | 2010-01-18 | 2014-03-26 | キヤノン株式会社 | Subject information processing apparatus and subject information processing method |
JP5818444B2 (en) | 2010-02-04 | 2015-11-18 | キヤノン株式会社 | Function information acquisition apparatus, function information acquisition method, and program |
JP5441795B2 (en) * | 2010-03-31 | 2014-03-12 | キヤノン株式会社 | Imaging apparatus and imaging method |
JP5773578B2 (en) * | 2010-04-08 | 2015-09-02 | キヤノン株式会社 | SUBJECT INFORMATION ACQUISITION DEVICE, CONTROL METHOD AND PROGRAM FOR SUBJECT INFORMATION ACQUISITION DEVICE |
JP5777358B2 (en) | 2010-04-27 | 2015-09-09 | キヤノン株式会社 | Subject information acquisition apparatus and signal processing method |
JP5627360B2 (en) * | 2010-09-14 | 2014-11-19 | キヤノン株式会社 | Photoacoustic imaging apparatus and control method thereof |
JP5648957B2 (en) * | 2010-10-22 | 2015-01-07 | 浜松ホトニクス株式会社 | Breast measuring device |
JP6151882B2 (en) * | 2010-12-24 | 2017-06-21 | キヤノン株式会社 | Subject information acquisition apparatus and subject information acquisition method |
JP2012152544A (en) * | 2011-01-07 | 2012-08-16 | Canon Inc | Measuring apparatus |
JP5783779B2 (en) * | 2011-04-18 | 2015-09-24 | キヤノン株式会社 | Subject information acquisition apparatus and subject information acquisition method |
US9610043B2 (en) * | 2012-06-13 | 2017-04-04 | Seno Medical Instruments, Inc. | System and method for producing parametric maps of optoacoustic data |
-
2013
- 2013-10-24 EP EP13190007.8A patent/EP2732756B1/en not_active Not-in-force
- 2013-11-06 JP JP2013230490A patent/JP6296759B2/en active Active
- 2013-11-06 US US14/073,184 patent/US9566006B2/en active Active
- 2013-11-12 CN CN201310562373.3A patent/CN103815929B/en not_active Expired - Fee Related
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
US9566006B2 (en) | 2017-02-14 |
CN103815929B (en) | 2017-05-31 |
EP2732756A1 (en) | 2014-05-21 |
JP2014113466A (en) | 2014-06-26 |
JP6296759B2 (en) | 2018-03-20 |
US20140135610A1 (en) | 2014-05-15 |
CN103815929A (en) | 2014-05-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10342436B2 (en) | Object information acquiring apparatus and processing method | |
JP5235586B2 (en) | Biological information processing apparatus and biological information processing method | |
US9741111B2 (en) | Subject information acquiring device and subject information acquiring method | |
US20100191109A1 (en) | Biological information processing apparatus and biological information processing method | |
JP4469903B2 (en) | Biological information imaging device | |
EP2533697B1 (en) | Photoacoustic imaging apparatus and photoacoustic imaging method | |
EP2826417B1 (en) | Object information acquiring apparatus and method for controlling object information acquiring apparatus | |
EP2002784A1 (en) | Intravital-information imaging apparatus | |
US10531798B2 (en) | Photoacoustic information acquiring apparatus and processing method | |
JP5441795B2 (en) | Imaging apparatus and imaging method | |
EP2382917B2 (en) | Display data obtaining apparatus and display data obtaining method | |
EP2732756B1 (en) | Object information acquisition apparatus | |
EP3138481B1 (en) | Object information acquiring apparatus and control method for object information acquiring apparatus | |
US20140296690A1 (en) | Object information acquiring apparatus and object information acquiring method | |
US10034611B2 (en) | Subject information obtaining apparatus and subject information obtaining method | |
JP5183406B2 (en) | Biological information processing apparatus and biological information processing method | |
US20170143278A1 (en) | Object information acquiring apparatus and signal processing method | |
US20170215804A1 (en) | Object information acquiring apparatus and signal processing method | |
EP3142543B1 (en) | Photoacoustic apparatus | |
US20160374565A1 (en) | Object information acquiring apparatus, object information acquiring method, and storage medium | |
JP5575293B2 (en) | Subject information acquisition apparatus and subject information acquisition method | |
JP2017086173A (en) | Subject information acquisition device and control method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20131024 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
R17P | Request for examination filed (corrected) |
Effective date: 20141121 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20181004 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20190320 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1177420 Country of ref document: AT Kind code of ref document: T Effective date: 20190915 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013060294 Country of ref document: DE Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20190911 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191211 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191211 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191212 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1177420 Country of ref document: AT Kind code of ref document: T Effective date: 20190911 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200113 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200224 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013060294 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG2D | Information on lapse in contracting state deleted |
Ref country code: IS |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191024 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191031 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191031 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200112 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20191031 |
|
26N | No opposition filed |
Effective date: 20200615 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191031 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20191211 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191211 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191111 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191024 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20131024 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190911 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20220616 Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602013060294 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240501 |