US20060241496A1 - Filter for use with imaging endoscopes - Google Patents
Filter for use with imaging endoscopes Download PDFInfo
- Publication number
- US20060241496A1 US20060241496A1 US11/122,267 US12226705A US2006241496A1 US 20060241496 A1 US20060241496 A1 US 20060241496A1 US 12226705 A US12226705 A US 12226705A US 2006241496 A1 US2006241496 A1 US 2006241496A1
- Authority
- US
- United States
- Prior art keywords
- light
- filter
- fluorescence
- endoscope
- image sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/043—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00006—Operational features of endoscopes characterised by electronic signal processing of control signals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00064—Constructional details of the endoscope body
- A61B1/00071—Insertion part of the endoscope body
- A61B1/0008—Insertion part of the endoscope body characterised by distal tip features
- A61B1/00101—Insertion part of the endoscope body characterised by distal tip features the distal tip features being detachable
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00163—Optical arrangements
- A61B1/00186—Optical arrangements with imaging filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/05—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0646—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with illumination filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0655—Control therefor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0661—Endoscope light sources
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
- G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
- G02B23/2407—Optical details
- G02B23/2423—Optical details of the distal end
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/555—Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
Definitions
- the present invention relates to medical imaging systems in general, and in particular to fluorescence endoscopy video systems.
- Fluorescence endoscopy utilizes differences in the fluorescence response of normal tissue and tissue suspicious for early cancer as a tool in the detection and localization of such cancer.
- the fluorescing compounds or fluorophores that are excited during fluorescence endoscopy may be exogenously applied photo-active drugs that accumulate preferentially in suspicious tissues, or they may be the endogenous fluorophores that are present in all tissue. In the latter case, the fluorescence from the tissue is typically referred to as autofluorescence or native fluorescence.
- Tissue autofluorescence is typically due to fluorophores with absorption bands in the UV and blue portion of the visible spectrum and emission bands in the green to red portions of the visible spectrum. In tissue suspicious for early cancer, the green portion of the autofluorescence spectrum is significantly suppressed. Fluorescence endoscopy that is based on tissue autofluorescence utilizes this spectral difference to distinguish normal from suspicious tissue.
- Fluorescence endoscopy is consequently performed by employing low light image sensors to acquire images of the fluorescing tissue through the endoscope. The images acquired by these sensors are most often encoded as video signals and displayed on a color video monitor.
- Representative fluorescence endoscopy video systems that image tissue autofluorescence are disclosed in U.S. Pat. No. 5,507,287, issued to Palcic et al.; U.S. Pat. No. 5,590,660, issued to MacAulay et al.; U.S. Pat. No.
- a fluorescence endoscopy video system in accordance with the present invention includes an endoscopic light source that is capable of operating in multiple modes to produce either white light, reflectance light, fluorescence excitation light, or fluorescence excitation light with reference reflectance light.
- An endoscope incorporates a light guide for transmitting light to the tissue under observation and includes either an imaging guide or a compact camera disposed in the insertion portion of the endoscope for receiving light from the tissue under observation.
- a compact camera includes at least one low light imaging sensor that receives light from the tissue and is capable of operating in multiple imaging modes to acquire color or multi-channel fluorescence and reflectance images.
- the system further includes an image processor and system controller that digitizes, processes and encodes the image signals produced by the image sensor(s) as a color video signal and a color video monitor that displays the processed video images.
- a filter is placed at the distal end of the endoscope in order to produce both autofluorescence and white light images from an image sensor.
- FIGS. 1A-1B are block diagrams of a fluorescence endoscopy video system according to one embodiment of the present invention.
- FIGS. 2A-2B are block diagrams of a multi-mode light source in accordance with different embodiments of the present invention.
- FIG. 3 shows a filter wheel and optical filters for the multi-mode light source
- FIGS. 4A-4C illustrate a number of alternative embodiments of a camera that can acquire color and/or fluorescence/reflectance images according to one embodiment of the present invention with optional placement for collimation and imaging optics;
- FIGS. 5A-5C illustrate a number of camera beamsplitter configurations
- FIGS. 6A-6E are graphs illustrating presently preferred transmission characteristics of filters utilized for color imaging and fluorescence/reflectance imaging with the camera embodiments shown in FIGS. 4A-4C ;
- FIGS. 7A-7B illustrate additional embodiments of a camera according to the present invention that can acquire color, fluorescence/reflectance, and/or fluorescence/fluorescence images according to an embodiment of the present invention with optional placement for collimation and imaging optics;
- FIGS. 8A-8F are graphs illustrating presently preferred transmission characteristics of filters for color imaging, fluorescence/fluorescence imaging, and fluorescence/reflectance imaging with the camera embodiment shown in FIGS. 7A-7B ;
- FIG. 9 illustrates a distal end filter in accordance with another embodiment of the present invention that allows a conventional endoscope to perform both fluorescence and white light imaging;
- FIGS. 10A and 10B illustrate how the distal end filter allows the endoscope to perform fluorescence and white light imaging in accordance with one embodiment of the present invention.
- FIG. 11 illustrates one embodiment of a distal end filter that can be secured to a conventional endoscope in accordance with the present invention.
- FIG. 1A is a block diagram of a fluorescence endoscopy video system 50 in accordance with one embodiment of the present invention.
- the system includes a multi-mode light source 52 that generates light for obtaining color and fluorescence images.
- the use of the light source for obtaining different kinds of images will be described in further detail below.
- Light from the light source 52 is supplied to an illumination guide 54 of an endoscope 60 , which then illuminates a tissue sample 58 that is to be imaged.
- the system also includes a multi-mode camera 100 , which is located at the insertion end of the endoscope 60 .
- the light from the tissue is directly captured by the multi-mode camera 100 .
- the resulting endoscope 60 can be characterized as a fluorescence video endoscope, similar to video endoscopes currently on the market (such as the Olympus CF-240L) in utility, but with the ability to be utilized for fluorescence/reflectance and/or fluorescence/fluorescence imaging, in additional to conventional color imaging. Fluorescence/reflectance and fluorescence/fluorescence imaging will be described in detail below.
- the inherent advantages of a video endoscope can be obtained: namely, the light available to form an image and the image resolution are improved compared to the case when the image is transmitted outside the body through an endoscope imaging guide or relay lens system.
- a processor/controller 64 controls the multi-mode camera 100 and the light source 52 , and produces video signals that are displayed on a video monitor 66 .
- the processor/controller 64 communicates with the multi-mode camera 100 with wires or other signal carrying devices that are routed within the endoscope. Alternatively, communication between the processor/controller 64 and the camera 100 can be conducted over a wireless link.
- FIG. 1B is a block diagram of an alternative fluorescence endoscopy video system 50 , which differs from that shown in FIG. 1A in that endoscope 60 also incorporates an image guide 56 and the multi-mode camera 100 is attached to an external portion of the endoscope that is outside the body. The light that is collected from the tissue by endoscope 60 is transmitted through the image guide 56 and projected into the multi-mode camera 100 .
- the system of FIG. 1B is identical to that shown in FIG. 1A .
- FIG. 2A shows the components of the light source 52 in greater detail.
- the light source 52 includes an arc lamp 70 that is surrounded by a reflector 72 .
- the arc lamp 70 is a high pressure mercury arc lamp (such as the Osram VIP R 150/P24).
- arc lamps such as the Osram VIP R 150/P24
- solid state devices such as light emitting diodes or diode lasers
- broadband light sources may be used, but a high pressure mercury lamp is currently preferred for its combination of high blue light output, reasonably flat white light-spectrum, and small arc size.
- the light from the arc lamp 70 is coupled to a light guide 54 of the endoscope 60 through appropriate optics 74 , 76 , and 78 for light collection, spectral filtering and focusing respectively.
- the light from the arc lamp is spectrally filtered by one of a number of optical filters 76 A, 76 B, 76 C . . . that operate to pass or reject desired wavelengths of light in accordance with the operating mode of the system.
- optical filters 76 A, 76 B, 76 C . . . that operate to pass or reject desired wavelengths of light in accordance with the operating mode of the system.
- wavelength is to be interpreted broadly to include not only a single wavelength, but a range of wavelengths as well.
- An intensity control 80 that adjusts the amount of light transmitted along the light path is positioned at an appropriate location between the arc lamp 70 and the endoscope light guide 54 .
- the intensity control 80 adjusts the amount of light that is coupled to the light guide 54 .
- a shutter mechanism 82 may be positioned in the same optical path in order to block any of the light from the lamp from reaching the light guide.
- a controller 86 operates an actuator 77 that moves the filters 76 A, 76 B or 76 C into and out of the light path.
- the controller 86 also controls the position of the intensity control 80 and the operation of the shutter mechanism 82 .
- the transmission characteristics of filters 76 A, 76 B, 76 C, . . . , the characteristics of the actuator 77 mechanism, and the time available for motion of the filters 76 A, 76 B, 76 C, . . . , into and out of the light path depend on the mode of operation required for use with the various camera embodiments. The requirements fall into two classes. If the light source shown in FIG. 2A is of the class wherein only one filter is utilized per imaging mode, the appropriate filter is moved in or out of the light path only when the imaging mode is changed. In that case, the actuator 77 only need change the filter in a time of approximately 1.0 second.
- the optical filter characteristics of filters 76 A, 76 B . . . are tailored for each imaging mode.
- optical filter 76 A used for color imaging, reduces any spectral peaks and modifies the color temperature of the arc lamp 70 so that the output spectrum simulates sunlight.
- Optical filter 76 B transmits only fluorescence excitation light for use with the fluorescence/fluorescence imaging mode and optical filter 76 C transmits both fluorescence excitation light and reference reflectance light for use with the fluorescence/reflectance imaging mode.
- a light source 52 A of a second class is illustrated in FIG. 2B ; only the differences from the light source shown in FIG. 2A will be elucidated.
- the light source 52 A uses multiple filters during each imaging mode. For example, light source filters, which provide red, green, and blue illumination sequentially for periods corresponding to a video frame or field, can be used for the acquisition of a color or a multi-spectral image with a monochrome image sensor, with the different wavelength components of the image each acquired at slightly different times. Such rapid filter changing requires a considerably different actuator than necessitated for the light source 52 of FIG. 2A . As shown in FIG.
- the filters are mounted on a filter wheel 79 that is rotated by a motor, which is synchronized to the video field or frame rate.
- a filter wheel 79 that is rotated by a motor, which is synchronized to the video field or frame rate.
- the layout of the blue, red and green filters, 79 A, 79 B, and 79 C respectively, in filter wheel 79 are shown in FIG. 3 .
- each of the various embodiments of the multi-mode camera 100 described below may be used both for color and fluorescence/reflectance and/or fluorescence/fluorescence imaging. These camera embodiments particularly lend themselves to incorporation within a fluorescence video endoscope due to their compactness and their ability to be implemented with no moving parts.
- a camera 100 A receives light from the tissue 58 , either directly from the tissue in the case of a camera located at the insertion end of an endoscope, as shown in FIG. 1A , or by virtue of an endoscope image guide 56 , which transmits the light from the tissue to the camera, as shown in FIG. 1B .
- the light is directed towards a monochrome image sensor 102 and a low light image sensor 104 by a fixed optical beamsplitter 106 that splits the incoming light into two beams.
- the light beam is split such that a smaller proportion of the light received from the tissue 58 is directed towards the monochrome image sensor 102 and a larger proportion of the incoming light is directed towards the low light image sensor 104 .
- the beamsplitter may be a standard commercially available single plate 88 , single cube 89 , or single pellicle design 90 , as shown in FIGS. 5A-5C . It should be noted that, if the optical path between the tissue 58 and the image sensors contains an uneven number of reflections (e.g., such as from a single component beamsplitter), the image projected onto the sensor will be left-to-right inverted. The orientation of such images will need to be corrected by image processing.
- light collimating optics 110 are positioned in front of the beamsplitter 106
- imaging optics 112 and 114 are positioned immediately preceding the monochrome image sensor 102 and the low light image sensor 104 , respectively.
- a spectral filter 118 is located in the optical path between the beamsplitter 106 and the low light image sensor 104 .
- the spectral filter 118 may be incorporated as an element of the beamsplitter 106 .
- FIG. 4B illustrates another embodiment of the camera 100 .
- a camera 100 B is the same as the camera 100 A described above except that the light collimating optics 110 and imaging optics 112 and 114 have been eliminated and replaced with a single set of imaging optics 113 located between the tissue and beamsplitter 106 .
- the advantage of this configuration is that all imaging is performed and controlled by the same imaging optics 113 .
- Such a configuration requires all beam paths to have the same optical path length, however, and this restriction must be considered in the design of the beamsplitter 106 and spectral filter 118 that is located in the path to the low light image sensor 104 .
- the fact that these optical elements are located in a converging beam path must be considered in specifying these elements and in the design of the imaging optics 113 .
- the low light image sensor 104 preferably comprises a charge coupled device with charge carrier multiplication (of the same type as the Texas Instruments TC253 or the Marconi Technologies CCD65), electron beam charge coupled device (EBCCD), intensified charge coupled device (ICCD), charge injection device (CID), charge modulation device (CMD), complementary metal oxide semiconductor image sensor (CMOS) or charge coupled device (CCD) type sensor.
- the monochrome image sensor 102 is preferably a CCD or a CMOS image sensor.
- FIG. 4C An alternative configuration of the camera 100 B is shown in FIG. 4C . All aspects of this embodiment of this camera 100 C are similar to the camera 100 B shown in FIG. 4B except for differences which arise from reducing the width of the camera by mounting both image sensors 102 and 104 perpendicular to the camera front surface.
- the low light image sensor 104 and the monochrome image sensor 102 are mounted with their image planes perpendicular to the input image plane of the camera.
- Light received from the tissue 58 is projected by imaging optics 113 through beamsplitter 106 onto the image sensors 102 and 104 .
- the beamsplitter 106 directs a portion of the incoming light in one beam towards one of the sensors 102 , 104 .
- Another portion of the incoming light in a second light beam passes straight through the beamsplitter 106 and is directed by a mirror 108 towards the other of the sensors 102 , 104 .
- a second set of imaging optics 115 is utilized to account for the longer optical path to this second sensor. The images projected onto both sensors will be left-to-right inverted and should be inverted by image processing.
- the processor/controller 64 as shown in FIGS. 1A and 1B receives the transduced image signals from the camera 100 and digitizes and processes these signals. The processed signals are then encoded in a video format and displayed on a color video monitor 66 .
- the processor/controller 64 Based on operator input, the processor/controller 64 also provides control functions for the fluorescence endoscopy video system. These control functions include providing control signals that control the camera gain in all imaging modes, coordinating the imaging modes of the camera and light source, and providing a light level control signal for the light source.
- a second fluorescence image acquired in a band of wavelengths in which the image signal is not significantly affected by tissue pathology, utilized for fluorescence/fluorescence imaging, or a reflected light image acquired in a band of wavelengths in which the image signal is not significantly affected by tissue pathology consisting of light that has undergone scattering within the tissue (known as diffuse reflectance), utilized for fluorescence/reflectance imaging, may be used as a reference signal with which the signal strength of the first fluorescence image can be “normalized.”
- diffuse reflectance utilized for fluorescence/reflectance imaging
- One technique for performing the normalization is to assign each of the two image signals a different display color, e.g., by supplying the image signals to different color inputs of a color video monitor.
- the two images When displayed on a color video monitor, the two images are effectively combined to form a single image, the combined color of which represents the relative strengths of the signals from the two images. Since light originating from fluorescence within tissue and diffuse reflectance light which has undergone scattering within the tissue are both emitted from the tissue with a similar spatial distribution of intensities, the color of a combined image is independent of the absolute strength of the separate image signals, and will not change as a result of changes in the distance or angle of the endoscope 60 to the tissue sample 58 , or changes in other imaging geometry factors.
- Another technique for performing the normalization is to calculate the ratio of the pixel intensities at each location in the two images. A new image can then be created wherein each pixel has an intensity and color related to the ratio computed. The new image can then be displayed by supplying it to a color video monitor.
- the mixture of colors with which normal tissue and tissue suspicious for early cancer are displayed depends on the gain applied to each of the two separate image signals. There is an optimal gain ratio for which tissue suspicious for early cancer in a fluorescence image will appear as a distinctly different color than normal tissue. This gain ratio is said to provide the operator with the best combination of sensitivity (ability to detect suspect tissue) and specificity (ability to discriminate correctly). If the gain applied to the reference image signal is too high compared to the gain applied to the fluorescence image signal, the number of tissue areas that appear suspicious, but whose pathology turns out to be normal, increases. Conversely, if the relative gain applied to the reference image signal is too low, sensitivity decreases and suspect tissue will appear like normal tissue.
- In vivo spectroscopy has been used to determine which differences in tissue autofluorescence and reflectance spectra have a pathological basis.
- the properties of these spectra determine the particular wavelength bands of autofluorescence and reflected light required for the fluorescence/reflectance imaging mode, or the particular two wavelength bands of autofluorescence required for fluorescence/fluorescence imaging mode. Since the properties of the spectra depend on the tissue type, the wavelengths of the important autofluorescence band(s) may depend on the type of tissue being imaged.
- the specifications of the optical filters described below are a consequence of these spectral characteristics, and are chosen to be optimal for the tissues to be imaged.
- the filters in the light source and camera should be optimized for the imaging mode of the camera, the type of tissue to be examined and/or the type of pre-cancerous tissue to be detected.
- all of the filters described below can be made to order using standard, commercially available components, the appropriate wavelength range of transmission and degree of blocking outside of the desired transmission range for the described fluorescence endoscopy images are important to the proper operation of the system.
- the importance of other issues in the specification of such filters, such as the fluorescence properties of the filter materials and the proper use of anti-reflection coatings, are taken to be understood.
- FIGS. 6A-6E illustrate the preferred filter characteristics for use in a fluorescence endoscopy system having a camera of the type shown in FIGS. 4A-4C and light source as shown in FIG. 2B , that operates in a fluorescence/reflectance imaging mode, or a color imaging mode.
- fluorescence endoscopy video systems operating in the fluorescence/reflectance imaging mode including green fluorescence with either red or blue reflectance, and red fluorescence with either green or blue reflectance.
- the particular configuration utilized depends on the target clinical organ and application. The filter characteristics will now be described for each of these four configurations.
- FIG. 6A illustrates the composition of the light transmitted by a blue filter, such as filter 79 A, which is used to produce excitation light in the system light source.
- This filter transmits light in the wavelength range from 370-460 nm or any subset of wavelengths in this range. Of the light transmitted by this filter, less than 0.001% is in the fluorescence imaging band from 480-750 nm (or whatever desired subsets of this range is within the specified transmission range of the primary and reference fluorescence image filters described below).
- FIG. 6B illustrates the composition of the light transmitted by a red filter, such as filter 79 B, which is used to produce red reflectance light in the system light source.
- This filter transmits light in the wavelength range from 590-750 nm or any subset of wavelengths in this range. Light transmitted outside this range should not exceed 1%.
- FIG. 6C illustrates the composition of the light transmitted by a green filter, such as filter 79 C, which is used to produce green reflectance light in the system light source.
- This filter transmits light in the wavelength range from 480-570 nm or any subset of wavelengths in this range. Light transmitted outside this range should not exceed 1%.
- FIG. 6D shows the composition of the light transmitted by a camera spectral filter, such as filter 118 , for defining the primary fluorescence image in the green spectral band.
- the filter blocks excitation light and red fluorescence light while transmitting green fluorescence light in the wavelength range of 480-570 nm or any subset of wavelengths in this range.
- the filter characteristics are such that any light outside of the wavelength range of 480-570 nm, or any desired subset of wavelengths in this range, contributes no more than 0.1% to the light transmitted by the filter.
- FIG. 6E shows the composition of the light transmitted by a camera filter, such as filter 118 , for defining the primary fluorescence image in the red spectral band.
- the filter blocks excitation light and green fluorescence light while transmitting red fluorescence light in the wavelength range of 590-750 nm or any subset of wavelengths in this range.
- the filter characteristics are such that any light outside of the wavelength range of 590-750 nm, or any desired subset of wavelengths in this range, contributes no more than 0.1% to the light transmitted by the filter.
- the cameras 100 A as shown in FIGS. 4A and 100B as shown in FIG. 4B or 100 C as shown in FIG. 4C are capable of operating in color and fluorescence/reflectance imaging modes.
- a light source of the type shown in FIG. 2B that provides a different output every video frame or field is required.
- the processor/controller 64 provides a control signal to the multi-mode light source 52 that indicates the light source should be operating in the white light mode and provides a synchronizing signal.
- the light source 52 sequentially outputs filtered red, green, and blue light, synchronously with the video field or frame of the image sensors 102 and 104 .
- the filtered light from the light source 52 is projected into the endoscope light guide 54 and is transmitted to the tip of the endoscope 60 to illuminate the tissue 58 .
- the processor/controller 64 also protects the sensitive low light image sensor 104 during color imaging by decreasing the gain of the amplification stage of the sensor.
- the light reflected by the tissue 58 is collected and transmitted by the endoscope image guide 56 to the camera where it is projected through beamsplitter 106 onto the monochrome image sensor 102 , or the light is directly projected through the camera beamsplitter 106 onto the monochrome image sensor 102 if the sensor is located within the insertion portion of the endoscope.
- the image projected during each of red, green, blue illuminations is transduced by the monochrome image sensor 102 and the resulting image signals are transmitted to the processor/controller 64 .
- the processor/controller 64 Based on the brightness of the images captured, the processor/controller 64 provides a control signal to the multi-mode light source 52 to adjust the intensity control 80 and thereby adjust the level of light output by the endoscope light guide 54 .
- the processor/controller 64 may also send a control signal to the camera 100 A, 100 B or 100 C to adjust the gain of the monochrome image sensor 102 .
- the processor/controller 64 interpolates the images acquired during sequential periods of red, green, and blue illumination to create a complete color image during all time periods, and encodes that color image as video signals.
- the video signals are connected to color video monitor 66 for display of the color image. All of the imaging operations occur at analog video display rates (30 frames per second for NTSC format and 25 frames per second for PAL format).
- the processor/controller 64 When switching to the fluorescence/reflectance imaging mode, the processor/controller 64 provides a control signal to the multi-mode light source 52 to indicate that it should be operating in fluorescence/reflectance mode.
- the light source filter wheel 79 stops rotating and the light source 52 selects and positions the appropriate blue optical filter 79 A continuously into the optical path between the arc lamp 70 and the endoscope light guide 54 .
- This change from sequentially changing filters to a static filter occurs in a period of approximately one second.
- Filter 79 A transmits only those wavelengths of light that will induce the tissue 58 under examination to fluoresce. All other wavelengths of light are substantially blocked as described above.
- the filtered light is then projected into the endoscope light guide 54 and transmitted to the tip of the endoscope 60 to illuminate the tissue 58 .
- the processor/controller 64 also increases the gain of the amplification stage of the low light image sensor 104 .
- the fluorescence emitted and excitation light reflected by the tissue 58 are either collected by the endoscope image guide 56 and projected through the camera beamsplitter 106 onto the low light image sensor 104 and the image sensor 102 , or are collected and directly projected through the camera beamsplitter 106 onto the low light image sensor 104 and the image sensor 102 at the insertion tip of the endoscope 60 .
- Spectral filter 118 limits the light transmitted to the low light image sensor 104 to either green or red autofluorescence light only and substantially blocks the light in the excitation wavelength band.
- the autofluorescence image is transduced by the low light image sensor 104 .
- the reference reflected excitation light image is transduced by the monochrome image sensor 102 and the resulting image signals are transmitted to the processor/controller 64 .
- the processor/controller 64 may provide a control signal to the multi-mode light source 52 to adjust the intensity control 80 and thereby adjust the level of light delivered to the endoscope 60 .
- the processor/controller 64 may also send control signals to the cameras 100 A, 100 B or 100 C to adjust the gains of the low light image sensor 104 and the monochrome image sensor 102 , in order to maintain constant image brightness while keeping the relative gain constant.
- the images from the two sensors are encoded as video signals by processor/controller 64 .
- the fluorescence/reflectance image is displayed by applying the video signals to different color inputs on the color video monitor 66 .
- the cameras 100 A, 100 B, 100 C can be operated in a variation of the fluorescence/reflectance mode to simultaneously obtain fluorescence images and reflectance images with red, green, and blue illumination.
- the operation of the system is similar to that described previously for color imaging, so only the points of difference from the color imaging mode will be described.
- the multi-mode light source 52 instead of changing from sequential red, green, and blue illumination to static blue illumination when switching from color imaging to fluorescence/reflectance imaging, the multi-mode light source 52 provides the same sequential illumination utilized in the color imaging mode, for all imaging modes. Capture and display of the light reflected by the tissue is similar to that described previously for the color imaging mode. However, in addition to the reflectance images captured in that mode, the gain of the amplification stage of the low light image sensor 104 is adjusted to a value that makes it possible to capture autofluorescence images during blue illumination. During red and green illumination, the gain of amplification stage of the low light sensor is decreased to protect the sensor while the image sensor 102 captures reflectance images.
- the camera captures both reflectance and fluorescence images during the blue illumination period, in addition to reflected light images during the red and green illumination periods.
- the reflectance images are interpolated and displayed on the corresponding red, green and blue channels of a color video monitor to produce a color image.
- a fluorescence/reflectance image is produced by overlaying the fluorescence image and one or more of the reflectance images displayed in different colors on a color video monitor.
- both a color image and a fluorescence/reflectance image can be displayed simultaneously on the color video monitor. In this case, there is no need to utilize a separate color imaging mode.
- only the fluorescence/reflectance image may be displayed during fluorescence/reflectance imaging and a color image displayed solely in the color imaging mode.
- a camera 100 D for this embodiment of a system is as shown in FIG. 7A . It differs from the cameras 100 A, 100 B or 100 C as described above in that all imaging modes utilize a single, low light color image sensor 103 (preferably a color CCD with charge carrier multiplication such as the Texas Instruments TC252) and that no beamsplitter is required.
- the color image sensor 103 may be a three-CCD with charge carrier multiplication color image sensor assembly, a color CCD, a three-CCD color image sensor assembly, a color CMOS image sensor, or a three-CMOS color image sensor assembly.
- Each of the pixel elements on the low light color sensor 103 is covered by an integrated filter, typically red, green or blue. These filters define the wavelength bands of fluorescence and reflectance light that reach the individual pixel elements. Such mosaic filters typically have considerable overlap between the red, green, and blue passbands, which can lead to considerable crosstalk when imaging dim autofluorescence light in the presence of intense reflected excitation light. Therefore, a separate filter 118 is provided to reduce the intensity of reflected excitation light to the same level as that of the autofluorescence light and, at the same time, pass autofluorescence light.
- the primary fluorescence and reference images are projected onto the same image sensor 103 , but, because of the individual filters placed over each pixel, these different images are detected by separate sensor pixels.
- individual primary fluorescence and reference image signals can be produced by processor/controller 64 from the single CCD image signal.
- FIG. 7A light collimating optics 110 is positioned between the tissue 58 and filter 118 and imaging optics 112 is positioned immediately preceding the color image sensor 103 .
- camera 100 E as shown in FIG. 7B , eliminates the collimating optics 110 and imaging optics 112 and replaces them with a single imaging optics 113 located between the tissue 58 and filter 118 .
- the advantage of this configuration is that all imaging is performed and controlled by the same imaging optics 113 .
- the fact that filter 118 is located in a converging beam path must be considered in specifying that element and in the design of the imaging optics.
- the operation of a system based on camera 100 D of FIG. 7A or 100 E of FIG. 7B will now be described.
- the cameras 100 D and 100 E are capable of operation in the color, fluorescence/fluorescence, and fluorescence/reflectance imaging modes.
- a light source of the type shown in FIG. 2A provides steady state output in each imaging mode.
- the light transmission specifications of the light source filters 76 A, 76 B, and 76 C, the filter 118 , and the mosaic color filters integrated with the image sensor 103 are selected such that the intensity of the reflected light and fluorescence light at the color image sensor's active elements results in transduced image signals with good signal-to-noise characteristics and without significant saturation.
- these filters have appropriate light transmission specifications for excitation and imaging of the primary fluorescence and for color imaging.
- the filter transmission characteristics are chosen to provide the desired ratio of relative primary fluorescence to reference light intensity at the image sensor.
- the processor/controller 64 provides a control signal to the multimode light source 52 that it should be in white light mode.
- the light source selects and positions the appropriate optical filter 76 A into the optical path between the arc lamp 70 and endoscope light guide 54 .
- the light source filter 76 A should incorporate reduced transmission at red and green wavelengths to obtain a balanced color image at image sensor 103 with the proper proportions of red, green, and blue components.
- Image signals from the color low light sensor 103 are processed by processor/controller 64 .
- Standard techniques are utilized to produce a color image from a single color sensor: the image signals from pixels having the same filter characteristics are interpolated by processor/controller 64 to produce an image signal, related to the pass band of each element of the mosaic filter (e.g., red, green, and blue), at every pixel location.
- the resulting multiple images, which when combined produce a color image, are encoded by processor/controller 64 as video signals.
- the color image is displayed by connecting the video signals to the appropriate inputs of color video monitor 66 .
- Processor/controller 64 also maintains the overall image brightness at a set level by monitoring the brightness of the image signal at each pixel and adjusting the intensity of the light source output and camera amplifier gains according to a programmed algorithm.
- processor/controller 64 When switching to the fluorescence/fluorescence imaging mode, processor/controller 64 provides a control signal to the multi-mode light source 52 to indicate that it should be in fluorescence/fluorescence mode.
- the light source 52 moves light source filter 76 B into position in the light beam. Filter 76 B transmits excitation light and blocks the transmission of light at the green and red fluorescence detection wavelengths, as described below.
- the characteristics of light source fluorescence excitation filter 76 B and excitation filter 118 , along with the mosaic filter elements on the color sensor 103 , are such that the intensity of blue light at the color sensor is less than the intensities of red and green autofluorescence at the sensor, and are such that the ratio of the intensity of red autofluorescence to the intensity of green autofluorescence at the color sensor 103 has the appropriate value for optimal differentiation between normal and abnormal tissue.
- the fluorescence images are processed, as previously described for color imaging, by processor/controller 64 to produce separate images corresponding to each of the pass bands of the mosaic filter (e.g., red, green, and blue). These separate images are encoded as video signals by processor/controller 64 .
- a composite fluorescence/fluorescence image is displayed on the color video monitor 66 by applying the video signals from red and green pass bands of the mosaic filter to different color inputs of the monitor.
- processor/controller 64 When switching to the fluorescence/reflectance imaging mode, processor/controller 64 provides a control signal to the multi-mode light source 52 to indicate that it should be in fluorescence/reflectance mode.
- the light source 52 moves light source filter 76 C into position in the light beam. Filter 76 C transmits both excitation light and reference light and blocks the transmission of light at fluorescence detection wavelengths, as described below.
- the characteristics of the light source filter 76 C for fluorescence excitation and the reflectance illumination and the camera filter 118 , along with the mosaic filter on the color sensor 103 , as detailed below, are such that the intensity of reflected excitation light at the color sensor is comparable to the intensity of autofluorescence at the sensor, and should be such that the ratio of the intensity of autofluorescence to the intensity of reflected reference light at the color sensor 103 has the appropriate value.
- the fluorescence and reflectance images are processed, as previously described for color imaging, by processor/controller 64 to produce separate images corresponding to each of the pass bands of the mosaic filter (e.g., red, green, and blue). These separate images are encoded as video signals by processor/controller 64 .
- a composite fluorescence/reflectance image is displayed on color video monitor 66 by applying the video signals from the appropriate mosaic filter pass bands (as discussed below) to different color inputs of the monitor.
- the filters in the light source and camera should be optimized for the imaging mode of the camera, the type of tissue to be examined and/or the type of pre-cancerous tissue to be detected.
- all of the filters described below can be made to order using standard, commercially available components, the appropriate wavelength range of transmission and degree of blocking outside of the desired transmission range for the described fluorescence endoscopy images modes are important to the proper operation of the system.
- the importance of other issues in the specification of such filters such as the fluorescence properties of the filter materials and the proper use of anti-reflection coatings are taken to be understood.
- the filters in the light source and camera should be optimized for the imaging mode of the camera, the type of tissue to be examined and/or the type of pre-cancerous tissue to be detected, based on in vivo spectroscopy measurements.
- the preferred filter characteristics for use in the fluorescence endoscopy video systems with a camera of the type shown in FIGS. 7A and 7B , operating in a fluorescence/reflectance imaging mode, or a fluorescence/fluorescence imaging mode, are shown in FIGS. 8A-8F .
- fluorescence endoscopy video systems operating in the fluorescence/reflectance imaging mode including green fluorescence with red reflectance, and red fluorescence with green reflectance and red or green fluorescence with blue reflectance.
- the particular configuration utilized depends on the target clinical organ and application. The filter characteristics will now be described for each of these four configurations.
- FIGS. 8A-8B illustrate a preferred composition of the light transmitted by filters for a color imaging mode.
- FIG. 8A illustrates the composition of the light transmitted by the light source filter, such as filter 76 A, which is used to produce light for color imaging.
- the spectral filter 118 remains in place during color imaging since there are no moving parts in the present camera embodiment. Accordingly, to achieve correct color rendition during color imaging it is necessary for the transmission of light source filter 76 A to be modified, compared to the usual white light transmission for color imaging, such that the light received by the high sensitivity color sensor 103 is white when a white reflectance standard is viewed with the camera.
- the transmission of filter 76 A in the red and green spectral bands must be less than the transmission in the blue, and the transmission of filter 76 A in the blue must extend to a long enough wavelength that there is an overlap with the short wavelength region of appreciable transmission of filter 1118 .
- Filter 76 A transmits light in the blue wavelength range from 370-480 nm or any subset of wavelengths in this range at the maximum possible transmission.
- the transmission of Filter 76 A in the green and red wavelength range from 500 nm-750 nm, or any subsets of wavelengths in this range, is preferably reduced by at least a factor of ten compared to the transmission in the blue, in order to achieve a balanced color image at the high sensitivity color sensor 103 , after taking into account the effect of filter 118 .
- FIG. 8B shows the composition of the light transmitted by the spectral filter 118 , which is used for all imaging modes.
- the filter blocks the blue excitation light in the range 370-450 nm while transmitting red and green light in the wavelength range of 470-750 nm or any subsets of wavelengths in this range.
- the filter characteristics are such that the intensity of light captured by high sensitivity color sensor 103 in the wavelength bands transmitted by the different regions of the sensor's mosaic filter are comparable, when a white reflectance standard is imaged.
- the filter characteristics are such that any light outside of the wavelength range of 470-750 nm (or any desired subset of wavelengths in this range) contributes no more than 0.1% to the light transmitted by the filter.
- FIG. 8C illustrates the composition of the light transmitted by a filter, such as filter 76 B, which is used to produce excitation light in the system light source.
- This filter transmits light in the wavelength range from 370-450 nm or any subset of wavelengths in this range. Of the light transmitted by this filter, preferably less than 0.001% is in the fluorescence imaging band from 470-750 nm (or whatever desired subsets of this range is within the transmission range of the primary and reference fluorescence wavelength bands defined by the transmission of the mosaic filter incorporated in the high sensitivity color sensor 103 ).
- FIG. 8D illustrates the composition of the light transmitted by the light source filter, such as filter 76 C, which is used to produce blue excitation light and red reference light for a green fluorescence and red reflectance imaging mode.
- This filter transmits light in the blue wavelength range from 370-450 nm, or any subset of wavelengths in this range. It also transmits light in the red wavelength range of 590-750 nm, or any subset of wavelengths in this range.
- the light transmitted in the red wavelength range (or subset of that range) is adjusted, as part of the system design, to be an appropriate fraction of the light transmitted in the blue wavelength range.
- This fraction is selected to meet the need to match the intensity of the reflected reference light projected on the color image sensor to the requirements of the sensor, at the same time as maintaining sufficient fluorescence excitation.
- less than 0.001% is in the green wavelength range of 470-570 nm (or whatever desired subset of this range is specified as the transmission range of the primary fluorescence wavelength band).
- FIG. 8E illustrates the composition of the light transmitted by a light source filter which is used to produce excitation light such as filter 76 C described above for a red fluorescence and green reflectance imaging mode.
- This filter transmits light in the blue wavelength range from 370-450 nm or any subset of wavelengths in this range. It also transmits light in the green wavelength range of 470-570 nm or any subset of wavelengths in this range.
- the light transmitted in the green wavelength range (or subset of that range) is adjusted, as part of the system design, to be an appropriate fraction of the light transmitted in the blue wavelength range. This fraction is selected to meet the need to match the intensity of the reflected reference light projected on the color image sensor to the requirements of the sensor, at the same time as maintaining sufficient fluorescence excitation.
- less than 0.001% is in the red fluorescence imaging wavelength range of 590-750 nm (or whatever desired subset of this range is specified as the transmission range of the primary fluorescence wavelength band).
- FIG. 8F illustrates the composition of the light transmitted by a light source filter which is used to produce excitation light such as filter 76 C described above for a red or green fluorescence and blue reflectance imaging mode.
- This filter transmits light in the blue wavelength range from 370-470 nm or any subset of wavelengths in this range.
- the light transmitted in the 450-470 nm wavelength range (or subset of that range) is adjusted, as part of the system design, to meet the need to match the intensity of the reflected reference light projected on the color image sensor to the requirements of the sensor and to provide the appropriate ratio of reference reflected light to fluorescence light, at the same time as maintaining sufficient fluorescence excitation.
- less than 0.001% is in the fluorescence imaging wavelength range of 490-750 nm (or whatever desired subset of this range is specified as the transmission range of the primary fluorescence wavelength band).
- fluorescence and white light images can be obtained by placing a filter on the distal tip of a video endoscope.
- a limitation of current fluorescence videoendoscopy systems is that they typically employ the use of dedicated endoscopes. Fluorescence imaging with such endoscopes is enabled by the use of an excitation barrier filter to block the strong excitation light used to excite the tissue fluorescence these systems are intended to image.
- These barrier filters are built in to the endoscope distal end (typically between the objective lens and the low light image sensor) and this built-in filter distinguishes these endoscopes from those used for conventional videoendoscopy.
- the alternative embodiment of the present invention describes the use of an externally mounted filter in conjunction with a videoendoscope that contains a sufficiently sensitive image sensor to image tissue fluorescence.
- This combination of a conventional video endoscope and an externally mounted barrier filter can be used in conjunction with an appropriate endoscopic light source to image both in both color and fluorescence modes.
- FIG. 9 illustrates one embodiment of a distal filter 202 that can be placed over the distal end of a conventional white light imaging endoscope to allow the endoscope to perform fluorescence and white light examinations of a patient.
- the filter 202 blocks excess excitation light from reaching the image sensor 103 but allows some blue light to pass in order to obtain white light images.
- FIGS. 10A and 10B illustrate the operation of the distal filter 202 in further detail.
- An endoscope 250 includes illumination ports 252 , 254 that supply illumination light to an area of interest.
- a port 256 is the distal entrance to a working channel through which endoscopic tools can be passed in order to perform a desired task such as obtaining a biopsy sample, marking tissue with dye or perform some other diagnostic or therapeutic procedures.
- Light that is reflected from the tissue 350 is captured by a lens 258 that images the light onto a low light color sensor.
- the low light sensor comprises a mosaic filter 260 that is positioned in front of a CCD, CMOS or equivalent image sensor 262 .
- Image signals produced by the image sensor are transmitted to an image processor (not shown) that converts the signals into video signals that are displayed on a monitor.
- the video signals may be recorded on a video tape, DVD or other storage media for later review or comparison.
- the endoscope 250 may be fitted with the distal end filter 202 .
- the filter 202 is included in a filter assembly 300 that does not obscure the illumination ports 252 , 254 in order to allow the illumination light to reach the tissue under examination.
- the filter assembly 300 does not interfere with other distal tip features including but not limited to features such as water/air nozzles, electrodes, confocal imaging ports, or the working channel 256 so that tools can still be routed through the endoscope.
- the filter assembly is made of appropriately inert and non-conductive materials such as plastic or glass or stainless steel, so as also not to interfere with the particular material or electrical characteristics of the endoscope tip that may be required for use in conjunction with endotherapy techniques, such as argon ion plasma coagulation (APC), electrocautery, cryotherapy, or photodynamic therapy (PDT)
- endotherapy techniques such as argon ion plasma coagulation (APC), electrocautery, cryotherapy, or photodynamic therapy (PDT)
- the filter 202 is positioned in front of the imaging lens 258 and prevents excitation light from reaching the image sensor.
- the filter removes the excitation light having wavelengths in the range of 370-450 nm. or some subset of this range but passes some blue light, for example 451-480 nm. for use in white light imaging as will be described below. Because most endoscope have objective lenses with a wide field of view, the filter should block excitation light over a corresponding wide field of view and over the range of angles of incidence of light collected by the endoscope objective.
- the filter should also be thin enough not to introduce optical aberrations or interfere with the mechanical properties and maneuverability of the endoscope tip.
- Dye-based absorption filters that block the desired range of excitation light and operate over a wide field of view may therefore be preferred for this application.
- Specific examples of such filters include Kodak Wratten gel filters.
- the filter is preferably constructed in a manner similar to optically protective eyewear such as laser goggles.
- the distal filter 202 allows fluorescence images to be obtained in at least two modes. In a first mode, excitation light, typically in the blue wavelength spectral band, is provided from a light source (not shown) and through the illumination ports 252 , 254 whereupon it strikes the tissue sample 350 .
- a portion of the excitation light is absorbed by the tissue and causes a tissue sample to produce fluorescence light while a portion of the excitation light is reflected off the surface of the tissue 350 .
- Excitation light reflecting from the surface of the tissue 350 is blocked by the filter 202 in the filter assembly 300 , while the fluorescence light and light in other spectral bands passes through the filter 202 .
- the tissue is illuminated with the excitation light and some amount of reflectance light.
- the reflectance light is in the red spectral band.
- the reflectance light passes through the filter 202 and the filter 260 in front of the image sensor 262 .
- Images of the tissue are obtained by combining for example, the green pixels from the image sensor 262 to obtain a fluorescence image in the green spectral band and the red pixels from the image sensor 262 to obtain a reflectance image in the red spectral band.
- the reflectance light may be provided in the green spectral band and a red fluorescence image obtained.
- blue reflectance light having wavelengths that are not filtered by the filter 202 can be used to produce the reflectance image.
- the fluorescence and reflectance images may be combined for display for a viewer.
- the amount of reflectance light supplied from the light source is selected to be comparable to the amount of fluorescence light received by the image sensor 262 .
- the endoscope 250 can also be used to obtain white light images of the tissue 350 by illuminating the tissue with light including red, green and blue spectral components.
- the illumination light is reflected by the tissue sample 350 , passes through the filter 202 and is focused onto the filter 260 by the endoscope's imaging lens 258 . Because the filter 202 removes most of the blue reflectance light, the light received by the image sensor 262 includes excess red and green light. To compensate for the reduced blue light at the image sensor, the illumination light should either contain excess blue light in the band that passes through the filter 202 or contain reduced green and red light so that the resulting image produced by the image sensor may be white balanced. Additional fine tuning of the white balance of the images produced by the image sensor 262 can be accomplished by image processing software in the image processing board (not shown).
- FIG. 11 One embodiment of a filter assembly 200 that is placed on the distal tip of an endoscope is shown in FIG. 11 .
- a filter 202 may be mounted in a frame that is snap-fitted over the distal end face of an endoscope.
- the filter and/or frame are secured to the endoscope with a mechanical, adhesive, magnetic force or other means.
- the frame includes a set of proximally extending tabs 204 , 206 that are secured to the outer circumference of the endoscope tip.
- the filter 202 is positioned in front of the imaging lens of the endoscope. As indicated above, the filter 202 operates to remove a substantial portion of reflected blue excitation light used during the fluorescence imaging mode.
- the frame also includes a hole 210 that is positioned over the working channel of the endoscope in order to allow tools, such as biopsy forceps, snares, cytology brushes, etc., to be passed through the working channel.
- a hole 210 Positioned on either side of the frame are holes 212 , 214 that allow light from the illumination guides to pass through the frame.
- Another embodiment of the present invention also utilizes a filter on the distal tip of a video endoscope.
- Some videoendoscope systems do not employ the use of color image sensors and instead use sequential illumination in various spectral (e.g blue, green, red) bands and then combine monochrome images to produce full color images.
- An external barrier filter 202 can be used in an endoscope of the type shown in FIG. 9 with the high sensitivity color sensor 103 replaced by a monochrome image sensor and sequential illumination of the type discussed in connection with FIG. 2B .
- autofluorescence images are obtained by illuminating with an excitation light.
- Color images are obtained by sequential illumination with red, green and blue light; wherein the blue light either includes wavelengths or is limited to wavelengths not blocked by the filter 202 .
- the fluorescence endoscopy video systems described in the above embodiments have been optimized for imaging endogenous tissue fluorescence. They are not limited to this application, however, and may also be used for photo-dynamic diagnosis (PDD) applications.
- PDD applications utilize photo-active drugs that preferentially accumulate in tissues suspicious for early cancer. Since effective versions of such drugs are currently in development stages, this invention does not specify the filter characteristics that are optimized for such drugs.
- a fluorescence endoscopy video system operating in either fluorescence/fluorescence or fluorescence/reflectance imaging mode as described herein may be used to image the fluorescence from such drugs.
- each of the embodiments of a camera for a fluorescence endoscopy video system described above due to their simplicity, naturally lend themselves to miniaturization and implementation in a fluorescence video endoscope, with the camera being incorporated into the insertion portion of the endoscope.
- the cameras can be utilized for both color imaging and fluorescence imaging, and in their most compact form contain no moving parts.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Radiology & Medical Imaging (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Astronomy & Astrophysics (AREA)
- General Physics & Mathematics (AREA)
- Endoscopes (AREA)
Abstract
Description
- This application is a continuation-in-part of U.S. patent application Ser. No. 11/009,965, filed Dec. 10, 2004, which is a continuation of U.S. patent application Ser. No. 10/050,601, filed Jan. 15, 2002, the benefit of the filing dates of which are being claimed under 35 U.S.C. § 120.
- The present invention relates to medical imaging systems in general, and in particular to fluorescence endoscopy video systems.
- Fluorescence endoscopy utilizes differences in the fluorescence response of normal tissue and tissue suspicious for early cancer as a tool in the detection and localization of such cancer. The fluorescing compounds or fluorophores that are excited during fluorescence endoscopy may be exogenously applied photo-active drugs that accumulate preferentially in suspicious tissues, or they may be the endogenous fluorophores that are present in all tissue. In the latter case, the fluorescence from the tissue is typically referred to as autofluorescence or native fluorescence. Tissue autofluorescence is typically due to fluorophores with absorption bands in the UV and blue portion of the visible spectrum and emission bands in the green to red portions of the visible spectrum. In tissue suspicious for early cancer, the green portion of the autofluorescence spectrum is significantly suppressed. Fluorescence endoscopy that is based on tissue autofluorescence utilizes this spectral difference to distinguish normal from suspicious tissue.
- Since the concentration and/or quantum efficiency of the endogenous fluorophores in tissue is relatively low, the fluorescence emitted by these fluorophores is not typically visible to the naked eye. Fluorescence endoscopy is consequently performed by employing low light image sensors to acquire images of the fluorescing tissue through the endoscope. The images acquired by these sensors are most often encoded as video signals and displayed on a color video monitor. Representative fluorescence endoscopy video systems that image tissue autofluorescence are disclosed in U.S. Pat. No. 5,507,287, issued to Palcic et al.; U.S. Pat. No. 5,590,660, issued to MacAulay et al.; U.S. Pat. No. 5,827,190, issued to Palcic et al., U.S. patent application Ser. No. 09/615,965, and U.S. patent application Ser. No. 09/905,642, all of which are herein incorporated by reference. Each of these is assigned to Xillix Technologies Corp. of Richmond, British Columbia, Canada, the assignee of the present application.
- While the systems disclosed in the above-referenced patents are significant advances in the field of early cancer detection, improvements can be made. In particular, it is desirable to reduce the size, cost, weight, and complexity of the camera.
- A fluorescence endoscopy video system in accordance with the present invention includes an endoscopic light source that is capable of operating in multiple modes to produce either white light, reflectance light, fluorescence excitation light, or fluorescence excitation light with reference reflectance light. An endoscope incorporates a light guide for transmitting light to the tissue under observation and includes either an imaging guide or a compact camera disposed in the insertion portion of the endoscope for receiving light from the tissue under observation. A compact camera includes at least one low light imaging sensor that receives light from the tissue and is capable of operating in multiple imaging modes to acquire color or multi-channel fluorescence and reflectance images. The system further includes an image processor and system controller that digitizes, processes and encodes the image signals produced by the image sensor(s) as a color video signal and a color video monitor that displays the processed video images.
- In one embodiment of the invention, a filter is placed at the distal end of the endoscope in order to produce both autofluorescence and white light images from an image sensor.
- The foregoing aspects and many of the attendant advantages of this invention will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein:
-
FIGS. 1A-1B are block diagrams of a fluorescence endoscopy video system according to one embodiment of the present invention; -
FIGS. 2A-2B are block diagrams of a multi-mode light source in accordance with different embodiments of the present invention; -
FIG. 3 shows a filter wheel and optical filters for the multi-mode light source; -
FIGS. 4A-4C illustrate a number of alternative embodiments of a camera that can acquire color and/or fluorescence/reflectance images according to one embodiment of the present invention with optional placement for collimation and imaging optics; -
FIGS. 5A-5C illustrate a number of camera beamsplitter configurations; -
FIGS. 6A-6E are graphs illustrating presently preferred transmission characteristics of filters utilized for color imaging and fluorescence/reflectance imaging with the camera embodiments shown inFIGS. 4A-4C ; -
FIGS. 7A-7B illustrate additional embodiments of a camera according to the present invention that can acquire color, fluorescence/reflectance, and/or fluorescence/fluorescence images according to an embodiment of the present invention with optional placement for collimation and imaging optics; -
FIGS. 8A-8F are graphs illustrating presently preferred transmission characteristics of filters for color imaging, fluorescence/fluorescence imaging, and fluorescence/reflectance imaging with the camera embodiment shown inFIGS. 7A-7B ; -
FIG. 9 illustrates a distal end filter in accordance with another embodiment of the present invention that allows a conventional endoscope to perform both fluorescence and white light imaging; -
FIGS. 10A and 10B illustrate how the distal end filter allows the endoscope to perform fluorescence and white light imaging in accordance with one embodiment of the present invention; and -
FIG. 11 illustrates one embodiment of a distal end filter that can be secured to a conventional endoscope in accordance with the present invention. -
FIG. 1A is a block diagram of a fluorescenceendoscopy video system 50 in accordance with one embodiment of the present invention. The system includes amulti-mode light source 52 that generates light for obtaining color and fluorescence images. The use of the light source for obtaining different kinds of images will be described in further detail below. Light from thelight source 52 is supplied to anillumination guide 54 of anendoscope 60, which then illuminates atissue sample 58 that is to be imaged. - As shown in
FIG. 1A , the system also includes amulti-mode camera 100, which is located at the insertion end of theendoscope 60. The light from the tissue is directly captured by themulti-mode camera 100. With themulti-mode camera 100 located at the insertion end of the endoscope, the resultingendoscope 60 can be characterized as a fluorescence video endoscope, similar to video endoscopes currently on the market (such as the Olympus CF-240L) in utility, but with the ability to be utilized for fluorescence/reflectance and/or fluorescence/fluorescence imaging, in additional to conventional color imaging. Fluorescence/reflectance and fluorescence/fluorescence imaging will be described in detail below. By locating the camera at the insertion end of the endoscope, the inherent advantages of a video endoscope can be obtained: namely, the light available to form an image and the image resolution are improved compared to the case when the image is transmitted outside the body through an endoscope imaging guide or relay lens system. - A processor/
controller 64 controls themulti-mode camera 100 and thelight source 52, and produces video signals that are displayed on avideo monitor 66. The processor/controller 64 communicates with themulti-mode camera 100 with wires or other signal carrying devices that are routed within the endoscope. Alternatively, communication between the processor/controller 64 and thecamera 100 can be conducted over a wireless link. -
FIG. 1B is a block diagram of an alternative fluorescenceendoscopy video system 50, which differs from that shown inFIG. 1A in thatendoscope 60 also incorporates animage guide 56 and themulti-mode camera 100 is attached to an external portion of the endoscope that is outside the body. The light that is collected from the tissue byendoscope 60 is transmitted through theimage guide 56 and projected into themulti-mode camera 100. Other than the addition of theimage guide 56 toendoscope 100 and the location of themulti-mode camera 100 at the external end of the endoscope, the system ofFIG. 1B is identical to that shown inFIG. 1A . -
FIG. 2A shows the components of thelight source 52 in greater detail. Thelight source 52 includes anarc lamp 70 that is surrounded by areflector 72. In the preferred embodiment of the invention, thearc lamp 70 is a high pressure mercury arc lamp (such as the Osram VIP R 150/P24). Alternatively, other arc lamps, solid state devices (such as light emitting diodes or diode lasers), or broadband light sources may be used, but a high pressure mercury lamp is currently preferred for its combination of high blue light output, reasonably flat white light-spectrum, and small arc size. - The light from the
arc lamp 70 is coupled to alight guide 54 of theendoscope 60 throughappropriate optics optical filters - An
intensity control 80 that adjusts the amount of light transmitted along the light path is positioned at an appropriate location between thearc lamp 70 and theendoscope light guide 54. Theintensity control 80 adjusts the amount of light that is coupled to thelight guide 54. In addition, ashutter mechanism 82 may be positioned in the same optical path in order to block any of the light from the lamp from reaching the light guide. Acontroller 86 operates anactuator 77 that moves thefilters controller 86 also controls the position of theintensity control 80 and the operation of theshutter mechanism 82. - The transmission characteristics of
filters actuator 77 mechanism, and the time available for motion of thefilters FIG. 2A is of the class wherein only one filter is utilized per imaging mode, the appropriate filter is moved in or out of the light path only when the imaging mode is changed. In that case, theactuator 77 only need change the filter in a time of approximately 1.0 second. The optical filter characteristics offilters optical filter 76A, used for color imaging, reduces any spectral peaks and modifies the color temperature of thearc lamp 70 so that the output spectrum simulates sunlight.Optical filter 76B transmits only fluorescence excitation light for use with the fluorescence/fluorescence imaging mode andoptical filter 76C transmits both fluorescence excitation light and reference reflectance light for use with the fluorescence/reflectance imaging mode. - A
light source 52A of a second class is illustrated inFIG. 2B ; only the differences from the light source shown inFIG. 2A will be elucidated. Thelight source 52A uses multiple filters during each imaging mode. For example, light source filters, which provide red, green, and blue illumination sequentially for periods corresponding to a video frame or field, can be used for the acquisition of a color or a multi-spectral image with a monochrome image sensor, with the different wavelength components of the image each acquired at slightly different times. Such rapid filter changing requires a considerably different actuator than necessitated for thelight source 52 ofFIG. 2A . As shown inFIG. 2B , the filters are mounted on afilter wheel 79 that is rotated by a motor, which is synchronized to the video field or frame rate. The layout of the blue, red and green filters, 79A, 79B, and 79C respectively, infilter wheel 79 are shown inFIG. 3 . - The transmission characteristics of light source filters, the characteristics of the filter actuator mechanism, and the time available for motion of the filters into and out of the light path, for the two different classes of light sources are described in more detail below in the context of the various camera embodiments.
- Because fluorescence endoscopy is generally used in conjunction with white light endoscopy, each of the various embodiments of the
multi-mode camera 100 described below may be used both for color and fluorescence/reflectance and/or fluorescence/fluorescence imaging. These camera embodiments particularly lend themselves to incorporation within a fluorescence video endoscope due to their compactness and their ability to be implemented with no moving parts. - In a first embodiment, shown in
FIG. 4A , acamera 100A receives light from thetissue 58, either directly from the tissue in the case of a camera located at the insertion end of an endoscope, as shown inFIG. 1A , or by virtue of anendoscope image guide 56, which transmits the light from the tissue to the camera, as shown inFIG. 1B . The light is directed towards amonochrome image sensor 102 and a lowlight image sensor 104 by a fixedoptical beamsplitter 106 that splits the incoming light into two beams. The light beam is split such that a smaller proportion of the light received from thetissue 58 is directed towards themonochrome image sensor 102 and a larger proportion of the incoming light is directed towards the lowlight image sensor 104. In this embodiment, the beamsplitter may be a standard commercially availablesingle plate 88,single cube 89, orsingle pellicle design 90, as shown inFIGS. 5A-5C . It should be noted that, if the optical path between thetissue 58 and the image sensors contains an uneven number of reflections (e.g., such as from a single component beamsplitter), the image projected onto the sensor will be left-to-right inverted. The orientation of such images will need to be corrected by image processing. - In
FIG. 4A , lightcollimating optics 110 are positioned in front of thebeamsplitter 106, andimaging optics monochrome image sensor 102 and the lowlight image sensor 104, respectively. Aspectral filter 118 is located in the optical path between thebeamsplitter 106 and the lowlight image sensor 104. Alternatively, thespectral filter 118 may be incorporated as an element of thebeamsplitter 106. -
FIG. 4B illustrates another embodiment of thecamera 100. Acamera 100B is the same as thecamera 100A described above except that thelight collimating optics 110 andimaging optics imaging optics 113 located between the tissue andbeamsplitter 106. The advantage of this configuration is that all imaging is performed and controlled by thesame imaging optics 113. Such a configuration requires all beam paths to have the same optical path length, however, and this restriction must be considered in the design of thebeamsplitter 106 andspectral filter 118 that is located in the path to the lowlight image sensor 104. In addition, the fact that these optical elements are located in a converging beam path must be considered in specifying these elements and in the design of theimaging optics 113. - The low
light image sensor 104 preferably comprises a charge coupled device with charge carrier multiplication (of the same type as the Texas Instruments TC253 or the Marconi Technologies CCD65), electron beam charge coupled device (EBCCD), intensified charge coupled device (ICCD), charge injection device (CID), charge modulation device (CMD), complementary metal oxide semiconductor image sensor (CMOS) or charge coupled device (CCD) type sensor. Themonochrome image sensor 102 is preferably a CCD or a CMOS image sensor. - An alternative configuration of the
camera 100B is shown inFIG. 4C . All aspects of this embodiment of thiscamera 100C are similar to thecamera 100B shown inFIG. 4B except for differences which arise from reducing the width of the camera by mounting bothimage sensors light image sensor 104 and themonochrome image sensor 102 are mounted with their image planes perpendicular to the input image plane of the camera. Light received from thetissue 58 is projected by imagingoptics 113 throughbeamsplitter 106 onto theimage sensors beamsplitter 106 directs a portion of the incoming light in one beam towards one of thesensors beamsplitter 106 and is directed by amirror 108 towards the other of thesensors imaging optics 115 is utilized to account for the longer optical path to this second sensor. The images projected onto both sensors will be left-to-right inverted and should be inverted by image processing. - The processor/
controller 64 as shown inFIGS. 1A and 1B receives the transduced image signals from thecamera 100 and digitizes and processes these signals. The processed signals are then encoded in a video format and displayed on acolor video monitor 66. - Based on operator input, the processor/
controller 64 also provides control functions for the fluorescence endoscopy video system. These control functions include providing control signals that control the camera gain in all imaging modes, coordinating the imaging modes of the camera and light source, and providing a light level control signal for the light source. - The reason that two separate images in different wavelength bands are acquired in fluorescence imaging modes of the fluorescence endoscopy video systems described herein, and the nature of the fluorescence/reflectance and fluorescence/fluorescence imaging, will now be explained. It is known that the intensity of the autofluorescence at certain wavelengths changes as tissues become increasingly abnormal (i.e. as they progress from normal to frank cancer). When visualizing images formed from such a band of wavelengths of autofluorescence, however, it is not easy to distinguish between those changes in the signal strength that are due to pathology and those that are due to imaging geometry and shadows. A second fluorescence image acquired in a band of wavelengths in which the image signal is not significantly affected by tissue pathology, utilized for fluorescence/fluorescence imaging, or a reflected light image acquired in a band of wavelengths in which the image signal is not significantly affected by tissue pathology consisting of light that has undergone scattering within the tissue (known as diffuse reflectance), utilized for fluorescence/reflectance imaging, may be used as a reference signal with which the signal strength of the first fluorescence image can be “normalized.” Such normalization is described in two patents previously incorporated herein by reference: U.S. Pat. No. 5,507,287, issued to Palcic et al. describes fluorescence/fluorescence imaging and U.S. Pat. No. 5,590,660, issued to MacAulay et al. describes fluorescence/reflectance imaging.
- One technique for performing the normalization is to assign each of the two image signals a different display color, e.g., by supplying the image signals to different color inputs of a color video monitor. When displayed on a color video monitor, the two images are effectively combined to form a single image, the combined color of which represents the relative strengths of the signals from the two images. Since light originating from fluorescence within tissue and diffuse reflectance light which has undergone scattering within the tissue are both emitted from the tissue with a similar spatial distribution of intensities, the color of a combined image is independent of the absolute strength of the separate image signals, and will not change as a result of changes in the distance or angle of the
endoscope 60 to thetissue sample 58, or changes in other imaging geometry factors. If, however, there is a change in the shape of the autofluorescence spectrum of the observed tissue that gives rise to a change in the relative strength of the two image signals, such a change will be represented as a change in the color of the displayed image. Another technique for performing the normalization is to calculate the ratio of the pixel intensities at each location in the two images. A new image can then be created wherein each pixel has an intensity and color related to the ratio computed. The new image can then be displayed by supplying it to a color video monitor. - The mixture of colors with which normal tissue and tissue suspicious for early cancer are displayed depends on the gain applied to each of the two separate image signals. There is an optimal gain ratio for which tissue suspicious for early cancer in a fluorescence image will appear as a distinctly different color than normal tissue. This gain ratio is said to provide the operator with the best combination of sensitivity (ability to detect suspect tissue) and specificity (ability to discriminate correctly). If the gain applied to the reference image signal is too high compared to the gain applied to the fluorescence image signal, the number of tissue areas that appear suspicious, but whose pathology turns out to be normal, increases. Conversely, if the relative gain applied to the reference image signal is too low, sensitivity decreases and suspect tissue will appear like normal tissue. For optimal system performance, therefore, the ratio of the gains applied to the image signals must be maintained at all times. The control of the gain ratio is described in two patent applications previously incorporated herein by reference: U.S. patent application Ser. No. 09/615,965, and U.S. patent application Ser. No. 09/905,642.
- In vivo spectroscopy has been used to determine which differences in tissue autofluorescence and reflectance spectra have a pathological basis. The properties of these spectra determine the particular wavelength bands of autofluorescence and reflected light required for the fluorescence/reflectance imaging mode, or the particular two wavelength bands of autofluorescence required for fluorescence/fluorescence imaging mode. Since the properties of the spectra depend on the tissue type, the wavelengths of the important autofluorescence band(s) may depend on the type of tissue being imaged. The specifications of the optical filters described below are a consequence of these spectral characteristics, and are chosen to be optimal for the tissues to be imaged.
- As indicated above, the filters in the light source and camera should be optimized for the imaging mode of the camera, the type of tissue to be examined and/or the type of pre-cancerous tissue to be detected. Although all of the filters described below can be made to order using standard, commercially available components, the appropriate wavelength range of transmission and degree of blocking outside of the desired transmission range for the described fluorescence endoscopy images are important to the proper operation of the system. The importance of other issues in the specification of such filters, such as the fluorescence properties of the filter materials and the proper use of anti-reflection coatings, are taken to be understood.
-
FIGS. 6A-6E illustrate the preferred filter characteristics for use in a fluorescence endoscopy system having a camera of the type shown inFIGS. 4A-4C and light source as shown inFIG. 2B , that operates in a fluorescence/reflectance imaging mode, or a color imaging mode. There are several possible configurations of fluorescence endoscopy video systems, operating in the fluorescence/reflectance imaging mode including green fluorescence with either red or blue reflectance, and red fluorescence with either green or blue reflectance. The particular configuration utilized depends on the target clinical organ and application. The filter characteristics will now be described for each of these four configurations. -
FIG. 6A illustrates the composition of the light transmitted by a blue filter, such asfilter 79A, which is used to produce excitation light in the system light source. This filter transmits light in the wavelength range from 370-460 nm or any subset of wavelengths in this range. Of the light transmitted by this filter, less than 0.001% is in the fluorescence imaging band from 480-750 nm (or whatever desired subsets of this range is within the specified transmission range of the primary and reference fluorescence image filters described below). -
FIG. 6B illustrates the composition of the light transmitted by a red filter, such asfilter 79B, which is used to produce red reflectance light in the system light source. This filter transmits light in the wavelength range from 590-750 nm or any subset of wavelengths in this range. Light transmitted outside this range should not exceed 1%. -
FIG. 6C illustrates the composition of the light transmitted by a green filter, such asfilter 79C, which is used to produce green reflectance light in the system light source. This filter transmits light in the wavelength range from 480-570 nm or any subset of wavelengths in this range. Light transmitted outside this range should not exceed 1%. -
FIG. 6D shows the composition of the light transmitted by a camera spectral filter, such asfilter 118, for defining the primary fluorescence image in the green spectral band. In this configuration, the filter blocks excitation light and red fluorescence light while transmitting green fluorescence light in the wavelength range of 480-570 nm or any subset of wavelengths in this range. When used in a fluorescence endoscopy video system with thelight source filter 79A described above, the filter characteristics are such that any light outside of the wavelength range of 480-570 nm, or any desired subset of wavelengths in this range, contributes no more than 0.1% to the light transmitted by the filter. -
FIG. 6E shows the composition of the light transmitted by a camera filter, such asfilter 118, for defining the primary fluorescence image in the red spectral band. In this configuration, the filter blocks excitation light and green fluorescence light while transmitting red fluorescence light in the wavelength range of 590-750 nm or any subset of wavelengths in this range. When used in a fluorescence endoscopy video system with thelight source filter 79A described above, the filter characteristics are such that any light outside of the wavelength range of 590-750 nm, or any desired subset of wavelengths in this range, contributes no more than 0.1% to the light transmitted by the filter. - The operation of the preferred embodiment of the fluorescence endoscopy video system will now be described. The
cameras 100A as shown inFIGS. 4A and 100B as shown inFIG. 4B or 100C as shown inFIG. 4C are capable of operating in color and fluorescence/reflectance imaging modes. A light source of the type shown inFIG. 2B , that provides a different output every video frame or field is required. In the color imaging mode, the processor/controller 64 provides a control signal to the multi-modelight source 52 that indicates the light source should be operating in the white light mode and provides a synchronizing signal. Thelight source 52 sequentially outputs filtered red, green, and blue light, synchronously with the video field or frame of theimage sensors light source 52 is projected into theendoscope light guide 54 and is transmitted to the tip of theendoscope 60 to illuminate thetissue 58. - The processor/
controller 64 also protects the sensitive lowlight image sensor 104 during color imaging by decreasing the gain of the amplification stage of the sensor. The light reflected by thetissue 58 is collected and transmitted by theendoscope image guide 56 to the camera where it is projected throughbeamsplitter 106 onto themonochrome image sensor 102, or the light is directly projected through thecamera beamsplitter 106 onto themonochrome image sensor 102 if the sensor is located within the insertion portion of the endoscope. The image projected during each of red, green, blue illuminations is transduced by themonochrome image sensor 102 and the resulting image signals are transmitted to the processor/controller 64. - Based on the brightness of the images captured, the processor/
controller 64 provides a control signal to the multi-modelight source 52 to adjust theintensity control 80 and thereby adjust the level of light output by theendoscope light guide 54. The processor/controller 64 may also send a control signal to thecamera monochrome image sensor 102. - The processor/
controller 64 interpolates the images acquired during sequential periods of red, green, and blue illumination to create a complete color image during all time periods, and encodes that color image as video signals. The video signals are connected to color video monitor 66 for display of the color image. All of the imaging operations occur at analog video display rates (30 frames per second for NTSC format and 25 frames per second for PAL format). - When switching to the fluorescence/reflectance imaging mode, the processor/
controller 64 provides a control signal to the multi-modelight source 52 to indicate that it should be operating in fluorescence/reflectance mode. In response to this signal, the lightsource filter wheel 79 stops rotating and thelight source 52 selects and positions the appropriate blueoptical filter 79A continuously into the optical path between thearc lamp 70 and theendoscope light guide 54. This change from sequentially changing filters to a static filter occurs in a period of approximately one second.Filter 79A transmits only those wavelengths of light that will induce thetissue 58 under examination to fluoresce. All other wavelengths of light are substantially blocked as described above. The filtered light is then projected into theendoscope light guide 54 and transmitted to the tip of theendoscope 60 to illuminate thetissue 58. - As part of setting the system in the fluorescence/reflectance mode, the processor/
controller 64 also increases the gain of the amplification stage of the lowlight image sensor 104. The fluorescence emitted and excitation light reflected by thetissue 58 are either collected by theendoscope image guide 56 and projected through thecamera beamsplitter 106 onto the lowlight image sensor 104 and theimage sensor 102, or are collected and directly projected through thecamera beamsplitter 106 onto the lowlight image sensor 104 and theimage sensor 102 at the insertion tip of theendoscope 60.Spectral filter 118 limits the light transmitted to the lowlight image sensor 104 to either green or red autofluorescence light only and substantially blocks the light in the excitation wavelength band. The autofluorescence image is transduced by the lowlight image sensor 104. The reference reflected excitation light image is transduced by themonochrome image sensor 102 and the resulting image signals are transmitted to the processor/controller 64. - Based on the brightness of the transduced images, the processor/
controller 64 may provide a control signal to the multi-modelight source 52 to adjust theintensity control 80 and thereby adjust the level of light delivered to theendoscope 60. The processor/controller 64 may also send control signals to thecameras light image sensor 104 and themonochrome image sensor 102, in order to maintain constant image brightness while keeping the relative gain constant. - After being processed, the images from the two sensors are encoded as video signals by processor/
controller 64. The fluorescence/reflectance image is displayed by applying the video signals to different color inputs on thecolor video monitor 66. - In order for the combined image to have optimal clinical meaning, for a given proportion of fluorescence to reference light signals emitted by the tissue and received by the system, a consistent proportion must also exist between the processed image signals that are displayed on the video monitor. This implies that the (light) signal response of the fluorescence endoscopy video system is calibrated. One suitable calibration technique is described in two patent applications previously incorporated herein by reference: U.S. patent application Ser. No. 09/615,965, and U.S. patent application Ser. No. 09/905,642.
- The
cameras - In this variation of the fluorescence/reflectance mode, instead of changing from sequential red, green, and blue illumination to static blue illumination when switching from color imaging to fluorescence/reflectance imaging, the multi-mode
light source 52 provides the same sequential illumination utilized in the color imaging mode, for all imaging modes. Capture and display of the light reflected by the tissue is similar to that described previously for the color imaging mode. However, in addition to the reflectance images captured in that mode, the gain of the amplification stage of the lowlight image sensor 104 is adjusted to a value that makes it possible to capture autofluorescence images during blue illumination. During red and green illumination, the gain of amplification stage of the low light sensor is decreased to protect the sensor while theimage sensor 102 captures reflectance images. - In this modified fluorescence/reflectance mode, the camera captures both reflectance and fluorescence images during the blue illumination period, in addition to reflected light images during the red and green illumination periods. As for the color imaging mode, the reflectance images are interpolated and displayed on the corresponding red, green and blue channels of a color video monitor to produce a color image. Like the previously described fluorescence/reflectance mode, a fluorescence/reflectance image is produced by overlaying the fluorescence image and one or more of the reflectance images displayed in different colors on a color video monitor.
- Since individual reflectance and fluorescence images are concurrently captured, both a color image and a fluorescence/reflectance image can be displayed simultaneously on the color video monitor. In this case, there is no need to utilize a separate color imaging mode. Alternatively, as described for the previous version of fluorescence/reflectance operation, only the fluorescence/reflectance image may be displayed during fluorescence/reflectance imaging and a color image displayed solely in the color imaging mode.
- Yet another embodiment of this invention will now be described. All points of similarity with the first embodiment will be assumed understood and only points that differ will be described.
- In this second embodiment, all aspects of the fluorescence endoscopy video system are similar to those of the first embodiment except for the camera and the light source. A
camera 100D for this embodiment of a system is as shown inFIG. 7A . It differs from thecameras color image sensor 103 may be a three-CCD with charge carrier multiplication color image sensor assembly, a color CCD, a three-CCD color image sensor assembly, a color CMOS image sensor, or a three-CMOS color image sensor assembly. - Each of the pixel elements on the low
light color sensor 103 is covered by an integrated filter, typically red, green or blue. These filters define the wavelength bands of fluorescence and reflectance light that reach the individual pixel elements. Such mosaic filters typically have considerable overlap between the red, green, and blue passbands, which can lead to considerable crosstalk when imaging dim autofluorescence light in the presence of intense reflected excitation light. Therefore, aseparate filter 118 is provided to reduce the intensity of reflected excitation light to the same level as that of the autofluorescence light and, at the same time, pass autofluorescence light. - In this embodiment, the primary fluorescence and reference images are projected onto the
same image sensor 103, but, because of the individual filters placed over each pixel, these different images are detected by separate sensor pixels. As a result, individual primary fluorescence and reference image signals can be produced by processor/controller 64 from the single CCD image signal. - In
FIG. 7A ,light collimating optics 110 is positioned between thetissue 58 andfilter 118 andimaging optics 112 is positioned immediately preceding thecolor image sensor 103. In an alternative optical configuration,camera 100E, as shown inFIG. 7B , eliminates thecollimating optics 110 andimaging optics 112 and replaces them with asingle imaging optics 113 located between thetissue 58 andfilter 118. The advantage of this configuration is that all imaging is performed and controlled by thesame imaging optics 113. The fact thatfilter 118 is located in a converging beam path must be considered in specifying that element and in the design of the imaging optics. - The operation of a system based on
camera 100D ofFIG. 7A or 100E ofFIG. 7B will now be described. Thecameras camera FIG. 2A , provides steady state output in each imaging mode. As described below, the light transmission specifications of the light source filters 76A, 76B, and 76C, thefilter 118, and the mosaic color filters integrated with theimage sensor 103 are selected such that the intensity of the reflected light and fluorescence light at the color image sensor's active elements results in transduced image signals with good signal-to-noise characteristics and without significant saturation. At the same time these filters have appropriate light transmission specifications for excitation and imaging of the primary fluorescence and for color imaging. The filter transmission characteristics are chosen to provide the desired ratio of relative primary fluorescence to reference light intensity at the image sensor. - In the color imaging mode, the processor/
controller 64 provides a control signal to the multimodelight source 52 that it should be in white light mode. The light source selects and positions the appropriateoptical filter 76A into the optical path between thearc lamp 70 andendoscope light guide 54. Given the presence offilter 118 incameras light source filter 76A should incorporate reduced transmission at red and green wavelengths to obtain a balanced color image atimage sensor 103 with the proper proportions of red, green, and blue components. - Image signals from the color low
light sensor 103 are processed by processor/controller 64. Standard techniques are utilized to produce a color image from a single color sensor: the image signals from pixels having the same filter characteristics are interpolated by processor/controller 64 to produce an image signal, related to the pass band of each element of the mosaic filter (e.g., red, green, and blue), at every pixel location. The resulting multiple images, which when combined produce a color image, are encoded by processor/controller 64 as video signals. The color image is displayed by connecting the video signals to the appropriate inputs ofcolor video monitor 66. - Processor/
controller 64 also maintains the overall image brightness at a set level by monitoring the brightness of the image signal at each pixel and adjusting the intensity of the light source output and camera amplifier gains according to a programmed algorithm. - When switching to the fluorescence/fluorescence imaging mode, processor/
controller 64 provides a control signal to the multi-modelight source 52 to indicate that it should be in fluorescence/fluorescence mode. Thelight source 52 moveslight source filter 76B into position in the light beam.Filter 76B transmits excitation light and blocks the transmission of light at the green and red fluorescence detection wavelengths, as described below. The characteristics of light sourcefluorescence excitation filter 76B andexcitation filter 118, along with the mosaic filter elements on thecolor sensor 103, are such that the intensity of blue light at the color sensor is less than the intensities of red and green autofluorescence at the sensor, and are such that the ratio of the intensity of red autofluorescence to the intensity of green autofluorescence at thecolor sensor 103 has the appropriate value for optimal differentiation between normal and abnormal tissue. The fluorescence images are processed, as previously described for color imaging, by processor/controller 64 to produce separate images corresponding to each of the pass bands of the mosaic filter (e.g., red, green, and blue). These separate images are encoded as video signals by processor/controller 64. A composite fluorescence/fluorescence image is displayed on the color video monitor 66 by applying the video signals from red and green pass bands of the mosaic filter to different color inputs of the monitor. - When switching to the fluorescence/reflectance imaging mode, processor/
controller 64 provides a control signal to the multi-modelight source 52 to indicate that it should be in fluorescence/reflectance mode. Thelight source 52 moves light source filter 76C into position in the light beam.Filter 76C transmits both excitation light and reference light and blocks the transmission of light at fluorescence detection wavelengths, as described below. The characteristics of thelight source filter 76C for fluorescence excitation and the reflectance illumination and thecamera filter 118, along with the mosaic filter on thecolor sensor 103, as detailed below, are such that the intensity of reflected excitation light at the color sensor is comparable to the intensity of autofluorescence at the sensor, and should be such that the ratio of the intensity of autofluorescence to the intensity of reflected reference light at thecolor sensor 103 has the appropriate value. The fluorescence and reflectance images are processed, as previously described for color imaging, by processor/controller 64 to produce separate images corresponding to each of the pass bands of the mosaic filter (e.g., red, green, and blue). These separate images are encoded as video signals by processor/controller 64. A composite fluorescence/reflectance image is displayed on color video monitor 66 by applying the video signals from the appropriate mosaic filter pass bands (as discussed below) to different color inputs of the monitor. - As indicated above, the filters in the light source and camera should be optimized for the imaging mode of the camera, the type of tissue to be examined and/or the type of pre-cancerous tissue to be detected. Although all of the filters described below can be made to order using standard, commercially available components, the appropriate wavelength range of transmission and degree of blocking outside of the desired transmission range for the described fluorescence endoscopy images modes are important to the proper operation of the system. The importance of other issues in the specification of such filters such as the fluorescence properties of the filter materials and the proper use of anti-reflection coatings are taken to be understood.
- As discussed above, the filters in the light source and camera should be optimized for the imaging mode of the camera, the type of tissue to be examined and/or the type of pre-cancerous tissue to be detected, based on in vivo spectroscopy measurements. The preferred filter characteristics for use in the fluorescence endoscopy video systems with a camera of the type shown in
FIGS. 7A and 7B , operating in a fluorescence/reflectance imaging mode, or a fluorescence/fluorescence imaging mode, are shown inFIGS. 8A-8F . There are several possible configurations of fluorescence endoscopy video systems, operating in the fluorescence/reflectance imaging mode including green fluorescence with red reflectance, and red fluorescence with green reflectance and red or green fluorescence with blue reflectance. The particular configuration utilized depends on the target clinical organ and application. The filter characteristics will now be described for each of these four configurations. -
FIGS. 8A-8B illustrate a preferred composition of the light transmitted by filters for a color imaging mode.FIG. 8A illustrates the composition of the light transmitted by the light source filter, such asfilter 76A, which is used to produce light for color imaging. Thespectral filter 118 remains in place during color imaging since there are no moving parts in the present camera embodiment. Accordingly, to achieve correct color rendition during color imaging it is necessary for the transmission of light source filter 76A to be modified, compared to the usual white light transmission for color imaging, such that the light received by the highsensitivity color sensor 103 is white when a white reflectance standard is viewed with the camera. Therefore, to balance the effect ofspectral filter 118, the transmission offilter 76A in the red and green spectral bands must be less than the transmission in the blue, and the transmission offilter 76A in the blue must extend to a long enough wavelength that there is an overlap with the short wavelength region of appreciable transmission of filter 1118.Filter 76A transmits light in the blue wavelength range from 370-480 nm or any subset of wavelengths in this range at the maximum possible transmission. The transmission ofFilter 76A in the green and red wavelength range from 500 nm-750 nm, or any subsets of wavelengths in this range, is preferably reduced by at least a factor of ten compared to the transmission in the blue, in order to achieve a balanced color image at the highsensitivity color sensor 103, after taking into account the effect offilter 118. -
FIG. 8B shows the composition of the light transmitted by thespectral filter 118, which is used for all imaging modes. In this configuration, the filter blocks the blue excitation light in the range 370-450 nm while transmitting red and green light in the wavelength range of 470-750 nm or any subsets of wavelengths in this range. When used in a fluorescence endoscopy video system in combination with thelight source filter 76A described above, the filter characteristics are such that the intensity of light captured by highsensitivity color sensor 103 in the wavelength bands transmitted by the different regions of the sensor's mosaic filter are comparable, when a white reflectance standard is imaged. When used in a fluorescence endoscopy video system for fluorescence/fluorescence imaging in combination with thelight source filter 76B described below, the filter characteristics are such that any light outside of the wavelength range of 470-750 nm (or any desired subset of wavelengths in this range) contributes no more than 0.1% to the light transmitted by the filter. -
FIG. 8C illustrates the composition of the light transmitted by a filter, such asfilter 76B, which is used to produce excitation light in the system light source. This filter transmits light in the wavelength range from 370-450 nm or any subset of wavelengths in this range. Of the light transmitted by this filter, preferably less than 0.001% is in the fluorescence imaging band from 470-750 nm (or whatever desired subsets of this range is within the transmission range of the primary and reference fluorescence wavelength bands defined by the transmission of the mosaic filter incorporated in the high sensitivity color sensor 103). -
FIG. 8D illustrates the composition of the light transmitted by the light source filter, such asfilter 76C, which is used to produce blue excitation light and red reference light for a green fluorescence and red reflectance imaging mode. This filter transmits light in the blue wavelength range from 370-450 nm, or any subset of wavelengths in this range. It also transmits light in the red wavelength range of 590-750 nm, or any subset of wavelengths in this range. The light transmitted in the red wavelength range (or subset of that range) is adjusted, as part of the system design, to be an appropriate fraction of the light transmitted in the blue wavelength range. This fraction is selected to meet the need to match the intensity of the reflected reference light projected on the color image sensor to the requirements of the sensor, at the same time as maintaining sufficient fluorescence excitation. Of the light transmitted by this filter, less than 0.001% is in the green wavelength range of 470-570 nm (or whatever desired subset of this range is specified as the transmission range of the primary fluorescence wavelength band). -
FIG. 8E illustrates the composition of the light transmitted by a light source filter which is used to produce excitation light such asfilter 76C described above for a red fluorescence and green reflectance imaging mode. This filter transmits light in the blue wavelength range from 370-450 nm or any subset of wavelengths in this range. It also transmits light in the green wavelength range of 470-570 nm or any subset of wavelengths in this range. The light transmitted in the green wavelength range (or subset of that range) is adjusted, as part of the system design, to be an appropriate fraction of the light transmitted in the blue wavelength range. This fraction is selected to meet the need to match the intensity of the reflected reference light projected on the color image sensor to the requirements of the sensor, at the same time as maintaining sufficient fluorescence excitation. Of the light transmitted by this filter, less than 0.001% is in the red fluorescence imaging wavelength range of 590-750 nm (or whatever desired subset of this range is specified as the transmission range of the primary fluorescence wavelength band). -
FIG. 8F illustrates the composition of the light transmitted by a light source filter which is used to produce excitation light such asfilter 76C described above for a red or green fluorescence and blue reflectance imaging mode. This filter transmits light in the blue wavelength range from 370-470 nm or any subset of wavelengths in this range. The light transmitted in the 450-470 nm wavelength range (or subset of that range) is adjusted, as part of the system design, to meet the need to match the intensity of the reflected reference light projected on the color image sensor to the requirements of the sensor and to provide the appropriate ratio of reference reflected light to fluorescence light, at the same time as maintaining sufficient fluorescence excitation. Of the light transmitted by this filter, less than 0.001% is in the fluorescence imaging wavelength range of 490-750 nm (or whatever desired subset of this range is specified as the transmission range of the primary fluorescence wavelength band). - In an alternative embodiment of the present invention, fluorescence and white light images can be obtained by placing a filter on the distal tip of a video endoscope. A limitation of current fluorescence videoendoscopy systems is that they typically employ the use of dedicated endoscopes. Fluorescence imaging with such endoscopes is enabled by the use of an excitation barrier filter to block the strong excitation light used to excite the tissue fluorescence these systems are intended to image. These barrier filters are built in to the endoscope distal end (typically between the objective lens and the low light image sensor) and this built-in filter distinguishes these endoscopes from those used for conventional videoendoscopy. The alternative embodiment of the present invention describes the use of an externally mounted filter in conjunction with a videoendoscope that contains a sufficiently sensitive image sensor to image tissue fluorescence. This combination of a conventional video endoscope and an externally mounted barrier filter can be used in conjunction with an appropriate endoscopic light source to image both in both color and fluorescence modes.
-
FIG. 9 illustrates one embodiment of adistal filter 202 that can be placed over the distal end of a conventional white light imaging endoscope to allow the endoscope to perform fluorescence and white light examinations of a patient. As will be described below, thefilter 202 blocks excess excitation light from reaching theimage sensor 103 but allows some blue light to pass in order to obtain white light images. -
FIGS. 10A and 10B illustrate the operation of thedistal filter 202 in further detail. Anendoscope 250 includesillumination ports port 256 is the distal entrance to a working channel through which endoscopic tools can be passed in order to perform a desired task such as obtaining a biopsy sample, marking tissue with dye or perform some other diagnostic or therapeutic procedures. Light that is reflected from thetissue 350 is captured by alens 258 that images the light onto a low light color sensor. In this embodiment, the low light sensor comprises amosaic filter 260 that is positioned in front of a CCD, CMOS orequivalent image sensor 262. Image signals produced by the image sensor are transmitted to an image processor (not shown) that converts the signals into video signals that are displayed on a monitor. In addition the video signals may be recorded on a video tape, DVD or other storage media for later review or comparison. - In order to allow the endoscope to obtain both fluorescence and white light images of the
tissue 350, theendoscope 250 may be fitted with thedistal end filter 202. In the embodiment shown, thefilter 202 is included in afilter assembly 300 that does not obscure theillumination ports filter assembly 300 does not interfere with other distal tip features including but not limited to features such as water/air nozzles, electrodes, confocal imaging ports, or the workingchannel 256 so that tools can still be routed through the endoscope. The filter assembly is made of appropriately inert and non-conductive materials such as plastic or glass or stainless steel, so as also not to interfere with the particular material or electrical characteristics of the endoscope tip that may be required for use in conjunction with endotherapy techniques, such as argon ion plasma coagulation (APC), electrocautery, cryotherapy, or photodynamic therapy (PDT) - The
filter 202 is positioned in front of theimaging lens 258 and prevents excitation light from reaching the image sensor. In one embodiment, the filter removes the excitation light having wavelengths in the range of 370-450 nm. or some subset of this range but passes some blue light, for example 451-480 nm. for use in white light imaging as will be described below. Because most endoscope have objective lenses with a wide field of view, the filter should block excitation light over a corresponding wide field of view and over the range of angles of incidence of light collected by the endoscope objective. The filter should also be thin enough not to introduce optical aberrations or interfere with the mechanical properties and maneuverability of the endoscope tip. Dye-based absorption filters that block the desired range of excitation light and operate over a wide field of view may therefore be preferred for this application. Specific examples of such filters include Kodak Wratten gel filters. For durability, the filter is preferably constructed in a manner similar to optically protective eyewear such as laser goggles. As shown inFIG. 10A , thedistal filter 202 allows fluorescence images to be obtained in at least two modes. In a first mode, excitation light, typically in the blue wavelength spectral band, is provided from a light source (not shown) and through theillumination ports tissue sample 350. A portion of the excitation light is absorbed by the tissue and causes a tissue sample to produce fluorescence light while a portion of the excitation light is reflected off the surface of thetissue 350. Excitation light reflecting from the surface of thetissue 350 is blocked by thefilter 202 in thefilter assembly 300, while the fluorescence light and light in other spectral bands passes through thefilter 202. - In one fluorescence imaging mode, only fluorescence light is used to produce video images of the tissue. In another mode, the tissue is illuminated with the excitation light and some amount of reflectance light. As shown in
FIG. 10A , the reflectance light is in the red spectral band. The reflectance light passes through thefilter 202 and thefilter 260 in front of theimage sensor 262. Images of the tissue are obtained by combining for example, the green pixels from theimage sensor 262 to obtain a fluorescence image in the green spectral band and the red pixels from theimage sensor 262 to obtain a reflectance image in the red spectral band. Alternatively, the reflectance light may be provided in the green spectral band and a red fluorescence image obtained. In yet another embodiment, blue reflectance light having wavelengths that are not filtered by thefilter 202 can be used to produce the reflectance image. The fluorescence and reflectance images may be combined for display for a viewer. In order to prevent the reflectance image from overpowering the fluorescence image, the amount of reflectance light supplied from the light source is selected to be comparable to the amount of fluorescence light received by theimage sensor 262. - As shown in
FIG. 10B , theendoscope 250 can also be used to obtain white light images of thetissue 350 by illuminating the tissue with light including red, green and blue spectral components. The illumination light is reflected by thetissue sample 350, passes through thefilter 202 and is focused onto thefilter 260 by the endoscope'simaging lens 258. Because thefilter 202 removes most of the blue reflectance light, the light received by theimage sensor 262 includes excess red and green light. To compensate for the reduced blue light at the image sensor, the illumination light should either contain excess blue light in the band that passes through thefilter 202 or contain reduced green and red light so that the resulting image produced by the image sensor may be white balanced. Additional fine tuning of the white balance of the images produced by theimage sensor 262 can be accomplished by image processing software in the image processing board (not shown). - One embodiment of a
filter assembly 200 that is placed on the distal tip of an endoscope is shown inFIG. 11 . Afilter 202 may be mounted in a frame that is snap-fitted over the distal end face of an endoscope. The filter and/or frame are secured to the endoscope with a mechanical, adhesive, magnetic force or other means. In one embodiment, the frame includes a set of proximally extendingtabs - The
filter 202 is positioned in front of the imaging lens of the endoscope. As indicated above, thefilter 202 operates to remove a substantial portion of reflected blue excitation light used during the fluorescence imaging mode. In the embodiment shown inFIG. 11 , the frame also includes ahole 210 that is positioned over the working channel of the endoscope in order to allow tools, such as biopsy forceps, snares, cytology brushes, etc., to be passed through the working channel. Positioned on either side of the frame areholes 212, 214 that allow light from the illumination guides to pass through the frame. - Another embodiment of the present invention also utilizes a filter on the distal tip of a video endoscope. Some videoendoscope systems do not employ the use of color image sensors and instead use sequential illumination in various spectral (e.g blue, green, red) bands and then combine monochrome images to produce full color images. An
external barrier filter 202 can be used in an endoscope of the type shown inFIG. 9 with the highsensitivity color sensor 103 replaced by a monochrome image sensor and sequential illumination of the type discussed in connection withFIG. 2B . - Briefly, in accordance with one embodiment of the invention, autofluorescence images are obtained by illuminating with an excitation light. Color images are obtained by sequential illumination with red, green and blue light; wherein the blue light either includes wavelengths or is limited to wavelengths not blocked by the
filter 202. - The fluorescence endoscopy video systems described in the above embodiments have been optimized for imaging endogenous tissue fluorescence. They are not limited to this application, however, and may also be used for photo-dynamic diagnosis (PDD) applications. As mentioned above, PDD applications utilize photo-active drugs that preferentially accumulate in tissues suspicious for early cancer. Since effective versions of such drugs are currently in development stages, this invention does not specify the filter characteristics that are optimized for such drugs. With the appropriate light source camera filter combinations, however, a fluorescence endoscopy video system operating in either fluorescence/fluorescence or fluorescence/reflectance imaging mode as described herein may be used to image the fluorescence from such drugs.
- As will be appreciated, each of the embodiments of a camera for a fluorescence endoscopy video system described above, due to their simplicity, naturally lend themselves to miniaturization and implementation in a fluorescence video endoscope, with the camera being incorporated into the insertion portion of the endoscope. The cameras can be utilized for both color imaging and fluorescence imaging, and in their most compact form contain no moving parts.
Claims (17)
Priority Applications (9)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/122,267 US20060241496A1 (en) | 2002-01-15 | 2005-05-04 | Filter for use with imaging endoscopes |
US11/412,715 US8630698B2 (en) | 2005-05-04 | 2006-04-26 | Filter for use with imaging endoscopes |
EP06721854.5A EP1883337A4 (en) | 2005-05-04 | 2006-04-27 | Filter for use with imaging endoscopes |
JP2008509275A JP2008539827A (en) | 2005-05-04 | 2006-04-27 | Filter for use with imaging endoscopes |
PCT/CA2006/000669 WO2006116847A1 (en) | 2005-05-04 | 2006-04-27 | Filter for use with imaging endoscopes |
JP2013246636A JP2014087661A (en) | 2005-05-04 | 2013-11-28 | Filter for use with imaging endoscope |
US14/154,177 US20140194687A1 (en) | 2005-05-04 | 2014-01-13 | Filter for use with imaging endoscopes |
US14/975,707 US10182709B2 (en) | 2002-01-15 | 2015-12-18 | Filter for use with imaging endoscopes |
US16/218,256 US20190357757A1 (en) | 2002-01-15 | 2018-12-12 | Filter for use with imaging endoscopes |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/050,601 US6899675B2 (en) | 2002-01-15 | 2002-01-15 | Fluorescence endoscopy video systems with no moving parts in the camera |
US11/009,965 US20050154319A1 (en) | 2002-01-15 | 2004-12-10 | Fluorescence endoscopy video systems with no moving parts in the camera |
US11/122,267 US20060241496A1 (en) | 2002-01-15 | 2005-05-04 | Filter for use with imaging endoscopes |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/009,965 Continuation-In-Part US20050154319A1 (en) | 2002-01-15 | 2004-12-10 | Fluorescence endoscopy video systems with no moving parts in the camera |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/412,715 Continuation-In-Part US8630698B2 (en) | 2002-01-15 | 2006-04-26 | Filter for use with imaging endoscopes |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060241496A1 true US20060241496A1 (en) | 2006-10-26 |
Family
ID=37307550
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/122,267 Abandoned US20060241496A1 (en) | 2002-01-15 | 2005-05-04 | Filter for use with imaging endoscopes |
US11/412,715 Expired - Fee Related US8630698B2 (en) | 2002-01-15 | 2006-04-26 | Filter for use with imaging endoscopes |
US14/154,177 Abandoned US20140194687A1 (en) | 2002-01-15 | 2014-01-13 | Filter for use with imaging endoscopes |
US14/975,707 Expired - Fee Related US10182709B2 (en) | 2002-01-15 | 2015-12-18 | Filter for use with imaging endoscopes |
US16/218,256 Abandoned US20190357757A1 (en) | 2002-01-15 | 2018-12-12 | Filter for use with imaging endoscopes |
Family Applications After (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/412,715 Expired - Fee Related US8630698B2 (en) | 2002-01-15 | 2006-04-26 | Filter for use with imaging endoscopes |
US14/154,177 Abandoned US20140194687A1 (en) | 2002-01-15 | 2014-01-13 | Filter for use with imaging endoscopes |
US14/975,707 Expired - Fee Related US10182709B2 (en) | 2002-01-15 | 2015-12-18 | Filter for use with imaging endoscopes |
US16/218,256 Abandoned US20190357757A1 (en) | 2002-01-15 | 2018-12-12 | Filter for use with imaging endoscopes |
Country Status (4)
Country | Link |
---|---|
US (5) | US20060241496A1 (en) |
EP (1) | EP1883337A4 (en) |
JP (2) | JP2008539827A (en) |
WO (1) | WO2006116847A1 (en) |
Cited By (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050065440A1 (en) * | 2003-09-23 | 2005-03-24 | Richard Levenson | Spectral imaging of deep tissue |
US20070102623A1 (en) * | 2005-10-17 | 2007-05-10 | Xillix Technologies Corp. | Device for short wavelength visible reflectance endoscopy using broadband illumination |
WO2008011722A1 (en) * | 2006-07-28 | 2008-01-31 | Novadaq Technologies Inc. | System and method for deposition and removal of an optical element on an endoscope objective |
US20080269576A1 (en) * | 2006-03-29 | 2008-10-30 | Uk Kang | Light Source for Fluorescence Diagnosis and Photodynamic Therapy |
US20080294032A1 (en) * | 2003-09-23 | 2008-11-27 | Cambridge Research And Instrumentation, Inc. | Spectral Imaging of Biological Samples |
CN101708120A (en) * | 2008-09-17 | 2010-05-19 | 富士胶片株式会社 | Image obtaining method and image obtaining apparatus |
US20100177181A1 (en) * | 2009-01-12 | 2010-07-15 | Fujifilm Corporation | Endoscope image processing method and apparatus, and endoscope system using the same |
CN102445443A (en) * | 2010-08-09 | 2012-05-09 | 卡尔蔡司医疗技术股份公司 | Fluorescence observation system and filter set |
US8280140B2 (en) | 2005-01-27 | 2012-10-02 | Cambridge Research & Instrumentation, Inc. | Classifying image features |
US20140046409A1 (en) * | 2012-08-09 | 2014-02-13 | Korea Electrotechnology Research Institute | Light source apparatus for photo-diagnosis and phototherapy |
US20160235278A1 (en) * | 2015-02-18 | 2016-08-18 | Karl Storz Gmbh & Co. Kg | Endoscope |
US9642532B2 (en) | 2008-03-18 | 2017-05-09 | Novadaq Technologies Inc. | Imaging system for combined full-color reflectance and near-infrared imaging |
US20170209050A1 (en) * | 2016-01-26 | 2017-07-27 | Novadaq Technologies Inc. | Configurable platform |
US9814378B2 (en) | 2011-03-08 | 2017-11-14 | Novadaq Technologies Inc. | Full spectrum LED illuminator having a mechanical enclosure and heatsink |
US9877654B2 (en) | 2006-02-07 | 2018-01-30 | Novadaq Technologies Inc. | Near infrared imaging |
CN107850767A (en) * | 2015-07-17 | 2018-03-27 | 徕卡显微系统复合显微镜有限公司 | For making the mating plate microscope of multiple object planes while imaging |
US9968244B2 (en) | 2000-07-14 | 2018-05-15 | Novadaq Technologies ULC | Compact fluorescence endoscopy video system |
US20180228354A1 (en) * | 2015-10-14 | 2018-08-16 | Olympus Corporation | Light source device for endoscope and endoscope system |
US10182709B2 (en) | 2002-01-15 | 2019-01-22 | Novadaq Technologies ULC | Filter for use with imaging endoscopes |
US20190064499A1 (en) * | 2017-08-31 | 2019-02-28 | Olympus Corporation | Measurement apparatus and method of operating measurement apparatus |
US10293122B2 (en) | 2016-03-17 | 2019-05-21 | Novadaq Technologies ULC | Endoluminal introducer with contamination avoidance |
US20190217006A1 (en) * | 2018-01-13 | 2019-07-18 | Ananya ANAND | Fiber optically illuminated medical infusion tubes |
US20200107727A1 (en) * | 2018-10-03 | 2020-04-09 | Verily Life Sciences Llc | Dynamic illumination to identify tissue type |
WO2020112726A1 (en) * | 2018-11-30 | 2020-06-04 | Intuitive Surgical Operations, Inc. | Medical imaging systems and methods |
US10694151B2 (en) | 2006-12-22 | 2020-06-23 | Novadaq Technologies ULC | Imaging system with a single color image sensor for simultaneous fluorescence and color video endoscopy |
US10820789B2 (en) | 2015-04-30 | 2020-11-03 | Panasonic I-Pro Sensing Solutions Co., Ltd. | Endoscope system and light source control method |
US10869645B2 (en) | 2016-06-14 | 2020-12-22 | Stryker European Operations Limited | Methods and systems for adaptive imaging for low light signal enhancement in medical visualization |
USD916294S1 (en) | 2016-04-28 | 2021-04-13 | Stryker European Operations Limited | Illumination and imaging device |
EP3805838A1 (en) * | 2019-10-10 | 2021-04-14 | Leica Instruments (Singapore) Pte. Ltd. | Microscope and related apparatuses, methods and computer programs |
US10980409B2 (en) * | 2017-10-04 | 2021-04-20 | Olympus Corporation | Endoscope device, image processing method, and computer readable recording medium |
US10992848B2 (en) | 2017-02-10 | 2021-04-27 | Novadaq Technologies ULC | Open-field handheld fluorescence imaging systems and methods |
WO2021087304A1 (en) * | 2019-11-01 | 2021-05-06 | Stryker Corporation | Systems and methods for image reorientation for endoscopic imaging |
US11369254B2 (en) | 2020-10-05 | 2022-06-28 | Nirec Corporation | Endoscope and image capturing unit provided therein |
WO2022192556A1 (en) * | 2021-03-10 | 2022-09-15 | Kevin Thomas | Als camera system |
US11839357B2 (en) | 2020-10-12 | 2023-12-12 | Karl Storz Imaging, Inc. | Filter assembly and filter kit for use with an endoscopic system |
US11930278B2 (en) | 2015-11-13 | 2024-03-12 | Stryker Corporation | Systems and methods for illumination and imaging of a target |
Families Citing this family (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1868485B1 (en) | 2005-04-15 | 2016-06-08 | Surgisense Corporation | Surgical instruments with sensors for detecting tissue properties, and systems using such instruments |
JP4761899B2 (en) * | 2005-09-12 | 2011-08-31 | Hoya株式会社 | Electronic endoscope system |
JP4818753B2 (en) * | 2006-02-28 | 2011-11-16 | オリンパス株式会社 | Endoscope system |
US8140141B2 (en) * | 2006-05-17 | 2012-03-20 | University Of Utah Research Foundation | Devices and methods for fluorescent inspection and/or removal of material in a sample |
US8248466B2 (en) * | 2006-10-11 | 2012-08-21 | International Business Machines Corporation | Image processing using multiple image devices |
KR100853655B1 (en) * | 2006-12-15 | 2008-08-25 | 한국전기연구원 | Apparatus, light source system and method for photo-diagnosis and phototherapy of skin disease |
US20130317295A1 (en) * | 2006-12-29 | 2013-11-28 | GE Inspection Technologies | Light assembly for remote visual inspection apparatus |
JP5036423B2 (en) * | 2007-06-28 | 2012-09-26 | 株式会社キーエンス | Imaging device |
WO2009021030A1 (en) * | 2007-08-08 | 2009-02-12 | Wilson-Cook Medical Inc. | Distal tip for an endoscope |
JP5372356B2 (en) * | 2007-10-18 | 2013-12-18 | オリンパスメディカルシステムズ株式会社 | Endoscope apparatus and method for operating endoscope apparatus |
JP5329177B2 (en) | 2007-11-07 | 2013-10-30 | 富士フイルム株式会社 | Imaging system and program |
PT2291640T (en) | 2008-05-20 | 2019-02-26 | Univ Health Network | Device and method for fluorescence-based imaging and monitoring |
US8159525B2 (en) * | 2008-06-13 | 2012-04-17 | The United States Of America, As Represented By The Secretary Of Agriculture | Portable multispectral imaging systems |
US9370324B2 (en) * | 2008-11-05 | 2016-06-21 | Fresenius Medical Care Holdings, Inc. | Hemodialysis patient data acquisition, management and analysis system |
US20100268069A1 (en) * | 2009-04-16 | 2010-10-21 | Rongguang Liang | Dental surface imaging using polarized fringe projection |
DE102009024943A1 (en) * | 2009-06-10 | 2010-12-16 | W.O.M. World Of Medicine Ag | Imaging system and method for fluorescence-optical visualization of an object |
KR101651521B1 (en) * | 2009-09-25 | 2016-08-29 | 엘지디스플레이 주식회사 | Organic electro-luminescence device for medical |
JP5371858B2 (en) * | 2009-09-29 | 2013-12-18 | 富士フイルム株式会社 | Electronic endoscope device |
DE102009060500B4 (en) * | 2009-12-22 | 2015-12-17 | Xion Gmbh | A method for stroboscopically examining repetitive processes and arrangement for operating this method |
US9211058B2 (en) * | 2010-07-02 | 2015-12-15 | Intuitive Surgical Operations, Inc. | Method and system for fluorescent imaging with background surgical image composed of selective illumination spectra |
US10682198B2 (en) | 2010-07-02 | 2020-06-16 | Intuitive Surgical Operations, Inc. | Method and system for fluorescent imaging with background surgical image composed of selective illumination spectra |
JP5507376B2 (en) * | 2010-07-28 | 2014-05-28 | 三洋電機株式会社 | Imaging device |
US9194792B2 (en) * | 2010-09-07 | 2015-11-24 | Fresenius Medical Care Holdings, Inc. | Blood chamber for an optical blood monitoring system |
US8743354B2 (en) | 2010-09-07 | 2014-06-03 | Fresenius Medical Care Holdings, Inc. | Shrouded sensor clip assembly and blood chamber for an optical blood monitoring system |
JP5604248B2 (en) * | 2010-09-28 | 2014-10-08 | 富士フイルム株式会社 | Endoscopic image display device |
DE102010050227A1 (en) * | 2010-11-04 | 2012-05-10 | Siemens Aktiengesellschaft | Endoscope with 3D functionality |
CN107307871B (en) | 2010-11-17 | 2020-04-28 | 弗雷泽纽斯医疗保健控股公司 | Sensor clip assembly for optical monitoring system |
US9173988B2 (en) | 2010-11-17 | 2015-11-03 | Fresenius Medical Care Holdings, Inc. | Sensor clip assembly for an optical monitoring system |
JP5451802B2 (en) * | 2011-04-01 | 2014-03-26 | 富士フイルム株式会社 | Electronic endoscope system and calibration method for electronic endoscope system |
US9420967B2 (en) | 2013-03-19 | 2016-08-23 | Surgisense Corporation | Apparatus, systems and methods for determining tissue oxygenation |
EP3171765B1 (en) | 2014-07-24 | 2021-09-01 | University Health Network | Collection and analysis of data for diagnostic purposes |
JP5897663B2 (en) * | 2014-08-25 | 2016-03-30 | 富士フイルム株式会社 | Endoscope device |
JP2017131559A (en) * | 2016-01-29 | 2017-08-03 | ソニー・オリンパスメディカルソリューションズ株式会社 | Medical imaging device, medical image acquisition system, and endoscope apparatus |
CN107050657A (en) * | 2017-04-06 | 2017-08-18 | 中国人民解放军总医院 | Photodynamic therapy system with organization chart picture and hot spot boundary visualization function |
US11653824B2 (en) * | 2017-05-30 | 2023-05-23 | Sony Corporation | Medical observation system and medical observation device |
US20210307597A1 (en) * | 2018-07-23 | 2021-10-07 | The Regents Of The University Of California | Oral and oropharyngeal cancer screening system and methods of use |
US11625825B2 (en) | 2019-01-30 | 2023-04-11 | Covidien Lp | Method for displaying tumor location within endoscopic images |
US11457154B2 (en) * | 2019-06-20 | 2022-09-27 | Cilag Gmbh International | Speckle removal in a pulsed hyperspectral, fluorescence, and laser mapping imaging system |
WO2021067622A1 (en) * | 2019-10-01 | 2021-04-08 | Najdahmadi Avid | Light-based medical device |
US10902572B1 (en) * | 2019-10-09 | 2021-01-26 | Karl Storz Imaging, Inc. | Enhanced fluorescence imaging for imaging system |
US11823433B1 (en) * | 2020-01-21 | 2023-11-21 | Lina M. Paz-Perez | Shadow removal for local feature detector and descriptor learning using a camera sensor sensitivity model |
GB2597521A (en) * | 2020-07-27 | 2022-02-02 | Sensor Coating Systems Ltd | Detection system and method |
DE102020124686B9 (en) * | 2020-09-22 | 2023-08-03 | Carl Zeiss Meditec Ag | Filter set, fluorescence observation system and method for simultaneous observation of fluorescent and non-fluorescent areas of an object |
DE102021124010A1 (en) * | 2021-09-16 | 2023-03-16 | Xion Gmbh | Method and device for videoendoscopy with fluorescent light |
KR102704299B1 (en) * | 2023-10-04 | 2024-10-04 | 전남대학교산학협력단 | Spectral filter kit |
Citations (77)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US527842A (en) * | 1894-10-23 | forney | ||
US3971068A (en) * | 1975-08-22 | 1976-07-20 | The United States Of America As Represented By The Secretary Of The Navy | Image processing system |
US4115812A (en) * | 1973-11-26 | 1978-09-19 | Hitachi, Ltd. | Automatic gain control circuit |
US4149190A (en) * | 1977-10-17 | 1979-04-10 | Xerox Corporation | Automatic gain control for video amplifier |
US4200801A (en) * | 1979-03-28 | 1980-04-29 | The United States Of America As Represented By The United States Department Of Energy | Portable spotter for fluorescent contaminants on surfaces |
US4355325A (en) * | 1980-03-24 | 1982-10-19 | Sony Corporation | White balance control system |
US4378571A (en) * | 1981-07-06 | 1983-03-29 | Xerox Corporation | Serial analog video processor for charge coupled device imagers |
US4424841A (en) * | 1982-09-30 | 1984-01-10 | Smith J Rudy | Modular stacking bag |
US4449535A (en) * | 1981-03-25 | 1984-05-22 | Compagnie Industrielle Des Lasers Cilas Alcatel | Apparatus for measuring in situ the state of oxidation-reduction of a living organ |
US4532918A (en) * | 1983-10-07 | 1985-08-06 | Welch Allyn Inc. | Endoscope signal level control |
US4556057A (en) * | 1982-08-31 | 1985-12-03 | Hamamatsu Tv Co., Ltd. | Cancer diagnosis device utilizing laser beam pulses |
US4638365A (en) * | 1984-01-31 | 1987-01-20 | Canon Kabushiki Kaisha | Image sensing device |
US4768513A (en) * | 1986-04-21 | 1988-09-06 | Agency Of Industrial Science And Technology | Method and device for measuring and processing light |
US4786813A (en) * | 1984-10-22 | 1988-11-22 | Hightech Network Sci Ab | Fluorescence imaging system |
US4821117A (en) * | 1986-11-12 | 1989-04-11 | Kabushiki Kaisha Toshiba | Endoscopic system for producing fluorescent and visible images |
US4837625A (en) * | 1987-02-20 | 1989-06-06 | Sgs-Thomson Microelectronics S.A. | Automatic gain control device for video signals |
US4856495A (en) * | 1986-09-25 | 1989-08-15 | Olympus Optical Co., Ltd. | Endoscope apparatus |
US4930516A (en) * | 1985-11-13 | 1990-06-05 | Alfano Robert R | Method for detecting cancerous tissue using visible native luminescence |
US4951135A (en) * | 1988-01-11 | 1990-08-21 | Olympus Optical Co., Ltd. | Electronic-type endoscope system having capability of setting AGC variation region |
US4954897A (en) * | 1987-05-22 | 1990-09-04 | Nikon Corporation | Electronic still camera system with automatic gain control of image signal amplifier before image signal recording |
US4974936A (en) * | 1989-03-15 | 1990-12-04 | Richard Wolf Gmbh | Device for supplying light to endoscopes with rotary filter plate and faster rotating runner plate with at least one opaque region |
US5001556A (en) * | 1987-09-30 | 1991-03-19 | Olympus Optical Co., Ltd. | Endoscope apparatus for processing a picture image of an object based on a selected wavelength range |
US5007408A (en) * | 1989-03-16 | 1991-04-16 | Olympus Optical Co., Ltd. | Endoscope light source apparatus |
US5034888A (en) * | 1988-02-26 | 1991-07-23 | Olympus Optical Co., Ltd. | Electronic endoscope apparatus having different image processing characteristics for a moving image and a still image |
US5134662A (en) * | 1985-11-04 | 1992-07-28 | Cell Analysis Systems, Inc. | Dual color camera microscope and methodology for cell staining and analysis |
US5165079A (en) * | 1989-02-02 | 1992-11-17 | Linotype-Hell Ag | Optical color-splitter arrangement |
US5214503A (en) * | 1992-01-31 | 1993-05-25 | The United States Of America As Represented By The Secretary Of The Army | Color night vision camera system |
US5225883A (en) * | 1991-06-05 | 1993-07-06 | The Babcock & Wilcox Company | Video temperature monitor |
US5255087A (en) * | 1986-11-29 | 1993-10-19 | Olympus Optical Co., Ltd. | Imaging apparatus and endoscope apparatus using the same |
US5365057A (en) * | 1993-07-02 | 1994-11-15 | Litton Systems, Inc. | Light-weight night vision device |
US5371355A (en) * | 1993-07-30 | 1994-12-06 | Litton Systems, Inc. | Night vision device with separable modular image intensifier assembly |
US5377686A (en) * | 1991-10-11 | 1995-01-03 | The University Of Connecticut | Apparatus for detecting leakage from vascular tissue |
US5408263A (en) * | 1992-06-16 | 1995-04-18 | Olympus Optical Co., Ltd. | Electronic endoscope apparatus |
US5410363A (en) * | 1992-12-08 | 1995-04-25 | Lightwave Communications, Inc. | Automatic gain control device for transmitting video signals between two locations by use of a known reference pulse during vertical blanking period so as to control the gain of the video signals at the second location |
US5420628A (en) * | 1990-01-16 | 1995-05-30 | Research Development Foundation | Video densitometer with determination of color composition |
US5419323A (en) * | 1988-12-21 | 1995-05-30 | Massachusetts Institute Of Technology | Method for laser induced fluorescence of tissue |
US5421337A (en) * | 1989-04-14 | 1995-06-06 | Massachusetts Institute Of Technology | Spectral diagnosis of diseased tissue |
US5430476A (en) * | 1992-06-24 | 1995-07-04 | Richard Wolf Gmbh | Device for supplying light to endoscopes |
US5485203A (en) * | 1991-08-12 | 1996-01-16 | Olympus Optical Co., Ltd. | Color misregistration easing system which corrects on a pixel or block basis only when necessary |
US5507287A (en) * | 1991-05-08 | 1996-04-16 | Xillix Technologies Corporation | Endoscopic imaging system for diseased tissue |
US5585846A (en) * | 1991-12-05 | 1996-12-17 | Samsung Electronics Co., Ltd. | Image signal processing circuit in a digital camera having gain and gamma control |
US5590660A (en) * | 1994-03-28 | 1997-01-07 | Xillix Technologies Corp. | Apparatus and method for imaging diseased tissue using integrated autofluorescence |
US5596654A (en) * | 1987-04-20 | 1997-01-21 | Fuji Photo Film Co., Ltd. | Method of determining desired image signal range based on histogram data |
US5646680A (en) * | 1994-10-20 | 1997-07-08 | Olympus Optical Co., Ltd. | Endoscope system having a switch forcibly set to display video signals not passed through outer peripheral apparatus |
US5647368A (en) * | 1996-02-28 | 1997-07-15 | Xillix Technologies Corp. | Imaging system for detecting diseased tissue using native fluorsecence in the gastrointestinal and respiratory tract |
US5749830A (en) * | 1993-12-03 | 1998-05-12 | Olympus Optical Co., Ltd. | Fluorescent endoscope apparatus |
US5772580A (en) * | 1995-03-03 | 1998-06-30 | Asahi Kogaku Kogyo Kabushiki Kaisha | Biological fluorescence diagnostic apparatus with distinct pickup cameras |
US5852498A (en) * | 1997-04-04 | 1998-12-22 | Kairos Scientific Inc. | Optical instrument having a variable optical filter |
US5891016A (en) * | 1995-11-09 | 1999-04-06 | Asahi Kogaku Kogyo Kabushiki Kaisha | Fluorescence endoscope having an exciting light filter and a fluorescence filter |
US5971918A (en) * | 1996-10-02 | 1999-10-26 | Richard Wolf Gmbh | Device for the photodynamic endoscopic diagnosis of tumor tissue |
US5984861A (en) * | 1997-09-29 | 1999-11-16 | Boston Scientific Corporation | Endofluorescence imaging module for an endoscope |
US5986271A (en) * | 1997-07-03 | 1999-11-16 | Lazarev; Victor | Fluorescence imaging system |
US6002137A (en) * | 1997-02-13 | 1999-12-14 | Fuji Photo Film Co., Ltd. | Fluorescence detecting system |
US6008889A (en) * | 1997-04-16 | 1999-12-28 | Zeng; Haishan | Spectrometer system for diagnosis of skin disease |
US6021344A (en) * | 1996-12-04 | 2000-02-01 | Derma Technologies, Inc. | Fluorescence scope system for dermatologic diagnosis |
US6028622A (en) * | 1997-04-25 | 2000-02-22 | Olympus Optical Co., Ltd. | Observation apparatus for endoscopes |
US6061591A (en) * | 1996-03-29 | 2000-05-09 | Richard Wolf Gmbh | Arrangement and method for diagnosing malignant tissue by fluorescence observation |
US6059720A (en) * | 1997-03-07 | 2000-05-09 | Asahi Kogaku Kogyo Kabushiki Kaisha | Endoscope system with amplification of fluorescent image |
US6070096A (en) * | 1996-03-06 | 2000-05-30 | Fuji Photo Film Co., Ltd. | Fluorescence detecting apparatus |
US6099466A (en) * | 1994-09-21 | 2000-08-08 | Asahi Kogaku Kogyo Kabushiki Kaisha | Fluorescence diagnosis endoscope system |
US6110106A (en) * | 1998-06-24 | 2000-08-29 | Biomax Technologies, Inc. | Endoscopes and methods relating to direct viewing of a target tissue |
US6120435A (en) * | 1997-07-16 | 2000-09-19 | Olympus Optical Co., Ltd. | Endoscope system in which operation switch sets designed to function and be handled same way are included in endoscope and image processing apparatus respectively |
US6148227A (en) * | 1998-01-07 | 2000-11-14 | Richard Wolf Gmbh | Diagnosis apparatus for the picture providing recording of fluorescing biological tissue regions |
US6161035A (en) * | 1997-04-30 | 2000-12-12 | Asahi Kogaku Kogyo Kabushiki Kaisha | Fluorescence diagnostic apparatus |
US6192267B1 (en) * | 1994-03-21 | 2001-02-20 | Scherninski Francois | Endoscopic or fiberscopic imaging device using infrared fluorescence |
US6212425B1 (en) * | 1995-09-26 | 2001-04-03 | Karl Storz Gmbh & Co., Kg | Apparatus for photodynamic diagnosis |
US6280378B1 (en) * | 1998-05-29 | 2001-08-28 | Fuji Photo Film Co., Ltd. | Fluorescence endoscope |
US6293911B1 (en) * | 1996-11-20 | 2001-09-25 | Olympus Optical Co., Ltd. | Fluorescent endoscope system enabling simultaneous normal light observation and fluorescence observation in infrared spectrum |
US6364829B1 (en) * | 1999-01-26 | 2002-04-02 | Newton Laboratories, Inc. | Autofluorescence imaging system for endoscopy |
US6422994B1 (en) * | 1997-09-24 | 2002-07-23 | Olympus Optical Co., Ltd. | Fluorescent diagnostic system and method providing color discrimination enhancement |
US20020138008A1 (en) * | 2000-01-13 | 2002-09-26 | Kazuhiro Tsujita | Method and apparatus for displaying fluorescence images and method and apparatus for acquiring endoscope images |
US20020161283A1 (en) * | 2001-04-27 | 2002-10-31 | Fuji Photo Film Co., Ltd. | Image obtaining method and apparatus of an endoscope apparatus |
US20020175993A1 (en) * | 2001-05-16 | 2002-11-28 | Olympus Optical Co., Ltd. | Endoscope system using normal light and fluorescence |
US6529768B1 (en) * | 1999-11-18 | 2003-03-04 | Fuji Photo Film Co., Ltd. | Method and apparatus for acquiring fluorescence images |
US6603552B1 (en) * | 1999-12-22 | 2003-08-05 | Xillix Technologies Corp. | Portable system for detecting skin abnormalities based on characteristic autofluorescence |
US20030153811A1 (en) * | 2002-02-12 | 2003-08-14 | Olympus Winter & Ibe Gmbh | Fluorescence endoscope with inserted/retracted short-pass filter |
US7235045B2 (en) * | 1998-01-26 | 2007-06-26 | Massachusetts Institute Of Technology | Fluorescence imaging endoscope |
Family Cites Families (244)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3215029A (en) | 1960-11-23 | 1965-11-02 | American Optical Corp | Fiber optical image transfer devices and method of making the same |
GB954629A (en) | 1959-07-16 | 1964-04-08 | Harold Horace Hopkins | Improvements in or relating to optical systems |
US4066330A (en) | 1976-06-14 | 1978-01-03 | Karl Storz Endoscopy-America, Inc. | Coupler for joining optical devices |
US4037866A (en) | 1976-07-26 | 1977-07-26 | Price Edward E | Contact lens applicator |
JPS5641684Y2 (en) | 1977-11-24 | 1981-09-30 | ||
JPS55168306U (en) | 1979-05-23 | 1980-12-03 | ||
CA1341012C (en) | 1982-09-27 | 2000-06-06 | Biogen, Inc. | Dna sequences, recombinant dna molecules and processes for producing swine growth hormone-like polypeptides |
US4611888A (en) | 1983-10-17 | 1986-09-16 | Mp Video, Inc. | Coupler for surgical endoscope and video camera |
JPS60140313A (en) | 1983-12-28 | 1985-07-25 | Olympus Optical Co Ltd | Diagonally viewing optical system of hard endoscope |
JPS60237419A (en) | 1984-05-09 | 1985-11-26 | Olympus Optical Co Ltd | Length measuring optical adapter for endoscope |
JPS60246733A (en) | 1984-05-21 | 1985-12-06 | 熊谷 博彰 | Optical photographing apparatus of organism tissue |
US4895145A (en) | 1985-05-28 | 1990-01-23 | Surgical Laser Technologies, Inc. | Two-piece disposable laser delivery system |
JPS61159936A (en) | 1985-07-02 | 1986-07-19 | 熊谷 博彰 | Spectral image pick-up apparatus of biological tissue |
DE3709021A1 (en) | 1987-03-19 | 1988-09-29 | Med Inventio Ag | RELAY LENS SYSTEM |
US4917457A (en) | 1987-06-08 | 1990-04-17 | Asahi Kogaku Kogyo Kabushiki Kaisha | Beam separating prism |
JPH01135349A (en) | 1987-11-19 | 1989-05-29 | Maaketsuto Bureinzu:Kk | Contact lens attaching and detaching instrument |
US5697885A (en) | 1989-01-30 | 1997-12-16 | Olympus Optical Co., Ltd. | Endoscope for recording and displaying time-serial images |
JP3006685B2 (en) | 1989-04-14 | 2000-02-07 | オリンパス光学工業株式会社 | Image transmission optical system |
US5206759A (en) | 1989-04-14 | 1993-04-27 | Olympus Optical Co., Ltd. | Image relaying optical system |
US5142410A (en) | 1989-04-14 | 1992-08-25 | Olympus Optical Co., Ltd. | Image relaying optical system |
JP2810717B2 (en) | 1989-09-08 | 1998-10-15 | オリンパス光学工業株式会社 | Endoscope for fluorescence observation |
JP2810715B2 (en) | 1989-09-08 | 1998-10-15 | オリンパス光学工業株式会社 | Endoscope device for fluorescence observation |
JPH0397442A (en) | 1989-09-08 | 1991-04-23 | Olympus Optical Co Ltd | Endoscope device for fluorescent observation |
JPH03136630A (en) | 1989-10-24 | 1991-06-11 | Olympus Optical Co Ltd | Endoscope guide tube |
US5305759A (en) | 1990-09-26 | 1994-04-26 | Olympus Optical Co., Ltd. | Examined body interior information observing apparatus by using photo-pulses controlling gains for depths |
US5205280A (en) | 1990-12-21 | 1993-04-27 | Mp Video, Inc. | Quick-release endoscopic coupling assembly |
FR2671405B1 (en) | 1991-01-04 | 1994-07-08 | Inst Nat Sante Rech Med | DEVICE FOR MEASURING THE PH OF A TARGET, METHOD OF USING SAID DEVICE AND ITS APPLICATIONS. |
DE69231614T2 (en) | 1991-02-26 | 2001-05-03 | Massachusetts Institute Of Technology, Cambridge | MOLECULAR SPECTROSCOPY METHOD AND DEVICES FOR TISSUE DIAGNOSIS |
JP2532420Y2 (en) | 1991-06-28 | 1997-04-16 | 富士写真光機株式会社 | Laparoscopic trocar |
WO1993004648A1 (en) | 1991-09-03 | 1993-03-18 | William Frank Clymer | A contact lens applicator |
JPH05115435A (en) * | 1991-10-25 | 1993-05-14 | Olympus Optical Co Ltd | Solid-state image pickup device |
US5278642A (en) * | 1992-02-26 | 1994-01-11 | Welch Allyn, Inc. | Color imaging system |
JPH05323186A (en) | 1992-04-08 | 1993-12-07 | Olympus Optical Co Ltd | Endoscope |
US5334191A (en) | 1992-05-21 | 1994-08-02 | Dix Phillip Poppas | Laser tissue welding control system |
JP3504677B2 (en) | 1992-08-14 | 2004-03-08 | オリンパス株式会社 | Laser irradiation device |
JPH0694989A (en) | 1992-08-22 | 1994-04-08 | Dr Canzek Endoscopie Ag | Optical relay lens system |
DE4229873C1 (en) | 1992-09-04 | 1994-03-24 | Ethicon Gmbh | Endoscopic test-seal for guide - has guide formed of sleeve with holed flange at proximal end distal end is capable of being cut to desired length |
US5379756A (en) | 1992-09-11 | 1995-01-10 | Welch Allyn, Inc. | Replaceable lens assembly for video laparoscope |
JP3236085B2 (en) | 1992-10-15 | 2001-12-04 | 浜松ホトニクス株式会社 | Endoscope device |
US5536236A (en) * | 1993-02-12 | 1996-07-16 | Olympus Optical Co., Ltd. | Covered endoscope system |
US5490015A (en) | 1993-03-04 | 1996-02-06 | Olympus Optical Co., Ltd. | Actuator apparatus |
JPH0668702U (en) | 1993-03-11 | 1994-09-27 | オリンパス光学工業株式会社 | Endoscope with channel cover system |
US5460166A (en) | 1993-03-11 | 1995-10-24 | Olympus Optical, Ltd. | Endoscope of an endoscope cover system wherein, at the time of the maximum curvature, a fluid tube path will be curved as twisted so as to move to the side on which the radius of curvature will become larger |
US5424841A (en) * | 1993-05-28 | 1995-06-13 | Molecular Dynamics | Apparatus for measuring spatial distribution of fluorescence on a substrate |
JPH08500045A (en) | 1993-06-03 | 1996-01-09 | ゾーメッド トリース,インコーポレイテッド | Disposable endoscopic sheath |
US5684629A (en) | 1993-10-05 | 1997-11-04 | Monadnock Optics, Inc. | Optical system for endoscope |
JP3285265B2 (en) | 1993-12-03 | 2002-05-27 | オリンパス光学工業株式会社 | Fluorescence observation device |
JPH07155290A (en) | 1993-12-03 | 1995-06-20 | Olympus Optical Co Ltd | Endoscope apparatus |
JPH07155291A (en) | 1993-12-03 | 1995-06-20 | Olympus Optical Co Ltd | Fluorescence observation apparatus |
JP3283128B2 (en) | 1993-12-03 | 2002-05-20 | オリンパス光学工業株式会社 | Fluorescence observation endoscope device |
JP3487933B2 (en) | 1993-12-03 | 2004-01-19 | オリンパス株式会社 | Fluorescence observation device |
JP3194660B2 (en) | 1993-12-03 | 2001-07-30 | オリンパス光学工業株式会社 | Fluorescence observation device |
JPH07222712A (en) | 1994-02-10 | 1995-08-22 | Olympus Optical Co Ltd | Fluorescent endoscope system |
JPH07184832A (en) | 1993-12-27 | 1995-07-25 | Olympus Optical Co Ltd | Cover type endoscope |
JPH07250804A (en) | 1994-03-15 | 1995-10-03 | Olympus Optical Co Ltd | Fluorescence observer |
JPH07250812A (en) | 1994-03-15 | 1995-10-03 | Olympus Optical Co Ltd | Fluorescence diagnosing apparatus |
US5512036A (en) | 1994-03-15 | 1996-04-30 | Welch Allyn, Inc. | Dental imaging system |
US5667472A (en) | 1994-03-18 | 1997-09-16 | Clarus Medical Systems, Inc. | Surgical instrument and method for use with a viewing system |
JPH08228998A (en) | 1995-02-28 | 1996-09-10 | Olympus Optical Co Ltd | Endoscopic device |
US5697888A (en) | 1994-04-21 | 1997-12-16 | Olympus Optical Co., Ltd. | Endoscope apparatus having valve device for supplying water and gas |
JP3368569B2 (en) * | 1994-06-13 | 2003-01-20 | オリンパス光学工業株式会社 | Cover-type endoscope |
US5647840A (en) | 1994-09-14 | 1997-07-15 | Circon Corporation | Endoscope having a distally heated distal lens |
JP3467130B2 (en) | 1994-09-21 | 2003-11-17 | ペンタックス株式会社 | Electronic endoscope device for fluorescence diagnosis |
JP3490807B2 (en) | 1994-09-21 | 2004-01-26 | ペンタックス株式会社 | Electronic endoscope device for fluorescence diagnosis |
JP3501388B2 (en) | 1994-09-21 | 2004-03-02 | ペンタックス株式会社 | Video processor of electronic endoscope for fluorescence diagnosis |
JP3467131B2 (en) | 1994-09-21 | 2003-11-17 | ペンタックス株式会社 | Electronic endoscope device for fluorescence diagnosis |
JPH0894928A (en) | 1994-09-28 | 1996-04-12 | Olympus Optical Co Ltd | Image transmission optical system |
US5952768A (en) | 1994-10-31 | 1999-09-14 | General Electric Company | Transparent heat conserving coating for metal halide arc tubes |
JP3556294B2 (en) | 1994-11-01 | 2004-08-18 | オリンパス株式会社 | Endoscope |
US6853485B2 (en) | 1994-12-06 | 2005-02-08 | Jan Hoogland | Integrated optical system for endoscopes and the like |
JP3334118B2 (en) | 1994-12-20 | 2002-10-15 | ニプロ株式会社 | Trocker |
JPH08224208A (en) | 1995-02-22 | 1996-09-03 | Olympus Optical Co Ltd | Fluorescence observing endoscope device |
JPH08224240A (en) | 1995-02-22 | 1996-09-03 | Olympus Optical Co Ltd | Fluorescent diagnosing device |
JP3560671B2 (en) | 1995-02-23 | 2004-09-02 | オリンパス株式会社 | Fluorescence observation device |
JPH08224210A (en) | 1995-02-23 | 1996-09-03 | Olympus Optical Co Ltd | Fluorescence observing device |
US5697373A (en) * | 1995-03-14 | 1997-12-16 | Board Of Regents, The University Of Texas System | Optical method and apparatus for the diagnosis of cervical precancers using raman and fluorescence spectroscopies |
US6258576B1 (en) * | 1996-06-19 | 2001-07-10 | Board Of Regents, The University Of Texas System | Diagnostic method and apparatus for cervical squamous intraepithelial lesions in vitro and in vivo using fluorescence spectroscopy |
US7236815B2 (en) * | 1995-03-14 | 2007-06-26 | The Board Of Regents Of The University Of Texas System | Method for probabilistically classifying tissue in vitro and in vivo using fluorescence spectroscopy |
JPH08252218A (en) | 1995-03-16 | 1996-10-01 | Olympus Optical Co Ltd | Fluorescent observing endoscope device |
US5822021A (en) * | 1996-05-14 | 1998-10-13 | Colorlink, Inc. | Color shutter liquid crystal display system |
US5999240A (en) * | 1995-05-23 | 1999-12-07 | Colorlink, Inc. | Optical retarder stack pair for transforming input light into polarization states having saturated color spectra |
JP2001518241A (en) | 1995-06-07 | 2001-10-09 | ストリカー・コーポレーション | An imaging system that processes visible light energy and infrared light energy separately |
US5713364A (en) | 1995-08-01 | 1998-02-03 | Medispectra, Inc. | Spectral volume microprobe analysis of materials |
GB9523218D0 (en) | 1995-11-14 | 1996-01-17 | Kodak Ltd | Photographic materials for use in redox amplification and process |
US6005612A (en) | 1995-11-17 | 1999-12-21 | Sanyo Electric Co., Ltd. | Video camera with high speed mode |
JPH09179539A (en) | 1995-12-27 | 1997-07-11 | Brother Ind Ltd | Color adjustment device |
US5722962A (en) | 1995-12-29 | 1998-03-03 | Garcia; Joxel | Trocar port filter |
US6571119B2 (en) | 1996-03-06 | 2003-05-27 | Fuji Photo Film Co., Ltd. | Fluorescence detecting apparatus |
US6004263A (en) | 1996-03-13 | 1999-12-21 | Hihon Kohden Corporation | Endoscope with detachable operation unit and insertion unit |
JPH10192297A (en) | 1996-05-09 | 1998-07-28 | Olympus Optical Co Ltd | Securing device of cavity for bone operation |
US5695049A (en) | 1996-10-10 | 1997-12-09 | Johnson & Johnson Vision Products, Inc. | Contact lens package with insertion feature |
JPH10127563A (en) | 1996-10-30 | 1998-05-19 | Olympus Optical Co Ltd | Endoscope unit |
JP3962122B2 (en) | 1996-11-20 | 2007-08-22 | オリンパス株式会社 | Endoscope device |
JP3713347B2 (en) | 1996-11-25 | 2005-11-09 | オリンパス株式会社 | Fluorescence endoscope device |
ES2156624T3 (en) * | 1996-11-30 | 2001-07-01 | Scharwaechter Ed Gmbh | DETACHABLE DOOR HINGE FOR CAR DOORS. |
US5779624A (en) | 1996-12-05 | 1998-07-14 | Boston Scientific Corporation | Sigmoid splint device for endoscopy |
US6331181B1 (en) | 1998-12-08 | 2001-12-18 | Intuitive Surgical, Inc. | Surgical robotic tools, data architecture, and use |
US5772355A (en) | 1996-12-19 | 1998-06-30 | Precision Optics Corporation | Quick attach/release adapter mechanism |
JP3771985B2 (en) | 1997-01-20 | 2006-05-10 | オリンパス株式会社 | Fluorescence observation endoscope device |
JPH10225426A (en) | 1997-02-17 | 1998-08-25 | Olympus Optical Co Ltd | Fluorescence observing device |
JPH10243915A (en) | 1997-03-04 | 1998-09-14 | Olympus Optical Co Ltd | Fluorescent observation device |
JPH10243920A (en) | 1997-03-07 | 1998-09-14 | Olympus Optical Co Ltd | Fluorescent observation endoscope device |
JPH10258034A (en) | 1997-03-19 | 1998-09-29 | Olympus Optical Co Ltd | Photographing apparatus for endoscope |
JP3422213B2 (en) | 1997-03-24 | 2003-06-30 | 富士写真光機株式会社 | Endoscope guide device |
DE19713275A1 (en) | 1997-03-29 | 1998-10-01 | Storz Karl Gmbh & Co | Endoscope with length compensation under thermal stress |
JPH10308114A (en) | 1997-05-06 | 1998-11-17 | Olympus Optical Co Ltd | Light source equipment |
JP3923595B2 (en) | 1997-05-13 | 2007-06-06 | オリンパス株式会社 | Fluorescence observation equipment |
JPH10309281A (en) | 1997-05-13 | 1998-11-24 | Olympus Optical Co Ltd | Fluorescent diagnostic device |
JPH10328129A (en) | 1997-06-02 | 1998-12-15 | Olympus Optical Co Ltd | Fluorescent observing device |
US5892625A (en) | 1997-07-09 | 1999-04-06 | Radiant Optics, Inc. | Fluid image transmitting optical system for endoscopes |
US5976146A (en) | 1997-07-11 | 1999-11-02 | Olympus Optical Co., Ltd. | Surgical operation system and method of securing working space for surgical operation in body |
JP4009350B2 (en) * | 1997-08-06 | 2007-11-14 | オリンパス株式会社 | Endoscope system |
US6059719A (en) | 1997-08-06 | 2000-05-09 | Olympus Optical Co., Ltd. | Endoscope system |
US6016038A (en) | 1997-08-26 | 2000-01-18 | Color Kinetics, Inc. | Multicolored LED lighting method and apparatus |
JPH1189789A (en) | 1997-09-24 | 1999-04-06 | Olympus Optical Co Ltd | Fluorescent image device |
JP4098402B2 (en) | 1998-05-28 | 2008-06-11 | オリンパス株式会社 | Fluorescent imaging device |
JPH11104060A (en) | 1997-10-03 | 1999-04-20 | Olympus Optical Co Ltd | Fluorescent observation device |
JPH11104059A (en) | 1997-10-02 | 1999-04-20 | Olympus Optical Co Ltd | Fluorescent observation device |
JP3853931B2 (en) | 1997-10-02 | 2006-12-06 | オリンパス株式会社 | Endoscope |
JPH11104061A (en) | 1997-10-02 | 1999-04-20 | Olympus Optical Co Ltd | Trans-endoscopic fluorescent observation device |
JPH11113839A (en) | 1997-10-14 | 1999-04-27 | Olympus Optical Co Ltd | Endoscope device |
JPH11155812A (en) | 1997-12-02 | 1999-06-15 | Olympus Optical Co Ltd | Fluorescent observation device |
JPH11244220A (en) * | 1998-03-03 | 1999-09-14 | Fuji Photo Film Co Ltd | Fluorescent endoscope |
US6462770B1 (en) | 1998-04-20 | 2002-10-08 | Xillix Technologies Corp. | Imaging system with automatic gain control for reflectance and fluorescence endoscopy |
DE19821401C2 (en) * | 1998-05-13 | 2000-05-18 | Storz Endoskop Gmbh Schaffhaus | Endoscope for inspection of an observation room |
US6592847B1 (en) | 1998-05-14 | 2003-07-15 | The General Hospital Corporation | Intramolecularly-quenched near infrared flourescent probes |
EP0959372A3 (en) * | 1998-05-22 | 2000-07-19 | Rohm And Haas Company | Light pipe composition |
US6332092B1 (en) | 1998-07-08 | 2001-12-18 | Lifespex, Incorporated | Optical probe having and methods for uniform light irradiation and/or light collection over a volume |
US6350233B1 (en) | 1998-07-30 | 2002-02-26 | David Z. Lubowski | Sigmoidoscope |
DE69931666T2 (en) | 1998-12-04 | 2007-05-24 | Nippon Zeon Co., Ltd. | A resin composition containing hydrogenated polymers and methods of making a substrate for use as a data recording medium |
KR20010110420A (en) | 1999-01-26 | 2001-12-13 | 추후제출 | Autofluorescence imaging system for endoscopy |
JP3720617B2 (en) * | 1999-03-03 | 2005-11-30 | オリンパス株式会社 | Endoscope device |
DE19910050C2 (en) | 1999-03-08 | 2003-08-14 | Storz Karl Gmbh & Co Kg | Image transmission system for endoscopes and the like periscopes and method for producing an image transmission system |
JP3309276B2 (en) | 1999-03-17 | 2002-07-29 | エーカポット・パンナチェート | Fluorescent endoscope system |
JP2000287915A (en) | 1999-04-08 | 2000-10-17 | Machida Endscope Co Ltd | Guide tube device for surgery |
JP2000354583A (en) | 1999-06-15 | 2000-12-26 | Olympus Optical Co Ltd | Endoscope fluoroscopic apparatus |
WO2001011343A1 (en) | 1999-08-06 | 2001-02-15 | Cambridge Research & Instrumentation Inc. | Spectral imaging system |
US6351663B1 (en) | 1999-09-10 | 2002-02-26 | Akorn, Inc. | Methods for diagnosing and treating conditions associated with abnormal vasculature using fluorescent dye angiography and dye-enhanced photocoagulation |
US6944493B2 (en) | 1999-09-10 | 2005-09-13 | Akora, Inc. | Indocyanine green (ICG) compositions and related methods of use |
US20020087047A1 (en) | 1999-09-13 | 2002-07-04 | Visionscope, Inc. | Miniature endoscope system |
US6915154B1 (en) | 1999-09-24 | 2005-07-05 | National Research Council Of Canada | Method and apparatus for performing intra-operative angiography |
US6890298B2 (en) | 1999-10-14 | 2005-05-10 | Karl Storz Gmbh & Co. Kg | Video laryngoscope with detachable light and image guides |
WO2001037917A1 (en) | 1999-11-25 | 2001-05-31 | Sumitomo Bakelite Company Limited | Guide tube and application method therefor |
JP2001212245A (en) | 1999-11-25 | 2001-08-07 | Sumitomo Bakelite Co Ltd | Guide tube and its usage |
US6443976B1 (en) | 1999-11-30 | 2002-09-03 | Akorn, Inc. | Methods for treating conditions and illnesses associated with abnormal vasculature |
JP3297033B2 (en) | 2000-02-02 | 2002-07-02 | オリンパス光学工業株式会社 | Endoscope |
DE10008710C2 (en) | 2000-02-24 | 2002-01-10 | Loh Optikmaschinen Ag | Device for centering clamping of optical lenses for their edge processing |
AU2001251164B2 (en) | 2000-03-28 | 2006-11-02 | Board Of Regents, The University Of Texas System | Methods and apparatus for diagnostic multispectral digital imaging |
DE60122894T2 (en) * | 2000-07-14 | 2007-03-15 | Xillix Technologies Corp., Richmond | COMPACT FLUORESCENT ENDOSCOPIC VIDEO SYSTEM |
US6347010B1 (en) | 2000-10-10 | 2002-02-12 | Chung-Shan Institute Of Science And Technology | Periscope using common optical path to have stabilized panoramic view |
US6907527B1 (en) | 2000-10-17 | 2005-06-14 | International Business Machines Corporation | Cryptography-based low distortion robust data authentication system and method therefor |
DE10052863A1 (en) | 2000-10-24 | 2002-04-25 | Christian Pilgrim | Endoscopic instrument for use in cavities detects at least two channels for at least two image points, preferably at least two color channels, in single polychromatic horizontally structured pixel |
US6826424B1 (en) * | 2000-12-19 | 2004-11-30 | Haishan Zeng | Methods and apparatus for fluorescence and reflectance imaging and spectroscopy and for contemporaneous measurements of electromagnetic radiation with multiple measuring devices |
US6786865B2 (en) * | 2001-01-17 | 2004-09-07 | Innon Holdings, Llc | Endoscope valve assembly and method |
US6490085B1 (en) | 2001-02-21 | 2002-12-03 | Richard Wolf Gmbh | Symmetric anastigmatic endoscope relay system |
JP2002244122A (en) | 2001-02-22 | 2002-08-28 | Sharp Corp | Display device |
JP2002253500A (en) | 2001-03-05 | 2002-09-10 | Olympus Optical Co Ltd | Light source device for endoscope |
JP2002336190A (en) | 2001-03-12 | 2002-11-26 | Olympus Optical Co Ltd | Endoscope |
US6600947B2 (en) * | 2001-03-16 | 2003-07-29 | Nymox Corporation | Method of detecting amyloid-containing lesions by autofluorescence |
JP4716595B2 (en) | 2001-04-04 | 2011-07-06 | オリンパス株式会社 | Endoscope apparatus and method for assembling endoscope optical adapter |
DE10121450A1 (en) | 2001-04-27 | 2002-11-21 | Storz Endoskop Gmbh Schaffhaus | Optical instrument, in particular an endoscope, with an exchangeable head |
JP3731814B2 (en) | 2001-05-07 | 2006-01-05 | 富士写真フイルム株式会社 | Fluorescent image display device |
DE60228165D1 (en) * | 2001-05-16 | 2008-09-25 | Olympus Corp | Endoscope with image processing device |
JP3985466B2 (en) | 2001-06-07 | 2007-10-03 | フジノン株式会社 | Endoscope lens device |
JP5259033B2 (en) * | 2001-08-03 | 2013-08-07 | オリンパス株式会社 | Endoscope system |
US6921920B2 (en) * | 2001-08-31 | 2005-07-26 | Smith & Nephew, Inc. | Solid-state light source |
US6911005B2 (en) | 2001-10-25 | 2005-06-28 | Pentax Corporation | Endoscope with detachable sheath |
US7033314B2 (en) | 2002-01-11 | 2006-04-25 | Fidelitycorp Limited | Endoscopic devices and method of use |
US6899675B2 (en) | 2002-01-15 | 2005-05-31 | Xillix Technologies Corp. | Fluorescence endoscopy video systems with no moving parts in the camera |
US20050154319A1 (en) | 2002-01-15 | 2005-07-14 | Xillix Technologies Corporation | Fluorescence endoscopy video systems with no moving parts in the camera |
US20060241496A1 (en) | 2002-01-15 | 2006-10-26 | Xillix Technologies Corp. | Filter for use with imaging endoscopes |
CA2478250C (en) | 2002-03-20 | 2011-09-06 | Novadaq Technologies Inc. | System and method for visualizing fluid flow through vessels |
JP4054222B2 (en) * | 2002-06-05 | 2008-02-27 | オリンパス株式会社 | Light source device for endoscope device |
JP3869324B2 (en) * | 2002-06-26 | 2007-01-17 | オリンパス株式会社 | Image processing device for fluorescence observation |
CA2499469C (en) | 2002-07-17 | 2013-06-04 | Novadaq Technologies Inc. | Combined photocoagulation and photodynamic therapy |
JP3743512B2 (en) | 2002-07-30 | 2006-02-08 | 株式会社八光 | Surgical mantle |
US7023543B2 (en) * | 2002-08-01 | 2006-04-04 | Cunningham David W | Method for controlling the luminous flux spectrum of a lighting fixture |
AU2003261845A1 (en) | 2002-08-30 | 2004-04-30 | Mitsubishi Chemical Corporation | Color liquid crystal display unit |
JP2004163902A (en) * | 2002-08-30 | 2004-06-10 | Mitsubishi Chemicals Corp | Color liquid crystal display device and photosensitive color resin composition |
JP4061156B2 (en) | 2002-09-02 | 2008-03-12 | オリンパス株式会社 | Optical unit assembling method and optical unit assembling apparatus |
US6958035B2 (en) | 2002-10-15 | 2005-10-25 | Dusa Pharmaceuticals, Inc | Medical device sheath apparatus and method of making and using same |
US7429472B2 (en) | 2003-01-31 | 2008-09-30 | Promega Corporation | Method of immobilizing a protein or molecule via a mutant dehalogenase that is bound to an immobilized dehalogenase substrate and linked directly or indirectly to the protein or molecule |
JP4320184B2 (en) | 2003-02-10 | 2009-08-26 | Hoya株式会社 | Objective lens unit and method of assembling the objective lens unit |
JP4023329B2 (en) * | 2003-02-13 | 2007-12-19 | 松下電工株式会社 | Optical filter and lighting apparatus using the same |
US7307783B2 (en) | 2003-02-21 | 2007-12-11 | Kla-Tencor Technologies Corporation | Catadioptric imaging system employing immersion liquid for use in broad band microscopy |
CA2519959A1 (en) | 2003-03-25 | 2004-10-14 | Precision Optics Corporation, Inc. | Optical device with lens positioning and method of making the same |
JP4041421B2 (en) * | 2003-03-25 | 2008-01-30 | 独立行政法人理化学研究所 | Raman probe and Raman scattering measuring apparatus using the same |
JP2004292722A (en) * | 2003-03-28 | 2004-10-21 | Mitsubishi Chemicals Corp | Coating liquid for die coater |
US7182752B2 (en) | 2003-04-08 | 2007-02-27 | Surgiquest, Incorporated | Continuous gas flow trocar assembly |
JP2005010315A (en) * | 2003-06-17 | 2005-01-13 | Scalar Corp | Optical element filter and optical element filter set |
US20050027166A1 (en) * | 2003-06-17 | 2005-02-03 | Shinya Matsumoto | Endoscope system for fluorescent observation |
JP4198086B2 (en) * | 2003-06-25 | 2008-12-17 | オリンパス株式会社 | Fluorescence observation equipment |
JP4475897B2 (en) | 2003-08-19 | 2010-06-09 | Hoya株式会社 | Endoscope system and endoscope |
JP2005058618A (en) | 2003-08-19 | 2005-03-10 | Pentax Corp | Endoscope and cap |
JP4394395B2 (en) | 2003-08-19 | 2010-01-06 | Hoya株式会社 | Endoscope system |
JP4420638B2 (en) | 2003-09-08 | 2010-02-24 | Hoya株式会社 | Endoscope |
JP4394402B2 (en) | 2003-09-11 | 2010-01-06 | Hoya株式会社 | Endoscope system |
US20050234302A1 (en) * | 2003-09-26 | 2005-10-20 | Mackinnon Nicholas B | Apparatus and methods relating to color imaging endoscope systems |
CA2581668A1 (en) | 2003-09-26 | 2005-04-07 | Tidal Photonics, Inc | Apparatus and methods relating to expanded dynamic range imaging endoscope systems |
US7103402B2 (en) | 2003-10-02 | 2006-09-05 | Ut-Battelle, Llc | Advanced synchronous luminescence imaging for chemical and medical diagnostics |
JP4294440B2 (en) * | 2003-10-30 | 2009-07-15 | オリンパス株式会社 | Image processing device |
JP4524099B2 (en) | 2003-12-19 | 2010-08-11 | オリンパス株式会社 | Endoscope device |
JP2005292404A (en) | 2004-03-31 | 2005-10-20 | Canon Inc | Accessory device |
RU2006137467A (en) | 2004-05-13 | 2008-06-20 | Сайтлайн Текнолоджиз Лтд. (Il) | REPLACEMENT KIT FOR USE WITH AN ENDOSCOPE |
JPWO2005110195A1 (en) | 2004-05-14 | 2008-03-21 | オリンパス株式会社 | Insertion device |
JP2008511341A (en) | 2004-05-28 | 2008-04-17 | ユー.エス. エンドスコピー グループ, インコーポレイテッド | Overtube assembly |
US20050275057A1 (en) | 2004-06-15 | 2005-12-15 | Breen Marc L | Schottky diode with dielectric isolation |
WO2006004652A1 (en) | 2004-06-29 | 2006-01-12 | Applied Medical Resources Corporation | Insufflating optical surgical instrument |
US7798955B2 (en) * | 2004-10-26 | 2010-09-21 | Olympus Corporation | Image generating device for generating a fluorescence image |
ES2382403T3 (en) | 2004-11-11 | 2012-06-08 | Daltray Pty Ltd. | SIGMOIDOSCOPE WITH OPTICAL COUPLING ELEMENT. |
US20080021274A1 (en) * | 2005-01-05 | 2008-01-24 | Avantis Medical Systems, Inc. | Endoscopic medical device with locking mechanism and method |
EP1698272B1 (en) * | 2005-03-04 | 2012-12-05 | FUJIFILM Corporation | Endoscope and image processing device |
US20060217594A1 (en) * | 2005-03-24 | 2006-09-28 | Ferguson Gary W | Endoscopy device with removable tip |
US20060239921A1 (en) | 2005-04-26 | 2006-10-26 | Novadaq Technologies Inc. | Real time vascular imaging during solid organ transplant |
US8185176B2 (en) | 2005-04-26 | 2012-05-22 | Novadaq Technologies, Inc. | Method and apparatus for vasculature visualization with applications in neurosurgery and neurology |
WO2006119349A2 (en) | 2005-04-29 | 2006-11-09 | Novadaq Technologies, Inc. | Choroid and retinal imaging and treatment system |
US7648457B2 (en) | 2005-05-13 | 2010-01-19 | Ethicon Endo-Surgery, Inc. | Method of positioning a device on an endoscope |
JP2007143624A (en) | 2005-11-24 | 2007-06-14 | Hamamatsu Photonics Kk | Fluorescence observation apparatus |
EP1815950A1 (en) | 2006-02-03 | 2007-08-08 | The European Atomic Energy Community (EURATOM), represented by the European Commission | Robotic surgical system for performing minimally invasive medical procedures |
WO2007106624A2 (en) | 2006-02-07 | 2007-09-20 | Novadaq Technologies Inc. | Near infrared imaging |
US8408269B2 (en) | 2006-07-28 | 2013-04-02 | Novadaq Technologies, Inc. | System and method for deposition and removal of an optical element on an endoscope objective |
US20080081948A1 (en) | 2006-10-03 | 2008-04-03 | Ethicon Endo-Surgery, Inc. | Apparatus for cleaning a distal scope end of a medical viewing scope |
CN200987662Y (en) | 2006-12-15 | 2007-12-12 | 天津市企美科技发展有限公司 | Thin diameter medical rigid endoscope |
US8498695B2 (en) * | 2006-12-22 | 2013-07-30 | Novadaq Technologies Inc. | Imaging system with a single color image sensor for simultaneous fluorescence and color video endoscopy |
US7733584B2 (en) | 2007-05-04 | 2010-06-08 | Smith & Nephew, Inc. | Color-corrected optical system |
CN201048936Y (en) | 2007-07-02 | 2008-04-23 | 李伟 | Ventricle endoscope external sheath |
CN201085616Y (en) | 2007-08-13 | 2008-07-16 | 广州三友科技有限公司 | Endoscope casing tube |
JP5185578B2 (en) | 2007-08-22 | 2013-04-17 | オリンパス株式会社 | Small-diameter objective optical system |
JP5164644B2 (en) | 2008-04-04 | 2013-03-21 | オリンパスメディカルシステムズ株式会社 | Endoscope |
US7821720B2 (en) | 2008-05-22 | 2010-10-26 | General Electric Company | Endoscope objective lens with large entrance pupil diameter and high numerical aperture |
US7724430B2 (en) | 2008-07-17 | 2010-05-25 | Olympus Medical Systems Corp. | Rigid endoscope |
EP3335651B1 (en) | 2008-09-29 | 2019-07-17 | Applied Medical Resources Corporation | First-entry trocar system |
EP2350583B1 (en) | 2008-10-06 | 2019-08-14 | Novadaq Technologies ULC | Compensating optical coupler for visible and nir imaging |
EP3456238B1 (en) | 2008-11-18 | 2020-05-13 | United States Endoscopy Group, Inc. | Method of attaching devices to endoscopes using an adapter |
US7903352B2 (en) | 2009-04-30 | 2011-03-08 | Durell & Gitelis, Inc. | Lens mounting system for use in lens relay systems |
JP2011194011A (en) | 2010-03-19 | 2011-10-06 | Fujifilm Corp | Image capturing apparatus |
JP5492030B2 (en) | 2010-08-31 | 2014-05-14 | 富士フイルム株式会社 | Image pickup display device and method of operating the same |
CN102004309B (en) | 2010-10-26 | 2012-05-23 | 张阳德 | Non-spherical lens rigid endoscope |
JP5368511B2 (en) | 2011-06-09 | 2013-12-18 | 富士フイルム株式会社 | Rigid endoscope oversheath |
WO2013021704A1 (en) | 2011-08-08 | 2013-02-14 | オリンパスメディカルシステムズ株式会社 | Rigid scope optical assembly and rigid endoscope |
CN103091829A (en) | 2012-11-23 | 2013-05-08 | 中国航天科工集团第三研究院第八三五八研究所 | Optical inversion system of rigid tube endoscope |
US20140187859A1 (en) | 2012-12-24 | 2014-07-03 | Novadaq Technologies Inc. | Endoluminal introducer |
KR20170129282A (en) | 2013-05-15 | 2017-11-24 | 노바다크 테크놀러지즈 인코포레이티드 | Highly corrected relay system |
US10293122B2 (en) | 2016-03-17 | 2019-05-21 | Novadaq Technologies ULC | Endoluminal introducer with contamination avoidance |
-
2005
- 2005-05-04 US US11/122,267 patent/US20060241496A1/en not_active Abandoned
-
2006
- 2006-04-26 US US11/412,715 patent/US8630698B2/en not_active Expired - Fee Related
- 2006-04-27 WO PCT/CA2006/000669 patent/WO2006116847A1/en not_active Application Discontinuation
- 2006-04-27 EP EP06721854.5A patent/EP1883337A4/en not_active Withdrawn
- 2006-04-27 JP JP2008509275A patent/JP2008539827A/en active Pending
-
2013
- 2013-11-28 JP JP2013246636A patent/JP2014087661A/en active Pending
-
2014
- 2014-01-13 US US14/154,177 patent/US20140194687A1/en not_active Abandoned
-
2015
- 2015-12-18 US US14/975,707 patent/US10182709B2/en not_active Expired - Fee Related
-
2018
- 2018-12-12 US US16/218,256 patent/US20190357757A1/en not_active Abandoned
Patent Citations (81)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US527842A (en) * | 1894-10-23 | forney | ||
US4115812A (en) * | 1973-11-26 | 1978-09-19 | Hitachi, Ltd. | Automatic gain control circuit |
US3971068A (en) * | 1975-08-22 | 1976-07-20 | The United States Of America As Represented By The Secretary Of The Navy | Image processing system |
US4149190A (en) * | 1977-10-17 | 1979-04-10 | Xerox Corporation | Automatic gain control for video amplifier |
US4200801A (en) * | 1979-03-28 | 1980-04-29 | The United States Of America As Represented By The United States Department Of Energy | Portable spotter for fluorescent contaminants on surfaces |
US4355325A (en) * | 1980-03-24 | 1982-10-19 | Sony Corporation | White balance control system |
US4449535A (en) * | 1981-03-25 | 1984-05-22 | Compagnie Industrielle Des Lasers Cilas Alcatel | Apparatus for measuring in situ the state of oxidation-reduction of a living organ |
US4378571A (en) * | 1981-07-06 | 1983-03-29 | Xerox Corporation | Serial analog video processor for charge coupled device imagers |
US4556057A (en) * | 1982-08-31 | 1985-12-03 | Hamamatsu Tv Co., Ltd. | Cancer diagnosis device utilizing laser beam pulses |
US4424841A (en) * | 1982-09-30 | 1984-01-10 | Smith J Rudy | Modular stacking bag |
US4532918A (en) * | 1983-10-07 | 1985-08-06 | Welch Allyn Inc. | Endoscope signal level control |
US4638365A (en) * | 1984-01-31 | 1987-01-20 | Canon Kabushiki Kaisha | Image sensing device |
US4786813A (en) * | 1984-10-22 | 1988-11-22 | Hightech Network Sci Ab | Fluorescence imaging system |
US5134662A (en) * | 1985-11-04 | 1992-07-28 | Cell Analysis Systems, Inc. | Dual color camera microscope and methodology for cell staining and analysis |
US4930516A (en) * | 1985-11-13 | 1990-06-05 | Alfano Robert R | Method for detecting cancerous tissue using visible native luminescence |
US4930516B1 (en) * | 1985-11-13 | 1998-08-04 | Laser Diagnostic Instr Inc | Method for detecting cancerous tissue using visible native luminescence |
US4768513A (en) * | 1986-04-21 | 1988-09-06 | Agency Of Industrial Science And Technology | Method and device for measuring and processing light |
US4856495A (en) * | 1986-09-25 | 1989-08-15 | Olympus Optical Co., Ltd. | Endoscope apparatus |
US4821117A (en) * | 1986-11-12 | 1989-04-11 | Kabushiki Kaisha Toshiba | Endoscopic system for producing fluorescent and visible images |
US5255087A (en) * | 1986-11-29 | 1993-10-19 | Olympus Optical Co., Ltd. | Imaging apparatus and endoscope apparatus using the same |
US4837625A (en) * | 1987-02-20 | 1989-06-06 | Sgs-Thomson Microelectronics S.A. | Automatic gain control device for video signals |
US5596654A (en) * | 1987-04-20 | 1997-01-21 | Fuji Photo Film Co., Ltd. | Method of determining desired image signal range based on histogram data |
US4954897A (en) * | 1987-05-22 | 1990-09-04 | Nikon Corporation | Electronic still camera system with automatic gain control of image signal amplifier before image signal recording |
US5001556A (en) * | 1987-09-30 | 1991-03-19 | Olympus Optical Co., Ltd. | Endoscope apparatus for processing a picture image of an object based on a selected wavelength range |
US4951135A (en) * | 1988-01-11 | 1990-08-21 | Olympus Optical Co., Ltd. | Electronic-type endoscope system having capability of setting AGC variation region |
US5034888A (en) * | 1988-02-26 | 1991-07-23 | Olympus Optical Co., Ltd. | Electronic endoscope apparatus having different image processing characteristics for a moving image and a still image |
US5419323A (en) * | 1988-12-21 | 1995-05-30 | Massachusetts Institute Of Technology | Method for laser induced fluorescence of tissue |
US5165079A (en) * | 1989-02-02 | 1992-11-17 | Linotype-Hell Ag | Optical color-splitter arrangement |
US4974936A (en) * | 1989-03-15 | 1990-12-04 | Richard Wolf Gmbh | Device for supplying light to endoscopes with rotary filter plate and faster rotating runner plate with at least one opaque region |
US5007408A (en) * | 1989-03-16 | 1991-04-16 | Olympus Optical Co., Ltd. | Endoscope light source apparatus |
US5421337A (en) * | 1989-04-14 | 1995-06-06 | Massachusetts Institute Of Technology | Spectral diagnosis of diseased tissue |
US5420628A (en) * | 1990-01-16 | 1995-05-30 | Research Development Foundation | Video densitometer with determination of color composition |
US5507287A (en) * | 1991-05-08 | 1996-04-16 | Xillix Technologies Corporation | Endoscopic imaging system for diseased tissue |
US5225883A (en) * | 1991-06-05 | 1993-07-06 | The Babcock & Wilcox Company | Video temperature monitor |
US5485203A (en) * | 1991-08-12 | 1996-01-16 | Olympus Optical Co., Ltd. | Color misregistration easing system which corrects on a pixel or block basis only when necessary |
US5377686A (en) * | 1991-10-11 | 1995-01-03 | The University Of Connecticut | Apparatus for detecting leakage from vascular tissue |
US5585846A (en) * | 1991-12-05 | 1996-12-17 | Samsung Electronics Co., Ltd. | Image signal processing circuit in a digital camera having gain and gamma control |
US5214503A (en) * | 1992-01-31 | 1993-05-25 | The United States Of America As Represented By The Secretary Of The Army | Color night vision camera system |
US5408263A (en) * | 1992-06-16 | 1995-04-18 | Olympus Optical Co., Ltd. | Electronic endoscope apparatus |
US5430476A (en) * | 1992-06-24 | 1995-07-04 | Richard Wolf Gmbh | Device for supplying light to endoscopes |
US5410363A (en) * | 1992-12-08 | 1995-04-25 | Lightwave Communications, Inc. | Automatic gain control device for transmitting video signals between two locations by use of a known reference pulse during vertical blanking period so as to control the gain of the video signals at the second location |
US5365057A (en) * | 1993-07-02 | 1994-11-15 | Litton Systems, Inc. | Light-weight night vision device |
US5371355A (en) * | 1993-07-30 | 1994-12-06 | Litton Systems, Inc. | Night vision device with separable modular image intensifier assembly |
US5749830A (en) * | 1993-12-03 | 1998-05-12 | Olympus Optical Co., Ltd. | Fluorescent endoscope apparatus |
US6192267B1 (en) * | 1994-03-21 | 2001-02-20 | Scherninski Francois | Endoscopic or fiberscopic imaging device using infrared fluorescence |
US5827190A (en) * | 1994-03-28 | 1998-10-27 | Xillix Technologies Corp. | Endoscope having an integrated CCD sensor |
US5590660A (en) * | 1994-03-28 | 1997-01-07 | Xillix Technologies Corp. | Apparatus and method for imaging diseased tissue using integrated autofluorescence |
US6099466A (en) * | 1994-09-21 | 2000-08-08 | Asahi Kogaku Kogyo Kabushiki Kaisha | Fluorescence diagnosis endoscope system |
US5646680A (en) * | 1994-10-20 | 1997-07-08 | Olympus Optical Co., Ltd. | Endoscope system having a switch forcibly set to display video signals not passed through outer peripheral apparatus |
US5772580A (en) * | 1995-03-03 | 1998-06-30 | Asahi Kogaku Kogyo Kabushiki Kaisha | Biological fluorescence diagnostic apparatus with distinct pickup cameras |
US6212425B1 (en) * | 1995-09-26 | 2001-04-03 | Karl Storz Gmbh & Co., Kg | Apparatus for photodynamic diagnosis |
US5891016A (en) * | 1995-11-09 | 1999-04-06 | Asahi Kogaku Kogyo Kabushiki Kaisha | Fluorescence endoscope having an exciting light filter and a fluorescence filter |
US5647368A (en) * | 1996-02-28 | 1997-07-15 | Xillix Technologies Corp. | Imaging system for detecting diseased tissue using native fluorsecence in the gastrointestinal and respiratory tract |
US6070096A (en) * | 1996-03-06 | 2000-05-30 | Fuji Photo Film Co., Ltd. | Fluorescence detecting apparatus |
US6061591A (en) * | 1996-03-29 | 2000-05-09 | Richard Wolf Gmbh | Arrangement and method for diagnosing malignant tissue by fluorescence observation |
US5971918A (en) * | 1996-10-02 | 1999-10-26 | Richard Wolf Gmbh | Device for the photodynamic endoscopic diagnosis of tumor tissue |
US6293911B1 (en) * | 1996-11-20 | 2001-09-25 | Olympus Optical Co., Ltd. | Fluorescent endoscope system enabling simultaneous normal light observation and fluorescence observation in infrared spectrum |
US6021344A (en) * | 1996-12-04 | 2000-02-01 | Derma Technologies, Inc. | Fluorescence scope system for dermatologic diagnosis |
US6002137A (en) * | 1997-02-13 | 1999-12-14 | Fuji Photo Film Co., Ltd. | Fluorescence detecting system |
US6059720A (en) * | 1997-03-07 | 2000-05-09 | Asahi Kogaku Kogyo Kabushiki Kaisha | Endoscope system with amplification of fluorescent image |
US5852498A (en) * | 1997-04-04 | 1998-12-22 | Kairos Scientific Inc. | Optical instrument having a variable optical filter |
US6008889A (en) * | 1997-04-16 | 1999-12-28 | Zeng; Haishan | Spectrometer system for diagnosis of skin disease |
US6069689A (en) * | 1997-04-16 | 2000-05-30 | Derma Technologies, Inc. | Apparatus and methods relating to optical systems for diagnosis of skin diseases |
US6028622A (en) * | 1997-04-25 | 2000-02-22 | Olympus Optical Co., Ltd. | Observation apparatus for endoscopes |
US6161035A (en) * | 1997-04-30 | 2000-12-12 | Asahi Kogaku Kogyo Kabushiki Kaisha | Fluorescence diagnostic apparatus |
US5986271A (en) * | 1997-07-03 | 1999-11-16 | Lazarev; Victor | Fluorescence imaging system |
US6120435A (en) * | 1997-07-16 | 2000-09-19 | Olympus Optical Co., Ltd. | Endoscope system in which operation switch sets designed to function and be handled same way are included in endoscope and image processing apparatus respectively |
US6422994B1 (en) * | 1997-09-24 | 2002-07-23 | Olympus Optical Co., Ltd. | Fluorescent diagnostic system and method providing color discrimination enhancement |
US5984861A (en) * | 1997-09-29 | 1999-11-16 | Boston Scientific Corporation | Endofluorescence imaging module for an endoscope |
US6364831B1 (en) * | 1997-09-29 | 2002-04-02 | Boston Scientific Corporation | Endofluorescence imaging module for an endoscope |
US6148227A (en) * | 1998-01-07 | 2000-11-14 | Richard Wolf Gmbh | Diagnosis apparatus for the picture providing recording of fluorescing biological tissue regions |
US7235045B2 (en) * | 1998-01-26 | 2007-06-26 | Massachusetts Institute Of Technology | Fluorescence imaging endoscope |
US6280378B1 (en) * | 1998-05-29 | 2001-08-28 | Fuji Photo Film Co., Ltd. | Fluorescence endoscope |
US6110106A (en) * | 1998-06-24 | 2000-08-29 | Biomax Technologies, Inc. | Endoscopes and methods relating to direct viewing of a target tissue |
US6364829B1 (en) * | 1999-01-26 | 2002-04-02 | Newton Laboratories, Inc. | Autofluorescence imaging system for endoscopy |
US6529768B1 (en) * | 1999-11-18 | 2003-03-04 | Fuji Photo Film Co., Ltd. | Method and apparatus for acquiring fluorescence images |
US6603552B1 (en) * | 1999-12-22 | 2003-08-05 | Xillix Technologies Corp. | Portable system for detecting skin abnormalities based on characteristic autofluorescence |
US20020138008A1 (en) * | 2000-01-13 | 2002-09-26 | Kazuhiro Tsujita | Method and apparatus for displaying fluorescence images and method and apparatus for acquiring endoscope images |
US20020161283A1 (en) * | 2001-04-27 | 2002-10-31 | Fuji Photo Film Co., Ltd. | Image obtaining method and apparatus of an endoscope apparatus |
US20020175993A1 (en) * | 2001-05-16 | 2002-11-28 | Olympus Optical Co., Ltd. | Endoscope system using normal light and fluorescence |
US20030153811A1 (en) * | 2002-02-12 | 2003-08-14 | Olympus Winter & Ibe Gmbh | Fluorescence endoscope with inserted/retracted short-pass filter |
Cited By (71)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9968244B2 (en) | 2000-07-14 | 2018-05-15 | Novadaq Technologies ULC | Compact fluorescence endoscopy video system |
US10182709B2 (en) | 2002-01-15 | 2019-01-22 | Novadaq Technologies ULC | Filter for use with imaging endoscopes |
US20090245605A1 (en) * | 2003-09-23 | 2009-10-01 | Richard Levenson | Spectral imaging of biological samples |
US8879812B2 (en) | 2003-09-23 | 2014-11-04 | Cambridge Research & Instrumentation, Inc. | Spectral imaging of biological samples |
US20050065440A1 (en) * | 2003-09-23 | 2005-03-24 | Richard Levenson | Spectral imaging of deep tissue |
US8385615B2 (en) | 2003-09-23 | 2013-02-26 | Cambridge Research & Instrumentation, Inc. | Spectral imaging of biological samples |
US8634607B2 (en) | 2003-09-23 | 2014-01-21 | Cambridge Research & Instrumentation, Inc. | Spectral imaging of biological samples |
US20080294032A1 (en) * | 2003-09-23 | 2008-11-27 | Cambridge Research And Instrumentation, Inc. | Spectral Imaging of Biological Samples |
US8391961B2 (en) | 2003-09-23 | 2013-03-05 | Cambridge Research & Instrumentation, Inc. | Spectral imaging |
US20070016082A1 (en) * | 2003-09-23 | 2007-01-18 | Richard Levenson | Spectral imaging |
US7321791B2 (en) * | 2003-09-23 | 2008-01-22 | Cambridge Research And Instrumentation, Inc. | Spectral imaging of deep tissue |
US9588099B2 (en) | 2003-09-23 | 2017-03-07 | Cambridge Research & Intrumentation, Inc. | Spectral imaging |
US8639043B2 (en) | 2005-01-27 | 2014-01-28 | Cambridge Research & Instrumentation, Inc. | Classifying image features |
US8280140B2 (en) | 2005-01-27 | 2012-10-02 | Cambridge Research & Instrumentation, Inc. | Classifying image features |
US20070102623A1 (en) * | 2005-10-17 | 2007-05-10 | Xillix Technologies Corp. | Device for short wavelength visible reflectance endoscopy using broadband illumination |
US7420151B2 (en) * | 2005-10-17 | 2008-09-02 | Novadaq Technologies Inc. | Device for short wavelength visible reflectance endoscopy using broadband illumination |
US9877654B2 (en) | 2006-02-07 | 2018-01-30 | Novadaq Technologies Inc. | Near infrared imaging |
US8175687B2 (en) * | 2006-03-29 | 2012-05-08 | Korea Electro Technology Research Institute | Light source for fluorescence diagnosis and photodynamic therapy |
US20080269576A1 (en) * | 2006-03-29 | 2008-10-30 | Uk Kang | Light Source for Fluorescence Diagnosis and Photodynamic Therapy |
WO2008011722A1 (en) * | 2006-07-28 | 2008-01-31 | Novadaq Technologies Inc. | System and method for deposition and removal of an optical element on an endoscope objective |
JP2009544373A (en) * | 2006-07-28 | 2009-12-17 | ノバダック テクノロジーズ インコーポレイテッド | System and method for depositing and removing optical members at the objective of an endoscope |
US9386909B2 (en) | 2006-07-28 | 2016-07-12 | Novadaq Technologies Inc. | System and method for deposition and removal of an optical element on an endoscope objective |
US11770503B2 (en) | 2006-12-22 | 2023-09-26 | Stryker European Operations Limited | Imaging systems and methods for displaying fluorescence and visible images |
US11025867B2 (en) | 2006-12-22 | 2021-06-01 | Stryker European Operations Limited | Imaging systems and methods for displaying fluorescence and visible images |
US10694151B2 (en) | 2006-12-22 | 2020-06-23 | Novadaq Technologies ULC | Imaging system with a single color image sensor for simultaneous fluorescence and color video endoscopy |
US10694152B2 (en) | 2006-12-22 | 2020-06-23 | Novadaq Technologies ULC | Imaging systems and methods for displaying fluorescence and visible images |
US10779734B2 (en) | 2008-03-18 | 2020-09-22 | Stryker European Operations Limited | Imaging system for combine full-color reflectance and near-infrared imaging |
US9642532B2 (en) | 2008-03-18 | 2017-05-09 | Novadaq Technologies Inc. | Imaging system for combined full-color reflectance and near-infrared imaging |
CN101708120A (en) * | 2008-09-17 | 2010-05-19 | 富士胶片株式会社 | Image obtaining method and image obtaining apparatus |
US8300093B2 (en) * | 2009-01-12 | 2012-10-30 | Fujifilm Corporation | Endoscope image processing method and apparatus, and endoscope system using the same |
US20100177181A1 (en) * | 2009-01-12 | 2010-07-15 | Fujifilm Corporation | Endoscope image processing method and apparatus, and endoscope system using the same |
CN102445443A (en) * | 2010-08-09 | 2012-05-09 | 卡尔蔡司医疗技术股份公司 | Fluorescence observation system and filter set |
US9814378B2 (en) | 2011-03-08 | 2017-11-14 | Novadaq Technologies Inc. | Full spectrum LED illuminator having a mechanical enclosure and heatsink |
US20140046409A1 (en) * | 2012-08-09 | 2014-02-13 | Korea Electrotechnology Research Institute | Light source apparatus for photo-diagnosis and phototherapy |
US10736489B2 (en) * | 2015-02-18 | 2020-08-11 | Karl Storz Se & Co. Kg | Endoscope having an optical waveguide with emergence portion and an objective with beam splitter |
US12053153B2 (en) | 2015-02-18 | 2024-08-06 | Karl Storz Se & Co. Kg | Endoscope having an optical waveguide with emergence portion an objective beam splitter |
US20160235278A1 (en) * | 2015-02-18 | 2016-08-18 | Karl Storz Gmbh & Co. Kg | Endoscope |
US10820789B2 (en) | 2015-04-30 | 2020-11-03 | Panasonic I-Pro Sensing Solutions Co., Ltd. | Endoscope system and light source control method |
CN107850767B (en) * | 2015-07-17 | 2021-09-28 | 徕卡显微系统复合显微镜有限公司 | Light sheet microscope for simultaneously imaging a plurality of object planes |
CN107850767A (en) * | 2015-07-17 | 2018-03-27 | 徕卡显微系统复合显微镜有限公司 | For making the mating plate microscope of multiple object planes while imaging |
US10877254B2 (en) * | 2015-07-17 | 2020-12-29 | Leica Microsystems Cms Gmbh | Light sheet microscope for simultaneously imaging a plurality of object planes |
US20180228354A1 (en) * | 2015-10-14 | 2018-08-16 | Olympus Corporation | Light source device for endoscope and endoscope system |
US10939811B2 (en) * | 2015-10-14 | 2021-03-09 | Olympus Corporation | Light source device for endoscope and endoscope system |
US11930278B2 (en) | 2015-11-13 | 2024-03-12 | Stryker Corporation | Systems and methods for illumination and imaging of a target |
US11298024B2 (en) | 2016-01-26 | 2022-04-12 | Stryker European Operations Limited | Configurable platform |
WO2017127929A1 (en) * | 2016-01-26 | 2017-08-03 | Novadaq Technologies Inc. | Configurable platform |
US20170209050A1 (en) * | 2016-01-26 | 2017-07-27 | Novadaq Technologies Inc. | Configurable platform |
US10980420B2 (en) * | 2016-01-26 | 2021-04-20 | Stryker European Operations Limited | Configurable platform |
US10293122B2 (en) | 2016-03-17 | 2019-05-21 | Novadaq Technologies ULC | Endoluminal introducer with contamination avoidance |
USD977480S1 (en) | 2016-04-28 | 2023-02-07 | Stryker European Operations Limited | Device for illumination and imaging of a target |
USD916294S1 (en) | 2016-04-28 | 2021-04-13 | Stryker European Operations Limited | Illumination and imaging device |
US10869645B2 (en) | 2016-06-14 | 2020-12-22 | Stryker European Operations Limited | Methods and systems for adaptive imaging for low light signal enhancement in medical visualization |
US11756674B2 (en) | 2016-06-14 | 2023-09-12 | Stryker European Operations Limited | Methods and systems for adaptive imaging for low light signal enhancement in medical visualization |
US10992848B2 (en) | 2017-02-10 | 2021-04-27 | Novadaq Technologies ULC | Open-field handheld fluorescence imaging systems and methods |
US12028600B2 (en) | 2017-02-10 | 2024-07-02 | Stryker Corporation | Open-field handheld fluorescence imaging systems and methods |
US11140305B2 (en) | 2017-02-10 | 2021-10-05 | Stryker European Operations Limited | Open-field handheld fluorescence imaging systems and methods |
US10620425B2 (en) * | 2017-08-31 | 2020-04-14 | Olympus Corporation | Measurement apparatus and method of operating measurement apparatus |
US20190064499A1 (en) * | 2017-08-31 | 2019-02-28 | Olympus Corporation | Measurement apparatus and method of operating measurement apparatus |
US10980409B2 (en) * | 2017-10-04 | 2021-04-20 | Olympus Corporation | Endoscope device, image processing method, and computer readable recording medium |
US20190217006A1 (en) * | 2018-01-13 | 2019-07-18 | Ananya ANAND | Fiber optically illuminated medical infusion tubes |
US20200107727A1 (en) * | 2018-10-03 | 2020-04-09 | Verily Life Sciences Llc | Dynamic illumination to identify tissue type |
US11918177B2 (en) * | 2018-10-03 | 2024-03-05 | Verily Life Sciences Llc | Dynamic illumination to identify tissue type |
US12035997B2 (en) | 2018-11-30 | 2024-07-16 | Intuitive Surgical Operations, Inc. | Medical imaging systems and methods |
WO2020112726A1 (en) * | 2018-11-30 | 2020-06-04 | Intuitive Surgical Operations, Inc. | Medical imaging systems and methods |
WO2021069512A1 (en) * | 2019-10-10 | 2021-04-15 | Leica Instruments (Singapore) Pte. Ltd. | Microscope and related apparatuses, methods and computer programs |
EP3805838A1 (en) * | 2019-10-10 | 2021-04-14 | Leica Instruments (Singapore) Pte. Ltd. | Microscope and related apparatuses, methods and computer programs |
EP3805838B1 (en) | 2019-10-10 | 2023-12-06 | Leica Instruments (Singapore) Pte. Ltd. | Microscope and related apparatuses, methods and computer programs |
WO2021087304A1 (en) * | 2019-11-01 | 2021-05-06 | Stryker Corporation | Systems and methods for image reorientation for endoscopic imaging |
US11369254B2 (en) | 2020-10-05 | 2022-06-28 | Nirec Corporation | Endoscope and image capturing unit provided therein |
US11839357B2 (en) | 2020-10-12 | 2023-12-12 | Karl Storz Imaging, Inc. | Filter assembly and filter kit for use with an endoscopic system |
WO2022192556A1 (en) * | 2021-03-10 | 2022-09-15 | Kevin Thomas | Als camera system |
Also Published As
Publication number | Publication date |
---|---|
US20190357757A1 (en) | 2019-11-28 |
US20140194687A1 (en) | 2014-07-10 |
US20070015963A1 (en) | 2007-01-18 |
JP2008539827A (en) | 2008-11-20 |
EP1883337A1 (en) | 2008-02-06 |
US20160270640A1 (en) | 2016-09-22 |
WO2006116847A1 (en) | 2006-11-09 |
US10182709B2 (en) | 2019-01-22 |
JP2014087661A (en) | 2014-05-15 |
US8630698B2 (en) | 2014-01-14 |
EP1883337A4 (en) | 2013-11-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10182709B2 (en) | Filter for use with imaging endoscopes | |
US6899675B2 (en) | Fluorescence endoscopy video systems with no moving parts in the camera | |
EP2122331B1 (en) | System for multi- wavelength fluorescence and reflectance imaging | |
US20050154319A1 (en) | Fluorescence endoscopy video systems with no moving parts in the camera | |
US20190082963A1 (en) | Compact fluorescence endoscopy video system | |
JP6298518B2 (en) | Endoscope light source device and endoscope system using the same | |
US6603552B1 (en) | Portable system for detecting skin abnormalities based on characteristic autofluorescence | |
US7658710B2 (en) | Endoscope system using normal light and fluorescence | |
JP6615959B2 (en) | Endoscope system | |
EP1239771B1 (en) | Portable system for detecting skin abnormalities |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: XILLIX TECHNOLOGIES CORP., CANADA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FENGLER, JOHN J.P.;REGAMEY, FRANCIS;REEL/FRAME:016336/0436 Effective date: 20050728 |
|
AS | Assignment |
Owner name: NOVADAQ TECHNOLOGIES INC., CANADA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:XILLIX TECHNOLOGIES CORP.;REEL/FRAME:019297/0691 Effective date: 20070502 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: NOVADAQ TECHNOLOGIES INC., CANADA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:MIDCAP FUNDING IV TRUST (AS SUCCESSOR AGENT TO MIDCAP FINANCIAL TRUST);REEL/FRAME:043786/0344 Effective date: 20170901 Owner name: NOVADAQ CORP., CANADA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:MIDCAP FUNDING IV TRUST (AS SUCCESSOR AGENT TO MIDCAP FINANCIAL TRUST);REEL/FRAME:043786/0344 Effective date: 20170901 Owner name: NOVADAQ CORP., CANADA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:MIDCAP FINANCIAL TRUST;REEL/FRAME:043788/0799 Effective date: 20170901 Owner name: NOVADAQ TECHNOLOGIES INC., CANADA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:MIDCAP FINANCIAL TRUST;REEL/FRAME:043788/0799 Effective date: 20170901 |