Nothing Special   »   [go: up one dir, main page]
Next Article in Journal
A CMOS Optoelectronic Transimpedance Amplifier Using Concurrent Automatic Gain Control for LiDAR Sensors
Previous Article in Journal
Polymer-Based Optical Guided-Wave Biomedical Sensing: From Principles to Applications
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Photonics
Volume 11
Issue 10
10.3390/photonics11100973
photonics-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Quantitative Analysis of Acquisition Speed of High-Precision FLIM Technologies via Simulation and Modeling

by
Jinzheng Lu
1,
Ling Miao
1,
Jiaxing Wen
2,*,
Qiang Li
1,*,
Jingwei Chen
3,
Qiang Yang
4,5,
Xing Zhang
2,
Jin Li
2,
Yuchi Wu
2,
Yue Yang
2,
Sixin Wu
2,
Wenbo Mo
2 and
Qiang Xiang
1
1
School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China
2
Laser Fusion Research Center, China Academy of Engineering Physics, Mianyang 621900, China
3
School of AI and Advanced Computing, Xi’an Jiaotong-Liverpool University, Suzhou 215123, China
4
China Academy of Engineering Physics, Mianyang 621900, China
5
Department of Engineering Physics, Tsinghua University, Beijing 100084, China
*
Authors to whom correspondence should be addressed.
Photonics 2024, 11(10), 973; https://doi.org/10.3390/photonics11100973
Submission received: 16 August 2024 / Revised: 18 September 2024 / Accepted: 16 October 2024 / Published: 17 October 2024
(This article belongs to the Section Biophotonics and Biomedical Optics)
Browse Figures
Figure 1
<p>Processes for 2D time-domain fluorescence lifetime imaging technique.</p> "> Figure 2
<p>The basic principle of the TCSPC-FLIM system. (<b>a</b>) The process of the TCSPC system capturing a fluorescence decay signal. (<b>b</b>) Histograms formed by single counts. (<b>c</b>) Histogram formed by large cumulative counts.</p> "> Figure 3
<p>The basic principle of the synchroscan SC-FLIM system. (<b>a</b>) The process of the synchroscan SC-FLIM system capturing a fluorescence decay signal. (<b>b</b>) The relationship between the readout camera-captured image and the histogram data. (<b>c</b>) Histogram at position <math display="inline"><semantics> <mrow> <mi>x</mi> <mo>=</mo> <mi>i</mi> </mrow> </semantics></math>.</p> "> Figure 4
<p>Scanning schematic of the FLIM system, where D denotes the detector, and T denotes the timing system. (<b>a</b>) Single-channel point scanning. (<b>b</b>) Multi-channel point scanning. (<b>c</b>) Wide-field scanning.</p> "> Figure 5
<p>Schematic diagram of synchroscan SC-FLIM system.</p> "> Figure 6
<p>Schematic diagram of spatial distribution of fluorescence signals in synchroscan SC-FLIM system. (<b>a</b>) Fluorescence transfer process in different modules of the SC-FLIM system. (<b>b</b>) Spatial resolution of the sample. (<b>c</b>) Spatial schematic of the slit. (<b>d</b>) Resolution of the readout camera.</p> "> Figure 7
<p>Decay curve of the standard deviation of the measured signal (<math display="inline"><semantics> <msub> <mi>σ</mi> <mi>τ</mi> </msub> </semantics></math>) with respect to the <math display="inline"><semantics> <msub> <mi>P</mi> <mrow> <mi>h</mi> <mi>i</mi> <mi>s</mi> <mi>t</mi> </mrow> </msub> </semantics></math>.</p> "> Figure 8
<p>Measurement accuracy of two FLIM systems at different <math display="inline"><semantics> <msub> <mi>R</mi> <mrow> <mi>d</mi> <mi>e</mi> <mi>c</mi> <mi>a</mi> <mi>y</mi> </mrow> </msub> </semantics></math> values. (<b>a</b>) <math display="inline"><semantics> <mrow> <msub> <mi>R</mi> <mrow> <mi>d</mi> <mi>e</mi> <mi>c</mi> <mi>a</mi> <mi>y</mi> </mrow> </msub> <mo>=</mo> <mn>4</mn> <mo>%</mo> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mi>R</mi> <mrow> <mi>d</mi> <mi>e</mi> <mi>c</mi> <mi>a</mi> <mi>y</mi> </mrow> </msub> <mo>=</mo> <mn>8</mn> <mo>%</mo> </mrow> </semantics></math>; (<b>b</b>) <math display="inline"><semantics> <mrow> <msub> <mi>R</mi> <mrow> <mi>d</mi> <mi>e</mi> <mi>c</mi> <mi>a</mi> <mi>y</mi> </mrow> </msub> <mo>=</mo> <mn>30</mn> <mo>%</mo> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mi>R</mi> <mrow> <mi>d</mi> <mi>e</mi> <mi>c</mi> <mi>a</mi> <mi>y</mi> </mrow> </msub> <mo>=</mo> <mn>60</mn> <mo>%</mo> </mrow> </semantics></math>.</p> "> Figure 9
<p>Measurement accuracy of two FLIM systems for short-lifetime signals (<math display="inline"><semantics> <mrow> <msub> <mi>τ</mi> <mrow> <mi>r</mi> <mi>e</mi> <mi>a</mi> <mi>l</mi> </mrow> </msub> <mo>=</mo> <mn>50</mn> </mrow> </semantics></math> ps and <math display="inline"><semantics> <mrow> <msub> <mi>τ</mi> <mrow> <mi>r</mi> <mi>e</mi> <mi>a</mi> <mi>l</mi> </mrow> </msub> <mo>=</mo> <mn>100</mn> </mrow> </semantics></math> ps).</p> "> Figure 10
<p>Measurement accuracy of two FLIM systems for Erythrosine B (methanol as a solvent).</p> ">
Versions Notes

Abstract

:
In practical applications such as cancer diagnosis and industrial detection, there is a critical demand for fast fluorescence lifetime imaging (Fast-FLIM). The Fast-FLIM systems suitable for complex environments are typically achieved by enhancing the hardware performance of time-correlated single-photon counting (TCSPC), with an acquisition speed of about a few frames per second (fps). However, due to the limitation of single-photon acquisition, the imaging speed is still far from the demand of practical application. The synchroscan streak camera (SC) maps signals from the temporal dimension to the spatial dimension, effectively overcoming the long acquisition time caused by single-photon acquisition. This paper constructs a method to calculate the acquisition time for the TCSPC-FLIM and SC-FLIM systems, and it quantitatively compares the speed. The research demonstrates that the main factors limiting the acquisition speed of the FLIM systems are the photon emission rate, the photon counting rate, the required SNR, the dwell time, and the number of parallel channels. In high-quality and large-scale lifetime imaging, the acquisition speed of the SC-FLIM is at least 10 4 times faster than that of the TCSPC-FLIM. Therefore, the synchroscan streak camera has more significant potential to promote Fast-FLIM.

1. Introduction

FLIM technology provides detailed information about the microenvironment in which a molecule resides by measuring the time it takes for a fluorescent molecule to return from the excited state to the ground state [1]. Unlike conventional fluorescence intensity imaging, the fluorescence lifetime is independent of excitation intensity, fluorophore concentration, and photobleaching effects [2]. Consequently, multiple biochemical parameters in the microenvironment, such as oxygen content [3], viscosity [4], ionic concentration [5], and temperature [6], can be quantitatively measured via the fluorescence lifetime. In recent years, researchers have made significant progress by utilizing FLIM technology to conduct comprehensive investigations into cell metabolism [7], tumor microenvironment [8], material properties [9], and chemical reaction kinetics [10]. However, in practical applications such as biomedical clinical diagnosis [11,12] and large-scale industrial detection [13], there is a higher demand for the imaging speed of FLIM technology [14].
FLIM techniques are mainly divided into two categories: time-domain (TD) and frequency-domain (FD) methods. The common implementations in time-domain FLIM are based on time-gating (TG), TCSPC, and a synchroscan streak camera (SC). Table 1 presents a comparative analysis of the temporal resolution, spatial resolution, response sensitivity, and data acquisition speed of these FLIM techniques.
Although FD-FLIM and TG-FLIM systems can achieve Fast-FLIM by using CCD or CMOS to construct multi-pixel (channel) parallel acquisition, the spatial resolution and sensitivity are unsatisfactory. In addition, FD-FLIM indirectly calculates the fluorescence lifetime by measuring the phase delay and modulation depth of fluorescence signals, and the measurement accuracy is limited due to the modulation frequency ( 10 8 Hz) and sampling frequency ( 10 9 Hz) [19]. Moreover, the process of measuring multi-exponential decay fluorescence is complex. TG-FLIM uses an electronic or optical shutter to turn the detector’s response on and off, and its temporal resolution depends on the width of the time gate (sub-nanoseconds) [2]. In contrast, TCSPC-FLIM and SC-FLIM use high-gain detection modules (Vgain = 1V [17]; gain = 10 3 [18]) that can detect a single photon. A unique method of constructing fluorescence decay curves enables these two technologies to achieve a high temporal resolution [12]. Consequently, this paper focuses on TCSPC and SC methods.
The TCSPC method effectively overcomes the signal broadening caused by the instrument response function (IRF) through single-photon counting and statistical analysis, resulting in high measurement accuracy [20]. However, the excitation–detection process must be repeated tens of thousands of times to achieve the required accuracy and precision, leading to a slow acquisition speed and even photobleaching [21]. In order to improve the acquisition speed of TCSPC, researchers have proposed two schemes to reduce repetitive measurements: (1) reducing the dead time of a single channel and (2) using a parallel multi-channel. When KOENIG M et al. [22] used a combination of a hybrid photomultiplier tube (hybrid PMT) and a low dead-time (less than 1 ns) time-to-digital converter (TDC) to visualize fluorescent beads, the acquisition speed was 3 fps (128 × 128 pixels). BECKER W et al. [23] employed a multi-channel parallel strategy to construct a FLIM system comprising eight parallel TCSPC channels, which required approximately 5 s to acquire a set of 256 × 256 pixels FLIM. POLAND S et al. [24] developed a multi-channel parallel Fast-FLIM system using a single-photon avalanche diode (SPAD) line array. The system has a speed of up to 4 fps (516 × 516 pixels).
The synchroscan streak camera disperses photoelectrons that arrive at different moments to corresponding spatial positions, enabling high-resolution time measurements through spatio-temporal conversion [25]. Currently, the temporal resolution of the synchroscan streak camera is less than 1ps [26]. The streak camera method not only overcomes the slow speed problem caused by single-photon counting but also possesses a wide-field imaging capability [20]. These advantages make it a new choice for Fast-FLIM. At present, Liu et al. [27] have developed a high-speed SC-FLIM system by integrating a synchroscan streak camera with an ultra-high frame rate readout camera and a high-speed spatial scanning device.
The measurement principle of the synchroscan streak camera determines that it is an effective way to achieve Fast-FLIM. Therefore, this paper calculates the acquisition speed of the SC-FLIM system. We provide a detailed analysis of the factors that influence the acquisition speed in various processes of lifetime imaging, including fluorescence generation, fluorescence detection, spatial scanning, and data processing. Then, the acquisition time of TCSPC-FLIM and synchroscan SC-FLIM systems is calculated using a numerical simulation and a theoretical analysis. Finally, we quantitatively compare the data acquisition time of these FLIM systems by measuring the lifetime of a standard fluorescent dye, Erythrosin B, based on the developed acquisition time model.
This paper is organized as follows: In Section 2, the method of constructing acquisition time models for TCSPC-FLIM and synchroscan SC-FLIM is described. In Section 3, the simulated experimental conditions and the results are discussed, and a quantitative comparison of the speed of the FLIM system is presented. Conclusions are drawn in Section 4.

2. Theory

The FLIM technology, based on TCSPC or synchroscan streak camera, is regarded as a representative high-precision time-domain FLIM technology. As illustrated in Figure 1, the 2D time-domain FLIM technology can be divided into four processes sequentially: fluorescence generation, fluorescence detection, lifetime fitting, and spatial scanning. After the sample is excited to produce fluorescence, the measuring instrument captures the fluorescence intensity decay signal and transmits the signal to the data processing module. The scanner completes 2D data acquisition by continuously changing the laser position and repeating the above process.

2.1. Factors Influencing the Acquisition Speed in the Fluorescence Generation Process

The photon emission rate of the sample exerts a direct influence on the acquisition time during the fluorescence generation process. When the fluorescence signal is weak, the system must repeat the excitation–detection process to obtain a high signal-to-noise ratio (SNR) signal, and the number of repetitions increases with the decrease in the photon emission rate. Therefore, the acquisition speed is influenced by the photon emission rate. Especially in multi-photon detection systems, such as the SC-FLIM system, the photon emission rate is closely related to the acquisition time.

2.2. Factors Influencing the Acquisition Speed in the Fluorescence Detection Process

The primary factor influencing the acquisition speed during the fluorescence detection process is the photon detection rate of the detection system. To assess the influence of photon detection rate on acquisition speed, it is essential to first comprehend the operational principles of diverse FLIM systems.
The TCSPC-FLIM system generates a histogram of photon arrival times by measuring the time interval between excitation and emission, as illustrated in Figure 2. The laser beam is split into two signals, one of which is detected via the single-photon detection system to form a “start” signal, which is used to initiate the timing system. The other signal is employed to excite the sample, thereby producing a fluorescence signal. The fluorescence signal passes through the single-photon detection system to form a “stop” signal, which is used to terminate the timing system. The interval ( Δ t ) between the “start” signal and the “stop” signal represents the delay time for fluorescent photon emission in the sample. The multi-channel analyzer records and accumulates the photon arrival time. This process is then repeated to form a histogram of the time distribution, as illustrated in Figure 2c.
The synchroscan streak camera is capable of mapping temporal information onto the spatial axis, thereby facilitating the rapid and high-resolution measurement of temporal optical signals, as illustrated in Figure 3. The fluorescence decay signals are projected onto the slit-shaped photocathode (PC) through a relay lens (L1), and they are converted into electrons sequentially via the photocathode. The electrons are accelerated via the accelerating electrode and deflected via high-voltage sweep electrodes. During the sweep, the electrons are deflected at slightly different angles, depending on the arrival time at the electrodes. The electrons are then multiplied via a microchannel plate (MCP) and converted back into photons via a phosphor screen (PS) to form a streak image. A high-speed CCD camera is used to digitize and transfer the streak image to a processing module for lifetime processing [28].
In instances where the photon emission rate is high, the photon counting rate of the detection system assumes a primary role in influencing the acquisition speed, as it serves to determine the number of repetitions of the excitation–detection process. TCSPC-FLIM is a single-photon detection system that records at most one photon during a single excitation–detection process. Moreover, due to dead time in the detector, the photon detection rate is typically set to 20% of the laser frequency to minimize the waveform distortion of the recorded signal caused by the “pile-up” effect. The synchroscan streak camera realizes a multi-photon record in an excitation–detection process through a temporal-to-spatial mapping strategy with a high photon counting rate.

2.3. Factors Influencing the Acquisition Speed in the Lifetime Fitting Process

A fluorescence decay signal with a sufficient SNR is a prerequisite for accurately fitting fluorescence lifetimes. In the TCSPC-FLIM and SC-FLIM systems, the number of photons recorded in a time bin follows a Poisson distribution [29], so the noise mainly comes from the Poisson noise of the photon counts, and the standard deviation of the noise can be approximated as the square root of the number of photons in the corresponding time bin. Assume that the photon histogram has a total of M time bins, and the number of photons in the i-th time bin is P i . The SNR can be expressed as follows:
S N R = ∑ i = 1 M P i ∑ i = 1 M P i = ∑ i = 1 M P i
The most straightforward method of enhancing the S N R is to increase the number of photons. However, this often leads to extended acquisition times and photobleaching, especially in dynamic scenes where sample motion can cause blurred imaging [20]. Therefore, the most crucial step is determining the minimum S N R before calculating the acquisition time.

2.4. Factors Influencing the Acquisition Speed in the Spatial Scanning Process

The most commonly utilized TCSPC-FLIM systems can be categorized into two principal types: laser scanning systems and wide-field imaging systems. The former can be further subdivided into single-channel and parallel multi-channel systems, as shown in Figure 4. Depending on the arrangement of the detectors, wide-field imaging systems can be divided into line-scanning and surface-scanning systems. The FLIM system based on a synchroscan streak camera is a line-scanning system.
In 2D-FLIM, the total acquisition time is influenced by the dwell time (DT) of the scanner and the number of parallel channels of the measuring instrument: (1) the dwell time is defined as the time during which the laser beam is fixed at a specific position before moving to the next position; (2) the number of parallel channels is defined as the number of independent detection channels capable of simultaneously acquiring fluorescence lifetime data from multi-pixels. The Polygon mirror (BFI Optilas, Lincoln Laser; Minimum(DT) = 0.07 μ s) and galvanometer (Superscan SC-30-Y-Dig2, Raylase; Minimum(DT) = 1.05 μ s) are generally selected as high-speed scanners [30].

Summary of the Factors Influencing the Acquisition Speed

Overall, in TCSPC-FLIM and synchroscan SC-FLIM systems, the factors influencing the acquisition speed include the photon emission rate, the photon counting rate, the required SNR, the dwell time, and the number of parallel channels. Table 2 presents these factors and their definitions.

3. Method

Calculating the acquisition time of 2D-FLIM can be divided into two steps: (1) Calculate the single-channel acquisition time ( T c h ) of the FLIM system. (2) Calculate the total acquisition time ( T t o t a l ) based on T c h , the scanning speed, and the number of parallel channels. T c h is determined using the photon counting rate and required photons. In SC-FLIM, the photon emission rate of the sample and the photon transfer efficiency of the system constitute the photon counting rate. Therefore, when calculating the T t o t a l of TCSPC-FLIM and synchroscan SC-FLIM, the photon emission rate, the photon transfer efficiency, the photon counting rate, the required photons, and the number of parallel channels are calculated sequentially.

3.1. Calculation of the Photon Emission Rate

The photon emission rate (PER) is the product of the number of fluorescence photons ( P h f l u o r e s c e n c e ) produced in a single laser cycle and the laser frequency ( F l a s e r ):
P E R = P h f l u o r e s c e n c e × F l a s e r
where F l a s e r ≤ 1 / 5 τ and P h f l u o r e s c e n c e are represented as in Equations (3) and (4). A is defined as the absorption efficiency of the sample at the excitation wavelength. It is worth noting that the value of A is proportional to the number of chances for excitation; Φ is the fluorescence quantum yield, P a v g and P p e a k are the average and peak power of the laser, respectively, and Δ t l a s e r is the pulse width.
P h f l u o r e s c e n c e = P h l a s e r × ( 1 − 10 − A ) × Φ
P h l a s e r = P a v g / F l a s e r h · ν = P p e a k × Δ t l a s e r h · ν
The most straightforward method for enhancing the photon emission rate is to increase the laser power. However, this approach may lead to photobleaching or even photodamage [31]. The use of multiphoton excitation effectively reduces the impact of laser light on sample stability. Single-photon excitation typically does not necessitate the use of high laser power, as the energy of a single photon is sufficient to prompt the molecule to transition directly to an excited state. In contrast, in multiphoton excitation, a fluorescent molecule enters the excited state by absorbing multiple low-energy photons simultaneously. This process necessitates the utilization of exceedingly high instantaneous laser power, with the objective of ensuring that effective nonlinear excitation occurs within the focal region of the laser. Single-photon excitation results in photon absorption across the entire laser path, affecting the sample in both the focal and non-focal regions. In contrast, the non-linear effect of multiphoton excitation occurs only in the focal region, significantly reducing photobleaching and photodamage in the non-focal region. In general, the laser requirements for multiphoton excitation are more demanding, necessitating the use of short-pulse, high-peak-power near-infrared lasers in conjunction with sophisticated optical focusing systems for the nonlinear imaging of deep biological samples [24].
In addition, increasing the fluorophore concentration to improve the photon emission rate is also limited by application scenarios. For example, the fluorophore concentration must be kept non-invasive in live FLIM. In industrial and materials science applications, samples are typically more stable and less sensitive to light damage than biological samples.

3.2. Calculation of the Photon Counting Rate

In the case of a high photon emission rate, the photon counting rate of the FLIM system becomes a significant factor influencing the acquisition time. In a TCSPC-FLIM system, the photon counting rate is dependent on the dead time of the detector and the timing circuit. However, in a multi-photon detection system such as synchroscan SC-FLIM, the photon count rate of the system is dependent on the photon transfer efficiency.

3.2.1. TCSPC-FLIM

For TCSPC at a high count rate and a high signal repetition rate, two instrumental effects have to be considered: (1) the counting loss, the loss of a photon detected within the signal processing time (“Dead time”) of a previous one, and (2) the pile-up effect, the loss of a photon detected in the same signal period with a previous one [17].
“Dead time” is the recovery time required for the photon detector after detecting a photon, during which the photon detector cannot detect new photons. In a time interval Δ t , the detector can detect Δ t × P D R photons without considering dead time. Due to the presence of the “Dead time”, the actual photon detection time of the detector in the time interval is Δ t + N m e a s u r e d × t d , where t d is the dead time, N m e a s u r e d is the number of photons actually detected, and the N m e a s u r e d can be expressed in two ways:
N m e a s u r e d = P D R × Δ t
N m e a s u r e d = P C R × ( Δ t + N m e a s u r e d × t d )
where PCR is the photon counting rate, and PDR is the photon detection rate. Therefore, the photon count rate of the TCSPC system can be derived from Equations (5) and (6) as follows:
P C R T C S P C = P D R ( 1 + P D R × t d )
Unlike “Counting loss”, the “Pile-up” effect causes an error in the detected fluorescence lifetime:
τ m e a n = τ × ( 1 − P D R / F l a s e r 4 )
where τ is the fluorescence lifetime, F l a s e r is the laser frequency, and τ m e a n is the intensity-weighted lifetime of the measured decay profile. When the PDR is 20% of the excitation laser rate, the error is about 5%, which is small and acceptable in many applications [20].

3.2.2. Synchroscan SC-FLIM

Due to the isotropy of fluorescence and the loss of photons during transmission, the photon counting rate of the SC-FLIM system is determined according to the photon emission rate and the photon transfer efficiency (PTE). Calculating the PTE is a prerequisite for calculating the photon counting rate. In the synchroscan SC-FLIM, as shown in Figure 5, the PTE is composed of the fluorescence focusing system (FFS) and the synchroscan streak camera.
The numerical aperture (NA) determines the angular range over which the objective lens can collect photons. The photon transfer efficiency of an objective lens, η o b j e c t i v e , can be expressed in Equations (9) and (10), where Ω is the photon collection range, and n is the refractivity of the medium in which the objective lens is located.
η o b j e c t i v e = Ω 4 π = 1 − c o s ( θ ) 2
θ = s i n − 1 ( N A n )
Photonics 11 00973 g005
Figure 5. Schematic diagram of synchroscan SC-FLIM system.
Figure 5. Schematic diagram of synchroscan SC-FLIM system.
Photonics 11 00973 g005
The photon transfer efficiency of the fluorescence focusing system is denoted as η F F S , which is jointly determined by the reflectivity of the galvanometer, the splitting ratio of the beam splitter, and the transmittance of the beam filter and focusing lens, which can be obtained from the instrument manual.
The photon transfer efficiency of the streak camera is also influenced by the slit size, the photon-electric conversion efficiency of the photocathode, and the electron penetration efficiency of the accelerating electrode. It is assumed that the imaging area of the fluorescence focusing system in the plane where the slit is located is S and that the width and height of the slit are H s i l t and W s i l t , respectively; the photon transfer efficiency of the slit ( η s l i t ) is as follows:
η s l i t = 1 , S ≤ H s l i t × W s l i t ( H s l i t × W s l i t ) / S , S > H s l i t × W s l i t
The photon-electric conversion efficiency of the photocathode is η p h o t o c a t h o d e , and the electron penetration efficiency of the accelerating electrode is η a c c e l e r a t e , which also can be obtained from the instrument manual. The photon transfer efficiency of the whole FLIM system ( η S C ), can be expressed as follows:
η S C = η o b j e c t i v e × η F F S × η s l i t × η p h o t o c a t h o d e × η a c c e l e r a t e
Synchroscan streak cameras employ a high-frequency sinusoidal scanning signal to convert a temporal signal into a spatial signal, rapidly accumulating it spatially to form a high-SNR spatial signal. Consequently, the photon counting rate of the streak camera is also dependent on the sinusoidal scanning signal frequency, F s i n :
P C R S C = P E R F l a s e r × η S C × m i n ( F l a s e r , F s i n )
The selection of the frequency of the sinusoidal signal must take into account the necessity of ensuring the accuracy of the signal accumulation. In most cases, the F s i n is equal to the F l a s e r or equal to the F l a s e r / 2 K , where K ∈ [ 1 , 2 , 3 . . . ] .

3.3. Calculation of the Required Photons

This paper uses numerical simulation methods to calculate the minimum number of photons required to form a fluorescence decay histogram when the fitting error is within a tolerable range, also known as the “Required Photons”. In the actual lifetime imaging process, the fitting error requirement, the systematic error, the fitting algorithm, and the decay model all affect the “Required Photons”.
This study firstly generated a histogram of photon distribution based on the mono-exponential decay model and reconstructed the lifetime using the least-squares fitting algorithm to explore the relationship between the photon number and the fitting accuracy. Then, the study calculated the “Required Photons” according to the fitting error requirement of a standard fluorescent dye, Erythrosin B.
The mono-exponential decay model of fluorescence signal can be expressed as follows:
I ( t ) = I 0 e ( − t / τ )
where τ is the lifetime, I 0 is the initial intensity, and I ( t ) is the fluorescence intensity at time t. In the numerical simulation, the uniformly distributed random numbers u ∈ [ 0 , 1 ] are initially converted into mono-exponentially distributed random numbers, t, based on the inverse transformation sampling method:
t = − τ l n ( 1 − u )
The number of mono-exponentially distributed random numbers, t, represents the number of photons, and the value of t represents the photon arrival time. Subsequently, a histogram of the photon arrival time distribution is generated through the mono-exponentially distributed random numbers, t, based on the number of time bins and the width of the time bin. The simulation parameters of the FLIM system are set as shown in Table 3. After the photons are dispersed into different time bins, the fluorescence decay curve is a discrete curve that can be expressed as I [ t ] .
In a practical FLIM system, the laser pulse, the detector, and the electronics system all have their response times. In order to simulate the measurement signal more realistically, the instrument response function (IRF) is convolved with I [ t ] to form the measurement signal I m [ t ] [32]:
I m [ t ] = I [ t ] ∗ I R F [ t ] + ε + c
where ε is a system noise obeying a Gaussian distribution, and c is a low-frequency background noise. The IRF for two FLIM systems is defined in reference [33]:
I R F [ t ] = e x p ( − ( t − t 0 ) 2 × 4 × l n 2 ( F W H M ) 2 )
Among them, F W H M represents the full width at half the maximum of the IRF, t 0 follows a uniform distribution in the range of [ 13 Δ t , 15 Δ t ] , and Δ t is the temporal resolution of the system. Histograms of fluorescence decay with different S N R values are generated by varying P h i s t . Then, the lifetime is calculated using the least-squares fitting method.
The ultimate goal of the numerical simulation experiment is to determine the “required photons”, which is the minimum number of photons required to form a fluorescence decay histogram ( P h i s t ). Suppose that the real value of the lifetime is set to τ r e a l and the number of photons to P h i s t in each of the M simulation experiments. Then, the standard deviation of the measured lifetime σ τ is expressed as follows:
σ τ = 1 M ∑ k = 1 M ( τ k − τ r e a l ) 2
where τ k is the fitting lifetime of the k-th experiment. When σ τ satisfies the requirements of the experimental scenario, the minimum value of P h i s t is the “required photons”.
In the numerical simulation, the applicability of the two FLIM systems to the length of a lifetime is demonstrated by means of the relative standard deviation, which is defined as follows:
R e l ( σ τ ) = σ τ τ r e a l × 100 %

3.4. Calculation of the Number of Parallel Channels

The conventional TCSPC-FLIM system employs a pixel-by-pixel scanning approach to achieve 2D-FLIM, whereas the wide field TCSPC-FLIM utilizes linear or planar array detectors, which no longer permit pixel-by-pixel scanning for 2D-FLIM. It can be observed that the number of parallel channels in a TCSPC-FLIM system is determined by the number of single-photon detectors. However, the synchroscan streak camera has a 1D-FLIM capability, and the number of parallel channels is related to the resolution of the readout camera (RC).
In a synchroscan streak camera, the number of parallel channels is less than or equal to the number of pixels in the x-direction ( P X ) of the readout frame, as illustrated in Figure 6. This subsection needs to solve the problem of setting the spatial magnification of the fluorescence focusing system, the input optical module, the streak tube, and the output optical module so that the SC-FLIM system can maximize the number of parallel channels with a fixed sample spatial resolution ( C × C ) and a fixed readout frame size ( P X × P T , and the pixel size is A × A ). The number of parallel channels is greatest when the fluorescence emitted from an area of C × C on the sample can be captured via a pixel sensor with a size of A × A on the readout camera.
The function of the slit is to perform a 1D sampling of spatial light signals. Consequently, the light passing through the slit only retains width information. The slit width is defined as W s l i t , and when Equation (20) is satisfied, all light passing through the slit can be recorded via the readout camera.
W s l i t = P X × A K S T × K O O M
Among them, K S T and K O O M are the magnification factors of the streak tube and the output optical system, respectively. Typically, K s t is fixed before the streak camera leaves the factory. K o o m is affected by the area and distance of the effective detection area of the readout camera. Adjusting the K O O M enables the capture of all light signals passing through the slit with the readout camera. This maximizes the utilization of the effective imaging area of the readout camera.
The number of parallel channels is equal to P X , the role of K F F S is to ensure that the system has the required sample spatial resolution (C × C), and C can be expressed as follows:
C = W s l i t K F F S × N P C
Under the assumption that, in a FLIM experiment, the required spatial resolution is 10 μ m × 10 μ m (C = 10 μ m), the slit width is 5 cm ( W s l i t = 5 cm), and the frame size is 1000 × 1000 ( P X = P T = 1000 ), then K F F S is as follows when NPC = 1000:
K F F S = W s l i t C × N P C = 5 × 10 4 10 × 1000 = 5
To ensure the one-dimensionality of the spatial signal, the slit height ( H s l i t ) is typically a few microns to a dozen microns. However, during weak signal measurements, H s l i t can be increased appropriately, provided that the following requirements are met:
H s l i t ≤ C × K F F S

3.5. Calculation of the Total Acquisition Time

In 2D-FLIM, the total acquisition time of a TCSPC-FLIM system is determined by the single-channel acquisition time ( T c h ), the scanning speed (represented by the dwell time (DT) of the scanner), and the number of parallel channels (NPC). When a resolution of 2D-FLIM is assumed to be N × M , the total acquisition time can be expressed as follows:
T t o t a l − T C S P C = ⌈ M N P C ⌉ × N × m a x ( D T , T c h )
In the synchroscan SC-FLIM system, there is a mutual constraint between the speed of movement of the scanning device and the exposure time of the readout camera. Specifically, when the exposure time of the readout camera is long, the speed of the scanning device must be slowed down accordingly to ensure that, at each scanning position, the readout camera is able to fully complete the data acquisition and recording. Therefore, the total acquisition time for synchroscan SC-FLIM can be expressed as Equation (25), where T e x p is the exposure time of the readout camera.
T t o t a l − S C = ⌈ M N P C ⌉ × N × m a x ( D T , T c h , T e x p )

4. Results

After analyzing the factors in TCSPC-FLIM and SC-FLIM systems, we quantitatively calculated the speed of different FLIM systems in measuring the standard fluorescent dye (Erythrosin B).

4.1. Details of Sample and Measuring Instrument

4.1.1. Standard Fluorescent Dye

Standard fluorescent dyes can be used to calibrate FLIM instruments. The recommended reference for the lifetime of standard fluorescent dyes is [34], a multinational collaborative project involving nine research institutions. We used Erythrosin B as an example. When the solvent is water, the average lifetime obtained via different research institutions is 89 ps with a standard deviation of 3 ps; when the solvent is methanol, the average lifetime is 470 ps with a standard deviation of 20 ps [35].

4.1.2. Parameter Settings in the Measuring Instrument

We quantitatively compared the acquisition time of TCSPC-FLIM and SC-FLIM through simulation experiments. Due to human factors such as the sample storage environment, device selection, and optical path design, the fluorescence photon emission rate and the photon transfer efficiency of SC-FLIM systems are affected. Therefore, this article quantitatively calculates the photon counting rate of the SC-FLIM system under two conditions:
  • A high photon emission rate and high photon transfer efficiency: The photon counting rate of the SC-FLIM system is high enough to record the required photons without repeating the excitation-detection process.
  • A low photon emission rate and low photon transfer efficiency: The photon counting rate of the SC-FLIM system is equal to the laser frequency, and the number of excitation–detection processes to be repeated is equal to the number of photons required.
Moreover, under the assumption that the laser pulse frequency is 100 MHz, the synchronous frequency of the synchroscan streak camera is 100 MHz, and the minimum dwell time of the galvanometer is 1.05 μ s.

4.2. Calculation Results of the Required Photons via Numerical Simulation

As the number of photons required to form a histogram ( P h i s t ) increases, the measured lifetime gets closer to the real lifetime ( τ r e a l ), as shown in Figure 7.
When τ r e a l = 500 ps and P h i s t = 1000, the lifetime measured by the TCSPC method is more accurate because the TCSPC-FLIM system sacrifices some temporal resolution for acquiring a high-SNR signal. When τ r e a l = 1000 ps, the measurement accuracy of the SC-FLIM system is much lower than that of the TCSPC-FLIM system. This result is due to the difference between the FLIM systems in terms of temporal resolution and the number of time bins.
In order to normalize the difference between the FLIM systems in terms of the temporal resolution ( Δ t ) and the number of time bins ( N b i n ), we defined a parameter to represent the ratio of the real lifetime to the total measurement time ( T t o t a l = Δ t × N b i n ), called the R d e c a y :
R d e c a y = τ r e a l T t o t a l ∗ 100 %
The relative standard deviation of the lifetime measurements of the two FLIM systems at different R d e c a y values are shown in Figure 8.
Due to the low temporal resolution of the TCSPC-FLIM, this system is not able to achieve high-precision measurements for either short-lifetime signals ( R d e c a y = 4%) or signals with incomplete decay ( R d e c a y = 60%). Although the range of R d e c a y applied to the TCSPC-FLIM system is narrower than the range of R d e c a y applied to the SC-FLIM system, the TCSPC-FLIM system has a wide dynamic range of lifetime measurements because of the system’s long total measurement time ( T t o t a l ). In the simulation experiment, four groups of R d e c a y were set up, as shown in Table 4.
To further illustrate the advantages of the high temporal resolution of the streak camera in short-lifetime signals’ measurement, we simulated the FLIM process for fluorescence signals with lifetimes of 50 ps and 100 ps, and the results are shown in Figure 9. This lifetime already exceeded the lower measurement limit of the TCSPC-FLIM system, while the SC-FLIM system can still realize high-precision FLIM.
Different application scenarios have different requirements for σ τ . In this numerical simulation, in order to quantitatively calculate the minimum P h i s t , Erythrosine B, a standard fluorescent dye, was used as the simulation sample, and the requirement for σ τ was less than 20 ps. As shown in Figure 10, when σ τ satisfies the requirement, the minimum P h i s t is 5000. So, when the sample is Erythrosin B (the solvent is methanol), the “required Photons” of SC-FLIM system and TCSPC-FLIM system equal 5000.
Photonics 11 00973 g009
Figure 9. Measurement accuracy of two FLIM systems for short-lifetime signals ( τ r e a l = 50 ps and τ r e a l = 100 ps).
Figure 9. Measurement accuracy of two FLIM systems for short-lifetime signals ( τ r e a l = 50 ps and τ r e a l = 100 ps).
Photonics 11 00973 g009
Photonics 11 00973 g010
Figure 10. Measurement accuracy of two FLIM systems for Erythrosine B (methanol as a solvent).
Figure 10. Measurement accuracy of two FLIM systems for Erythrosine B (methanol as a solvent).
Photonics 11 00973 g010

4.3. Calculation of Acquisition Time

4.3.1. Acquisition Time of TCSPC-FLIMs

In practical scenarios, to minimize the occurrence of the “pile-up” effect, the photon detection rate (PDR) of classical TCSPC technology is usually set to one-tenth of the laser pulse frequency. In addition, in the classical TCSPC system, the dead time is usually in the range of 20 ns to 200 ns [20], and the minimum photon counting rate can be derived from Equation (7) to be 4 MHz. Therefore, the single-channel acquisition time ( T c h ) of this system for a high-precision measurement of the fluorescence lifetime of Erythrosin B is at least 1.25 ms.
Hybrid PMTs can reduce the dead time of detectors to less than 1ns, and TDCs devices can reduce the dead time of counters to less than 1ns [32]. Therefore, the “Counting loss” due to dead time in the TCSPC-FLIM system is ignored, and the photon counting rate of the TCSPC system that combines PMT and TDC can be equivalent to one-twentieth of the laser pulse frequency. The T c h can be shortened to 0.25 ms. However, reducing the dead time is not a recommended approach to enhancing the photon counting rate because decreasing the detector’s dead time can lead to an increase in background noise caused via detector afterpulsing [17].
In these TCSPC-FLIM systems, the number of parallel channels is 1. When the resolution of the target lifetime image is N × M , the data acquisition time for 2D-FLIM can be calculated according to Equation (24). Since the dwell time of the galvanometer is much lower than the single-channel acquisition time of the TCSPC system, the total acquisition time ( T N × M ) is determined via the single-channel acquisition time and the total number of pixels. Table 5 presents the single-channel acquisition time and 2D-FLIM acquisition time for various TCSPC systems.
In recent years, SPAD arrays with time measurement capabilities have promoted the rapid development and application of wide-field FLIM. The number of parallel channels of the TCSPC-FLIM system based on the SPAD array can reach up to 32 × 32, 64 × 64, and even 256 × 256 pixels [20].

4.3.2. Acquisition Time of Synchroscan SC-FLIMs

As previously stated in Section 4.1.2, we calculated the photon counting rate (PCR) of the synchroscan SC-FLIM system in two scenarios and calculated the acquisition time using PHANTOM’s T4040 as the readout camera (a frame rate of up to 13,510 fps at a resolution of 2048 × 1152 pixels) [36] and Raylase’s Superscan SC-30-Y-Dig2 as the scanning galvanometer (a dwell time as low as 1.05 μ s).
In the high photon emission rate and high photon transfer efficiency (High-PER and High-PTE) condition, when the SC-FLIM system measures the lifetime of Erythrosin B, the photon counting rate reaches up to 10 8 MHz. The single-channel acquisition time ( T c h ) is equal to the time of an excitation–detection process, which is the reciprocal of the laser frequency ( T c h = 10 ns). However, the camera’s minimum exposure time is 74.02 μ s, which is much greater than 10 ns, so T c h = 74 μ s. In some special cases, the resolution of the camera can be reduced to increase the frame rate, such as when the fluorescence signal has a very short lifetime and the decay signal is only present on some of the line pixels of the readout image. At a resolution of 2560 × 256, the frame rate can be increased to 60,500 fps with a single-channel acquisition time of 16.53 μ s.
In the low photon emission rate and low photon transfer efficiency (Low-PER and Low-PTE) condition, when the SC-FLIM system measures the lifetime of Erythrosin B, the photon counting rate (PCR) is 100 MHz. The method for calculating the necessary exposure time of the readout camera at this time is as follows:
T e x p = M i n ( P h i s t ) P C R
When M i n ( P h i s t ) = 5000, the necessary exposure time is 50 μ s. Since the lifetime of Erythrosin B is 470 ps, increasing the frame rate by reducing the resolution of the camera is not recommended, and the minimum exposure time of the camera remains at 74.02 μ s, so T c h = 74.02 μ s.
In 2D-FLIM, if the resolution of the readout camera is N × M , the number of parallel channels is N. Since the dwell time of the galvanometer is smaller than the single-channel acquisition time of the SC-FLIM system, the total acquisition time ( T N × M ) is determined by the single-channel acquisition time, the total number of pixels, and the number of parallel channels. For a lifetime image of 2048 × 2048 and 256 × 256 , the total acquisition time can be expressed as in Table 6.
Although the speed of the wide-field TCSPC-FLIM system based on SPAD arrays can be close to that of the SC-FLIM system, it still cannot surpass the classical TCSPC-FLIM imaging in terms of spatial resolution and SNR. Moreover, as the number of channels increases in the wide-field TCSPC-FLIM system, the cost also doubles. Compared with high-precision TCSPC-FLIM, SC-FLIM has increased the imaging speed of FLIM systems by at least 10 4 times.

5. Discussion

The acquisition time of FLIM systems is related to the photon emission rate, the photon counting rate, the number of “required photons”, the dwell time of the scanning device, and the number of parallel channels. Therefore, we provide a detailed analysis of these factors through numerical simulation and theoretical modeling, and we quantitatively compare the acquisition time of the TCSPC-FLIM and SC-FLIM systems when Erythromycin B is used as a sample. The results of this paper quantitatively illustrate that the synchroscan streak camera with a unique lifetime measurement approach has great potential for implementing Fast-FLIM, which has an acquisition speed about 14,000 times faster than the TCSPC-FLIM system.
Compared with TCSPC technology, the synchroscan streak camera is more suitable for the fluorescence lifetime imaging of samples with high fluorescence intensity and a short fluorescence lifetime. Although the acquisition speed of the TCSPC-FLIM system based on the SPAD array is similar to that of the SC-FLIM system (with a low photon detection rate), the TCSPC-FLIM system based on the SPAD array has a low spatial resolution and a low SNR for the acquired signal. As the readout camera frame rate increases, the acquisition speed of the SC-FLIM system will also be further improved. In addition, the synchroscan streak camera commonly has the single-photon detection mode of operation and a broader spectral response range, which can adapt to a more comprehensive range of application scenarios.
In the future, with the continuous development of streak camera technology, spatial scanning technology, and high frame rate camera technology, as well as the application of deep learning algorithms in lifetime fitting, synchroscan streak cameras will be able to be effectively applied to Fast-FLIM. This advancement will enable FLIM technology to play a crucial role in clinical diagnosis and industrial detection.

Author Contributions

Conceptualization, J.W., Q.L., J.L. (Jinzheng Lu), and J.C.; data curation, L.M., Q.Y., J.W., X.Z., J.L. (Jin Li), and Y.W.; formal analysis, L.M., Y.Y., S.W., W.M., and J.C.; methodology, J.L. (Jinzheng Lu), L.M., Q.L., Q.Y., and J.W.; project administration, J.W., Q.L., and Q.Y.; software, L.M. and Q.X.; validation, L.M. and J.W.; writing—original draft, L.M.; writing—review and editing, Q.L., J.L. (Jinzheng Lu), Q.Y., J.W., and L.M.; supervision, J.W., Q.L., and J.C.; funding acquisition, J.W. and Q.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China, grant number 12305228, the Heilongjiang Provincial Science and Technology Program, grant number 2022ZX01A16, and the Project of Southwest University of Science and Technology, grant number 23xsxy03.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Becker, W. Fluorescence lifetime imaging–techniques and applications. J. Microsc. 2012, 247, 119–136. [Google Scholar] [CrossRef] [PubMed]
  2. Datta, R.; Heaster, T.M.; Sharick, J.T.; Gillette, A.A.; Skala, M.C. Fluorescence lifetime imaging microscopy: Fundamentals and advances in instrumentation, analysis, and applications. Med. Photonics 2020, 25, 071203. [Google Scholar] [CrossRef] [PubMed]
  3. Kurokawa, H.; Ito, H.; Inoue, M.; Tabata, K.; Sato, Y.; Yamagata, K. High resolution imaging of intracellular oxygen concentration by phosphorescence lifetime. Sci. Rep. 2015, 5, 10657. [Google Scholar] [CrossRef] [PubMed]
  4. Shimolina, L.; Izquierdo, M.A. Imaging tumor microscopic viscosity in vivo using molecular rotors. Sci. Rep. 2017, 7, 41097. [Google Scholar] [CrossRef]
  5. Priessner, M.; Summers, P.A.; Lewis, B.W.; Sastre, M.; Ying, L.; Kuimova, M.K.; Vilar, R. Selective detection of Cu+ ions in live cells via fluorescence lifetime imaging microscopy. Angew. Chem. Int. Ed. 2021, 60, 23148–23153. [Google Scholar] [CrossRef]
  6. Gao, H.; Kam, C.; Chou, T.Y.; Wu, M.Y.; Zhao, X.; Chen, S. A simple yet effective AIE-based fluorescent nano-thermometer for temperature mapping in living cells using fluorescence lifetime imaging microscopy. Nanoscale Horiz. 2020, 5, 488–494. [Google Scholar] [CrossRef]
  7. Penjweini, R.; Roarke, B.; Alspaugh, G.; Gevorgyan, A.; Andreoni, A.; Pasut, A.; Sackett, D.L.; Knutson, J.R. Single cell-based fluorescence lifetime imaging of intracellular oxygenation and metabolism. Redox Biol. 2020, 34, 101549. [Google Scholar] [CrossRef]
  8. Ouyang, Y.; Liu, Y.; Wang, Z.M.; Liu, Z.; Wu, M. FLIM as a promising tool for cancer diagnosis and treatment monitoring. Nano-Micro Lett. 2021, 13, 133. [Google Scholar] [CrossRef]
  9. He, T.; Ren, C.; Li, Z.; Xiao, S.; Li, J.; Lin, X.; Ye, C. Thermally activated delayed fluorescence organic dots for two-photon fluorescence lifetime imaging. Appl. Phys. Lett. 2018, 112, 211102. [Google Scholar] [CrossRef]
  10. Sarder, P.; Maji, D.; Achilefu, S. Molecular probes for fluorescence lifetime imaging. Appl. Phys. Lett. 2015, 26, 963–974. [Google Scholar] [CrossRef]
  11. Liu, L.; QI, M.; Gao, P. Application of Fluorescence Lifetime Imaging in Cancer Diagnosis (Invited). Acta Photonica Sin. 2021, 50, 1017001. [Google Scholar]
  12. Alfons, B.; Bec, J.; Weyers, B.; Marsden, M.; Zhou, X.; Li, C.; Marcu, L. Mesoscopic fluorescence lifetime imaging: Fundamental principles, clinical applications and future directions. J. Biophoton. 2021, 14, e202000472. [Google Scholar] [CrossRef]
  13. Laurence, T.A.; Bude, J.D.; Shen, N.; Miller, P.E.; Steele, W.A.; Guss, G.; Adams, J.J.; Wong, L.L. Ultrafast photoluminescence as a diagnostic for laser damage initiation. In Proceedings of the SPIE 7504: Laser-Induced Damage in Optical Materials, Boulder, CO, USA, 31 December 2009. [Google Scholar] [CrossRef]
  14. Elson, D.S.; Munro, I.; Requejo-Isidro, J.; Dunsby, C. Real-time time-domain fluorescence lifetime imaging including single-shot acquisition with a segmented optical image intensifier. New J. Phys. 2004, 6, 180. [Google Scholar] [CrossRef]
  15. Franke, R.; Holst, G.A. Frequency-domain fluorescence lifetime imaging system (pco. flim) based on a in-pixel dual tap control CMOS image sensor. In Proceedings of the SPIE 9328: Imaging, Manipulation, and Analysis of Biomolecules, Cells, and Tissues XIII, San Francisco, CA, USA, 2 March 2015. [Google Scholar] [CrossRef]
  16. Agronskaia, A.V.; Tertoolen, L.; Gerritsen, H.C. Fast fluorescence lifetime imaging of calcium in living cells. J. Biomed. Opt. 2004, 9, 1230–1237. [Google Scholar] [CrossRef]
  17. Katsoulidou, K.; Bergmann, A.; Becker, W. How fast can TCSPC FLIM be made. In Proceedings of the SPIE 6771: Advanced Photon Counting Techniques, Boston, MA, USA, 15 October 2007. [Google Scholar] [CrossRef]
  18. Fujiwara, M.; Cieslik, W. Fluorescence Lifetime Imaging Microscopy: Two-Dimensional Distribution Measurement of Fluorescence Lifetime. Methods Enzymol. 2006, 414, 633–642. [Google Scholar] [CrossRef]
  19. Lin, F.; Wang, Y.; Yi, M.; Zhang, C.; Liu, L. Research Progress on Fast Fluorescence Lifetime Imaging Microscopy and Its in vivo Applications (Invited). Laser Optoelectron. Prog. 2024, 61, 0618005. [Google Scholar]
  20. Liu, X.; Lin, D.; Becker, W. Fast fluorescence lifetime imaging techniques: A review on challenge and development. J. Innov. Opt. Health Sci. 2019, 12, 1930003. [Google Scholar] [CrossRef]
  21. Becker, W.; Bergmann, A.; Biscotti, G.L. Advanced time-correlated single photon counting techniques for spectroscopy and imaging in biomedical systems. In Proceedings of the SPIE 5340: Commercial and Biomedical Applications of Ultrafast Lasers, San Jose, CA, USA, 1 June 2004. [Google Scholar] [CrossRef]
  22. Koenig, M.; Orthaus-Mueller, S.; Dowler, R. Rapid FLIM: The new and innovative method for ultra-fast imaging of biological processes. Biophys. J. 2017, 112, 298a. [Google Scholar] [CrossRef]
  23. Becker, W.; Su, B.; Bergmann, A. Fast-acquisition multispectral FLIM by parallel TCSPC. In Proceedings of the SPIE 7183: Multiphoton Microscopy in the Biomedical Sciences, San Jose, CA, USA, 13 February 2009. [Google Scholar] [CrossRef]
  24. Poland, S.P.; Krstajić, N.; Monypenny, J. A high speed multifocal multiphoton fluorescence lifetime imaging microscope for live-cell FRET imaging. Biomed. Opt. Express 2015, 6, 277–296. [Google Scholar] [CrossRef]
  25. Liu, X.; Lin, D.; Wu, Q. Recent progress of fluorescence lifetime imaging microscopy technology and its application. Acta Phys. Sin. 2018, 67, 178701. [Google Scholar] [CrossRef]
  26. Features of Universal Streak Camera. Available online: https://www.hamamatsu.com/us/en/product/photometry-systems/streak-camera/universal-streak-camera/features (accessed on 22 April 2024).
  27. Liu, L.; Li, Y.; Sun, L. Fluorescence lifetime imaging microscopy using a streak camera. In Proceedings of the SPIE 8948: Multiphoton Microscopy in the Biomedical Sciences, San Francisco, CA, USA, 28 February 2014. [Google Scholar] [CrossRef]
  28. Krishnan, R.V.; Saitoh, H.; Terada, H. Development of a multiphoton fluorescence lifetime imaging microscopy system using a streak camera. Rev. Sci. Instrum. 2003, 74, 2714–2721. [Google Scholar] [CrossRef]
  29. Philip, J.; Carlsson, K. Theoretical investigation of the signal-to-noise ratio in fluorescence lifetime imaging. J. Opt. Soc. Am. A 2003, 20, 368–379. [Google Scholar] [CrossRef] [PubMed]
  30. Exner, H.; Hartwig, L.; Ebert, R.; Kloetzer, S.; Streek, A.; Schille, J.; Loeschner, U. High speed laser micro processing using high brilliance continuous wave laser radiation. J. Laser Micro Nanoeng. 2012, 7, 115. [Google Scholar] [CrossRef]
  31. Forbes, M.W.; Jockusch, R.A. Gas-phase fluorescence excitation and emission spectroscopy of three xanthene dyes (rhodamine 575, rhodamine 590 and rhodamine 6G) in a quadrupole ion trap mass spectrometer. J. Am. Soc. Mass Spectrom. 2011, 22, 93–109. [Google Scholar] [CrossRef] [PubMed]
  32. Hirvonen, L.M.; Suhling, K. Fast timing techniques in FLIM applications. Front. Phys. 2020, 8, 161. [Google Scholar] [CrossRef]
  33. Xiao, D.; Chen, Y.; Li, D.D. One-dimensional deep learning architecture for fast fluorescence lifetime imaging. IEEE J. Sel. Top. Quantum Electron. 2021, 27, 1–10. [Google Scholar] [CrossRef]
  34. Boens, N.; Qin, W.; Basari, N. Fluorescence lifetime standards for time and frequency domain fluorescence spectroscopy. Anal. Chem. 2007, 79, 2137–2149. [Google Scholar] [CrossRef]
  35. Fluorescence Lifetime Standards Data Table. Available online: https://www.edinst.com/blog/fluorescence-lifetime-standards/ (accessed on 25 April 2024).
  36. The T4040 Delivers a Custom 4.2 Mpx Back Side Illuminated Sensor in the Compact T-Series form Factor. Available online: https://www.phantomhighspeed.com/products/cameras/tseries/t4040 (accessed on 9 June 2024).
Photonics 11 00973 g001
Figure 1. Processes for 2D time-domain fluorescence lifetime imaging technique.
Figure 1. Processes for 2D time-domain fluorescence lifetime imaging technique.
Photonics 11 00973 g001
Photonics 11 00973 g002
Figure 2. The basic principle of the TCSPC-FLIM system. (a) The process of the TCSPC system capturing a fluorescence decay signal. (b) Histograms formed by single counts. (c) Histogram formed by large cumulative counts.
Figure 2. The basic principle of the TCSPC-FLIM system. (a) The process of the TCSPC system capturing a fluorescence decay signal. (b) Histograms formed by single counts. (c) Histogram formed by large cumulative counts.
Photonics 11 00973 g002
Photonics 11 00973 g003
Figure 3. The basic principle of the synchroscan SC-FLIM system. (a) The process of the synchroscan SC-FLIM system capturing a fluorescence decay signal. (b) The relationship between the readout camera-captured image and the histogram data. (c) Histogram at position x = i .
Figure 3. The basic principle of the synchroscan SC-FLIM system. (a) The process of the synchroscan SC-FLIM system capturing a fluorescence decay signal. (b) The relationship between the readout camera-captured image and the histogram data. (c) Histogram at position x = i .
Photonics 11 00973 g003
Photonics 11 00973 g004
Figure 4. Scanning schematic of the FLIM system, where D denotes the detector, and T denotes the timing system. (a) Single-channel point scanning. (b) Multi-channel point scanning. (c) Wide-field scanning.
Figure 4. Scanning schematic of the FLIM system, where D denotes the detector, and T denotes the timing system. (a) Single-channel point scanning. (b) Multi-channel point scanning. (c) Wide-field scanning.
Photonics 11 00973 g004
Photonics 11 00973 g006
Figure 6. Schematic diagram of spatial distribution of fluorescence signals in synchroscan SC-FLIM system. (a) Fluorescence transfer process in different modules of the SC-FLIM system. (b) Spatial resolution of the sample. (c) Spatial schematic of the slit. (d) Resolution of the readout camera.
Figure 6. Schematic diagram of spatial distribution of fluorescence signals in synchroscan SC-FLIM system. (a) Fluorescence transfer process in different modules of the SC-FLIM system. (b) Spatial resolution of the sample. (c) Spatial schematic of the slit. (d) Resolution of the readout camera.
Photonics 11 00973 g006
Photonics 11 00973 g007
Figure 7. Decay curve of the standard deviation of the measured signal ( σ τ ) with respect to the P h i s t .
Figure 7. Decay curve of the standard deviation of the measured signal ( σ τ ) with respect to the P h i s t .
Photonics 11 00973 g007
Photonics 11 00973 g008
Figure 8. Measurement accuracy of two FLIM systems at different R d e c a y values. (a) R d e c a y = 4 % and R d e c a y = 8 % ; (b) R d e c a y = 30 % and R d e c a y = 60 % .
Figure 8. Measurement accuracy of two FLIM systems at different R d e c a y values. (a) R d e c a y = 4 % and R d e c a y = 8 % ; (b) R d e c a y = 30 % and R d e c a y = 60 % .
Photonics 11 00973 g008
Table 1. Comparison of performance metrics of four FLIM systems.
Table 1. Comparison of performance metrics of four FLIM systems.
System Performance MetricsFD [15]TG [16]TCSPC [17]SC [18]
Temporal Resolution (ps)1002003.515
Spatial Resolution ( μ m)5.6160.20.2
Response SensitivityR 1 = 0.16 A/W @500 nmR = 0.17 A/W @600 nmSER 2 = 200 mV @490 nmR = 250 A/W   @500 nm
Spectral Response Range (nm)380–800200–900300–900400–900
Data Acquisition Speed (fps)22 (1008 × 1008)50   (128 × 128)2   (128 × 128)0.3 (240 × 225)
1 R is an abbreviation for “Responsivity”, which reflects the efficiency of a photodetector in converting incident light energy into electrical energy. 2 SER is an abbreviation for “Single Photon Response”, which reflects the voltage (or current) output of the detector when it receives a single photon.
Table 2. Factors and their definitions that determine the acquisition time.
Table 2. Factors and their definitions that determine the acquisition time.
ParameterDefinition
Photon Emission Rate
(PER)		Number of photons emitted from the sample per unit time.
Photon Counting Rate
(PCR)		Number of photons counted via a FLIM system per unit time.
Required SNRMinimum SNR of the acquired signal when the fitting lifetime meets the fitting accuracy requirements.
Dwell Time
(DT)		The time during which the laser beam is fixed at a specific position before moving to the next position.
Number of Parallel Channels
(NPC)		The number of independent detection channels capable of simultaneously acquiring fluorescence lifetime data from multi-pixels.
Table 3. Simulation parameter settings of the FLIM system.
Table 3. Simulation parameter settings of the FLIM system.
TCSPC-FLIMSynchroscan SC-FLIM
Number of time bins2561600
Width of time bins50 ps1 ps
Table 4. The lifetime of fluorescence signals collected via two FLIM systems under the same R d e c a y value.
Table 4. The lifetime of fluorescence signals collected via two FLIM systems under the same R d e c a y value.
R decay SC-FLIM ( Δ t = 1 ps ; N bin = 1600 ) TCSPC-FLIM ( Δ t = 50 ps ; N bin = 256 )
4%64 ps512 ps
8%128 ps1024 ps
30%480 ps3840 ps
60%960 ps7680 ps
Table 5. Data acquisition time of the different TCSPC-FLIM systems.
Table 5. Data acquisition time of the different TCSPC-FLIM systems.
TCSPC TechnologiesMinimum PCR T ch T 2048 × 2048 T 256 × 256
Classical TCSPC4 MHz1.25 ms5242.88 s 81.92 s
Hybrid PMT20 MHz0.25 ms1048.58 s 16.384 s
SPAD array (64 × 64)13,516.8 MHz 11.25 ms 21.54 s 3 0.02 s 4
1 The minimum global photon counting rate is equal to 3.3 × 64 × 64 MHz. 2 Each individual TCSPC-FLIM channel utilizes classical TCSPC technology. 3 For images with a size of 2048 × 2048, the 64 × 64 SPAD array requires 1024 repetitions of data acquisition. 4 For images with a size of 256 × 256, the 64 × 64 SPAD array requires 16 repetitions of data acquisition.
Table 6. Data acquisition time of the synchroscan SC-FLIM system in different conditions.
Table 6. Data acquisition time of the synchroscan SC-FLIM system in different conditions.
Simulated ConditionsReadout Camera T ch vs. T exp  1 T 2048 × 2048 T 256 × 256
High-PER and High-PTE13,510 fps (2048 × 1152)10 ns < 74.02  μ s0.15 s 0.019 s
High-PER and High-PTE60,500 fps (2560 × 256)10 ns < 16.53  μ s0.03 s 0.424 ms
Low-PER and Low-PTE13,510 fps (2048 × 1152)50  μ s < 74.02  μ s0.15 s 0.019 s
1 T c h indicates the theoretical single-channel acquisition time, and the actual single-channel acquisition time is determined by the camera’s minimum exposure time and T c h together.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lu, J.; Miao, L.; Wen, J.; Li, Q.; Chen, J.; Yang, Q.; Zhang, X.; Li, J.; Wu, Y.; Yang, Y.; et al. Quantitative Analysis of Acquisition Speed of High-Precision FLIM Technologies via Simulation and Modeling. Photonics 2024, 11, 973. https://doi.org/10.3390/photonics11100973

AMA Style

Lu J, Miao L, Wen J, Li Q, Chen J, Yang Q, Zhang X, Li J, Wu Y, Yang Y, et al. Quantitative Analysis of Acquisition Speed of High-Precision FLIM Technologies via Simulation and Modeling. Photonics. 2024; 11(10):973. https://doi.org/10.3390/photonics11100973

Chicago/Turabian Style

Lu, Jinzheng, Ling Miao, Jiaxing Wen, Qiang Li, Jingwei Chen, Qiang Yang, Xing Zhang, Jin Li, Yuchi Wu, Yue Yang, and et al. 2024. "Quantitative Analysis of Acquisition Speed of High-Precision FLIM Technologies via Simulation and Modeling" Photonics 11, no. 10: 973. https://doi.org/10.3390/photonics11100973

APA Style

Lu, J., Miao, L., Wen, J., Li, Q., Chen, J., Yang, Q., Zhang, X., Li, J., Wu, Y., Yang, Y., Wu, S., Mo, W., & Xiang, Q. (2024). Quantitative Analysis of Acquisition Speed of High-Precision FLIM Technologies via Simulation and Modeling. Photonics, 11(10), 973. https://doi.org/10.3390/photonics11100973

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop