Nothing Special   »   [go: up one dir, main page]

Next Article in Journal
Research on the NI-MLA Method for Enhancing the Spot Position Detection Accuracy of Quadrant Detectors Under Atmospheric Turbulence
Previous Article in Journal
Advances in Portable Optical Microscopy Using Cloud Technologies and Artificial Intelligence for Medical Applications
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Polarization-Enhanced Underwater Laser Range-Gated Imaging for Subaquatic Applications

1
College of Engineering, Southern University of Science and Technology, 1088 Xueyuan Avenue, Shenzhen 518055, China
2
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
3
University of Chinese Academy of Sciences, Beijing 100049, China
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(20), 6681; https://doi.org/10.3390/s24206681
Submission received: 3 September 2024 / Revised: 14 October 2024 / Accepted: 15 October 2024 / Published: 17 October 2024
(This article belongs to the Section Sensing and Imaging)
Figure 1
<p>Program workflow of the polarization enhancement algorithm.</p> ">
Figure 2
<p>Polarization camera used to validate the polarization enhancement algorithm.</p> ">
Figure 3
<p>Original image and algorithm-enhanced image. (<b>a</b>) Normal polarized image of <math display="inline"><semantics> <msup> <mn>0</mn> <mo>°</mo> </msup> </semantics></math>. (<b>b</b>) Normal polarized image of <math display="inline"><semantics> <msup> <mn>90</mn> <mo>°</mo> </msup> </semantics></math>. (<b>c</b>) Original image. (<b>d</b>) Reconstruced image by Schechner’s method <math display="inline"><semantics> <msup> <mn>90</mn> <mo>°</mo> </msup> </semantics></math>. (<b>e</b>) Reconstruced image by CLAHE. (<b>f</b>) Reconstruced image by polynomial fitting. (<b>g</b>) Reconstruced image by Butterworth filter. (<b>h</b>) Reconstruced image by method in the paper.</p> ">
Figure 4
<p>Scene of the image taken by a polarization camera.</p> ">
Figure 5
<p>Range-gated system.</p> ">
Figure 6
<p>Experiment imaging target.</p> ">
Figure 7
<p>Examination of the preservation of the polarization state of the image by adjusting the angle of the polarizer.</p> ">
Figure 8
<p>Experimental setup for polarization-enhanced laser range-gated imaging.</p> ">
Figure 9
<p>The coin used in the experiment.</p> ">
Figure 10
<p>Original images of the three materials, along with images obtained and enhanced using the polarization algorithm. (<b>a</b>) Range-gated image of target board. (<b>b</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>a</mi> <mi>x</mi> </mrow> </msub> </semantics></math>. (<b>c</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>i</mi> <mi>n</mi> </mrow> </msub> </semantics></math>. (<b>d</b>) Polarization-enhanced range-gated images of target board. (<b>e</b>) Range-gated image of metal sheet. (<b>f</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>a</mi> <mi>x</mi> </mrow> </msub> </semantics></math>. (<b>g</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>i</mi> <mi>n</mi> </mrow> </msub> </semantics></math>. (<b>h</b>) Polarization-enhanced range-gated images of metal sheet. (<b>i</b>) Range-gated image of diving suit. (<b>j</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>a</mi> <mi>x</mi> </mrow> </msub> </semantics></math>. (<b>k</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>i</mi> <mi>n</mi> </mrow> </msub> </semantics></math>. (<b>l</b>) Polarization-enhanced range-gated images of diving suit.</p> ">
Figure 11
<p>Original images of the target at different turbidities, along with images obtained and enhanced using the polarization algorithm. (<b>a</b>) Range-gated image. (<b>b</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>a</mi> <mi>x</mi> </mrow> </msub> </semantics></math>. (<b>c</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>i</mi> <mi>n</mi> </mrow> </msub> </semantics></math>. (<b>d</b>) Polarization-enhanced range-gated images of the target board under turibidity of 1.70 NTU. (<b>e</b>) Range-gated image. (<b>f</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>a</mi> <mi>x</mi> </mrow> </msub> </semantics></math>. (<b>g</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>i</mi> <mi>n</mi> </mrow> </msub> </semantics></math>. (<b>h</b>) Polarization-enhanced range-gated images of the target board under turibidity of 3.89 NTU. (<b>i</b>) Range-gated image. (<b>j</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>a</mi> <mi>x</mi> </mrow> </msub> </semantics></math>. (<b>k</b>) <math display="inline"><semantics> <msub> <mi>I</mi> <mrow> <mi>m</mi> <mi>i</mi> <mi>n</mi> </mrow> </msub> </semantics></math>. (<b>l</b>) Polarization-enhanced range-gated images of the target board under turibidity of 5.41 NTU.</p> ">
Versions Notes

Abstract

:
Laser range-gated underwater imaging technology, by removing most of the backscattering noise, can effectively increase image contrast and extend the detection range. The optical signal captured by a range-gated imaging system primarily comprises reflected light from the object and backscattered light from the surrounding water. Consequently, surfaces with low reflectivity or highly turbid water environments substantially constrain the applicability of the range-gated imaging system. To enhance the detection capability of underwater laser range-gated imaging, this paper proposes the incorporation of underwater polarized light imaging technology as an enhancement method. Based on polarization differences, backscattered light and reflected light from an object can be distinguished. Experimental results indicate that, compared to images obtained using a conventional range-gated laser imaging system, those captured with a polarization-enhanced system exhibit an increase of up to 47% for the corresponding Enhancement Measure Evaluation (EME) index. The proposed approach, which integrates polarization imaging with range-gated laser imaging, has the potential to broaden the applicability of underwater laser imaging scenarios, such as deep-sea exploration and military applications.

1. Introduction

In ocean exploration, the acquisition of image data has become an essential component for comprehensive regional exploration and for resource extraction activities, such as mining and oil extraction [1]. Underwater imaging research primarily encompasses two main branches: optical imaging and acoustic imaging. Compared to acoustic imaging, optical imaging provides superior resolution and contrast.
Due to the complex underwater environment, light experiences significant absorption, scattering and turbulence during propagation [2]. This explains why conventional underwater optical images exhibit significantly lower contrast, increased blurring and greater distortion compared to images captured in air. Therefore, there is substantial potential for advancement in the restoration and enhancement of underwater images. To mitigate noise in underwater images, researchers have investigated optimization techniques including polarization imaging [3], binocular imaging [4] and LiDAR imaging [5].
In 1995, researchers first trained octopuses to distinguish between targets based on the presence or absence of a pattern created by a 90° polarization contrast within the target [6]. Based on the experimental results, it was found that polarized vision could provide information analogous to color vision, thereby enhancing the detection and recognition of objects. Subsequently, Yoav Y. Schechner and Nir Karpel developed a model of light transmission in water by adapting an existing model for air, and proposed a computer vision method that integrates the target image captured by using a polarizer [7].
In 2008, Tali delineated the role of active light sources in polarization imaging [8]. Since then, more specialized imaging methods have been proposed, building upon previous models. To achieve optimal image pairs, some researchers have utilized the maximum peak difference in the optical correlation plane within reconstruction programs [9,10]. Researchers estimate background light using various methods, including parameter relationships across estimating the polarized-difference image [11], polynomial fitting [12], Gaussian surface fitting combined with least squares [13] and hierarchical image analysis integrated with wavelet variations [14]. Based on the properties of underwater polarized light, methods such as traversal optimization for Degree of Polarization (DOP) values [15], periodic polarized image integration [16] and the application of Gaussian low-pass filters [17] or Butterworth filters [18] have been reported to enhance restoration algorithms. The laser range-gated imaging technique was first introduced to underwater imaging in 1967 [19], when Georges’ team developed the initial corresponding system [20]. Over the years, the technology has undergone significant updates and iterations, including the development of three-dimensional range-gated imaging [21] and the introduction of more compact and practical systems, such as UTOFIA [22] and LUCIE3 [23]. In recent years, polarization imaging has become an important area of research for image enhancement in underwater imaging. Polarization imaging demonstrates significant advantages in reducing scattering, enhancing image contrast and recovering details. Particularly in situations where background areas or prior information are not available [24], it can effectively improve the image recovery quality of moving targets by utilizing the intensity and degree of the polarization of global or local backscattered light. Some studies have also introduced rapid processing techniques, such as optical correlation methods and image downsampling, which significantly increase computational speed [25]. Additionally, in air, gated imaging technology has been combined with methods to shield non-target scattered light, along with deep prior and denoising algorithms, to enhance imaging under foggy conditions [26]. Gated imaging can effectively remove backscattering through the principle of spatial slicing; however, it requires significant power from active light sources. In contrast, polarization imaging can reduce some background scattered light but also depends on the characteristics of the target object.
To address the limitations associated with laser range-gated imaging, this study investigates the integration of range-gated technology with polarization imaging techniques. The objective is to enhance the image clarity of the target. By optimizing the range-gated polarization system, this approach aims to enable its deployment in diverse aquatic environments and adapt its use across various applications, including resource exploration.

2. Materials and Methods

2.1. Principles of Polarization-Enhanced Range-Gated Imaging Technology

2.1.1. Polarization Enhancement

The optical propagation model in aqueous media is fundamentally analogous to that in gaseous media. The camera primarily captures two components of illumination: ambient light and light reflected from the target. A simple monochrome model for light transmission in water is
I ( x , y ) = D ( x , y ) + B ( x , y ) = T ( x , y ) t ( x , y ) + B ( x , y ) ( 1 t ( x , y ) ) ,
where I denotes the light intensity incident upon the receiving end, D represents the light reflected by the object and B signifies the background illumination arriving at the receiving end. T, t and B represent the light distribution of the object, the transmittance of the water medium and the backscattered light from the infinitely distant water, respectively. Regarding polarization, there are various representations, including the Jones matrix, Mueller matrix and Stokes vector, among others. In this study, Stokes parameters are utilized to describe the polarization state of the light field, enabling the separation of reflected light from the object and backscattered light from the water.
S = I Q U V = I 0 ° + I 90 ° I 0 ° I 90 ° I 45 ° I 135 ° I left I right .
In Equation (2), I represents the total irradiance, independent of the polarization state; Q denotes the difference between the time-averaged irradiances measured with a linear polarizer oriented at 0° and 90°; U signifies the difference between the time-averaged irradiances measured with a linear polarizer oriented at 45° and 135°; and V is defined as the difference between the time-averaged irradiances of right and left circularly polarized light. The Stokes vector provides a quantitative representation of the polarization state of light.
Building on this expression, researchers have introduced a parameter to characterize the polarization state of light, known as the D O P , which is computed as follows:
D O P = I max I min I max + I min .
Consequently, the D O P for the reflected polarized light from the target object and the D O P for the background polarized light from the water can be determined as specified in Equations (4) and (5), respectively.
D O P t a r g e t = D max D min D max + D min ,
D O P s c a t t e r = B max B min B max + B min .
In the Stokes matrix formalism, Δ I can be derived as follows:
Δ I = I max I min .
Based on Equation (1), the expression for D can be reformulated as follows:
T = I B t + B .
Considering both Equations (4) and (5), B can be expressed as
B = Δ I D · D O P t a r g e t D O P s c a t t e r · ( 1 t ) .
Finally, integrating all the aforementioned equations, the reflected light from the target object can be expressed as follows:
T = I · D O P s c a t t e r Δ I t · ( D O P s c a t t e r D O P t a r g e t ) .

2.1.2. Range-Gated Imaging

Underwater optical imaging without active illumination is significantly influenced by the aquatic environment, which often fails to meet the requirements for effectively imaging underwater targets in diverse aquatic conditions. However, with the use of active illumination, the light reflected from the target and received by the camera often contains significant amounts of backscattered light generated by the water body. Therefore, the elimination of backscattered light is the focus in the study of underwater optical imaging. Taking into account the time difference between the arrival of backscattered light from the water and the reflected light from the target object at the receiver, researchers have explored a range-gated imaging method to mitigate the background scattered light. The fundamental principle involves configuring the gate at the receiving end to open at a specific time, thereby permitting only the light within the depth of field where the reflected light from the target object is located to be detected.
According to [27], the model for the energy detected by the receiver in a laser range-gated system can be expressed as follows:
E 1 = K · B r r 2 · E 0 e x p ( 2 σ r ) , r R 1 , R 2 ,
where K denotes the proportional impact factor associated with the light’s path, B r represents the sensitive area of the camera, and r represents the distance between the camera and the target, ranging from R 1 to R 2 , within which the reflected light can be detected by the system. Based on the research of underwater light propagation [28], by integrating a polarizer in the optical path, the backscattered light accumulated at the receiving end, situated at a distance r from the range-gated system, can be expressed as follows:
I b = R 1 R 2 E cos ( θ ) d r ,
where θ represents the angle of the polarizer.

2.2. Principle Verification Experiment

2.2.1. Image Evaluation Indicators

Since relying on a single-image evaluation metric often leads to inaccurate assessments, multiple-image evaluation metrics were employed in the experiment. To quantitatively assess the image quality, we analyzed the image contrast. According to [7], the expression for contrast is given by
C ( I ) = δ δ ( x , y ) 2 P δ ( x , y ) ,
in which δ ( x , y ) represents the gray-level difference between adjacent pixels, while P δ ( x , y ) denotes the probability distribution function of the gray-level differences between adjacent pixels. Contrast measurement serves as a fundamental parameter for determining the modulation transfer function of the medium and has been demonstrated to correlate with underwater visual performance.
Another metric employed for image evaluation is information entropy, which quantifies the average amount of information contained within the image. And according to [29], it can be calculated as
H ( I ) = i j p i , j log p i , j .
In the equation, p i , j represents the proportion of the gray value of the pixel within the image. Additionally, as described in the literature [30], a quantitative method is introduced to assess the enhancement effect of an image. This method is used to select the optimal parameters and transformations for each enhancement technique, with the Enhancement Measure Evaluation (EME) calculated as follows:
E M E ( T ) = 1 k l k 1 = 0 k k 2 = 0 l 20 l o g T m a x ; k 1 , k 2 T m i n ; k 1 , k 2 + q ,
where k and l denote the number of segments in the horizontal and vertical directions of the image, respectively. T m a x and T m i n represent the maximum and minimum gray values within each image segment, while q is a correction factor that prevents the occurrence of a minimum gray value of 0, which could otherwise lead to a failure in the EME calculation. The main role of the EME metric is to evaluate image contrast and enhancement effects, particularly when assessing the effectiveness of image enhancement algorithms for low-light images. It provides quantitative information on contrast improvement.

2.2.2. Practical Parameter Acquisition in Polarization-Enhanced Range-Gated Imaging Experiment

From the preceding section, to obtain a clear target image requires determining the mathematical expressions for the optical transmission matrix t, the degree of polarization of the reflected light from the target, and the degree of polarization of the reflected light from the surrounding water environment. At the first step, histogram equalization is applied to the two input images, designated as I m a x and I m i n . Based on the assumption that high-frequency information primarily represents the reflected light from the target, and low-frequency information primarily represents the reflected light from the water environment in the polarization-selective image, the high-frequency and low-frequency components of I m a x and I m i n are separated by using an ideal filter. This could be achieved through the application of an ideal high-pass filter and an ideal low-pass filter, as described below:
H 0 ( μ ) = 1 , if | μ | D 0 0 , if | μ | > D 0 ,
H 1 ( μ ) = 1 , if | μ | D 0 0 , if | μ | < D 0 .
In the equation, H 0 ( μ ) and H 1 ( μ ) represent the filter responses in the frequency domain, where μ is the frequency variable and D 0 denotes the cutoff frequency. In the experiment, μ was set to 1. Convolution was then performed between the input image and the filter frequency response, as described by the following:
I f r e = F 1 { F { I } × H ( u , v ) } .
The high-frequency and low-frequency information of the image obtained could be used to determine the value of the D O P . On one hand, the separated high-frequency image was used to calculate D O P t a r g e t , representing the degree of polarization of the target’s reflected light. Additionally, a parameter factor ϵ 0 was introduced to adjust the calculation result to more closely approximate the true value. On the other hand, the separated low-frequency image was used to calculate D O P s c a t t e r , which represents the degree of polarization of the background light. This value was adjusted to reflect the actual conditions through polynomial fitting and an additional factor ϵ 1 . The expression for the background light grayscale value polynomial fitting is as follows:
I ( x , y ) = a x 2 + b y 2 + c x y + d x + e y + f .
In the equation, a , b , c , d , e and f all represent the coefficients to be determined. Considering the limited spatial extent of the selected region within the water body, we assumed that the optical properties of the water in this small area are uniform, and that the value of t is consistent within a plane perpendicular to the direction of transmission. Thus, the corrected expression for the reflected light from the target is given by
D = I · ϵ 1 D O P s c a t t e r Δ I t · ( ϵ 1 D O P s c a t t e r ϵ 0 D O P t a r g e t ) .
Since both the values of D O P and t range from 0 to 1, an evaluation index score can be introduced by partitioning the parameter interval and conducting optimization calculations. This approach helps to identify the influence factor value and the corresponding t value that maximize the evaluation index for the enhanced image. The expression for the evaluation index is as follows:
s c o r e ( ϵ 0 , ϵ 1 , t ) = a × N o r m a l i z e d E M E + b × N o r m a l i z e d e n t r o p y + c × N o r m a l i z e d c o n t r a s t .
In the equation, a , b and c are undetermined coefficients, which could be set to 0.4, 0.3 and 0.3, respectively, during the construction of the target board image. Furthermore, N o r m a l i z e d E M E , N o r m a l i z e d E n t r o p y and N o r m a l i z e d C o n t r a s t represent the normalized values obtained through the following equations:
N o r m a l i z e d E M E = E M E E M E m i n E M E max E M E min , N o r m a l i z e d C o n t r a s t = C o n t r a s t C o n t r a s t m i n C o n t r a s t max C o n t r a s t min , N o r m a l i z e d E n t r o p y = E n t r o p y E n t r o p y m i n E n t r o p y max E n t r o p y min .
The optimal values of ϵ 0 , ϵ 1 and t can be determined through the following:
ϵ o p t 0 , ϵ o p t 1 , t = arg max { s c o r e ( ϵ 0 , ϵ 1 , t ) } .
Figure 1 illustrates the overall practical procedure, using mutually orthogonal target polarization images as an example.
To verify the image enhancement algorithm, a pre-experiment using a polarized camera was conducted. Initially, we conducted a functional verification of the polarization image enhancement algorithm. The input images consisted of 0 ° and 90 ° polarization images acquired by a Lucid camera (PHX050S-QC), which captures images with different polarization states using a polarization mask at the pixel level. The target was a resolution test target made of acrylic. The imaging environment consisted of an acrylic water tank containing water with dimensions of 11.2 cm × 39.0 cm × 39.0 cm. The experimental setup is shown in Figure 2. To simulate water environments with different turbidity levels in actual scenarios, we added a certain amount of milk to the water tank to validate the effectiveness of image enhancement techniques on images captured under these conditions.
The target images were enhanced using various methods, as illustrated in Figure 3, based on input images with mutually orthogonal polarization. These methods include Schechner’s approach [7], traditional CLAHE [31], polynomial fitting [12], Butterworth low-pass filtering [18] and the techniques described in this article.
As illustrated in Figure 3, the target object is nearly invisible in both conventional camera images and polarized images. For polarized images, the image enhancement method presented in this article distinctly reveals the fine details of the stripes. Comparing the image’s yellow enhancement results obtained from various methods, it is evident that the enhancement method proposed in this study reveals more pronounced detailed features compared to Schechner’s method, and its results are generally consistent with those obtained using the Butterworth filter.
By calculating picture evaluation metrics such as EME, contrast and entropy for each image shown in Figure 3, we obtain the results presented in Table 1.
Based on this table, it is evident that the EME of the enhanced images obtained using this method shows a significant improvement compared to the EME values of images enhanced using other polarization enhancement methods. The contrast and entropy values demonstrate clear advantages over both the original image and the results from other enhancement methods. Overall, the results demonstrate that the polarization image enhancement method proposed in this article is effective and beneficial for enhancing underwater images.

2.2.3. Verification of the Polarization State Received in the Range-Gated System

The laser range-gated imaging experiment, which utilized polarized light enhancement, was conducted in a pool with an approximate depth of 1 meter. The experimental setup is shown in Figure 4. The range-gated system emits a 532nm illumination laser which passes through the water and a polarizer successively to ensure that the illumination light has good linear polarization state. Laser light transmits through the water body and is then reflected by the target. The reflected light passes through another polarizer before reaching the gated camera. The angle of a polarizer that the reflected light passes through can be rotated from 0 ° to 360 ° .
The range-gated imaging system is shown in Figure 5. It emits pulsed laser with a repetition frequency of 2 kHz and a pulse width of 1.5 ns. The outer side of the polarizer has a scale that allows for the precise display of the polarization angle. The polarization-enhanced range-gated imaging experiments were conducted in a 9.1 m×1.7 m×1.0 m pool. The three targets employed in the experiment are a diving suit, a target board and a metal sheet, as depicted in Figure 6.
The entire photo capture experiment can be divided into two phases. In the first phase, a green laser with a wavelength of 532 nm was utilized, and the target object was positioned 5 meters from the range-gated imaging system. Subsequently, 100 mL and 200 mL of milk were added to the water, respectively. We then captured images of the object at polarizer’s angles of 0 ° , 45 ° , 00 ° and 135 ° under varying turbidity conditions. The acquired images were subsequently enhanced and optimized through post-processing.
The optimized target image can be derived by inputting orthogonal images into the polarization enhancement program. In this experiment, images of the target were also acquired at various polarization angles ranging from 0 ° to 180 ° , with increments of 10 ° . For the three different target objects, we rotated the polarizer to collect the polarized pictures obtained from different polarization angles, and then calculated the grayscale value of each picture to obtain the fitting curves as shown in Figure 7. As the rotation angle of the polarizer changes, the fitted curves exhibit sinusoidal characteristics, indicating that the reflected light captured by the selective imaging system possesses polarization properties.

2.2.4. Validation Experiment in a Small Water Tank

The enhancement effect of polarization on range-gated imaging was first tested in a small water tank measuring 60.0 cm × 12.5 cm × 28.5 cm (length × width × height), as shown in Figure 8.
The pulsed laser with a wavelength of 532 nm passed through a polarizer before entering the water tank to ensure the polarization state of the active illumination light. A rotatable polarizer is placed in front of the ICCD used for imaging to capture reflected light with different polarization states. As shown in Figure 9, the target object chosen for the experiment is a coin with patterns and text, which is placed 30 cm away from the laser incidence window. The small water tank originally contained pure water, which was then mixed with milk to alter the turbidity. For each turbidity level, the polarizer in front of the ICCD was rotated to 0 ° , 45 ° , 90 ° and 135 ° to capture images of different polarization states. The imaging hardware system, consisting of a pulsed laser, ICCD and FPGA, operates in a gated mode.
The verification experiment results in the small water tank are shown in Table 2 and Table 3. Table 2 displays the coin images captured using conventional range-gated imaging under different turbidity conditions, while the photos obtained with the polarization-enhanced range-gated imaging system under the same water conditions are shown below. The image comparison shows that the images captured by the polarization-enhanced system have more details and less white noise. Table 3 provides the image quality metrics for the images shown in Table 2. The results indicate that, in most metrics, the polarization-enhanced images perform better.

3. Polarization-Enhanced Range-Gated Imaging Experiment Results

3.1. Polarization Enhancement Effect under Different Material Conditions

In the second phase of the experiment mentioned in Figure 4, photographs of objects located 2.26 meters away were captured in an underwater environment with a turbidity of approximately 2.67 NTU. By rotating the polarizer, we can acquire images of the objects—including metal sheets, target boards and diving suits—at polarization angles of 0 ° , 45 ° , 90 ° and 135 ° . For the range-gated imaging system, after acquiring polarization images of three targets at different polarization angles, and inputting the 0 ° and 90 ° images, we obtained the enhanced images of the three types of objects, as illustrated in Figure 10.
Compared to the range-gated images, the image enhancement results obtained with the polarizer generally exhibit greater clarity. From the image pairs, it is evident that the enhanced pictures reveal greater detail, including the stripes, numbers on the standard target, the swan logo on the metal sheet and the collar silhouette of the diving suit. It can be observed that the image enhancement of the metal sheet is primarily evident in the delineation of the twisted metal edges rather than in the flat, overall image shape. By calculating picture evaluation metrics such as EME, contrast and entropy for each image shown in Figure 10, we derive the results presented in Table 4.
Among the different objects used in the experiment, the polarization algorithm enhancement results for the three targets show improvements in the three indicators: EME, contrast, and entropy. Considering EME, the corresponding values for the target board image, metal sheet image and diving suit image increased by 47.47%, 32.09% and 15.63%, respectively. Additionally, with respect to the entropy index, the corresponding values for the target board image, metal sheet image and diving suit image increased by 22.26%, 37.52% and 2.36%, respectively.
Considering the enhanced images, the image enhancement effect for the target board and metal sheet images is significantly superior to that for the diving suit image, as evidenced by the EME and entropy indexes. The values of the first two are markedly higher than that of the third. It can be observed that, although both the target board and the diving suit are composed of polymeric materials, the enhancement effects differ due to the variations in the types of materials used. While the primary components of the diving suit are neoprene and nylon, the target board is made of acrylic.

3.2. Polarization Enhancement Effect under Different Turbidity Conditions

As discussed in the preceding section, the target is positioned at a constant distance from the range-gated imaging system, and polarized images are acquired at varying angles through the rotation of the polarizer. The varying levels of turbidity in the environment are achieved by incorporating different quantities of milk. By inputting mutually orthogonal image pairs acquired under different turbidity conditions, the corresponding polarization-enhanced images, as illustrated in Figure 11, can be obtained.
The images below demonstrate that range-gated images, when subjected to a polarization enhancement process, exhibit improved clarity under various turbidity conditions. As the turbidity of the underwater environment increases, the enhancement effect becomes more pronounced. For instance, utilizing the polarization enhancement algorithm allows for the visibility of the target board concealed within the obscured range-gated image.
Table 5 presents the evaluation metrics of the system for images captured without polarizers as well as for enhanced images obtained through polarization enhancement. It is evident from the table that after polarization enhancement, the Enhancement Measure Evaluation (EME), contrast of the enhanced image and entropy value have shown substantial improvement.
Regarding the entropy index, the values for the target board image, metal sheet image and diving suit image increased by 6.77%, 15.58% and 37.53%, respectively. This indicates that the enhancement effect of the polarization enhancement algorithm becomes more pronounced as the turbidity of the underwater environment increases.

4. Conclusions

This study investigates the feasibility of integrating polarization imaging with laser range-gated imaging to optimize underwater imaging quality. It employs a comprehensive methodology, supported by specific experiments to demonstrate the efficacy of polarization imaging enhancement in enhancing the quality of range-gated imaging.
Through polarization-gated imaging experiments with various materials, it has been verified that incorporating polarization enhancement imaging yields higher-quality underwater images compared to gated imaging alone. However, the effectiveness of the enhancement varies depending on the material composition of the objects. In comparison to targets composed of plastic materials, polarization imaging has a more pronounced impact on optimizing the imaging quality of targets made from metal materials.
The experimental results of vibration image enhancement demonstrate that, compared to a standalone underwater laser range-gated imaging system, the system incorporating polarized light enhancement significantly improves the contrast and entropy values of images captured in turbid water. As the turbidity of the water body increases, the enhancement in image metrics becomes more pronounced. Experimental results indicate that as the turbidity of the water body increases, the entropy index of the same target image rises by approximately 6% to 38%. Among images of target objects composed of different materials, the enhancement in Enhancement Measure Evaluation (EME) indicators ranges from 16% to 47%.
As an effective underwater imaging technique, the range-gated imaging method combined with the polarization enhancement algorithm proposed in this study warrants further exploration and potential application in the underwater domain.
The system applies a pulsed laser with an average power of 2 W and a single-pulse energy of 2 mJ. According to UTOFIA’s report on behavioral studies on laser light source [32] on their website, this laser has no significant effect on the behavior of fish and shrimp at a distance of 1 meter, nor does it have a strong impact on fish eyes at 1 meter. Considering the environmental impact of laser usage, in the future, our system will be structurally adjusted to position the laser focus within the system itself, thereby reducing the potential impact of the laser on the environment.
Currently, this technology is limited by the acquisition of polarization images. In the future, the introduction of unsupervised learning and the combination of efficient computing power may promote its real-time application.

Author Contributions

Conceptualization, S.C. and W.H.; Methodology, S.C.; Software, S.C.; Validation, S.C.; Formal analysis, S.C.; Investigation, S.C. and P.L.; Resources, S.C., P.L., W.H., D.L., Y.T., L.C., J.W., Q.Z., G.J. and W.C.; Data curation, S.C. and P.L.; Writing—original draft, S.C.; Writing—review & editing, S.C., W.H. and W.C.; Visualization, S.C.; Supervision, S.C.; Project administration, W.H.; Funding acquisition, W.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Youth Innovation Promotion Association CAS, the Shenzhen Science and Technology Program (Grant No. GJHZ20210705141403009) and Water Conservancy Science and Technology Innovation Project of Guangdong Province (No. 2022-03).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Shi, Z.; Yu, L.; Cao, D.; Wu, Q.; Yu, X.; Lin, G. Airborne ultraviolet imaging system for oil slick surveillance: Oil–seawater contrast, imaging concept, signal-to-noise ratio, optical design, and optomechanical model. Appl. Opt. 2015, 54, 7648–7655. [Google Scholar] [CrossRef]
  2. Shen, Y.; Zhao, C.; Liu, Y.; Wang, S.; Huang, F. Underwater optical imaging: Key technologies and applications review. IEEE Access 2021, 9, 85500–85514. [Google Scholar] [CrossRef]
  3. Wolff, L.B. Polarization vision: A new sensory approach to image understanding. Image Vis. Comput. 1997, 15, 81–93. [Google Scholar] [CrossRef]
  4. Huo, G.; Wu, Z.; Li, J.; Li, S. Underwater target detection and 3D reconstruction system based on binocular vision. Sensors 2018, 18, 3570. [Google Scholar] [CrossRef]
  5. He, D.M.; Seet, G.G. Underwater LIDAR imaging in highly turbid waters. In Proceedings of the Ocean Optics: Remote Sensing and Underwater Imaging, San Diego, CA, USA, 29 July–3 August 2002; Volume 4488, pp. 71–81. [Google Scholar]
  6. Shashar, N.; Cronin, T.W. Polarization contrast vision in Octopus. J. Exp. Biol. 1996, 199, 999–1004. [Google Scholar] [CrossRef]
  7. Schechner, Y.Y.; Karpel, N. Recovery of underwater visibility and structure by polarization analysis. IEEE J. Ocean. Eng. 2005, 30, 570–587. [Google Scholar] [CrossRef]
  8. Treibitz, T.; Schechner, Y.Y. Active polarization descattering. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 31, 385–399. [Google Scholar] [CrossRef]
  9. Dubreuil, M.; Delrot, P.; Leonard, I.; Alfalou, A.; Brosseau, C.; Dogariu, A. Exploring underwater target detection by imaging polarimetry and correlation techniques. Appl. Opt. 2013, 52, 997–1005. [Google Scholar] [CrossRef]
  10. Liu, F.; Han, P.; Wei, Y.; Yang, K.; Huang, S.; Li, X.; Zhang, G.; Bai, L.; Shao, X. Deeply seeing through highly turbid water by active polarization imaging. Opt. Lett. 2018, 43, 4903–4906. [Google Scholar] [CrossRef]
  11. Huang, B.; Liu, T.; Hu, H.; Han, J.; Yu, M. Underwater image recovery considering polarization effects of objects. Opt. Express 2016, 24, 9826–9838. [Google Scholar] [CrossRef]
  12. Hu, H.; Zhao, L.; Li, X.; Wang, H.; Liu, T. Underwater image recovery under the nonuniform optical field based on polarimetric imaging. IEEE Photonics J. 2018, 10, 6900309. [Google Scholar] [CrossRef]
  13. Li, H.; Zhu, J.; Deng, J.; Guo, F.; Yue, L.; Sun, J.; Zhang, Y.; Hou, X. Visibility enhancement of underwater images based on polarization common-mode rejection of a highly polarized target signal. Opt. Express 2022, 30, 43973–43986. [Google Scholar] [CrossRef]
  14. Liu, F.; Cao, L.; Shao, X.; Han, P.; Bin, X. Polarimetric dehazing utilizing spatial frequency segregation of images. Appl. Opt. 2015, 54, 8116–8122. [Google Scholar] [CrossRef]
  15. Feng, F.; Wu, G.; Wu, Y.; Miao, Y.; Liu, B. Algorithm for underwater polarization imaging based on global estimation. Acta Opt. Sin 2020, 40, 75–83. [Google Scholar]
  16. Wang, J.; Wan, M.; Gu, G.; Qian, W.; Ren, K.; Huang, Q.; Chen, Q. Periodic integration-based polarization differential imaging for underwater image restoration. Opt. Lasers Eng. 2022, 149, 106785. [Google Scholar] [CrossRef]
  17. Liang, J.; Ren, L.; Liang, R. Low-pass filtering based polarimetric dehazing method for dense haze removal. Opt. Express 2021, 29, 28178–28189. [Google Scholar] [CrossRef]
  18. Yu, T.; Wang, X.; Xi, S.; Mu, Q.; Zhu, Z. Underwater polarization imaging for visibility enhancement of moving targets in turbid environments. Opt. Express 2023, 31, 459–468. [Google Scholar] [CrossRef]
  19. Heckman, P.; Hodgson, R. 2.7-Underwater optical range gating. IEEE J. Quantum Electron. 1967, 3, 445–448. [Google Scholar] [CrossRef]
  20. Fournier, G.R.; Bonnier, D.; Forand, J.L.; Pace, P.W. Range-gated underwater laser imaging system. Opt. Eng. 1993, 32, 2185–2190. [Google Scholar] [CrossRef]
  21. Wang, X.; Sun, L.; Lei, P.; Chen, J.; He, J.; Zhou, Y. High-resolution 3D range gated laser imaging for unmanned underwater vehicles. In Proceedings of the Real-Time Photonic Measurements, Data Management, and Processing VI, Nantong, China, 10–20 October 2021; Volume 11902, pp. 24–41. [Google Scholar]
  22. Hou, W.; Gray, D.J.; Weidemann, A.D.; Fournier, G.R.; Forand, J. Automated underwater image restoration and retrieval of related optical properties. In Proceedings of the 2007 IEEE International Geoscience and Remote Sensing Symposium, Barcelona, Spain, 23–28 July 2007; pp. 1889–1892. [Google Scholar]
  23. Driewer, A.; Abrosimov, I.; Alexander, J.; Benger, M.; O’Farrell, M.; Haugholt, K.H.; Softley, C.; Thielemann, J.T.; Thorstensen, J.; Yates, C. UTOFIA: An underwater time-of-flight image acquisition system. In Proceedings of the Electro-Optical Remote Sensing XI, Warsaw, Poland, 11–14 September 2017; Volume 10434, pp. 9–18. [Google Scholar]
  24. Wang, H.; Hu, H.; Jiang, J.; Li, X.; Zhang, W.; Cheng, Z.; Liu, T. Automatic underwater polarization imaging without background region or any prior. Opt. Express 2021, 29, 31283–31295. [Google Scholar] [CrossRef]
  25. Zhang, H.; Ren, M.; Wang, H.; Yao, J.; Zhang, Y. Fast processing of underwater polarization imaging based on optical correlation. Appl. Opt. 2021, 60, 4462–4468. [Google Scholar] [CrossRef]
  26. Huang, F.; Qiu, S.; Liu, H.; Liu, Y.; Wang, P. Active imaging through dense fog by utilizing the joint polarization defogging and denoising optimization based on range-gated detection. Opt. Express 2023, 31, 25527–25544. [Google Scholar] [CrossRef]
  27. Xinwei, W.; Yan, Z.; Songtao, F.; Yuliang, L.; Hongjun, L. Echo broadening effect in range-gated active imaging technique. In Proceedings of the SPIE, the International Society for Optical Engineering; Society of Photo-Optical Instrumentation Engineers: Bellingham, WA, USA, 2009. [Google Scholar]
  28. Wang, M.; Wang, X.; Sun, L.; Yang, Y.; Zhou, Y. Underwater 3D deblurring-gated range-intensity correlation imaging. Opt. Lett. 2020, 45, 1455–1458. [Google Scholar] [CrossRef]
  29. Xi, L.; Guosui, L.; Ni, J. Autofocusing of ISAR images based on entropy minimization. IEEE Trans. Aerosp. Electron. Syst. 1999, 35, 1240–1252. [Google Scholar] [CrossRef]
  30. Agaian, S.S.; Panetta, K.; Grigoryan, A.M. Transform-based image enhancement algorithms with performance measure. IEEE Trans. Image Process. 2001, 10, 367–382. [Google Scholar] [CrossRef]
  31. Zuiderveld, K. Contrast limited adaptive histogram equalization. In Graphics Gems; Academic Press Professional, Inc.: San Diego, CA, USA, 1994; pp. 474–485. [Google Scholar]
  32. Jane Behrens, D.A. Report on Behavioural Studies to Laser Light Source Available. 2016. Available online: https://ec.europa.eu/research/participants/documents/downloadPublic?documentIds=080166e5a8587ed1&appId=PPGMS (accessed on 29 April 2016).
Figure 1. Program workflow of the polarization enhancement algorithm.
Figure 1. Program workflow of the polarization enhancement algorithm.
Sensors 24 06681 g001
Figure 2. Polarization camera used to validate the polarization enhancement algorithm.
Figure 2. Polarization camera used to validate the polarization enhancement algorithm.
Sensors 24 06681 g002
Figure 3. Original image and algorithm-enhanced image. (a) Normal polarized image of 0 ° . (b) Normal polarized image of 90 ° . (c) Original image. (d) Reconstruced image by Schechner’s method 90 ° . (e) Reconstruced image by CLAHE. (f) Reconstruced image by polynomial fitting. (g) Reconstruced image by Butterworth filter. (h) Reconstruced image by method in the paper.
Figure 3. Original image and algorithm-enhanced image. (a) Normal polarized image of 0 ° . (b) Normal polarized image of 90 ° . (c) Original image. (d) Reconstruced image by Schechner’s method 90 ° . (e) Reconstruced image by CLAHE. (f) Reconstruced image by polynomial fitting. (g) Reconstruced image by Butterworth filter. (h) Reconstruced image by method in the paper.
Sensors 24 06681 g003
Figure 4. Scene of the image taken by a polarization camera.
Figure 4. Scene of the image taken by a polarization camera.
Sensors 24 06681 g004
Figure 5. Range-gated system.
Figure 5. Range-gated system.
Sensors 24 06681 g005
Figure 6. Experiment imaging target.
Figure 6. Experiment imaging target.
Sensors 24 06681 g006
Figure 7. Examination of the preservation of the polarization state of the image by adjusting the angle of the polarizer.
Figure 7. Examination of the preservation of the polarization state of the image by adjusting the angle of the polarizer.
Sensors 24 06681 g007
Figure 8. Experimental setup for polarization-enhanced laser range-gated imaging.
Figure 8. Experimental setup for polarization-enhanced laser range-gated imaging.
Sensors 24 06681 g008
Figure 9. The coin used in the experiment.
Figure 9. The coin used in the experiment.
Sensors 24 06681 g009
Figure 10. Original images of the three materials, along with images obtained and enhanced using the polarization algorithm. (a) Range-gated image of target board. (b) I m a x . (c) I m i n . (d) Polarization-enhanced range-gated images of target board. (e) Range-gated image of metal sheet. (f) I m a x . (g) I m i n . (h) Polarization-enhanced range-gated images of metal sheet. (i) Range-gated image of diving suit. (j) I m a x . (k) I m i n . (l) Polarization-enhanced range-gated images of diving suit.
Figure 10. Original images of the three materials, along with images obtained and enhanced using the polarization algorithm. (a) Range-gated image of target board. (b) I m a x . (c) I m i n . (d) Polarization-enhanced range-gated images of target board. (e) Range-gated image of metal sheet. (f) I m a x . (g) I m i n . (h) Polarization-enhanced range-gated images of metal sheet. (i) Range-gated image of diving suit. (j) I m a x . (k) I m i n . (l) Polarization-enhanced range-gated images of diving suit.
Sensors 24 06681 g010
Figure 11. Original images of the target at different turbidities, along with images obtained and enhanced using the polarization algorithm. (a) Range-gated image. (b) I m a x . (c) I m i n . (d) Polarization-enhanced range-gated images of the target board under turibidity of 1.70 NTU. (e) Range-gated image. (f) I m a x . (g) I m i n . (h) Polarization-enhanced range-gated images of the target board under turibidity of 3.89 NTU. (i) Range-gated image. (j) I m a x . (k) I m i n . (l) Polarization-enhanced range-gated images of the target board under turibidity of 5.41 NTU.
Figure 11. Original images of the target at different turbidities, along with images obtained and enhanced using the polarization algorithm. (a) Range-gated image. (b) I m a x . (c) I m i n . (d) Polarization-enhanced range-gated images of the target board under turibidity of 1.70 NTU. (e) Range-gated image. (f) I m a x . (g) I m i n . (h) Polarization-enhanced range-gated images of the target board under turibidity of 3.89 NTU. (i) Range-gated image. (j) I m a x . (k) I m i n . (l) Polarization-enhanced range-gated images of the target board under turibidity of 5.41 NTU.
Sensors 24 06681 g011
Table 1. Evaluation metrics of images processed by different image enhancement methods.
Table 1. Evaluation metrics of images processed by different image enhancement methods.
Enhancement MethodEMEContrastEntropy
Original image6.7452.3342.934
Schechner’s method20.07849.4165.609
CLAHE9.03055.5215.147
Polynomial fitting1.59014.6515.618
Butterworth filter1.50936.1404.713
Method in the paper3.855115.4056.829
Table 2. Pictures from conventional range-gated imaging and polarization-enhanced range-gated imaging.
Table 2. Pictures from conventional range-gated imaging and polarization-enhanced range-gated imaging.
Turbidity/NTU41.85261.869.3
Pictures from conventional range-gated imagingSensors 24 06681 i001Sensors 24 06681 i002Sensors 24 06681 i003Sensors 24 06681 i004
Pictures from polarization-enhanced range-gated imagingSensors 24 06681 i005Sensors 24 06681 i006Sensors 24 06681 i007Sensors 24 06681 i008
Table 3. Comparison of image evaluation metrics between conventional range-gated imaging and polarization-enhanced range-gated imaging.
Table 3. Comparison of image evaluation metrics between conventional range-gated imaging and polarization-enhanced range-gated imaging.
Polarization Imaging OptimizationTurbidity (NTU)EMEContrastEntropy
NO41.810.575143.8946.985
YES41.811.758157.3587.180
NO52.05.86175.5697.498
YES52.07.27690.7007.396
NO61.85.07359.6397.492
YES61.824.898107.3907.547
NO69.34.53327.8776.750
YES69.342.124125.6987.335
Table 4. Impact on image evaluation metrics for different targets after polarization enhancement.
Table 4. Impact on image evaluation metrics for different targets after polarization enhancement.
TargetPolarization EnhancementEMEContrastEntropy
target boardNO10.9194.9596.365
YES16.077310.9957.782
metal sheetNO62.1941.2973.825
YES82.792402.3475.260
diving suitNO8.25122.1717.260
YES9.541124.7757.431
Table 5. Impact of polarization enhancement on image evaluation metrics under different turbidity conditions.
Table 5. Impact of polarization enhancement on image evaluation metrics under different turbidity conditions.
Polarization EnhancementTurbidity/NTUEMEContrastEntropy
NO1.708.0265.9786.084
YES1.70135.374571.3027.032
NO3.896.9133.2504.771
YES3.8928.69028.9015.094
NO5.411.5170.1724.511
YES5.414.421140.4376.204
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chen, S.; Liu, P.; He, W.; Luo, D.; Tan, Y.; Chen, L.; Wang, J.; Zhao, Q.; Jiao, G.; Chen, W. Polarization-Enhanced Underwater Laser Range-Gated Imaging for Subaquatic Applications. Sensors 2024, 24, 6681. https://doi.org/10.3390/s24206681

AMA Style

Chen S, Liu P, He W, Luo D, Tan Y, Chen L, Wang J, Zhao Q, Jiao G, Chen W. Polarization-Enhanced Underwater Laser Range-Gated Imaging for Subaquatic Applications. Sensors. 2024; 24(20):6681. https://doi.org/10.3390/s24206681

Chicago/Turabian Style

Chen, Shuaibao, Peng Liu, Wei He, Dong Luo, Yuguang Tan, Liangpei Chen, Jue Wang, Qi Zhao, Guohua Jiao, and Wei Chen. 2024. "Polarization-Enhanced Underwater Laser Range-Gated Imaging for Subaquatic Applications" Sensors 24, no. 20: 6681. https://doi.org/10.3390/s24206681

APA Style

Chen, S., Liu, P., He, W., Luo, D., Tan, Y., Chen, L., Wang, J., Zhao, Q., Jiao, G., & Chen, W. (2024). Polarization-Enhanced Underwater Laser Range-Gated Imaging for Subaquatic Applications. Sensors, 24(20), 6681. https://doi.org/10.3390/s24206681

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop