Nothing Special   »   [go: up one dir, main page]

Next Article in Journal
A Continuously Worn Dual Temperature Sensor System for Accurate Monitoring of Core Body Temperature from the Ear Canal
Previous Article in Journal
Surface-Electromyography-Based Co-Contraction Index for Monitoring Upper Limb Improvements in Post-Stroke Rehabilitation: A Pilot Randomized Controlled Trial Secondary Analysis
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Survey on Unmanned Underwater Vehicles: Challenges, Enabling Technologies, and Future Research Directions

1
Department of Intelligent Mechatronics Engineering and Convergence Engineering for Intelligent Drone, Sejong University, Seoul 05006, Republic of Korea
2
Department of Computer Science and Engineering, Sejong University, Seoul 05006, Republic of Korea
3
Department of Information and Communication Engineering and Convergence Engineering for Intelligent Drone, Sejong University, Seoul 05006, Republic of Korea
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(17), 7321; https://doi.org/10.3390/s23177321
Submission received: 21 July 2023 / Revised: 9 August 2023 / Accepted: 16 August 2023 / Published: 22 August 2023
(This article belongs to the Section Communications)
Figure 1
<p>Organization of the paper.</p> ">
Figure 2
<p>Survey taxonomy based on general to specific keywords.</p> ">
Figure 3
<p>(<b>a</b>) Omnidirectional, (<b>b</b>) hydrojet, (<b>c</b>) hydrojet maneuver and (<b>d</b>) undulating propulsion and dive system [<a href="#B16-sensors-23-07321" class="html-bibr">16</a>,<a href="#B21-sensors-23-07321" class="html-bibr">21</a>,<a href="#B22-sensors-23-07321" class="html-bibr">22</a>].</p> ">
Figure 4
<p>Sensing tracking target involves a sequential process depicted in (<b>a</b>). Initially, upon target detection, the measured aspect angle remains unresolved, as evidenced by both port and starboard rays extending from the vehicle. Subsequent maneuvering and data collection during the second leg facilitate the completion of the resolve-ps-ambiguity behavior, leading to the determination of target orientation. Once resolved, the keep-broadside behavior utilizes the obtained vehicle-relative bearing measurement, indicated by a single ray extending from the vehicle, to effectively track the target’s movements. (<b>b</b>) In the realm of optical sensing, a progression unfolds from the top left to right, followed by a downward transition. The initial view showcases the original image captured. Subsequently, the HSV image processing unveils a distinct perspective, enabling the extraction of key color information. Finally, the journey culminates in the presentation of color masks, representing specific regions of interest and aiding in targeted analysis. This holistic sensing approach harmonizes various stages of processing, culminating in a comprehensive understanding of the tracked target’s dynamics and optical properties [<a href="#B30-sensors-23-07321" class="html-bibr">30</a>,<a href="#B34-sensors-23-07321" class="html-bibr">34</a>].</p> ">
Figure 5
<p>(<b>a</b>) Two-dimensional seafloor example. The blue line represents the DVL signal that performs seafloor measurements and estimates. (<b>b</b>) GPS–GNSS Work [<a href="#B42-sensors-23-07321" class="html-bibr">42</a>].</p> ">
Figure 6
<p>Scenario joint-operation: UAV, USV, UUV.</p> ">
Figure 7
<p>Simulation of a diving system using the law of buoyancy: <math display="inline"><semantics> <mrow> <msub> <mi>δ</mi> <mi>i</mi> </msub> <mo>=</mo> <mrow> <mo>(</mo> <msub> <mi>i</mi> <mi>t</mi> </msub> <mi>W</mi> <mo>−</mo> <msub> <mi>i</mi> <mi>b</mi> </msub> <mi>W</mi> <mo>)</mo> </mrow> </mrow> </semantics></math> approach, where <math display="inline"><semantics> <msub> <mi>δ</mi> <mi>i</mi> </msub> </semantics></math> is a coefficient attitude-dependent magnitude of the moment produced by any offset between the center of mass (<math display="inline"><semantics> <msub> <mi>i</mi> <mi>t</mi> </msub> </semantics></math>) and buoyancy (<math display="inline"><semantics> <msub> <mi>i</mi> <mi>b</mi> </msub> </semantics></math>) and (<span class="html-italic">W</span>) is the weight of the vehicle.</p> ">
Figure 8
<p>Control system: these waypoints, represented by a vector <math display="inline"><semantics> <msub> <mi>p</mi> <mi>k</mi> </msub> </semantics></math>, can be written in the equation <math display="inline"><semantics> <mrow> <msub> <mi>ω</mi> <mi>k</mi> </msub> <mo>=</mo> <mrow> <mo>[</mo> <msub> <mi>x</mi> <mrow> <mi>p</mi> <mi>k</mi> </mrow> </msub> <mo>,</mo> <msub> <mi>y</mi> <mrow> <mi>p</mi> <mi>k</mi> </mrow> </msub> <mo>,</mo> <msub> <mi>z</mi> <mrow> <mi>p</mi> <mi>k</mi> </mrow> </msub> <mo>,</mo> <msub> <mi>V</mi> <mrow> <mi>p</mi> <mi>k</mi> </mrow> </msub> <mo>]</mo> </mrow> </mrow> </semantics></math>, where <math display="inline"><semantics> <msub> <mi>x</mi> <mrow> <mi>p</mi> <mi>k</mi> </mrow> </msub> </semantics></math>, <math display="inline"><semantics> <msub> <mi>y</mi> <mrow> <mi>p</mi> <mi>k</mi> </mrow> </msub> </semantics></math>, and <math display="inline"><semantics> <msub> <mi>z</mi> <mrow> <mi>p</mi> <mi>k</mi> </mrow> </msub> </semantics></math> are the absolute coordinates of the waypoints in the environment frame. <math display="inline"><semantics> <msub> <mi>V</mi> <mrow> <mi>p</mi> <mi>k</mi> </mrow> </msub> </semantics></math> is the desired norm of the AUV velocity vector (mostly surge and dive) at the considered waypoint (can be 0).</p> ">
Figure 9
<p>Sensing: works by changing the environment image into light–dark parameters, where the light path (1 <math display="inline"><semantics> <mrow> <msub> <mi>I</mi> <mi>i</mi> </msub> <mo>≤</mo> <msub> <mover accent="true"> <mi>T</mi> <mo stretchy="false">¯</mo> </mover> <mi>i</mi> </msub> </mrow> </semantics></math>) means it can be skipped and the dark band (0 <math display="inline"><semantics> <mrow> <msub> <munder> <mi>T</mi> <mo>̲</mo> </munder> <mi>i</mi> </msub> <mo>≤</mo> <msub> <mi>I</mi> <mi>i</mi> </msub> </mrow> </semantics></math>) must be avoided.</p> ">
Figure 10
<p>Localization: works by identifying <math display="inline"><semantics> <mrow> <mo>(</mo> <mi>x</mi> <mo>,</mo> <mi>y</mi> <mo>)</mo> </mrow> </semantics></math> position and <math display="inline"><semantics> <mrow> <mo>(</mo> <mi>θ</mi> <mo>)</mo> </mrow> </semantics></math> as orientation.</p> ">
Figure 11
<p>Energy supply: battery state of charge (SoC), which is affected by ambient temperature, where <math display="inline"><semantics> <mrow> <msub> <mi>P</mi> <mrow> <mi>l</mi> <mi>o</mi> <mi>a</mi> <mi>d</mi> </mrow> </msub> <mo>=</mo> <mrow> <mo>(</mo> <mi>R</mi> <mi>e</mi> <mrow> <mo>(</mo> <msub> <mi>Z</mi> <mrow> <mi>r</mi> <mn>0</mn> </mrow> </msub> <mo>)</mo> </mrow> <mo>)</mo> </mrow> <msubsup> <mi>I</mi> <mi>p</mi> <mn>2</mn> </msubsup> <mo>=</mo> <msub> <mi>ω</mi> <mn>0</mn> </msub> <mfrac> <msup> <mi>M</mi> <mn>2</mn> </msup> <msub> <mi>L</mi> <mi>s</mi> </msub> </mfrac> <msubsup> <mi>I</mi> <mi>P</mi> <mn>2</mn> </msubsup> <msub> <mi>Q</mi> <mi>s</mi> </msub> <mo>·</mo> <mi>T</mi> </mrow> </semantics></math>.</p> ">
Versions Notes

Abstract

:
Unmanned underwater vehicles (UUVs) are becoming increasingly important for a variety of applications, including ocean exploration, mine detection, and military surveillance. This paper aims to provide a comprehensive examination of the technologies that enable the operation of UUVs. We begin by introducing various types of unmanned vehicles capable of functioning in diverse environments. Subsequently, we delve into the underlying technologies necessary for unmanned vehicles operating in underwater environments. These technologies encompass communication, propulsion, dive systems, control systems, sensing, localization, energy resources, and supply. We also address general technical approaches and research contributions within this domain. Furthermore, we present a comprehensive overview of related work, survey methodologies employed, research inquiries, statistical trends, relevant keywords, and supporting articles that substantiate both broad and specific assertions. Expanding on this, we provide a detailed and coherent explanation of the operational framework of UUVs and their corresponding supporting technologies, with an emphasis on technical descriptions. We then evaluate the existing gaps in the performance of supporting technologies and explore the recent challenges associated with implementing the Thorp model for the distribution of shared resources, specifically in communication and energy domains. We also address the joint design of operations involving unmanned surface vehicles (USVs), unmanned aerial vehicles (UAVs), and UUVs, which necessitate collaborative research endeavors to accomplish mission objectives. This analysis highlights the need for future research efforts in these areas. Finally, we outline several critical research questions that warrant exploration in future studies.

1. Introduction

Unmanned vehicles are developed to operate in various environments, including those operating on the surface of the water, known as unmanned surface vehicles (USVs) [1], those operating in the air as unmanned aerial vehicles (UAVs) [2], and those that operate underwater as unmanned underwater vehicles (UUVs). Currently, UUVs are growing in communication, control systems, and automation, and are even using Machine Learning processes such as setting trajectories, sensing, and managing flocks of unmanned vehicles [3].
As compared to unmanned vehicles that operate on the ground and those that operate in the air, which are able to access wireless communication systems properly, the conditions for unmanned vehicles that operate on the ground are different. This is due to the reliability of air in transmitting communication signals, especially with relay technology and shared resource management [4]. In spite of the fact that there are several disturbances, fault handling, recovery, and fault management can still be used to handle them [5]. Meanwhile, UUVs are affected by fluid properties, which interfere with signal propagation [6]. Furthermore, the energy required to transmit the signal is relatively high [7], whereas the signal received is lower, resulting in the loss of large data [6,8].
The underwater communication technologies can be categorized into five models: (1) acoustic communication that uses sound waves as a communication signal [9]; (2) optical communication uses visible and invisible light waves [10]; (3) wireless communication via radio waves [11]; (4) Satellite communication communicates with devices in the water through intermediary relays on the surface [12]; (5) direct electrical communication used for UUV charging docks [13,14].
There are four indicators that can be used to measure communication effectiveness: bit-error-rate (BER); signal-to-noise ratio (SNR) in decibels (dB); spectral efficiency, which is decrypted as the number of bits per second that can be transmitted through a specific bandwidth unit (bps/Hz); and energy efficiency. Specific propagation loss coefficient and noise floor are employed for different signal frequencies, as well as water characteristics (such as temperature, salinity, and depth) [6]. The signal-to-noise ratio measures the strength of the signal compared to the background noise. Better communication conditions are indicated by a higher SNR.
The propulsion system and dive system allow the UUV to move and control its depth in the water [15]. To propel the vehicle through the viscosity of water, one or more thrusters are used [16,17]. The propulsion system also controls the vehicle’s buoyancy, usually using a ballast system, which absorbs or releases water to regulate the vehicle’s buoyancy, as well as control systems to control dives and ascents [18]. UUVs can also be propelled by wings, fins, and hydrojets [19,20,21,22].
Five types of UUVs are considered in the control system, which focuses on control algorithms: the first is proportional–integral–derivative (PID) [23], which utilizes sensor feedback and processes it proportionally, integrally, and derivatively. Integrational means accumulating the errors over time and adjusting the control output based on those errors, while proportional means comparing; for example, comparing the output with the desired output. Derivative means calculating the error rate and adjusting the output based on that rate. The second type, model predictive control (MPC), predicts the future behavior of the system [24]. It uses a mathematical technique called sliding mode to achieve robust control of a system, regardless of variations in its dynamics or disturbances in the environment. Sliding mode control or SMC is a third method [25]. Fourth, adaptive control (AC) uses a mathematical model of the system to estimate the current state of the system [26] and then adjusts the control inputs accordingly. Last but not least, adjusting UUV trajectory [27] or UUV herd localization uses Artificial Intelligence and Machine Learning (ML) [28]. Control algorithms are chosen based on the application and the requirements given, but there are a number of testing models that can be used, including (1) simulation; (2) closed-loop testing; (3) comparison with other algorithms; and (4) measuring key performance indicators (KPIs).
UUV uses several sensor devices in environmental sensing and recognition systems, and they are grouped based on how they work into four types: acoustic-sensors, such as sound navigation and ranging (SONAR) [29] and hydrophones [30], that detect and locate objects in water using sound waves; optical sensors, such as cameras and light detection and ranging (LiDAR) [31,32], that use light waves to capture images and gather data on the surface of the water; chemical-sensors [33], which can detect and measure the concentration of dissolved gases, pollutants, and other substances in the water [34]; and physical-sensors [35], which can detect and measure the properties of water and its surroundings. Using these four types of sensors together can provide a comprehensive picture of the underwater environment for navigation, object detection, and environmental monitoring. As a result of the sensing function, UUV operations can be conducted to collect various types of data, such as bathymetry [36], water quality [32], images of the seafloor [32], etc., depending on the mission and the sensors and instruments installed on the vehicle.
Several types of navigation systems can be used by unmanned vehicles underwater, including inertial navigation systems (INS) which use accelerometers and gyroscope sensors to measure linear and angular motion, and once the angular position and orientation are known, the location of the UUV can be estimated [37,38]. Another application using similar measurement data is the Doppler velocity log (DVL), which measures the relative velocity of UUV to water by using the theory of the Doppler effect [39,40,41,42]. Furthermore, the third system is the use of the global navigation satellite system (GNSS) and global positioning system (GPS) which utilize satellite signals to determine UUV position and speed [43] based on the difference between a signal transmitted by a satellite and a signal received by a GPS receiver. In addition, the GNSS system transmits longitude, latitude, altitude and time signals simultaneously [44,45,46]. Currently GPS/GNSS technology can only be used for vehicles operating in the sea surface environment, such as the Vessel UUV, and further research is needed in order to apply it to the underwater environment. Furthermore, the fourth system introduced in this paper is the use of sound waves to determine the position and speed of the UUV using an acoustic navigation system (ANS) [47]. Acoustic signals can be measured by measuring the time delay or the Doppler shift [48]. To track the position and orientation of the UUV, the last or fifth system is the use of visual odometry (VO) [49]. UUV localization optimization can be improved by integrating navigation systems, various sensors, and other data sources, as mentioned above. In summary, the key point is that GNSS can provide absolute position measurements, while INS and DVL can provide accurate speed measurements. This integration is referred to as sensor fusion, i.e., when sensors and data sources are integrated in one unit.
The primary source of energy for most unmanned underwater vehicle is batteries [50]. Depending on the specific application and mission requirements, these batteries can be rechargeable or disposable. UUVs have also used fuel cells [51], hydrogen [52], and solar panels [53], which require cooperative control systems to harvest solar energy continuously if the energy source battery backup is low. The UUV’s energy requirements and supply will be determined by the specific mission and operating conditions, such as mission duration, water depth, and payload type.
Additionally, several studies predict an increase in demand for underwater vehicles in the future [54,55]. The underwater wireless sensor network (UWSN) [56] infrastructure is also being utilized to support the continuity of operation of the UUV which has limitations when operating in water. Because it is supported by air–water boundary communication technology (AWBC) [57,58] and underwater cyber physical system (UCPS) for data collection needs [59,60], it is possible to collaborate on communication and control systems [57,58] for multi-environmental unmanned vehicles. Internet of Underwater Things or (IoUT) localization techniques based on reinforcement learning [61] can be used in collaboration with vessel-based UUVs to collect marine survey information [62]. Several other studies, such as those based on controversy adjudication (CATM) [63], are expected to further improve the effectiveness of UUV operations underwater and eliminate its limitations [64].
While the poor supporting technology in the underwater environment has implications for many things, including difficulties controlling the UUV, reduced situational awareness, difficulty executing missions, and the risk of losing the UUV [54], reliable supporting technology is urgently needed. Furthermore, the entire discussion outlined above opens this survey paper and invites readers to better understand the concept of unmanned vehicles operating underwater, as well as the importance of technological support.
This paper employs state-of-the-art writing, which flows and makes it easy for readers to read, including an introduction, which provides information about unmanned vehicles, their types, communication technology, propulsion and dive systems, control systems, sensors, localization, energy resources, and supplies that support the operation of UUVs under water. It explains the workings of the supporting technology from a technical and a mathematical perspective. We also explain how the literacy survey was conducted, starting with frequently asked research questions, statistical trends, and the keywords used to find articles that support the general and specific statements.
An integrated mathematical approach is then used to discuss the work system of each UUV-supporting technology, including communication technology, propulsion, control systems, sensing, localization, and energy resources. Next, through simulations, the performance of technology supporting UUV operations is simulated. Then, we examine the performance gaps found in research in supporting technology performance, discussing the latest issues such as the implementation of the Thorp model for the distribution of shared resources for communication and energy, as well as a joint-design of USV–UAV–UUV operations for completing a mission that requires future research contributions. Finally, we outline several critical open research challenges for future studies.
The paper is organized as follows: an introduction that covers types of unmanned vehicles, UUV support technology, research contributions, and the state of the art. This is followed by a discussion of related works, including research questions, existing surveys, and statistical trends. Next, a coherent and mathematical approach is used to discuss the UUV work system and conduct a performance simulation. The paper concludes with a discussion on future research directions and a summary of the performance gaps found.
Recent research advances in the field of underwater vehicles encompass various aspects, including sensing, cross-boundary cooperation patterns of autonomous vehicles, optimization of cross-boundary communication utilizing signal propagation theories within water and signal modulation engineering, the adoption of successful models from autonomous vehicle types operating in terrestrial-aerial environments, and the incorporation of deep learning and deterministic Artificial Intelligence technologies. Collectively, these aspects represent future research avenues that can be developed based on what the researcher has presented in this review.
Figure 1 shows the structure of this survey paper more detail.

2. Related Works

In addition to using a correlational method, this survey considers literacy novelty. In order to perform this task, we follow the following steps.
  • Identifying research topics by considering the need for survey contributions, summarizing questions that are frequently asked in similar surveys, etc.;
  • Examining similar survey papers to identify subtopics that have not been reviewed;
  • Searching for answers using general and specific keywords;
  • Identifying future research directions by looking at trends statistically.

3. Research Questions

In this field of research, we are motivated to explore and answer some frequently asked questions (FAQ). These questions are clearly summarized in Table 1.

3.1. Existing Surveys

By comparing FAQs with answers, we provide a summary of statements in other research articles that answer the questions raised, which can be seen clearly in Table 2.

3.2. Keyword Used

As part of this research, general and specific keywords are used to locate supportive references, compile mindmaps, compare studies, search for appropriate research approach models, examine future trends, and determine what contribution is needed in this area of research. References used have a publication year limit of 2017–2023 with a minimum citation level of 2 and are from reputable journals. Keywords are used to identify research directions and support general theoretical and technical statements. For technical discussions, special formulations, and simulations, special keywords are used. As shown in Figure 2, the search results based on general and specific keywords in the field of UUV and its supporting technology are illustrated in a branching graph.

3.3. Statistics Trends

We classify acronyms used as unique identifiers for several studies using search engines and reference management applications. To understand trends in this field of research, we also identify publications by the publisher in the second table. The grouping data is shown in Table 3 and Table 4:

4. UUV Work System

A mission scenario illustrates how an unmanned vehicle works in an underwater environment.

4.1. Underwater Commmunication

In communication systems that use the hexagonal model for localization (buoy) as a ground station transmitter relay, the hexagonal model represents the sphere-shaped Earth, which is mathematically divisible by the hexagonal model. Relay placement by measuring the effective beacon distance is calculated as follows [67]:
C = i = 1 N V n ( i ) V ,
Network coverage ratio is represented by C, summazation volume monitoring area is denoted by V, and monitoring area of node V n ( i ) is denoted as n i . It is assumed that the nodes are equipped with an omidirectional antenna that monitors in all directions (sphere area) which has a radius and is denoted in r s .
The signal transmission system uses a combination of acoustic communication for long-distance transmission at sea depth [9], optical for fast short-range communication in the depths of the sea [10], and radio waves for communication at sea level between the USV, relay station, and ground transmitting station [11]. Additionally, the USV is equipped with a direct electrical [13,14] system that allows for the recharging of UUV swarms operating underwater and a swarm drone carrier with an air–water boundary communication system [29]. Repeating the previous statement that a higher SNR ratio indicates better communication conditions, to calculate the SNR value [29], we proceed with the following:
S N R = ( I r ) 2 σ n 2 ,
where I r is the received light intensity and σ n 2 is the variance of noise within the system. I r can be represented as
I r = I · L t · L c h · A · I s cos ψ .
In the context of the study, the following terms are defined: I represents turbulence-induced channel fading, following a lognormal distribution; L t and L c h denote temperature and channel loss, respectively; I s represents irradiance in the pattern of ideal emission; ψ is the incident angle of the receiving plane; and A represents the active area of the photodiode.
σ n 2 = 2 q P n B
In the given context, the following terms are defined: q is the charge of an electron; P n represents the solar noise power, B denotes the signal bandwidth; and is the responsivity of the photodiode.

4.2. Dive System

A herd of UUVs in the mission scenario consists of three types, each distinguished by its propulsion and dive system. The first UUV is propelled by propellers on all sides, referred to as omnidirectional [15,16,17], and is able to move in any direction to maximize its efficiency. The Buoyancy force generated by the object expressed in newton ( N ) , Δ B o u y a n c y can be represented as:
Δ B o u y a n c y = π × ρ w a t e r × ( D o u t ) 2 4 × L ,
where π is the mathematical constant pi, approximately equal to 3.14159; ρ w a t e r is the density of water expressed in (kg/m3); D o u t is the outer diameter of the submerged object expressed in meters (m); and L is the length of the submerged object expressed in meters (m).
The origin axis of the vehicle is located at the middle of the xy axis and at the bottom of the z-axis. To calculate the center of gravity with respect to the origin axis, the following formula can be used:
M x = i = 0 i = n W i χ X i + W a i χ X a i
M y = i = 0 i = n W i χ Y i + W a i χ Y a i
M z = i = 0 i = n W i χ Z i + W a i χ Z a i .
The following terms are defined in the context of the study: W i , W a i , X i , Y i , Z i , and X a i , Y a i , Z a i represent the weight component, added weight by ballast water, offset of the center of weight component, and added weight component, respectively. For UUVs that utilize an omnidirectional dive system, a visual representation of the system can be observed in Figure 3a.
The second type of UUV uses a hydrojet propulsion system and diving system [22]. Known as a cross-domain vehicle (CDV), this vehicle can operate in both surface and underwater environments because it is equipped with a ballast tank, propulsion system, and rudder. The buoyancy law [68] is used in this approach, which is based on:
Δ B = ( F B F G ) / g = M ρ .
In the given context, the following terms are defined: Δ B represents the net buoyancy in k g ; F G denotes the gravitational force; F B represents the buoyant force exerted by the fluid on the floating object; M is the total mass of the object; ∇ denotes the volume of the fluid displaced by the object; and ρ is the density of the fluid. The rudder is responsible for directing the CDV into three modes of motion, as outlined below.
  • Dynamic model of surface state:
    m U i = P cos θ F cos ( α θ ) F f cos ( β θ ) F r cos ( γ θ ) ,
    m U j = F sin ( α θ ) + F f sin ( β θ ) + F r sin ( γ θ ) + P sin θ G ,
    J k θ = M + F f l f sin β F r l r sin γ .
  • Dynamic model of the underwater state:
    m U i = P cos θ F cos ( α + θ ) F f cos ( β θ ) F r cos ( γ θ ) ,
    m U j = F v cos θ + F f sin ( β θ ) + F r sin ( γ θ ) + P sin θ + G F sin ( α + θ ) ,
    J k θ = F v l v + F f l f sin β F r l r sin γ M .
  • Underwater and surface transition state:
    m U i = P cos θ F cos ( α θ ) F f cos ( β θ ) F r cos ( γ θ ) F v sin θ ,
    m U j = F v cos θ + F f sin ( β θ ) + F r sin ( γ θ ) + P sin θ + F sin ( α + θ ) G ,
    J k θ = F v l v + F f l f sin β + M F r l r sin γ .
Table 5 provides detailed information regarding each symbol and unit. An illustration of a UUV that uses a propulsion system and hydrojet diving is shown in Figure 3b, while Figure 3c illustrates movement maneuvers resulting from the three equations above.
Futhermore, a third type of UUV is the undulating UUV; this means that the UUV is equipped with fins that function simultaneously as a propulsion and diving system. In their study, the authors provided a comprehensive account of the intricate six-degrees-of-freedom (DOF) motion exhibited by the manta ray robot [21]. This encompassing movement involves a spectrum of displacements including longitudinal, sideways, and vertical shifts, in addition to the nuanced roll, pitch, and yaw rotations. The manta ray robot’s overall motion finds representation through elegant flowing vectors: η = [ x , y , z , φ , θ , ψ ] T , v = [ u , v , w , p , q , r ] T , and τ = [ X , Y , Z , K , M , N ] T . Here, η captures the vector describing the robot’s position and attitude in the earth-fixed frame, while v characterizes the body-fixed linear and angular velocity vector. The intricate interplay of forces and moments acting on the robot within the body-fixed frame is succinctly described by τ , as depicted in Figure 4. By assuming the robot’s movement takes place in an ideal fluid at a consistent velocity of V 0 and by disregarding the effects of water’s viscosity and inertia, the equations governing the robot’s motion are elegantly simplified, particularly in the vertical plane.
m u = ( G B ) sin θ F X
m w = ( G B ) cos θ F Z
B = B 0 + Δ B
G = G 0 + Δ G
F X = 1 2 ρ u 2 S x C x
F Z = 1 2 ρ w 2 S y C y
The intricate interplay of forces and factors influencing the manta ray robot’s behavior is encapsulated by a set of key variables. These include G, representing the robot’s gravitational force; G 0 , which captures the robot’s gravity in the absence of the mass block; and Δ G , signifying the gravitational impact of the mass block itself. Furthermore, the buoyant forces at play are delineated by B, indicating general buoyancy; B 0 , reflecting the buoyancy when equated to the robot’s gravity; and Δ B , representing an adjustable buoyancy component. Within this fluid dynamic context, F X and F Z step forward as vital descriptors of fluid resistances acting along the x-axis. The fundamental physical attributes of the robot and its environment are given voice by m denoting the robot’s mass and ρ standing for the water density. The geometric characteristics of the robot are encapsulated by S x and S y , the maximum transverse and longitudinal cross-sectional areas, while the nuanced hydrodynamics are unveiled by C x and C y , the hydrodynamic parameters that contribute to the robot’s interaction with its surroundings. Each of these variables weaves together to define the intricate dance of forces and dynamics that shape the manta ray robot’s journey. Refer to Figure 3d for a visualization of the propulsion and undulating diving system.

4.3. Control

The first drone used a model-predictive-control algorithm to set the maneuvers and trajectory of the herd UUV, which predicts future behavior and optimizes a control action based on that prediction. According to Saback et al. [24] and Heshmati-Alamdari et al. [68], whose logic flow employs a discrete-time form:
x k + 1 = f ( x k , τ k ) x k + 1 = x k + Λ ( x k ) d t + ( τ k ) d t ,
where
Λ ( x k ) = u r k cos ( ψ k ) v r k sin ( ψ k ) + u c τ u r k sin ( ψ k ) + v r k cos ( ψ k ) + v c τ w r k + w c τ r r k 1 m 11 ( m 22 v r k r r k + X u u r k + X u | u | | u r k | u r k ) 1 m 22 ( m 11 u r k r r k + Y v v r k + Y v | v | | v r k | v r k ) 1 m 33 ( Z w w r k m 22 u r k v r k + Z w | w | | w r k | w r k ) 1 m 44 ( ( m 11 m 22 ) u r k v r k + N r r r k ) + N r | r | | r r k | r r k
( τ k ) = 0 4 × 1 T A τ k .
x k = [ η k T , v r k T ] T R 8 represents the state vector at time step k, which includes the position and orientation of the vehicle with respect to the inertial frame τ , and the relative linear and angular velocity of the vehicle with respect to the water. m 11 , i = 1 , , 4 , X u , Y v , Z w , N r < 0 , X u | u | , Y v | v | , Z w | w | , N r | r | > 0 , and d t denote the mass terms, linear, and quadratic drag terms, and sampling period, respectively. The control input of the system is τ k = [ τ p k , τ s k , τ v k , τ l k ] T R 4 , representing the thrusters’ forces. Ocean current profile uncertainties are presented by δ k = [ 0 1 × 4 , δ u k , δ v k , δ w k , δ r k ] T D R 8 , with D being a compact set and | | δ k | | δ . The perturbed system is modeled by taking into consideration the disturbances caused by ocean current profile uncertainties and dynamic parameter uncertainties denoted by Δ f ( x k , τ k ) . The vehicle’s dynamic parameters are assumed to have been identified through a proper identification scheme.
x k + 1 = f ( x k , τ k ) + δ k = f ( x k , τ k ) + Δ f ( x k , τ k ) + δ k = f ( x k , τ k ) + γ k + δ k
where
γ k = Δ f ( x k , τ k ) T , | | γ k | | γ x k X , τ k T ,
where T is the compact set of uncertainties bounded by γ 0 .
x k + 1 = f ( x k , τ k ) + w k
Let w k = γ k + δ k W R 8 be the vector of uncertainties and external disturbances affecting the system. W is a compact set, defined as W = D T , where D and T are also compact sets. Hence, W is bounded by | | w k | | w , where w = Δ y + δ . The dynamical equation of the system includes the vector of disturbances. However, for the nominal model, we neglect the effect of disturbances.
Employing a sliding-mode control algorithm, the second drone distinguishes itself through the implementation of a nonlinear control strategy. This strategy, characterized by its simplified logical framework, stands resilient against various disturbances and uncertainties that might arise during operation. The foundation of this innovative approach is rooted in the insightful work of Qiao et al., who have introduced a significant advancement in trajectory tracking control. Referred to as the fast integral terminal sliding mode control (FITSM) method, it represents a refined iteration of the ITSM method, as discussed in their authoritative references [25]. This amalgamation of cutting-edge techniques underscores the second drone’s prowess in achieving precise and robust control, poised to navigate challenges with a balanced blend of sophistication and adaptability.
s ( t ) = e ( t ) + α e I ( t ) ,
e I ( t ) = e m / n ( t ) , with e I ( 0 ) = α 1 e ( 0 ) .
In the context of this control framework, let us denote e ( t ) R as the tracking error, where its significance cannot be understated. To further shape the dynamics, a positive constant α is introduced, playing a pivotal role in influencing the system’s behavior. Additionally, we introduce the integers m and n, both of which are odd, with a clear constraint ensuring that n holds a greater value than m, and both remain greater than zero. The interplay of these elements intertwines to orchestrate a controlled system marked by intricate relationships and carefully orchestrated dynamics.
In the scenario where s ( t ) remains consistently at zero, effectively dictating that e ( t ) takes on the form α e I ( t ) , a fascinating consequence unfolds within the realm of the fractional integrator. Under these conditions, the fractional integrator demonstrates its distinctive behavior and characteristics, showcasing the remarkable interplay between the components involved. This alignment not only offers insights into the system’s response but also unveils a unique facet of the fractional integration process that emerges when specific constraints are meticulously maintained.
e I ( t ) = α m / n e I m / n ( t )
The solution to the error dynamic provides crucial insights into the behavior and evolution of the system, unraveling the intricate interplay of variables and shedding light on its underlying dynamics.
e I ( t ) = [ e I 1 m / n ( 0 ) α m / n ( 1 m / n ) t ] 1 / ( 1 m / n )
Subsequently, the time at which e I ( t ) achieves convergence is determined, yielding a fundamental understanding of the temporal aspect of this critical variable’s behavior.
t r = e I ( 0 ) 1 m / n α m / n ( 1 m / n ) = e ( 0 ) 1 m / n α ( 1 m / n )
The convergence of the tracking error e ( t ) to the ITSM surface s ( t ) = 0 is achieved within a finite timeframe under the condition e ( t ) = α e I ( t ) . This pivotal observation encapsulates the essence of the FITSM approach, characterizing it as a dynamic system where the interplay of variables culminates in this precise convergence scenario.
s ( t ) = e ( t ) + α e I ( t )
e ˙ I ( t ) = e ( t ) + β e m / n ( t ) , with e I ( 0 ) = α 1 e ( 0 )
On the FITSM surface, s ( t ) = 0 (i.e., e ( t ) = α e I ( t ) ), with β > 1 and other parameters defined as in the ITSM. The integrator is equivalent to
e ˙ I ( t ) = α e I ( t ) α m / n β e I m / n ( t ) .
We adapt Chu et al.’s approach presented in [69] for developing a nervous system-based control system for AUVs using DRL-based control. This control system transforms local environmental information into an array S 1 = ( s 1 , s 2 ) , where s 1 represents the direction of the ocean current.
s 1 = X X X X n × n ,
where, X [ 0 , 360 ] and s 1 represent the ocean current direction, while s 2 is a matrix with information on obstacles and ocean currents. To ensure AUV safety, we define a forbidden area around each obstacle considering changing ocean current directions and eddy currents.
s 2 = 3 3 3 3 3 2 2 2 3 1 1 1 1 1 3 1 2 1 n × n ,
where “1” represents the obstacle area; “2” indicates the prohibited zone; and “3” is the navigation region. The navigation state vector, S 2 = ( ϑ 1 , s 1 , s 2 , υ 1 ) , represents the angle between vector α and β , where α and β depict the points from the current and initial locations to the destination, respectively. This crucial value can be acquired through the following method:
ϑ 1 = cos 1 α · β α · β .
The allocation of the destination within the AUV coordinate system is succinctly represented by the direction variables ( s 1 , s 2 ) , encapsulating the spatial arrangement of the target point. This system is meticulously defined as follows:
( s 1 , s 2 ) = ( 0 , 0 ) The first quadrant ( 0 , 1 ) The second quadrant ( 1 , 0 ) The third quadrant ( 1 , 1 ) The fourth quadrant .

4.4. Sensing

The underwater unmanned vehicle (UUV) is outfitted with an array of sensors, which encompass passive, active, or fused sensing capabilities, enabling it to perceive the surrounding environment, underwater entities, and fellow UUVs. As detailed in [30], precision in measurements is attainable solely when the target resides within the sonar’s effective field of view. Upon acquiring a set of N measurements during the initial leg, the UUV’s behavior dictates both its operational mode and the corresponding turn angle δ [ 0 , π ] , calculated through the utilization of α ¯ . Operating under a non-preferential turning direction, the vehicle consistently executes right turns, expressed in radians as the turn angle unfolds.
δ ( α ¯ ) = π / 2 , if α ¯ [ 0 , ω 1 ) ( π ω 1 , π ] π / 2 , if α ¯ [ ω 1 , ω 2 ) ( π ω 2 , π ω 1 ] α ¯ ω 1 , if α ¯ [ ω 2 , π ω 2 ]
The array configuration follows a structured pattern: the initial row corresponds to the first leg, the subsequent row pertains to the second leg, and the final row is designated for the broadside target. This systematic arrangement effectively organizes the data collected. To visualize the operational process of the system, refer to Figure 4a, which visually captures the step-by-step functioning of the system.
Song et al. [34] suggested using a color screening filter based on hue–saturation value (HSV) to detect oil leaks. However, RGB color space, which is commonly used in optical displays, is not accurate enough for oil spill segmentation. In HSV space, the video can be converted to screen the oil spill region under the foreground mask. The computation methodologies for the S and V channels are well-defined: S is determined as v min ( R , G , B ) , while V is calculated as m a x ( R , G , B ) . Equally integral is the calculation of the H channel, which follows the subsequent process:
H = 60 ( G B ) / ( V min ( R , G , B ) ) if V = R 60 ( B R ) / ( V min ( R , G , B ) ) + 120 if V = G 60 ( R G ) / ( V min ( R , G , B ) ) + 240 if V = B .
By applying the threshold screening process to the HSV model, areas suspected of being affected by oil spills can be described effectively using the following equation:
M a s k i = 1 , T ̲ i I i T ¯ i 0 , others .
The process involves setting lower threshold T ̲ i and upper threshold T ¯ i values for each color channel. These thresholds are applied to individual pixel values, denoted as I i , within the HSV color space. The resultant mask pixel value is assigned as 1 if and only if the pixel values across all three channels satisfy the threshold conditions; otherwise, it is assigned a value of 0. For a more comprehensive understanding of the HSV concept, refer to Figure 4b, which provides a visual elucidation of the HSV model’s intricacies. This visual aid serves to enhance clarity in grasping the nuances of HSV-based thresholding.
Employing the HSV extraction method within the realm of autonomous intelligence for autonomous underwater vehicles (AUVs) holds profound significance. This technique empowers AUVs to not only detect but also comprehend intricate color details present within their aquatic surroundings. Such an ability proves indispensable for the AUVs’ capacity to conduct thorough and insightful analyses of the underwater environment, thereby enhancing their overall capabilities and contributions to underwater exploration and research. AUV can detect objects based on distinctive color patterns, understand its surroundings, aid in navigation and obstacle avoidance, and enhance underwater observation and monitoring. Machine learning techniques can also be used for color-based object recognition, identifying environmental changes, and predicting environmental conditions. The development of autonomous intelligence through the combination of HSV extraction and Machine Learning holds the potential to improve AUV’s adaptability and interaction with the underwater environment, enhancing AUV’s mission performance in various applications, such as resource exploration, marine environmental monitoring, and scientific research beneath the ocean’s surface. More about the potential use of Machine Learning in AUV operations is discussed in the future research directions chapter.

4.5. Localization

We use two models for UUV localization. The first model, adapted from Braginsky et al. [42], uses the Doppler velocity log (DVL) method. DVL sends out acoustic beams and measures the Doppler frequency shift to compute the velocity and direction of each beam. Relevant definitions and calculations are as follows: R b n is the rotation matrix defined by Euler angles ( ϕ , θ , ψ ) .
R b n ( ϕ , θ , ψ ) = c θ c ψ s ϕ s θ c ψ c ϕ s ψ c ϕ s θ c ψ + s ϕ s ψ c θ s ψ s ϕ s θ s ψ + c ϕ c ψ c ϕ s θ s ψ s ϕ c ψ s θ s ϕ c θ c ϕ c θ
Using the DVL method for UUV localization involves two models. The first sends out acoustic beams and measures the Doppler frequency shift for each beam to compute velocity and direction. To transform a vector from body-fixed to DVL coordinates, we use the following coordinate transformation with c α = cos ( α ) and s ( α ) . Correction of DVL measurement requires considering seafloor-to-platform angles during velocity calculations. Assuming the local seafloor is represented by the plane equation z i = a + b x i + c y i for i = [ 1 4 ] representing the DVL’s four altitude measurements, the measurement can be expressed in matrix form.
z = A a b c T .
Using the seafloor equation and linear algebra, we estimate angles ϕ ^ and θ ^ s . Figure 5a provides an illustration of the DVL and its measurement.
We are demonstrating GPS- or GNSS-based location techniques for unmanned surface vehicles (USV). However, GPS measurements in water are inaccurate and misleading. According to Jiang et al. [43], GPS works on the principle of 2D Cartesian coordinates ( x , y ) and their respective covariances, using Universal Transverse Mercator (UTM) from the World Geodetic System (WGS84) ellipsoid. This theory is illustrated in Figure 5b.
Measurement by GPS z t G P S provides the position and orientation parameters written in the equation:
z t GPS = μ GPS μ θ GPS , Σ GPS 0 0 σ θ GPS , μ GPS = μ x GPS μ y GPS , Σ GPS = σ x GPS 2 σ x y GPS σ x y GPS σ y GPS 2 .
Assuming that position ( x , y ) and orientation ( θ ) follow a Gaussian probability density function (PDF), the posterior given a GPS reading can be obtained according to the following:
p ( x t z t GPS ) p ( z t GPS x t ) · p ( x t ) = f ( x , y ) · f WN ( θ ) · p ( x t ) ,
where the PDF for the position is in
f ( x , y ) = 1 2 π Σ GPS 1 / 2 e 1 2 x μ x GPS y μ y GPS T Σ GPS 1 x μ x GPS y μ y GPS ,
and the PDF corresponding to the orientation angle, which follows a wrapped normal distribution:
f WN ( θ ) = 1 σ θ GPS 2 π k = e ( θ μ θ GPS + 2 π k ) 2 / 2 σ θ GPS 2 .

4.6. Energy Supply

In addition to internal battery power, UUVs can utilize potential renewable energy sources in the aquatic environment. Baik et al. [51], Sezgin et al. [52], and Tian et al. [53] have explored this topic, and we summarize their findings in Table 6.
Lindsay et al. [59] and Fang et al. [63,64] suggest using track lines and a collaborative approach with unmanned underwater vehicles and systemized underwater communication resources to improve energy efficiency during underwater survey missions.
We propose using UAVs equipped with reconfigurable intelligence surface (RIS) devices [70,71] as communication relays to expand coverage to previously unreachable water areas.
The joint operation scenario for UAV, USV, and UUV is shown in Figure 6 and summarized in Table 7.
In a series of sequentially arranged mission illustrations, we can form a comprehensive overview of potential collaboration patterns in the execution of missions involving various types of unmanned vehicles (Unmanned Aerial Vehicle (UAV); Unmanned Surface Vehicle (USV); and Unmanned Underwater Vehicle (UUV)). This concept is supported by networking and communication resources operating both underwater and on the surface. This collaborative approach integrates diverse unmanned vehicle platforms and holds the potential to revolutionize cross-domain mission execution.
Previous research references have discussed the benefits of each type of unmanned vehicle separately within the contexts of maritime and aerial missions. UAVs prove valuable for aerial monitoring and data collection, USVs are suitable for surface water monitoring and patrols, and UUVs can perform exploration and reconnaissance in underwater depths. However, to optimize these potentials, the integration of these elements into a coordinated framework is necessary.
In the described scenario, cooperation between UAVs, USVs, and UUVs is facilitated by a robust network and communication infrastructure in both the air and water environments. This enables these vehicles to share real-time information, coordinate movements, and execute complementary tasks across various environmental layers. For instance, UAVs can gather data from the air and transmit them to USVs on the surface, which can then direct UUVs to conduct further surveys in the ocean depths.
The application of this concept holds extensive potential, ranging from environmental monitoring missions, military reconnaissance, and exploration of marine resources to disaster response in maritime settings. By harnessing the strengths of various types of unmanned vehicles and the support of cross-air and water communication networks, we can create an adaptable, responsive, and efficient system for cross-domain missions. In conclusion, through the amalgamation of ideas from various preceding research references, we have delineated a comprehensive vision of how collaboration among unmanned vehicles, supported by cross-air and water communication networks, can shape new working paradigms in solving cross-domain missions. This concept harbors substantial potential for optimizing resource utilization, expanding operational scope, and delivering innovative solutions to diverse challenges in both maritime and aerial environments.

5. Performance Simulations

The previous section described a swarm of UUVs and their six leading supporting technologies: underwater communication; dive system; control; sensing; localization; and energy supply. These technologies are computationally simulated to estimate malfunctions and performance gaps.

5.1. Underwater Communication

In the introduction to this paper, we stated our aim to achieve a minimum B E R and maximum S N R for the communication system [6]. Direct communication is ideal for achieving this, while other methods such as acoustic communication have a long transmission time [72], optical communication has a short range [10,73], and wireless radio and satellite communications experience high attenuation in water.
We assumed that wired communication is the best alternative with low SNR and BER. However, it lacks flexibility. Optical communication is the second-best option with low SNR and BER, but it has limited range. On the other hand, the most equitable and feasible alternative for use is the acoustic communication model, which is directly transmitted underwater. Wireless and satellite communications perform poorly because they still require intermediary media to connect between the aerial and underwater domains.

5.2. Dive System

A diving system’s performance is measured by synchronizing the required energy with the resulting buoyancy. It uses the δ i = ( i t W i b W ) approach, where δ i is a coefficient attitude-dependent magnitude of the moment produced by any offset between the center of mass ( i t ) and buoyancy ( i b ), and (W) is the weight of the vehicle [15,19]. This statement is supported by the simulation results shown in Figure 7.

5.3. Control

The accuracy of the control system can be measured by the unmanned vehicle’s ability to follow a predetermined path using Cartesian coordinates ( X , Y , Z ) . The path-following controller’s goal is to enable autonomous navigation through a series of waypoints represented by a vector p k , defined by the equation ω k = [ x p k , y p k , z p k , V p k ] . The KPIs for the control system are V p k , which are shown in the simulation results in Figure 8.

5.4. Sensing

The UUV sensing performance, simulated as in Song et al. [35], converts environmental parameters into hue–saturation value (HSV) images for easy recognition via binary computing systems. The HSV threshold values T ̲ i and T ¯ i are set for each color channel, and the pixel value on the mask is 1 only when the pixel values on all three channels meet the threshold requirements. This is illustrated in Figure 9.

5.5. Localization

Localization performance is indicated by the ability to identify UUV position and orientation [43], with the GPS reading represented as p ( x t z t G P S ) ! p ( z t G P S x t ) · p ( x t ) = f ( x , y ) · f W N ( θ ) · p ( x t ) . This is supported by simulation results in Figure 10.

5.6. Energy Supply

UUV battery performance depends on ambient temperature during charging. Low temperatures can reduce capacity, while high temperatures can increase battery aging and shorten lifespan. The equation P l o a d = ( R e ( Z r 0 ) ) I p 2 = ω 0 M 2 L s I P 2 Q s (Teeneti et al. [15]) can be modified by adding temperature ( T ) , as P l o a d = ( R e ( Z r 0 ) ) I p 2 = ω 0 M 2 L s I P 2 Q s · T . Figure 11 shows the optimal temperature range for storage capacity and lifespan.

6. Performance Gaps

This research takes a general approach to the field of underwater vehicles and communications with the aim of identifying gaps for further investigation.
  • Currently, underwater communication technology lacks a description of actual underwater signal conditions and instead relies on calculated approaches using existing research and surveys.
  • We only simulate buoyancy and its energy requirements, without making comparisons.
  • We have only measured UUV control system effectiveness based on time. However, we have not compared models using other parameters such as system autonomy or algorithm capabilities during system failure. Additionally, the optimal control algorithm should trace the shortest path based on our assumptions.
  • We use the HSV method to convert environmental parameters into computer-readable notations of 0 and 1. However, due to the complex underwater environment and its impact on sensing functions, more research is necessary to identify additional parameters.
  • Underwater localization technology only tracks GPS locations, identifying ( x , y ) position and θ orientation. Real-time, accurate positions of underwater vehicles require consideration of factors such as speed and orientation, whether diving or floating. Combining sensor functions to form an IMU and calculate position with GPS is also worth considering. Therefore, further research on this topic is needed.
  • Simulations provided an overview of the ambient temperature’s effect on the vehicle’s state of charge capability for energy supply. However, further simulations are necessary, including battery life calculations, as underwater vehicles operate remotely and system failures due to power outages can be challenging to evacuate. Therefore, more research is required on this topic.

7. Future Research Directions

The study analyzes the performance gap between UUV operation support technology and the latest research in the field. Further research on resource management, including communication, dive system, control, sensing, localization, and energy supply, is being considered. The Throp model approach, adapted from Menaka et al. [74] and the CATM model by Jiang et al. [65], is used to optimize UUV operational capabilities using energy network infrastructure resources, communication, and underwater environment monitoring. Menaka [74] emphasizes the importance of resource management in communication and underwater vehicle research, which will become the backbone of future sea-related research. The study by Jiang et al. [65] supports this claim. Mathematical and computer simulations are conducted using IoUT-assisted underwater communication and sensing resource-sharing management.
In future research, we will propose joint operations of AUV, UUV, and USV, optimize the air–water boundary communication model [29], and model the use of reconfigurable intelligence surfaces (RIS) in AUVs to support these joint operations [71].
In the implementation of UUV operations, it is possible that Doppler effect may occur, similar to what happens in mobile cellular communication. This is due to the changes in the location and distance between the transmitter (TX) and receiver (RX) as the UUV moves relative to such changes. The extent of the impact of this can be calculated using basic mathematical approaches:
f D = v ± v d v ± v s f S ,
where f D is the detected frequency; f S is the frequency emitted by the source; v is the speed of sound waves through the underwater environment; v D is the relative detector speed with respect to the underwater environment; and v S is the speed of sound waves. A simple illustration is that there is a stronger frequency change as the source approaches the detector, and the opposite occurs as the source moves away. The values of the other parameters will automatically adjust to this phenomenon.
Some studies have anticipated this phenomenon and offered solutions, such as Li et al. [75] who also discuss the Doppler shift phenomenon in underwater acoustic (UWA) communication and propose a multicarrier orthogonal frequency division multiplexing (OFDM) communication system to overcome this challenge. Furthermore, Abdelkareem et al. [76] offer a Doppler shift compensation scheme by modifying the carrier frequency of OFDM subcarriers to match the Doppler shift frequency. In the study by Li et al. [75], an experiment was conducted using different numbers of subcarriers—512, 1024, and 2048—each with the corresponding number of active subcarriers: 484, 968, and 1936, respectively. The experiment focused on bit rates, employing a fixed guard interval of T g = 25 and an OFDM block duration T representing values of 42.8, 85.38, and 170.73, respectively. For these setups, the bit rates without coding resulted in 10.52 kb/s, 12.90 kb/s, and 14.55 kb/s. Furthermore, after applying a rate 2/3 channel coding, the bit rates were observed to 7.0 kb/s, 8.6 kb/s, and 9.7 kb/s, respectively [75].
From the observation above, it can be concluded that the working mechanism of OFDM multicarrier is capable of addressing the classic issue of Doppler shift, as indicated by the constant interval. However, there are certain concerns related to the limitations of this approach. Therefore, an examination of the Doppler effect, its implications, and strategies by which to mitigate it should also be included as part of future research directions in the field of unmanned underwater vehicles.
In addition to future issues regarding the technologies that can be integrated into AUV operations, there are also concerns about potential applications that may arise in the future given the rapid and advancing field of research. We predict that with the development of communication technology and the increasing demands in underwater vehicle research for various purposes such as resource exploration, marine environmental monitoring, and scientific research, there may also be a demand for research in the field of maritime transportation assisted by underwater vehicles, autonomous surface vehicles, and the utilization of Artificial Intelligence technology. Due to the limited references on the utilization of underwater vehicles, autonomous surface vehicles, and Artificial Intelligence technology, we have drawn some references from similar research fields applied to different devices and environments, such as the use of autonomous aerial vehicles in some case studies, including unmanned transportation options equipped with cognitive awareness capabilities that enable UAVs to actively recognize and understand their surroundings, making smarter and more responsive decisions in various situations, and studies using UAVs for autonomous traffic monitoring and management assisted by Artificial Intelligence.
Among the researchers examining and presenting their findings are Filippone et al. [77], who discussed the developments in urban air mobility and the use of rotorcraft as air transportation options in urban areas. Furthermore, Barmpounakis et al. [78] conducted a review on the application of unmanned aerial vehicle systems in transportation engineering, covering current practices and future challenges. Additionally, Cavaliere et al. [79] researched the development of proactive Unmanned Aerial Vehicles (UAVs) to enhance cognitive contextual awareness, aiming to integrate Artificial Intelligence and data processing technologies to enable UAVs to actively recognize and understand their surroundings, making smarter and more responsive decisions in various situations, including obstacle avoidance and mission adaptation based on environmental changes. Vlahogianni et al. [80] conducted research on model-free traffic condition identification using unmanned aerial vehicles (UAVs) and deep learning, developing a data processing model for traffic analysis from aerial perspectives and training deep learning algorithms to recognize traffic density patterns. Moreover, Trivedi et al. [81] developed a real-time vision-based vehicle detection and speed measurement system using morphology and binary logical operations. The research aims to create a method capable of accurately detecting vehicles in real time using visual data from cameras and accurately measuring vehicle speeds based on inter-frame movement, achieved by combining morphology and binary logical operation techniques.
If successfully implemented in terrestrial and aerial environments, the possibility of applying these techniques to surface and underwater environments in the case of autonomous underwater vehicles may also be feasible. However, researchers must also address factors that could lead to system and operational failures, considering the unique underwater environment distinct from other environments.
Furthermore, the development of applying Machine Learning for optimization across various sectors involving computation is also predicted to have an impact on the research and development of unmanned underwater vehicles. Several studies supporting this statement include Teng et al. [82], who investigated underwater target recognition methods based on deep learning frameworks (DL); Bhopale et al. [83], who developed obstacle avoidance systems based on reinforcement learning (RL) for autonomous underwater vehicles (AUVs); and Sands and Timothy [84], who developed deterministic Artificial Intelligence (AI) for unmanned underwater vehicles, where “deterministic” signifies that decisions made by the AI system possess a high degree of certainty and definiteness. This leverages predictability and consistency in the behavior of the AI system, implying that it produces identical responses or actions when confronted with the same situation.
Research by Sun et al. [85] involved developing a three-dimensional path tracking control system for autonomous underwater vehicles using a deep reinforcement learning (DRL) approach. Another study by Sun et al. [86] focused on mapless motion planning systems for AUVs using a policy gradient-based DRL approach. The main emphasis of policy gradient-based methods is on learning policies that link environmental states to actions that need to be taken by the agent. A notable advantage of this approach is its capability to address continuous action spaces and exhibit stochastic (probabilistic) policies.
From the entire series of reviews, several proposals can be summarized which are expected to be able to overcome common problems and issues regarding research in the field of unmanned underwater vehicles, among others shown in Table 8.

8. Conclusions

From the overall discussion above, several conclusions can be drawn by the researchers.
First, the prospects for the research and development of autonomous underwater vehicles (AUVs) in the future heavily rely on technological support. Collaborative communication technology capable of overcoming the limitations of signal transmission across air and water or signal transmission at water depths, utilizing support from the underwater communication network infrastructure, is crucial. It is essential for UUVs to have energy-efficient propulsion systems, sustainable power supply, reliable navigation control, and robust sensing capabilities, as the success of missions depends on these technological supports, as demonstrated in several simulations where efficiency and optimization are the primary focus of attention.
Second, resource management can enhance efficiency, and with good resource management supported by available infrastructure, joint operations involving AUVs, USVs, and UUVs can be deployed simultaneously.
Third, future research is likely to focus on implementing new technologies that can potentially be integrated to address research barriers and challenges. The application of autonomous underwater vehicles similar to autonomous vehicles operating on land and in the air can be considered by exploring new theories and utilizing the currently available technological support, including underwater communication technology and Artificial Intelligence.

Author Contributions

This article was prepared through the collective efforts of all the authors. Conceptualization, A.W., M.J.P., H.-K.S. and B.M.L.; writing—original draft, A.W. and M.J.P.; writing—review and editing, A.W., M.J.P., H.-K.S. and B.M.L. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (Grant No.: NRF-2020R1A6A1A03038540) and the Korean government (MSIT) (Grant No.: NRF-2023R1A2C1002656).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Specht, C.; Lewicka, O.; Specht, M.; Dąbrowski, P.; Burdziakowski, P. Methodology for Carrying out Measurements of the Tombolo Geomorphic Landform Using Unmanned Aerial and Surface Vehicles near Sopot Pier, Poland. J. Mar. Sci. Eng. 2020, 8, 384. [Google Scholar] [CrossRef]
  2. Tyrsa, V.; Carrio, A.; Sampredo, C.; Rodriguez-Ramos, A.; Campoy, P. A Review of Deep Learning Methods and Applications for Unmanned Aerial Vehicles. J. Sensors 2017, 2017, 3296874. [Google Scholar] [CrossRef]
  3. Liu, H.; Lyu, Y.; Lewis, F.L.; Wan, Y. Robust time-varying formation control for multiple underwater vehicles subject to nonlinearities and uncertainties. Int. J. Robust Nonlinear Control 2019, 29, 2712–2724. [Google Scholar] [CrossRef]
  4. Liu, D.; Wang, S.; Wen, Z.; Cheng, L. Edge Learning With Unmanned Ground Vehicle: Joint Path, Energy, and Sample Size Planning. IEEE Internet Things J. 2021, 8, 2959–2975. [Google Scholar] [CrossRef]
  5. Hooey, B.L.; Kaber, D.B.; Adams, J.A.; Fong, T.W.; Gore, B.F. The Underpinnings of Workload in Unmanned Vehicle Systems. IEEE Trans. Hum. Mach. Syst. 2018, 48, 452–467. [Google Scholar] [CrossRef]
  6. El-Banna, A.A.A.; Wu, K.; ElHalawany, B.M. Opportunistic Cooperative Transmission for Underwater Communication Based on the Water’s Key Physical Variables. IEEE Sens. J. 2020, 20, 2792–2802. [Google Scholar] [CrossRef]
  7. Al Guqhaiman, A.; Akanbi, O.; Aljaedi, A.; Chow, C.E. A Survey on MAC Protocol Approaches for Underwater Wireless Sensor Networks. IEEE Sens. J. 2021, 21, 3916–3932. [Google Scholar] [CrossRef]
  8. Wang, C.; Yu, H.Y.; Zhu, Y.J. A Long Distance Underwater Visible Light Communication System With Single Photon Avalanche Diode. IEEE Photonics J. 2016, 8, 1–11. [Google Scholar] [CrossRef]
  9. Qu, F.; Qin, X.; Yang, L.; Yang, T.C. Spread-Spectrum Method Using Multiple Sequences for Underwater Acoustic Communications. IEEE J. Ocean. Eng. 2018, 43, 1215–1226. [Google Scholar] [CrossRef]
  10. Al-Halafi, A.; Shihada, B. UHD Video Transmission Over Bidirectional Underwater Wireless Optical Communication. IEEE Photonics J. 2018, 10, 1–14. [Google Scholar] [CrossRef]
  11. Gupta, B.D.; Khalid, M.; Ahmad, N.; Arshad, M. A Survey of Routing Issues and Associated Protocols in Underwater Wireless Sensor Networks. J. Sensors 2017, 2017, 7539751. [Google Scholar] [CrossRef]
  12. Gamal, C.; Elsayed, M.; Samir, A.; Tageldien, H.A.; Chatzinotas, S.; Fouda, M.M.; Elhalawany, B.M. Reliability of Spectrum-Efficient Mixed Satellite-Underwater Systems. IEEE Open J. Commun. Soc. 2022, 3, 2237–2244. [Google Scholar] [CrossRef]
  13. Page, B.R.; Mahmoudian, N. Simulation-Driven Optimization of Underwater Docking Station Design. IEEE J. Ocean. Eng. 2020, 45, 404–413. [Google Scholar] [CrossRef]
  14. Teeneti, C.R.; Truscott, T.T.; Beal, D.N.; Pantic, Z. Review of Wireless Charging Systems for Autonomous Underwater Vehicles. IEEE J. Ocean. Eng. 2021, 46, 68–87. [Google Scholar] [CrossRef]
  15. Wang, Z.; Zhou, H.; Wei, Z.; Wei, S.; Yun, H.; Dong, L.; Yu, C.; Yao, B.; Lian, L. Design, Implementation, and Characterization of a Novel Positive Buoyancy Autonomous Vehicle. J. Intell. Robot. Syst. 2022, 104, 62. [Google Scholar] [CrossRef]
  16. Rahimuddin; Hasan, H.; Rivai, H.A.; Iskandar, Y.; Claudio, P. Design of Omni Directional Remotely Operated Vehicle (ROV). J. Phys. Conf. Ser. 2018, 962, 012017. [Google Scholar] [CrossRef]
  17. Lu, D.; Xiong, C.; Zeng, Z.; Lian, L. Adaptive Dynamic Surface Control for a Hybrid Aerial Underwater Vehicle With Parametric Dynamics and Uncertainties. IEEE J. Ocean. Eng. 2020, 45, 740–758. [Google Scholar] [CrossRef]
  18. Sholl, N.; Nelson, K.; Mohseni, K. Autonomous Underwater Vehicle Depth and Pitch Trajectory Tracking Using Fiber-Reinforced Elastomer Bladders for Buoyancy Control. IEEE J. Ocean. Eng. 2022, 47, 690–703. [Google Scholar] [CrossRef]
  19. Song, J.; Zhong, Y.; Du, R.; Yin, L.; Ding, Y. Tail shapes lead to different propulsive mechanisms in the body/caudal fin undulation of fish. Proc. Inst. Mech. Eng. Part C J. Mech. Eng. Sci. 2021, 235, 351–364. [Google Scholar] [CrossRef]
  20. Wang, Z.; Dong, C.; Zhang, Z.; Tian, Q.; Sun, A.; Yuan, L.; Zhang, L. Review of multi-fin propulsion and functional materials of underwater bionic robotic fish. Proc. Inst. Mech. Eng. Part C J. Mech. Eng. Sci. 2022, 236, 7350–7367. [Google Scholar] [CrossRef]
  21. Zhang, D.; Pan, G.; Cao, Y.; Huang, Q.; Cao, Y. A Novel Integrated Gliding and Flapping Propulsion Biomimetic Manta-Ray Robot. J. Mar. Sci. Eng. 2022, 10, 924. [Google Scholar] [CrossRef]
  22. Shi, Z.; Tan, X.; Wang, Y.; Lv, P.; Zou, Y.; Wan, X.; Lv, K.; Li, B.; Duan, H.; Li, H. Experimental Investigation of High Speed Cross-Domain Vehicles with Hydrofoil. J. Mar. Sci. Eng. 2023, 11, 152. [Google Scholar] [CrossRef]
  23. Shi, L.; Hu, Y.; Su, S.; Xing, H.; Hou, X.; Liu, Y.; Chen, Z.; Li, Z.; Xia, D. A Fuzzy PID Algorithm for a Novel Miniature Spherical Robots with Three-dimensional Underwater Motion Control. J. Bionic Eng. 2020, 17, 959–969. [Google Scholar] [CrossRef]
  24. Saback, R.M.; Conceicao, A.G.S.; Santos, T.L.M.; Albiez, J.; Reis, M. Nonlinear Model Predictive Control Applied to an Autonomous Underwater Vehicle. IEEE J. Ocean. Eng. 2020, 45, 799–812. [Google Scholar] [CrossRef]
  25. Qiao, L.; Zhang, W. Double-Loop Integral Terminal Sliding Mode Tracking Control for UUVs With Adaptive Dynamic Compensation of Uncertainties and Disturbances. IEEE J. Ocean. Eng. 2019, 44, 29–53. [Google Scholar] [CrossRef]
  26. Rodriguez, J.; Castaneda, H.; Gordillo, J. Design of an Adaptive Sliding Mode Control for a Micro-AUV Subject to Water Currents and Parametric Uncertainties. J. Mar. Sci. Eng. 2019, 7, 445. [Google Scholar] [CrossRef]
  27. Xi, M.; Yang, J.; Wen, J.; Liu, H.; Li, Y.; Song, H.H. Comprehensive Ocean Information-Enabled AUV Path Planning Via Reinforcement Learning. IEEE Internet Things J. 2022, 9, 17440–17451. [Google Scholar] [CrossRef]
  28. Wu, G.; Xu, T.; Shun, Y.; Zhang, J. Review of multiple unmanned surface vessels collaborative search and hunting based on swarm intelligence. Int. J. Adv. Robot. Syst. 2022, 19, 17298806221091885. [Google Scholar] [CrossRef]
  29. Luo, H.; Wang, J.; Bu, F.; Ruby, R.; Wu, K.; Guo, Z. Recent Progress of Air/Water Cross-Boundary Communications for Underwater Sensor Networks: A Review. IEEE Sens. J. 2022, 22, 8360–8382. [Google Scholar] [CrossRef]
  30. Wolek, A.; Dzikowicz, B.R.; McMahon, J.; Houston, B.H. At-Sea Evaluation of an Underwater Vehicle Behavior for Passive Target Tracking. IEEE J. Ocean. Eng. 2019, 44, 514–523. [Google Scholar] [CrossRef]
  31. Hong, S.; Kim, J. Three-dimensional Visual Mapping of Underwater Ship Hull Surface Using Piecewise-planar SLAM. Int. J. Control. Autom. Syst. 2020, 18, 564–574. [Google Scholar] [CrossRef]
  32. Nakath, D.; She, M.; Song, Y.; Köser, K. An Optical Digital Twin for Underwater Photogrammetry. PFG J. Photogramm. Remote Sens. Geoinf. Sci. 2022, 90, 69–81. [Google Scholar] [CrossRef]
  33. Shahat, A.; Mohamed, M.; Awual, M.R.; Mohamed, S.K. Novel and potential chemical sensors for Au(III) ion detection and recovery in electric waste samples. Microchem. J. 2020, 158, 105312. [Google Scholar] [CrossRef]
  34. Song, H.; Song, J.; Ren, P. Underwater Pipeline Oil Spill Detection Based on Structure of Root and Branch Cells. J. Mar. Sci. Eng. 2020, 8, 1016. [Google Scholar] [CrossRef]
  35. Parra, L.; Lloret, G.; Lloret, J.; Rodilla, M. Physical Sensors for Precision Aquaculture: A Review. IEEE Sens. J. 2018, 18, 3915–3923. [Google Scholar] [CrossRef]
  36. Stateczny, A.; Gronska-Sledz, D.; Motyl, W. Precise Bathymetry as a Step Towards Producing Bathymetric Electronic Navigational Charts for Comparative (Terrain Reference) Navigation. J. Navig. 2019, 72, 1623–1632. [Google Scholar] [CrossRef]
  37. Karmozdi, A.; Hashemi, M.; Salarieh, H.; Alasty, A. INS-DVL Navigation Improvement Using Rotational Motion Dynamic Model of AUV. IEEE Sens. J. 2020, 20, 14329–14336. [Google Scholar] [CrossRef]
  38. Liu, P.; Wang, B.; Deng, Z.; Fu, M. INS/DVL/PS Tightly Coupled Underwater Navigation Method With Limited DVL Measurements. IEEE Sens. J. 2018, 18, 2994–3002. [Google Scholar] [CrossRef]
  39. Davari, N.; Aguiar, A.P. Real-Time Outlier Detection Applied to a Doppler Velocity Log Sensor Based on Hybrid Autoencoder and Recurrent Neural Network. IEEE J. Ocean. Eng. 2021, 46, 1288–1301. [Google Scholar] [CrossRef]
  40. Zhu, J.; Li, A.; Qin, F.; Chang, L.; Qian, L. A Hybrid Method for Dealing with DVL Faults of SINS/DVL Integrated Navigation System. IEEE Sens. J. 2022, 22, 15844–15854. [Google Scholar] [CrossRef]
  41. Klein, I.; Gutnik, Y.; Lipman, Y. Estimating DVL Velocity in Complete Beam Measurement Outage Scenarios. IEEE Sens. J. 2022, 22, 20730–20737. [Google Scholar] [CrossRef]
  42. Braginsky, B.; Baruch, A.; Guterman, H. Correction of DVL Error Caused by Seafloor Gradient. IEEE Sens. J. 2020, 20, 11652–11659. [Google Scholar] [CrossRef]
  43. Perea-Strom, D.; Morell, A.; Toledo, J.; Acosta, L. GNSS Integration in the Localization System of an Autonomous Vehicle Based on Particle Weighting. IEEE Sens. J. 2020, 20, 3314–3323. [Google Scholar] [CrossRef]
  44. Jiang, H.; Li, T.; Song, D.; Shi, C. An Effective Integrity Monitoring Scheme for GNSS/INS/Vision Integration Based on Error State EKF Model. IEEE Sens. J. 2022, 22, 7063–7073. [Google Scholar] [CrossRef]
  45. Sun, R.; Yang, Y.; Chiang, K.W.; Duong, T.T.; Lin, K.Y.; Tsai, G.J. Robust IMU/GPS/VO Integration for Vehicle Navigation in GNSS Degraded Urban Areas. IEEE Sens. J. 2020, 20, 10110–10122. [Google Scholar] [CrossRef]
  46. Liu, Y.; Li, S.; Fu, Q.; Liu, Z.; Zhou, Q. Analysis of Kalman Filter Innovation-Based GNSS Spoofing Detection Method for INS/GNSS Integrated Navigation System. IEEE Sens. J. 2019, 19, 5167–5178. [Google Scholar] [CrossRef]
  47. Kepper, J.H.; Claus, B.C.; Kinsey, J.C. A Navigation Solution Using a MEMS IMU, Model-Based Dead-Reckoning, and One-Way-Travel-Time Acoustic Range Measurements for Autonomous Underwater Vehicles. IEEE J. Ocean. Eng. 2019, 44, 664–682. [Google Scholar] [CrossRef]
  48. Terracciano, D.S.; Costanzi, R.; Manzari, V.; Stifani, M.; Caiti, A. Passive Bearing Estimation Using a 2-D Acoustic Vector Sensor Mounted on a Hybrid Autonomous Underwater Vehicle. IEEE J. Ocean. Eng. 2022, 47, 799–814. [Google Scholar] [CrossRef]
  49. Yin, J.; Zhou, H.; Zhang, H.; Li, C.; Sun, G. Direct Visual Odometry by Fusing Luminosity and Depth Information. J. Phys. Conf. Ser. 2022, 2203, 012004. [Google Scholar] [CrossRef]
  50. Alzu’bi, H.; Mansour, I.; Rawashdeh, O. Loon Copter: Implementation of a hybrid unmanned aquatic–aerial quadcopter with active buoyancy control. J. Field Robot. 2018, 35, 764–778. [Google Scholar] [CrossRef]
  51. Baik, K.D.; Lee, E.H.; Yoon, H.; Kim, J.Y.; Yang, S.H. Effect of multi-hole flow field structure on the performance of H2/O2 polymer electrolyte membrane fuel cells. Int. J. Hydrogen Energy 2019, 44, 25894–25904. [Google Scholar] [CrossRef]
  52. Sezgin, B.; Devrim, Y.; Ozturk, T.; Eroglu, I. Hydrogen energy systems for underwater applications. Int. J. Hydrogen Energy 2022, 47, 19780–19796. [Google Scholar] [CrossRef]
  53. Tian, B.; Yu, J. Current status and prospects of marine renewable energy applied in ocean robots. Int. J. Energy Res. 2019, 43, 2016–2031. [Google Scholar] [CrossRef]
  54. Hou, X.; Wang, J.; Bai, T.; Deng, Y.; Ren, Y.; Hanzo, L. Environment-Aware AUV Trajectory Design and Resource Management for Multi-Tier Underwater Computing. IEEE J. Sel. Areas Commun. 2023, 41, 474–490. [Google Scholar] [CrossRef]
  55. Neira, J.; Sequeiros, C.; Huamani, R.; Machaca, E.; Fonseca, P.; Nina, W. Review on Unmanned Underwater Robotics, Structure Designs, Materials, Sensors, Actuators, and Navigation Control. J. Robot. 2021, 2021, 5542920. [Google Scholar] [CrossRef]
  56. Luo, J.; Yang, Y.; Wang, Z.; Chen, Y. Localization Algorithm for Underwater Sensor Network: A Review. IEEE Internet Things J. 2021, 8, 13126–13144. [Google Scholar] [CrossRef]
  57. Guo, J.; Li, C.; Guo, S. Study on the Autonomous Multirobot Collaborative Control System Based on Spherical Amphibious Robots. IEEE Syst. J. 2021, 15, 4950–4957. [Google Scholar] [CrossRef]
  58. Li, J.H.; Kim, M.G.; Kang, H.; Lee, M.J.; Cho, G.R. UUV Simulation Modeling and its Control Method: Simulation and Experimental Studies. J. Mar. Sci. Eng. 2019, 7, 89. [Google Scholar] [CrossRef]
  59. Lindsay, J.; Ross, J.; Seto, M.L.; Gregson, E.; Moore, A.; Patel, J.; Bauer, R. Collaboration of Heterogeneous Marine Robots Toward Multidomain Sensing and Situational Awareness on Partially Submerged Targets. IEEE J. Ocean. Eng. 2022, 47, 880–894. [Google Scholar] [CrossRef]
  60. Purser, A.; Marcon, Y.; Dreutter, S.; Hoge, U.; Sablotny, B.; Hehemann, L.; Lemburg, J.; Dorschel, B.; Biebow, H.; Boetius, A. Ocean Floor Observation and Bathymetry System (OFOBS): A New Towed Camera/Sonar System for Deep-Sea Habitat Surveys. IEEE J. Ocean. Eng. 2019, 44, 87–99. [Google Scholar] [CrossRef]
  61. Yan, J.; Yang, X.; Luo, X.; Chen, C. Energy-Efficient Data Collection Over AUV-Assisted Underwater Acoustic Sensor Network. IEEE Syst. J. 2018, 12, 3519–3530. [Google Scholar] [CrossRef]
  62. Fang, Z.; Wang, J.; Jiang, C.; Zhang, Q.; Ren, Y. AoI-Inspired Collaborative Information Collection for AUV-Assisted Internet of Underwater Things. IEEE Internet Things J. 2021, 8, 14559–14571. [Google Scholar] [CrossRef]
  63. Jiang, J.; Hua, S.; Han, G.; Li, A.; Lin, C. Controversy-Adjudication-Based Trust Management Mechanism in the Internet of Underwater Things. IEEE Internet Things J. 2023, 10, 2603–2614. [Google Scholar] [CrossRef]
  64. Tiwari, B.K.; Sharma, R. Design and Analysis of a Variable Buoyancy System for Efficient Hovering Control of Underwater Vehicles with State Feedback Controller. J. Mar. Sci. Eng. 2020, 8, 263. [Google Scholar] [CrossRef]
  65. Yan, J.; Gong, Y.; Chen, C.; Luo, X.; Guan, X. AUV-Aided Localization for Internet of Underwater Things: A Reinforcement-Learning-Based Method. IEEE Internet Things J. 2020, 7, 9728–9746. [Google Scholar] [CrossRef]
  66. Fang, Z.; Wang, J.; Du, J.; Hou, X.; Ren, Y.; Han, Z. Stochastic Optimization-Aided Energy-Efficient Information Collection in Internet of Underwater Things Networks. IEEE Internet Things J. 2022, 9, 1775–1789. [Google Scholar] [CrossRef]
  67. Shen, Z.; Yin, H.; Liang, Y.; Maao, R.; Jing, L. A routing-benefited deployment approach combining static and dynamic layouts for underwater optical wireless networks. Int. J. Distrib. Sens. Netw. 2021, 17, 1550147721999614. [Google Scholar] [CrossRef]
  68. Heshmati-Alamdari, S.; Karras, G.C.; Marantos, P.; Kyriakopoulos, K.J. A Robust Predictive Control Approach for Underwater Robotic Vehicles. IEEE Trans. Control. Syst. Technol. 2020, 28, 2352–2363. [Google Scholar] [CrossRef]
  69. Chu, Z.; Wang, F.; Lei, T.; Luo, C. Path Planning Based on Deep Reinforcement Learning for Autonomous Underwater Vehicles Under Ocean Current Disturbance. IEEE Trans. Intell. Veh. 2023, 8, 108–120. [Google Scholar] [CrossRef]
  70. Al-Hilo, A.; Samir, M.; Elhattab, M.; Assi, C.; Sharafeddine, S. RIS-Assisted UAV for Timely Data Collection in IoT Networks. IEEE Syst. J. 2022, 17, 431–442. [Google Scholar] [CrossRef]
  71. Zhao, J.; Zhu, Y.; Mu, X.; Cai, K.; Liu, Y.; Hanzo, L. Simultaneously Transmitting and Reflecting Reconfigurable Intelligent Surface (STAR-RIS) Assisted UAV Communications. IEEE J. Sel. Areas Commun. 2022, 40, 3041–3056. [Google Scholar] [CrossRef]
  72. Zhang, Y.; Venkatesan, R.; Dobre, O.A.; Li, C. Efficient Estimation and Prediction for Sparse Time-Varying Underwater Acoustic Channels. IEEE J. Ocean. Eng. 2020, 45, 1112–1125. [Google Scholar] [CrossRef]
  73. Rahman, Z.; Tailor, N.V.; Zafaruddin, S.M.; Chaubey, V.K. Unified Performance Assessment of Optical Wireless Communication Over Multi-Layer Underwater Channels. IEEE Photonics J. 2022, 14, 1–14. [Google Scholar] [CrossRef]
  74. Menaka, D.; Gauni, S.; Manimegalai, C.T.; Kalimuthu, K. Challenges and vision of wireless optical and acoustic communication in underwater environment. Int. J. Commun. Syst. 2022, 35, e5227. [Google Scholar] [CrossRef]
  75. Li, B.; Zhou, S.; Stojanovic, M.; Freitag, L.; Willet, P. Multicarrier Communication Over Underwater Acoustic Channels With Nonuniform Doppler Shifts. IEEE J. Ocean. Eng. 2008, 33, 198–209. [Google Scholar] [CrossRef]
  76. Abdelkareem, A.; Sharif, B.; Tsimenidis, C.; Neasham, J. Time Varying Doppler-Shift Compensation for OFDM-Based Shallow Underwater Acoustic Communication Systems. In Proceedings of the 8th IEEE International Conference on Mobile Ad-hoc and Sensor Systems, MASS 2011, Denver, CO, USA, 4–7 October 2021; pp. 885–891. [Google Scholar] [CrossRef]
  77. Filippone, A.; Barakos, G. Rotorcraft systems for urban air mobility: A reality check. Aeronaut. J. 2021, 125, 3–21. [Google Scholar] [CrossRef]
  78. Barmpounakis, E.N.; Vlahogianni, E.I.; Golias, J.C. Unmanned Aerial Aircraft Systems for transportation engineering: Current practice and future challenges. Int. J. Transp. Sci. Technol. 2016, 5, 111–122. [Google Scholar] [CrossRef]
  79. Cavaliere, D.; Senatore, S.; Loia, V. Proactive UAVs for Cognitive Contextual Awareness. IEEE Syst. J. 2019, 13, 3568–3579. [Google Scholar] [CrossRef]
  80. Vlahogianni, E.I.; Del Ser, J.; Kepaptsoglou, K.; Lana, I. Model Free Identification of Traffic Conditions Using Unmanned Aerial Vehicles and Deep Learning. J. Big Data Anal. Transp. 2021, 3, 1–13. [Google Scholar] [CrossRef]
  81. Trivedi, J.D.; Mandalapu, S.D.; Dave, D.H. Vision-based real-time vehicle detection and vehicle speed measurement using morphology and binary logical operation. J. Ind. Inf. Integr. 2022, 27, 100280. [Google Scholar] [CrossRef]
  82. Teng, B.; Zhao, H. Underwater target recognition methods based on the framework of deep learning: A survey. Int. J. Adv. Robot. Syst. 2020, 17, 1729881420976307. [Google Scholar] [CrossRef]
  83. Bhopale, P.; Kazi, F.; Singh, N. Reinforcement Learning Based Obstacle Avoidance for Autonomous Underwater Vehicle. J. Mar. Sci. Appl. 2019, 18, 228–238. [Google Scholar] [CrossRef]
  84. Sands, T. Development of Deterministic Artificial Intelligence for Unmanned Underwater Vehicles (UUV). J. Mar. Sci. Eng. 2020, 8, 578. [Google Scholar] [CrossRef]
  85. Sun, Y.; Zhang, C.; Zhang, G.; Xu, H.; Ran, X. Three-Dimensional Path Tracking Control of Autonomous Underwater Vehicle Based on Deep Reinforcement Learning. J. Mar. Sci. Eng. 2019, 7, 443. [Google Scholar] [CrossRef]
  86. Sun, Y.; Cheng, J.; Zhang, G.; Xu, H. Mapless Motion Planning System for an Autonomous Underwater Vehicle Using Policy Gradient-based Deep Reinforcement Learning. J. Intell. Robot. Syst. 2019, 96, 591–601. [Google Scholar] [CrossRef]
Figure 1. Organization of the paper.
Figure 1. Organization of the paper.
Sensors 23 07321 g001
Figure 2. Survey taxonomy based on general to specific keywords.
Figure 2. Survey taxonomy based on general to specific keywords.
Sensors 23 07321 g002
Figure 3. (a) Omnidirectional, (b) hydrojet, (c) hydrojet maneuver and (d) undulating propulsion and dive system [16,21,22].
Figure 3. (a) Omnidirectional, (b) hydrojet, (c) hydrojet maneuver and (d) undulating propulsion and dive system [16,21,22].
Sensors 23 07321 g003
Figure 4. Sensing tracking target involves a sequential process depicted in (a). Initially, upon target detection, the measured aspect angle remains unresolved, as evidenced by both port and starboard rays extending from the vehicle. Subsequent maneuvering and data collection during the second leg facilitate the completion of the resolve-ps-ambiguity behavior, leading to the determination of target orientation. Once resolved, the keep-broadside behavior utilizes the obtained vehicle-relative bearing measurement, indicated by a single ray extending from the vehicle, to effectively track the target’s movements. (b) In the realm of optical sensing, a progression unfolds from the top left to right, followed by a downward transition. The initial view showcases the original image captured. Subsequently, the HSV image processing unveils a distinct perspective, enabling the extraction of key color information. Finally, the journey culminates in the presentation of color masks, representing specific regions of interest and aiding in targeted analysis. This holistic sensing approach harmonizes various stages of processing, culminating in a comprehensive understanding of the tracked target’s dynamics and optical properties [30,34].
Figure 4. Sensing tracking target involves a sequential process depicted in (a). Initially, upon target detection, the measured aspect angle remains unresolved, as evidenced by both port and starboard rays extending from the vehicle. Subsequent maneuvering and data collection during the second leg facilitate the completion of the resolve-ps-ambiguity behavior, leading to the determination of target orientation. Once resolved, the keep-broadside behavior utilizes the obtained vehicle-relative bearing measurement, indicated by a single ray extending from the vehicle, to effectively track the target’s movements. (b) In the realm of optical sensing, a progression unfolds from the top left to right, followed by a downward transition. The initial view showcases the original image captured. Subsequently, the HSV image processing unveils a distinct perspective, enabling the extraction of key color information. Finally, the journey culminates in the presentation of color masks, representing specific regions of interest and aiding in targeted analysis. This holistic sensing approach harmonizes various stages of processing, culminating in a comprehensive understanding of the tracked target’s dynamics and optical properties [30,34].
Sensors 23 07321 g004
Figure 5. (a) Two-dimensional seafloor example. The blue line represents the DVL signal that performs seafloor measurements and estimates. (b) GPS–GNSS Work [42].
Figure 5. (a) Two-dimensional seafloor example. The blue line represents the DVL signal that performs seafloor measurements and estimates. (b) GPS–GNSS Work [42].
Sensors 23 07321 g005
Figure 6. Scenario joint-operation: UAV, USV, UUV.
Figure 6. Scenario joint-operation: UAV, USV, UUV.
Sensors 23 07321 g006
Figure 7. Simulation of a diving system using the law of buoyancy: δ i = ( i t W i b W ) approach, where δ i is a coefficient attitude-dependent magnitude of the moment produced by any offset between the center of mass ( i t ) and buoyancy ( i b ) and (W) is the weight of the vehicle.
Figure 7. Simulation of a diving system using the law of buoyancy: δ i = ( i t W i b W ) approach, where δ i is a coefficient attitude-dependent magnitude of the moment produced by any offset between the center of mass ( i t ) and buoyancy ( i b ) and (W) is the weight of the vehicle.
Sensors 23 07321 g007
Figure 8. Control system: these waypoints, represented by a vector p k , can be written in the equation ω k = [ x p k , y p k , z p k , V p k ] , where x p k , y p k , and z p k are the absolute coordinates of the waypoints in the environment frame. V p k is the desired norm of the AUV velocity vector (mostly surge and dive) at the considered waypoint (can be 0).
Figure 8. Control system: these waypoints, represented by a vector p k , can be written in the equation ω k = [ x p k , y p k , z p k , V p k ] , where x p k , y p k , and z p k are the absolute coordinates of the waypoints in the environment frame. V p k is the desired norm of the AUV velocity vector (mostly surge and dive) at the considered waypoint (can be 0).
Sensors 23 07321 g008
Figure 9. Sensing: works by changing the environment image into light–dark parameters, where the light path (1 I i T ¯ i ) means it can be skipped and the dark band (0 T ̲ i I i ) must be avoided.
Figure 9. Sensing: works by changing the environment image into light–dark parameters, where the light path (1 I i T ¯ i ) means it can be skipped and the dark band (0 T ̲ i I i ) must be avoided.
Sensors 23 07321 g009
Figure 10. Localization: works by identifying ( x , y ) position and ( θ ) as orientation.
Figure 10. Localization: works by identifying ( x , y ) position and ( θ ) as orientation.
Sensors 23 07321 g010
Figure 11. Energy supply: battery state of charge (SoC), which is affected by ambient temperature, where P l o a d = ( R e ( Z r 0 ) ) I p 2 = ω 0 M 2 L s I P 2 Q s · T .
Figure 11. Energy supply: battery state of charge (SoC), which is affected by ambient temperature, where P l o a d = ( R e ( Z r 0 ) ) I p 2 = ω 0 M 2 L s I P 2 Q s · T .
Sensors 23 07321 g011
Table 1. FAQ about UUV surveys and their supporting technologies.
Table 1. FAQ about UUV surveys and their supporting technologies.
S. NoRelated Research QuestionsAnswer
RQ1How can UUVs be used to collect data?Depending on the mission and the sensors and instruments installed on the vehicle, UUVs can collect a variety of data such as bathymetry, water quality, imagery of the seafloor, and other types [28,31,32,36,41,42,49].
RQ2How do UUVs navigate and control their movements in water?To move through water, UUVs use navigation and control systems. An inertial navigation system, a GPS system, and a sonar system are a few examples [20,21,23,28,37,43,44,54,55,59].
RQ3What are the ways in which UUVs communicate and store data?UUVs have wireless communication systems for transmitting data and storage devices for storing data, such as hard drives or solid-state drives [6,29,31,59,65].
RQ4How do UUVs obtain power?Alternative energy sources such as fuel cells, batteries, and lithium-ion batteries are used to power UUVs [54,62,63,66].
RQ5How can UUVs be equipped with payloads?UUVs can be equipped with various payloads to perform specific tasks such as sampling, imaging, and mapping [23,28,32,44,49,54,55,59].
RQ6What are the steps involved in planning and controlling a UUV survey?In order to plan and control their missions, UUVs and UAVs use mission planning and control software. The software can be used for navigation, sensor control, and data analysis [23,28,37,44,49,54,55,59].
RQ7Why should UUVs be used for surveys?UUVs provide many advantages over traditional survey methods, such as flexibility, cost-effectiveness, and the ability to access areas that are difficult or dangerous for divers [31,32,56,62,64,65].
RQ8How do UUV surveys present challenges?UUV surveys can be challenging due to the need for specialized equipment and expertise, as well as the inability to operate in poorly lit or difficult-to-access underwater environments [60].
Table 2. Using existing surveys as references, mindmaps are compiled, comparisons are made, research approach models are applied, future trends are examined, and contributions are determined.
Table 2. Using existing surveys as references, mindmaps are compiled, comparisons are made, research approach models are applied, future trends are examined, and contributions are determined.
ResearchYearRQ1RQ2RQ3RQ4RQ5RQ6RQ7RQ8
Al Guqhaiman et al. [7]2021
Wang et al. [20]2022
Zhang et al. [21]2022
Shi et al. [23]2020
Wu et al. [28]2020
Hong et al. [31]2020
Nakath et al. [32]2022
Karmozdi et al. [37]2020
Klein et al. [41]2022
Braginsky et al. [42]2020
Perea-Storm et al. [43]2020
Jiang et al. [44]2022
Yin et al. [49]2022
Sezgin et al. [52]2022
Hou et al. [54]2023
Neira et al. [55]2021
Luo et al. [56]2021
Lindsay et al. [59]2022
Purser et al. [60]2022
Luo et al. [56]2022
Yan et al. [62]2020
Fang et al. [64]2022
Jiang et al. [65]2023
Table 3. List of acronyms.
Table 3. List of acronyms.
AcronymDefinitionAcronymDefinition
USVUnmanned Surface VehicleGPSGlobal Positioning System
UAVUnmanned Aerial VehicleANSAcoustic Navigation System
UUVUnmanned Underwater VehicleVOVisual Odometry
ECEnergy ConsumptionUWSNUnderwater Wireless Sensor Network
TXTranceiverROVRemotely Operated Vehicle
RXReceiverAWBCAir–Water Boundaries Communication System
SSSpherical SpreadingUCPSUnderwater Cyber–Physical System
BERBit Error RateIoUTInternet of Underwater Things
SNRSignal-to-Noise RatioCATMControversy-Adjudication-Based Trust Management
PIDProportional Integral DerivativeMPCModel-Predictive Control
SMCSliding Mode ControlAWBCAir–Water Boundaries Communication System
ACAdaptive ControlUCPSUnderwater Cyber–Physical System
AIArtificial IntelligenceIoUTInternet of Underwater Things
MLMachine LearningCATMControversy-Adjudication-Based Trust Management
KPIKey Performance IndicatorsCDVCross-Domain Vehicle
SoNARSound Navigation and RangingDOFDegrees of Freedom
LiDARLight Detection and RangingITSMIntegral Terminal Sliding Mode
INSInertial Navigation SystemFITSMFast Integral Terminal Sliding Mode
DVLDoppler Velocity LogAUVAutonomous Underwater Vehicle
GNSSGlobal Navigation Satellite SystemDRLDeep Reinforcement Learning
RGBRed Green BlueHSVHue Saturation Value
DVLDoppler Velocity LogUTMUniversal Transverse Mercator
WGSWorld Geodetic SystemRISReconfigurable Intelligence Surface
Table 4. List of publishers and the number of publications surveyed.
Table 4. List of publishers and the number of publications surveyed.
DatabaseNumber of Papers
IEEE Xplore49
ScienceDirect-Elsevier4
MDPI7
SpringerLink8
Hindawi5
Wiley4
Inder Science Online1
Table 5. The definitional variable furnishes comprehensive insights into every symbol and unit employed to elucidate the equations within a cross-domain vehicle (CDV) motion system [22].
Table 5. The definitional variable furnishes comprehensive insights into every symbol and unit employed to elucidate the equations within a cross-domain vehicle (CDV) motion system [22].
SymbolExplanation
θ The angle of pitch
F f The force exerted by the front hydrofoil
I f The distance between the front hydrofoil and the center of gravity
I r The distance between the rear hydrofoil and the center of gravity
F r The force applied by the rear hydrofoil
PThe thrust generated by the water jet propeller
FThe combined buoyancy and drag force of the CDV
GThe force of gravity
F v The force generated by the vertical propeller
MThe moment caused by buoyancy
α The angle between F and the axial direction of the CDV
β The angle formed between F f and the axial direction of the CDV
γ The angle included between F r and the axial direction of the CDV
φ The angle of roll
U i , j The velocity components in the i and j directions
I v The distance between the vertical propeller and the center of gravity
J k The moment around the k axis
The pitch angle ( θ ) of the cross-domain vehicle (CDV) induces lift forces ( F f ) on the hull through the action of the front hydrofoil. The magnitudes of these forces are determined by considering the distances ( l f and l r ) from the center of gravity to the front and rear hydrofoils, respectively. The angle β represents the included angle between the lift force ( F f ) and the axis direction of the CDV. This angle is calculated through inverse trigonometric functions based on the lift and drag components of the front hydrofoil. A similar analysis can be performed for the lift force ( F r ) generated by the rear hydrofoil on the hull. This interplay of pitch angles, hydrofoil forces, and geometric considerations contributes to the dynamic equilibrium and motion characteristics of the CDV in its operational environment.
Table 6. Summary of references regarding renewable energy sources that can be considered as alternative sustainable energy supplies for UUV operations [53].
Table 6. Summary of references regarding renewable energy sources that can be considered as alternative sustainable energy supplies for UUV operations [53].
Sustainable Energy SourcesThe Form of Energy GeneratedTypes of Vehicles That Can Apply It
Hydrogen–Oxygen fuel cellHeat–Electric energyROV, AUV
Photovoltaic energyHeat–Electric energyAUV, USV, and UG
Ocean wave powerMechanical–Electrical energyUSV, AUV
Heat energyPressure–Electric energyUSV, AUV, and UG with profilling float
Marine current energyMechanical–Electric energyUG, AUV
Abbreviations: ROV, remotely operated vehicle; AUV, autonomous underwater vehicle; USV, unmanned surface vehicle; UG, underwater glider.
Table 7. Summary of reference used to describe mission scenarios.
Table 7. Summary of reference used to describe mission scenarios.
ResearchContributionOutcome
Shen et al. [67]Buoy transmitter relayCover communications for surface waters area
Qu et al. [9]Underwater wireless acoustic communicationCover long-distance transmission at sea depth
Al-Halafi et al. [10]Underwater wireless optical communicationCover short-range communication at sea depth
Gupta et al. [11]Underwater wireless communication radio-wavesCover communication at sea level
Page et al. [13,14]Direct electrical systemA system that allows recharging for UUV
Luo et al. [29]Air–water boundaries communicationAir–water communication link
Wang et al. [15,16,17]Omnidirectional propulsion and dive systemA system that allows UUV free to move to all directions in underwater
Shi et al. [22]Hydrojet propulsion and dive systemAllows the UUV to capable of operating in surface and underwater environments
Zhang et al. [21]Undulating propulsion and dive systemUUV can move in an ideal fluid with a constant velocity
Saback et al. [24,68]MPC algorithmCapable to optimize control of UUV based on the prediction
Qiao et al. [25]Sliding mode control algorithmConsiders simpler logical systematics but can withstand disturbances and uncertainties
Chu et al. [69]Deep reinforcement learning control baseControl system based on the nervous system with the ability to make decisions based on training and past learning experience in recognizing the environment
Wolek et al. [30]Use of fusion sensorsMake UUV have the ability to recognize the environment, detect the presence of underwater objects, or detect the presence of fellow UUV herds
Song et al. [34]Use of optical sensorsAccurately used to recognize the environment based on image capture
Braginsky et al. [42]Localization using DVL methodCan compute velocity and direction UUV using acoustic-beam
Perea-Strom et al. [43]Localization using GPS–GNSSUUV localization using GPS–GNSS, while currently only being able detect USV, will, in the future, be applicable for types of UUV after the discovery of air–water boundaries communication technology
Baik et al. [51,52,53]Supply of powerPotential renewable energy based on fuel cell, solar, wind, wave, thermal, and tidal current energy
Reference was used to describe mission scenario.
Table 8. Identified issues and proposed solutions.
Table 8. Identified issues and proposed solutions.
Identified IssuesProposed Solutions
Cross-border communication [70,71]Optimization can be achieved through collaborative mission management involving UAVs, USVs, and UUVs, utilizing underwater communication network infrastructure resources. Additionally, the use of surface buoys as relays, assisted by satellites, can help extend the coverage area.
Movement and dive system [16,21,22]Optimization can be achieved by employing biorobotic mechanisms or vehicles inspired by living organisms. This approach is more efficient in generating propulsion and minimizing energy consumption.
Control system [24,25,68]Optimization can be achieved through the implementation of adaptive control mechanisms, enabling vehicles to autonomously react to obstacles along the mission path and optimize routes based on predictions.
Sensing [30,34]Optimization can be achieved by implementing a holistic sensing approach, wherein unmanned underwater vehicles can employ various types of sensors or diverse measurement methods in an integrated manner. This allows for a more comprehensive and profound understanding of the surrounding environment.
Localization [42,43]Optimization can be achieved through passive underwater localization techniques that utilize the Doppler Velocity Log (DVL) sensor to ascertain the vehicle’s position in relation to the seafloor surface.
Supply energy [51,52,53]Optimization can be accomplished by harnessing the potential renewable energy available in the vicinity of the operational area, while considering the ambient temperature of each model. This is essential as the storage capacity of batteries is influenced by ambient temperature.
Machine learning [82,83,84,85,86]All the sub-technologies that support the operation of unmanned underwater vehicles can be optimized through the utilization of Machine Learning. This includes the optimization of the sensing system to accurately recognize underwater objects, avoid and prevent collisions, make predictions, and formulate measurable decisions, should similar challenges arise in the future.
The proposed solutions are expected to address common issues and challenges in the field of unmanned underwater vehicle research.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wibisono, A.; Piran, M.J.; Song, H.-K.; Lee, B.M. A Survey on Unmanned Underwater Vehicles: Challenges, Enabling Technologies, and Future Research Directions. Sensors 2023, 23, 7321. https://doi.org/10.3390/s23177321

AMA Style

Wibisono A, Piran MJ, Song H-K, Lee BM. A Survey on Unmanned Underwater Vehicles: Challenges, Enabling Technologies, and Future Research Directions. Sensors. 2023; 23(17):7321. https://doi.org/10.3390/s23177321

Chicago/Turabian Style

Wibisono, Arif, Md. Jalil Piran, Hyoung-Kyu Song, and Byung Moo Lee. 2023. "A Survey on Unmanned Underwater Vehicles: Challenges, Enabling Technologies, and Future Research Directions" Sensors 23, no. 17: 7321. https://doi.org/10.3390/s23177321

APA Style

Wibisono, A., Piran, M. J., Song, H. -K., & Lee, B. M. (2023). A Survey on Unmanned Underwater Vehicles: Challenges, Enabling Technologies, and Future Research Directions. Sensors, 23(17), 7321. https://doi.org/10.3390/s23177321

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop