Nothing Special   »   [go: up one dir, main page]

Next Article in Journal
A Transfer Reinforcement Learning Approach for Capacity Sharing in Beyond 5G Networks
Previous Article in Journal
Using Multimodal Foundation Models for Detecting Fake Images on the Internet with Explanations
Previous Article in Special Issue
Enhancing Heart Disease Prediction with Federated Learning and Blockchain Integration
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Integrating UAVs and RISs in Future Wireless Networks: A Review and Tutorial on IoTs and Vehicular Communications

by
Mohsen Eskandari
* and
Andrey V. Savkin
*
School of Electrical Engineering and Telecommunication, University of New South Wales, Sydney 2033, Australia
*
Authors to whom correspondence should be addressed.
Future Internet 2024, 16(12), 433; https://doi.org/10.3390/fi16120433
Submission received: 19 October 2024 / Revised: 18 November 2024 / Accepted: 19 November 2024 / Published: 21 November 2024
Figure 1
<p>Organization of the paper based on the taxonomy of the UAV-enabled, RIS-assisted communication into quintuple studied and topics.</p> ">
Figure 2
<p>Illustration of direct LoS path and multi-path.</p> ">
Figure 3
<p>UAV-enabled, RIS-assisted communication: (<b>a</b>) RISeUAV with a UPA of the RIS aligned in the XY plane facing the ground; (<b>b</b>) UAV-BS as an active aerial (airborne) BS.</p> ">
Figure 4
<p>Schematic of RISeUAV-assisted communication for channel modeling: (<b>a</b>) geometry of system in 3D coordinates; (<b>b</b>) UPA of the RIS in XY plane; <math display="inline"><semantics> <mrow> <msup> <mrow> <mi>v</mi> </mrow> <mrow> <mi>R</mi> <mi>U</mi> </mrow> </msup> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msup> <mrow> <mi>u</mi> </mrow> <mrow> <mi>R</mi> <mi>U</mi> </mrow> </msup> </mrow> </semantics></math> denote UAV’s horizontal and vertical linear velocities, respectively; <math display="inline"><semantics> <mrow> <msup> <mrow> <mi>ω</mi> </mrow> <mrow> <mi>R</mi> <mi>U</mi> </mrow> </msup> </mrow> </semantics></math> denotes the UAV’s horizontal rotational velocity and <math display="inline"><semantics> <mrow> <msup> <mrow> <mi>θ</mi> </mrow> <mrow> <mi>R</mi> <mi>U</mi> </mrow> </msup> </mrow> </semantics></math> denotes the UAV heading (angle) with respect to the X-axis. The UAV motion is studied in <a href="#sec4-futureinternet-16-00433" class="html-sec">Section 4</a>.</p> ">
Figure 5
<p>Schematic of UAV-enabled, RIS-assisted wireless communication for intelligent vehicles (IVs) in IoVs with mMIMO BSs. Notice that, for the sake of illustration, the sizes of the mMIMO BS and RISeUAV are exaggerated compared with the distances.</p> ">
Figure 6
<p>Aerial backhauling through the RISeUAV to UAV-BSs.</p> ">
Figure 7
<p>The schematic of the actor-critic deep deterministic policy gradient DRL agent.</p> ">
Figure 8
<p>The geometry of the SLAPS for RISeUAV.</p> ">
Versions Notes

Abstract

:
The rapid evolution of smart cities relies heavily on advancements in wireless communication systems and extensive IoT networks. This paper offers a comprehensive review of the critical role and future potential of integrating unmanned aerial vehicles (UAVs) and reconfigurable intelligent surfaces (RISs) to enhance Internet of Vehicles (IoV) systems within beyond-fifth-generation (B5G) and sixth-generation (6G) networks. We explore the combination of quasi-optical millimeter-wave (mmWave) signals with UAV-enabled, RIS-assisted networks and their applications in urban environments. This review covers essential areas such as channel modeling and position-aware beamforming in dynamic networks, including UAVs and IoVs. Moreover, we investigate UAV navigation and control, emphasizing the development of obstacle-free trajectory designs in dense urban areas while meeting kinodynamic and motion constraints. The emerging potential of RIS-equipped UAVs (RISeUAVs) is highlighted, along with their role in supporting IoVs and in mobile edge computing. Optimization techniques, including convex programming methods and machine learning, are explored to tackle complex challenges, with an emphasis on studying computational complexity and feasibility for real-time operations. Additionally, this review highlights the integrated localization and communication strategies to enhance UAV and autonomous ground vehicle operations. This tutorial-style overview offers insights into the technical challenges and innovative solutions of the next-generation wireless networks in smart cities, with a focus on vehicular communications. Finally, future research directions are outlined.

1. Introduction

The modernization of human life, characterized by advancements in smart cities, smart grids, smart transportation, etc., increasingly depends on wireless communication and sensor networks built upon the massive Internet of Things (IoT) [1,2,3]. The growing demand for high-bandwidth wireless networks capable of supporting high data transmission rates has driven the development of technologies beyond fifth-generation (B5G), sixth-generation (6G) [4], and optical (visible light) wireless communication networks (WCNs) [5]. Future WCNs leverage quasi-optic millimeter wave (mmWave) electromagnetic signals to achieve higher carrier frequencies, enabling high-speed, high-data-rate wireless communication [6].
Although mmWave signals offer higher bandwidth, they face significant propagation challenges due to rapid attenuation, fast fading, shadowing, as well as blockage and blind-spot issues [7]. To mitigate these limitations, the concept of massive multi-input multi-output (MIMO) communication has been introduced [8]. MIMO base stations (BSs) are equipped with arrays of mmWave antennas [9], enabling them to enhance signal strength through beamforming. This technique focuses electromagnetic waves to transmit steered signals in line-of-sight (LoS) directions toward user equipment (UE) [10].
However, the massive MIMO concept introduces complexity and reduces sustainability in future WCNs due to the intensive baseband signal processing and active beamforming requirements, which can lead to energy and spectral efficiency challenges [11]. Reconfigurable intelligent surfaces (RISs), which act as passive yet smart mmWave reflectors, offer a solution to enhance both spectral and energy efficiency in future WCNs [12]. Unlike active MIMO systems, RISs do not require radio frequency (RF) chains for signal processing and consume minimal energy for passive beamforming, making them a viable option for more sustainable and less complex network architectures [13].
The significant mobility of unmanned aerial vehicles (UAVs), commonly referred to as drones, has proven advantageous for enhancing WCNs by improving coverage [14], ubiquitousness [15], capacity [16], flexibility, throughput [17], and reliability. UAVs can be utilized for data collection in sensor networks [18] or as enablers for mobile edge computing (MEC) to support remote IoT applications [19]. Among UAV types, quadrotors, which are vertical take-off and landing (VTOL) vehicles [20], are particularly well-suited for deployment in dense urban environments. Their ability to maintain proximity for efficient data collection, from IoT sensors that transmit low power over short distances, makes them ideal for such tasks [21]. Additionally, quadrotors play an essential role in smart city applications, especially in intelligent transportation systems involving intelligent vehicles (IVs) [22]. Their flexibility allows them to support aerial wireless communication for the Internet of Vehicles (IoVs) [23,24,25], which function as dynamic IoT nodes. IoVs require high-speed, reliable, low-latency, and stable wireless links [26] to exchange perception data [27] critical for safe self-diving [28].
Device-to-device (D2D) communication is expected to be indispensable in future WCNs for enabling high-speed connectivity, offloading data traffic, and optimizing the capacity of large-scale networks [29]. IVs can leverage vehicle-to-vehicle (V2V) communication to establish vehicular networks [30] and enhance safety features such as collision avoidance for autonomous driving [31]. Additionally, IVs can utilize vehicle-to-everything (V2X) communication for applications related to commercial use, road safety, and traffic efficiency [32]. In this context, drones play a crucial role due to their high mobility and ability to disseminate urgent information swiftly among vehicles. They can also provide aerial LoS communication links for IoVs in obstructed, densely populated urban environments [33]. Given the inherent characteristics of future WCNs that often rely on LoS channels, integrating UAVs with RISs is essential for achieving more robust and efficient wireless communication [34,35].
UAV-enabled, RIS-assisted communication is generally formulated as a multi-objective optimization problem with the following joint objectives [34]:
  • Power transmission for propagating communication signals and/or power allocation to multiple UEs, where the power transmit is implemented by the terrestrial BS or UAV as the airborne BS.
  • UAV energy-efficient path planning and trajectory optimization, taking into account communication performance and quality of service (QoS) requirements.
  • Design of BS beamforming (BS-BF) and RIS phase shift (RIS-PhSh) to enhance signal quality and communication reliability.
In this context, with a focus on the integration of UAV-RIS in dense urban environments and wireless vehicular networks, our literature review identifies several research gaps, categorized into five main areas of study:
  • A new paradigm is required for channel modeling in the context of UAV-enabled, RIS-assisted communication for IoT sensors and particularly for mobile IoVs in dense urban environments. Notably, the channel modeling is based on localization-aware communication, which is promising due to the intrinsic characteristics of future B5G and 6G WCNs with mmWave signals, particularly considering dynamic IoTs and IoVs networks for vehicular communications.
  • Kinodynamic-aware, obstacle-free trajectory optimization for crash avoidance and navigation in dense urban areas has been largely overlooked in the wireless communication community and requires further exploration.
  • The emergence and applications of RIS-equipped UAVs (RISeUAVs).
  • A new perspective of optimization algorithms regarding the impact of trajectory optimization with LoS links.
  • Investigating integrated localization and communication within UAV-enabled, RIS-assisted communication systems for IoVs.
In the following Section, we present a taxonomy of UAV-enabled, RIS-assisted communication studies, which structured around the five main areas above.

2. Organization and Contribution of the Paper

The topics examined in this paper are illustrated in Figure 1. A significant portion of related research focuses on UAV placement, either for hovering or determining optimal navigation paths/trajectories. The UAV’s navigation should be designed to maximize communication performance and associated metrics. Consequently, in addition to UAV navigation, key research areas include communication channel modeling, RIS phase shift design, and beamforming for MIMO base stations. To achieve these objectives, optimization problems are formulated based on defined goals and subject to physical constraints. Additional constraints often relate to communication metrics such as QoS, minimum achievable rate, signal-to-noise ratio (SNR), cognitive radio capabilities, multiple-access coding, or user-specific requirements.
Minimizing energy consumption, both for UAV propulsion and transmitted communication power, is a recurring objective to enhance energy efficiency, sustainability, and cost-effectiveness. Since UAVs have limited onboard energy storage due to battery constraints, reducing propulsion energy consumption is crucial for extending UAV endurance during communication missions. This paper categorizes the research into five major sections, which are briefly explained following Remark 1.
Remark 1.
The central focus of this paper is on “RIS-assisted UAV navigation in future wireless networks for supporting IoT and IoV communication in dense urban areas of smart cities.” This is an emerging research area, particularly relevant in the context of autonomous intelligent vehicles that require sensor fusion, incorporating visual data, V2X communication, and mmWave localization for safe and secure autonomous driving. This paper is structured from this viewpoint and adopts a tutorial approach, summarizing key concepts and methodologies found in the literature. Notably, related works often address multiple aspects of this taxonomy, as we summarize in a Table, which maps the contributions of various research papers to the following five main areas.
  • Section 3 delves into communication and channel modeling, examining key aspects such as channel modeling, network performance, and modern multiple-access communication technologies. UAV deployment and navigation are considered as strategies for augmenting existing terrestrial cellular networks or delivering on-demand or remote coverage. In these scenarios, the channel model, path loss, and phase shift significantly influence the performance of RIS-assisted, UAV-enabled communication and must be integrated into the optimization framework. Unlike conventional ground-to-ground (G2G) channels, air-to-ground (A2G) channel modeling presents unique challenges and characteristics [29]. Therefore, this Section reviews channel modeling specific to UAV-enabled, RIS-assisted communication, highlighting its distinct aspects. Additionally, network performance indices, such as QoS, throughput, coverage, and weighted sum rate (WSR), are mathematically formulated and incorporated into the optimization problem. Recent advancements in multiple-access communication technologies for cognitive networks are also explored, showcasing their ability to enhance spectrum and energy efficiency, thereby improving overall network performance and connectivity. Moreover, relevant works consider the coding and decoding order of these multiple-access techniques as part of the optimization problem.
  • Section 4 explores UAV navigation and control, a topic of significant importance from two critical perspectives. Firstly, energy efficiency is a major concern; UAV navigation, including localization, path planning, path tracking, and trajectory design for generating motion primitives, affects the UAV’s energy input and consequently its propulsion energy consumption. Therefore, studies should incorporate UAV navigation considerations to enhance energy efficiency. Secondly, from a practical standpoint, generated paths and trajectories must be both dynamically and kinematically (kinodynamically) feasible. This means that UAV motion must adhere to kinematic constraints such as speed, acceleration, and nonholonomic limitations (e.g., rate of heading change). Moreover, in dense urban environments where paths are often obstructed and maintaining LoS links is crucial, the trajectory should also account for the UAV’s rotational dynamics. This practical aspect is frequently overlooked in the current literature within the wireless communication field.
  • Applications of UAVs and RISs in wireless networks are discussed in Section 5, where various services involving UAV deployment in communication networks, UAV design, and RIS technologies are reviewed. Each application, whether it involves UAVs as airborne BS, IoT sensor data collection, support for V2X communication in IoVs, maritime communication, etc., comes with its own unique environment and network characteristics. These differences necessitate distinct objectives and constraints in the optimization problems and significantly influence UAV navigation and control models. Additionally, depending on the application or available resources, the aerial package, comprising the UAV and communication module, can vary in design. For example, UAVs may be deployed as active aerial base stations (UAV-BS) or equipped with RIS (RISeUAV) to enhance energy efficiency and reduce system complexity.
  • Solutions to the optimization problems are discussed in Section 6, covering convex programming, machine (deep) learning, and game theory approaches. Convex programming is a widely used solution for optimization problems. However, optimization challenges in UAV navigation, such as joint energy-efficient trajectory design and communication performance, are typically highly nonlinear and non-convex. As a result, alternating optimization (AO) techniques, including sequential convex programming (SCP) and successive convex approximation (SCA), are employed after applying convex relaxation methods. These techniques provide computationally tractable solutions, albeit at the cost of suboptimality [36]. Additionally, with recent advancements in artificial intelligence (AI), deep learning, and particularly deep reinforcement learning (DRL) agents, these methods have garnered significant attention.
  • Section 7 explores integrated localization and communication. The radio frequency sensor (radar) has been employed for object detection and tracking. In future WCNs, mmWave communication and beamforming are expected to enable higher angular resolution, leading to more accurate centimeter-level localization. As a result, mmWave localization technology has garnered significant attention for autonomous unmanned vehicles [37]. Additionally, RISs are increasingly valuable for creating smart radio environments, where the propagation and scattering of communication signals can be controlled, reducing multipath interference. Furthermore, localization-assisted communication is instrumental in transmitting and propagating directional communication signals, enhancing the efficiency and effectiveness of communication. The integration of sensing (localization) and communication (ISAC) serves as a powerful technique to optimize resource utilization, network capacity, and spectrum efficiency.

3. Communication and Channel Modeling

In this section, we present a brief study on channel modeling and the impact of environment and RIS-assisted communication on channel performance. Through channel modeling, we highlight critical points that should be considered in the UAV navigation for UAV-enabled, RIS-assisted communication.

3.1. Channel Modeling

The received signal at the UE is affected by the channel gain between the transmitter and that point as the following:
y = P T   g L o S T R s + w ,
where y denotes the received signal, P T denotes the transmitted power, g L o S T R denotes the LoS channel gain, s denotes the coded signal, and w C N ( 0 ,   σ 2 ) is a complex Gaussian additive noise with zero mean and covariance σ 2 for modeling scattering components. The channel gain may be adversely affected by the environment, resulting in NLoS multipath signals due to scattering and consequence random reflections, diffractions, and refractions, see Figure 2.
In future networks, the LoS singles are assumed to be dominant compared to NLoS multipath signals that are negligible based on real-world experimental [38]. The channel (power) gain is determined by the free-space LoS path loss affected by the distance between a transmitter and receiver as follows:
g L o S T R λ 4 π G T G R   e 2 π λ d T R ϕ T R p T x p R x 2 d T R
where g L o S T R C denotes the LoS channel gain between the transmitter T x and receiver R x ; G T and G R denote the transmitter and receiver antenna gain, respectively; d T R = p T x p R x 2 presents the distance between the transmitter and the receiver, with p T x = x T x y T x z T x R 3 and p R x = x R x y R x z R x R 3 denoting the 3D position (i.e., Cartesian coordinates) of the transmitter and receiver, respectively; superscript denotes matrix transpose, and 2 presents Euclidean norm; ϕ T R denotes the induced phase shift, and λ is the carrier wavelength.
Remark 2.
The communication performance in B5G and 6G is affected by LoS paths where the channel gain of LoS paths is affected by the distance. Also, the LoS path may be randomly blocked in the case of mobile IoVs in urban environments. In UAV-enabled, RIS-assisted communication, UAVs may be deployed as airborne BSs (UAV-BS) to provide aerial LoS paths through RISs mounted on buildings. Alternatively, UAVs may be equipped with RISs as the RIS-equipped UAV (RISeUAV) to cover blind spots and provide extra (indirect) cascaded LoS (CLoS) paths for IoVs, see Figure 3.

3.1.1. Deployment of UAV-BS and RISeUAV

After the deployment of a UAV equipped with an aerial RIS as the RISeUAV, the channel modeling is obtained as follows. The same methodology can be applied to the RIS-assisted UAV-BS.
The channel gain of the cascaded T x R I S R x LoS path for the RISeUAV, in Figure 3a, is obtained as [39,40]:
g C L o S T R λ 4 π     g L o S R I S _ R Ψ R I S g L o S T _ R I S ,
where the notations of (3) is presented in the following: denotes conjugate (Hermitian) transpose; g C L o S T R C denotes the channel gain of the indirect CLoS link between transmitter and receiver through RIS (i.e., the T x R I S R x link); Ψ R I S C M × M denotes the RIS phase shift matrix given as follows:
Ψ R I S = d i a g e j ψ 1 R I S ,   e j ψ 2 R I S , , e j ψ m R I S , ,   e j ψ M R I S n C M × M ,
where ψ m R I S denotes the phase shift of the m t h RIS element, and M denotes the number of RIS reflector elements; g L o S T _ R I S C M denotes the LoS channel gain of the T x R I S link given as follows:
g L o S T _ R I S λ 4 π G T p T x p R I S 2 d T _ R I S   e j ϕ m = 1 T _ R I S ,   , e j ϕ m T _ R I S , , e j ϕ M T _ R I S    
where p R I S = x R I S y R I S z R I S R 3 denotes the 3D position of the RIS; ϕ m T _ R I S = 2 π λ d m T _ R I S indicates the imposed phase shift in the associated incident path (i.e., the path between the transmitter and m t h RIS element) where d m T _ R I S = p T x p m R I S 2 ; and p m R I S = x m R I S y m R I S z m R I S R 3 denotes the Cartesian coordinates of the m t h RIS element. p m R I S ,   m M can be obtained based on the RIS position and its spacing among its elements [41], see Figure 4 and Appendix A. g L o S R I S _ R C M denotes the LoS channel gain of the R I S R x link given as follows:
g L o S R I S _ R λ 4 π G R p R I S p R x 2 d R I S _ R   e j ϕ m = 1 R I S _ R ,   , e j ϕ m R I S _ R , , e j ϕ M R I S _ R    
where ϕ m R I S _ R = 2 π λ d m R I S _ R indicates the imposed phase shift in the associated reflection path (i.e., the path between m t h RIS element and the receiver), where d m R I S _ R = p m R I S p R x 2 . Therefore, the equivalent channel gain of the indirect T x R I S R x CLoS link can be obtained as follows:
g C L o S T R λ 4 π 2 G T   G R   m = 1 M e ψ m R I S + ϕ m T _ R I S ϕ m R I S _ R p T x p R I S 2 d T _ R I S p R I S p R x 2 d R I S _ R
By assigning the phase shift for the m t h RIS element as follows:
ψ m R I S = ϕ m R I S _ R ϕ m T _ R I S ,
all reflected signals by the RIS elements arrive at the receiver with the same phase shift so they are inherently accumulated in the receiver. Therefore, the indirect CLoS is obtained as follows:
g C L o S T R λ 4 π 2 G T   G R   M p T x p R I S 2 d T _ R I S p R I S p R x 2 d R I S _ R
Finally, the achievable rate is obtained as follows:
R = log 2 1 + P T g L o S T R + g C L o S T R 2 σ 2  
which is a concave function.
There are critical points given from the equivalent channel gain of the CLoS link which are highlighted in the following remarks.
Remark 3.
In the channel gain of the CLoS link, the product of two Euclidean norms appears in the denominator, which makes the channel gain formula nonconvex, notably, when the optimization problem is the RISeUAV trajectory design. Notice that in (9), the RIS position p R I S is determined by the UAV position. Handling this issue is the contribution of research works that are studied in the optimization solution Section (Section 6).
Remark 4.
Although the product of the two Euclidean distances associated with the incident path to and reflection path from the RIS reduces the channel gain, the accumulated signals reflected by the RIS elements significantly enhance the channel gain, making it M times stronger, which compensates for the challenges of CLoS links. This notable improvement is achieved by using RIS without consuming energy or requiring complex processing. Since the phase shifts of RIS elements are passive, RIS presents a promising, sustainable solution to enhance the performance of future WCNs. However, the RISeUAV may need to fly at lower altitudes to increase channel performance, which introduces potential obstacles such as skyscrapers and urban canyons. Therefore, the trajectory optimization method must account for an obstacle-free path to avoid collisions.
Remark 5.
The rationale behind the phase shift design in (8) is that perfect channel state information (CSI) is available, which is not practical in UAV-enabled communication, particularly for mobile IoVs. Therefore, the possible cost-effective solution is directional phase shift/beamforming, considering that the localization information of the UAV-BS, RISeUAV, and UEs are available [42]. It is not an unwarranted assumption as the mmWave localization has been studied in the literature, which is discussed as the integrated localization and communication inSection 7.

3.1.2. Position-Aware Directional Beam-Steering

Based on Remark 5, directional beam-steering can be implemented to improve the channel gain and communication performance. Assuming the localization-aware communication and geometry-based directional phase shift, the channel gain can be obtained in the angular domain as follows:
g C L o S T R λ 4 π 2 G T   G R   a i n c R I S φ T _ R I S ,   ζ T _ R I S   Ψ R I S   a r e f R I S φ R I S _ R ,   ζ R I S _ R R I S e ϕ i n c + ϕ r e f   p T x p R I S 2 d T _ R I S p R I S p R x 2 d R I S _ R
with   ϕ i n c = 2 π λ w φ T _ R I S ,   ζ T _ R I S p R I S p T x ϕ r e f = 2 π λ w φ R I S _ R ,   ζ R I S _ R p R x p R I S
where φ T _ R I S   a n d   ζ T _ R I S denote azimuth and elevation angles of the incident ( i n c ) path, respectively; φ R I S _ R   a n d   ζ R I S _ R denote azimuth and elevation angles of the reflection ( r e f ) path, respectively, which are given based on the geometry information, see Figure 4 and Appendix B; a i n c R I S n φ T _ R I S ,   ζ T _ R I S C M × 1 denotes the RIS array response (wave) vector to the incident signal from the transmitter to the RIS and is obtained as follows:
a i n c R I S φ T _ R I S ,   ζ T _ R I S = e j ϕ m = 1 i n c , , e j ϕ m i n c , , e j ϕ M i n c
where ϕ m i n c denotes the imposed phase shift to the signal received at the m t h element of the RIS with respect to the center point of RIS given as follows:
ϕ m i n c = 2 π λ w φ T _ R I S ,   ζ T _ R I S p m R I S p R I S ;
w φ T _ R I S ,   ζ T _ R I S R 3 denotes the normalized 3D wave vector of the T x R I S path given as follows:
w φ T _ R I S ,   ζ T _ R I S = cos ζ T _ R I S cos φ T _ R I S cos ζ T _ R I S sin φ T _ R I S sin ζ T _ R I S ;
Similarly, the RIS array response to the reflected signal a r e f R I S n φ R I S _ R ,   ζ R I S _ R can be achieved using the azimuth and elevation angles of the reflection path. The RIS phase shift design is implemented based on Remark 6.
Remark 6.
Directional beam-steering is achieved by controlling the phase shifts (i.e., UPA phased array) of the RIS. It has been proven that by discrete Fourier transform (DFT)-based codebook design, the directional beam-steering is achieved if the DFT weight vector is equivalent to the normalized array response vector (i.e., the normalized wave vector) [43]. Therefore, the normalized array response vectors of the BS-RIS path and RIS-UE (e.g., RIS-IoVs) path are used to control the phased array for BS-BF and RIS-PhSh, respectively, to realize directional beam steering.
In this light, the phase shift matrix can be designed as follows:
Ψ R I S = a i n c R I S φ T _ R I S ,   ζ T _ R I S   a r e f R I S   φ R I S _ R ,   ζ R I S _ R .
After using (15), (11) is converted to (9). However, the advantage of using a geometry-based phase shift design (i.e., directional beam-steering) is that it can be effectively implemented through an appropriate codebook design, as highlighted in Remark 6. Additionally, this approach is well-suited for dynamic vehicular networks, where vehicles are in motion. Positioning-aware beam steering can be employed as an alternative to CSI, which is challenging to obtain in such dynamic environments.

3.1.3. MIMO Beamforming

By deploying massive mMIMO BSs in future 6G networks [44] stronger signals can be propagated for IoVs, see Figure 5. In multiple antennas, the precoding (weighting) vector corresponding to the unit power signal is equal to the unit response vector of the linear antenna arrays to maximize the SNR. Therefore, based on Remark 6, the channel gain of the cascaded LoS path BS-RIS-IoV is obtained as
g C L o S B S R I S I V g B S R U φ B S R U ,   ζ B S R U B S R U × a i n c R I S φ B S R U ,   ζ B S R U   Ψ R I S   a r e f R I S φ B S I V ,   ζ B S I V R I S × g R U I V φ R U I V ,   ζ R U I V R U I V
where N is the number of antennas in the mMIMO BS; superscripts “ B S R U ” and “ R U I V ” denote the BS-RISeUAV (RU) link (i.e., corresponding to the incident ( i n c ) signal with respect to the RIS) and RU-IV link (i.e., corresponding to the reflection ( r e f ) signal with respect to the IV), respectively. g B S R U φ B S R U ,   ζ B S R U C denotes the channel gain of the BS-RU path given as follows:
g B S R U φ B S R U ,   ζ B S R U = G B S a B S φ B S R U ,   ζ B S R U × Γ B S φ B S R U ,   ζ B S R U × g P l o s s B S R U ,
where a B S φ B S R U ,   ζ B S R U C N denotes the array response (wave) vector of the mMIMO BS with respect to the RU position given as follows:
a B S φ B S R U ,   ζ B S R U = e j ϕ n = 1 B S R U , , e j ϕ n B S R U , , e j ϕ N B S R U ,
with   ϕ n B S R U = 2 π λ w φ B S R U ,   ζ B S R U p n B S p B S
and   w φ B S R U ,   ζ B S R U = sin ζ B S R U cos φ B S R U sin ζ B S R U sin φ B S R U sin ζ B S R U ,
p n B S = x n B S y n B S z n B S R 3 denotes the Cartesian coordinates of the n t h antenna of the mMIMO BS, which can be obtained based on the BS position and its spacing among its elements, see Figure 5 and Appendix C. Γ B S φ B S R U ,   ζ B S R U C N denotes the BS phase array
Γ B S φ B S R U ,   ζ B S R U = 1 N e j γ n = 1 B S R U , , e j γ n B S R U , , e j γ N B S R U ,
g P l o s s B S R U C denotes the path loss of the BS-RIS path:
g P l o s s B S R U = λ 4 π e j ϕ B S R U p R U p B S 2 d B S R U ,
where
ϕ B S R U = 2 π λ w T φ B S R U , ζ B S R U p R U p B S ;
The array response vectors of the RIS for incident and reflected paths are obtained as presented earlier in (12)–(15). After applying the directional beam steering method for BS-beamforming (i.e., Γ B S φ B S R U ,   ζ B S R U = a B S * φ B S R U ,   ζ B S R U , and RIS phase shift design in (15), the channel gain can be approximated as follows:
g C L o S B S R I S I V λ 4 π 2 G B S G I V C o n s t a n t   F i n c φ B S R U ,   ζ B S R U F r e f φ B S I V ,   ζ B S I V   e ϕ B S R U + ϕ R U I V p R U p B S 2 d B S R U p I V p R U 2 d R U I V
where F φ ,   ζ denotes the cosine shape scan loss function [45] that is embedded in the channel modeling for modeling the mismatches between actual positions and estimated positions of mobile elements such as UAV or IVs:
F φ ,   ζ =             cos φ L o S φ b e a m × cos ζ L o S ζ b e a m ,     ζ 0 , π 2 , φ π 2 , π 2                                           0                                                           ,     ζ π 2 , π , φ π 2 , π 2 ;
with subscript “ L o S ” denoting the actual LoS path and the subscript “ b e a m ” denoting the propagated beam based on estimated positions.
Remark 7.
By utilizing mMIMO beamforming technology and implementing directional beam-steering with narrow beams, higher angular resolution can be achieved, which enhances the accuracy of localization. This is a significant advantage of mmWave communication [46]. The channel model in (20) can be leveraged to enable cost-effective and computationally efficient localization. Localization is achieved by adjusting the beam-steering based on the estimated position and measuring the variation in signal strength. When the estimated position of the RISeUAV and IV approaches the actual position, the channel gains, and consequently the signal strength, are maximized. The signal strength can be used as a measure for accurate localization.

3.1.4. Obstructed LoS and Outage Probability

Channel modeling in UAV-enabled communication is mostly based on Rician fading and free path loss gain for compromising LoS links and scattering [47]. Rician distribution is a more realistic scenario since the UAV is in a high position in the sky and can create a direct LoS to UEs. However, since future RIS-assisted mmWave communication networks most likely will be limited to beamforming to LoS paths, deterministic LoS channel gain has been considered [48]. Also, probabilistic LoS is common in urban environments with buildings appearing as random obstacles. This issue was initially considered for coverage maximization of low-altitude aerial platforms (LAPs) [49]. Following this work, some papers have used the developed probabilistic LoS modeling for applications in urban environments [50,51]. The probability of LoS link between the UAV and ground UE in urban areas is obtained as follows:
P r o b L o S = 1 1 + a     e x p b 180 π a r c s i n z U A V d U A V _ U E ζ U A V _ U E a
where a and b are constant values determined based on the environment; z U A V denotes the UAV altitude; d U A V _ U E denotes the Euclidean distance; ζ U A V _ U E denotes the elevation angle between UAV and UE. The outage probability is 1 P r o b L o S . Therefore, since the elevation angle in the deterministic LoS impact the channel, there is a tradeoff between elevation angle and distance that is considered in the RISeUAV (or UAV-BS) placement and path planning [52].
Further, more recently, the stochastic geometry of the LoS path has been considered in determining the LoS probability of the A2G links [53]. In the case of RISeUAV, it is assumed the LoS links are valid in the incident and reflection directions, thanks to the great mobility of the UAV [48]. Therefore, a deterministic CLoS channel model has been considered as given in (9). However, the channel model is affected by a variety of realistic physical disturbances affecting the channel conditions such as the UAV mobility [54] and weather conditions [55]. By incorporating the UAV’s rotational aerodynamics, the array response of the RIS array in the RISeUAV has been modified following UAV fluctuations [54]. The environmental characteristics affect the small-scale and large-scale fading and potential spatial correlation in shadowing. Therefore, to realize a generic mode, (9) is modified through a statistical study to develop a generic model [55], where the closed-form expressions for the outage probability and the ergodic capacity have been presented.
Also, the RISeUAV faces the double-Rician channel, due to the CLoS link that needs a new closed-form for modeling the outage probability [56]. The impact of the UAV position and the number of RIS reflective surface elements on the channel modeling and the performance of the communication network are investigated using Monte Carlo simulations [56]. Further, the variance of the double-Rician channel and a closed-form expression of the outage probability have been developed.
Realistic environment testing has characterized obstructed V2V LoS links, highlighting the impact of shadowing from other vehicles and self-shadowing on flat and sloped terrains [57]. Higher antenna placement (e.g., on vehicle roofs) can improve coverage in obstructed scenarios but may worsen coverage on sloped terrains due to self-shadowing. Deploying RISeUAV can effectively provide aerial indirect LoS links to enhance V2V communication.

3.1.5. Imperfect CSI

Normally, the communication strategies and trajectory optimization are based on the knowledge of channel coefficients such as full and partial CSI. The main issue with UAV-enabled, RIS-assisted communication is imperfect CSI and channel estimation and beamforming in dynamic environments.
A UAV-BS-based multiple RIS-assisted communication with outdated and imperfect CSI has been studied in [58]. In the case of multiple RISs, the problem is RIS allocation to a given user. The statistical distributions of instantaneous SNR under imperfect CSIs for both direct and composite fading links were derived using Rician fading. Using the cumulative distribution function (CDF) of SNR, series-based expressions for average coverage probability (ACP) and average bit error rate over the UAV’s flight were obtained.
To support ultra-reliable and low-latency communications (e.g., for IoTs and IoVs in B5G and 6G cellular networks [59]), short-packet transmissions are essential. In this light, a new framework for short-packet communications has been developed in [60], where an error probability bound for a given block length (BL) and coding rate have been derived. Followed by this, Agrawal, et al. investigated the application of RIS in energy harvesting in a UAV-RIS-IoT communication network with finite BL codes [61]. Using the derived statistics, the system’s performance with finite block length codes was analyzed for average outage probability, block error rate, and goodput over the UAV’s flight duration. The impact of factors such as imperfect CSI, number of RISs and reflecting elements, IoT locations, UAV altitude, and channel fading severity on UAV-RIS link performance was also investigated.

3.1.6. Codebook Design

Utilizing codebooks, with pre-designed codewords, is considered an effective and promising technique for handling channel estimation problems in dynamic environments including IoVs [62]. On top of IoVs’ motion, the estimation of the end-to-end T x R I S e U A V R x cascaded channel is more challenging due to the passive nature of RIS and limited onboard resources for the UAV’s overhead controller. Therefore, the beamforming design is complicated in practice. However, beam training based on a predefined codebook can be used. Codebook design is based on offline beam training for beam alignment between two end nodes. However, an exhaustive search along the large conventional codebook, to find the optimal UPA phase shift matrix configuration, will cause extremely high system overhead and power consumption. Therefore, as pointed out in Remark 6, a positioning-based codebook with an affordable size has been utilized [63]. The proposed predesigned codebook uses the estimated positions as initial points for determining the main reflecting pattern. Then, depending on the standard deviation of the localization error, sets of sampled points are determined for steering the beam. Also, optimization-based codebook design techniques have been considered utilizing the Karush–Kuhn–Tucker (KKT) condition to solve the problem with low-precision non-uniform codebooks [64] and the steepest-descent method (SDM) [65].

3.2. Communication Performance

Communication performance plays a crucial role in the optimization of UAV navigation and trajectory design, and it is integrated into the objective function and optimization problems. Key performance indicators for communication systems in UAV-based networks are QoS, secrecy, reliability, and efficiency in terms of energy and spectrum utilization. These factors ensure that the UAVs can maintain reliable, secure, and efficient communication links with UEs or other UAVs, thereby enabling seamless operation in dynamic environments.

3.2.1. Quality of Service (QoS)

QoS is a critical communication performance metric that dictates the overall user experience in terms of data rate, latency, and connection reliability. In UAV-based networks, particularly those utilizing UAVs, RIS, and UEs, the primary objective for QoS is often the maximization of the sum rate of the UAV-RIS-UEs LoS communication channels [40]. The sum rate optimization aims to achieve the highest possible throughput while adhering to minimum achievable rate constraints for UEs, ensuring that each device obtains an adequate data rate for its operation.
In the context of UAVs, RISs can be deployed to enhance signal quality by intelligently reflecting and directing signals to specific UEs, thus improving the communication channel’s performance. The UAV serves as a mobile base station or relay, and the RIS acts as an intelligent medium to adjust and optimize the propagation conditions between the UAV and UEs. This approach enables better control over the channel conditions and allows for more efficient utilization of the available spectrum, especially in complex environments with high interference or obstructions.
The objective function in such optimization problems typically incorporates factors such as the total system throughput, latency, and reliability. Constraints are imposed to ensure that the QoS requirements for UEs, such as minimum data rates or maximum latency, are met, see Table 1.

3.2.2. Secrecy, Security and Reliability

The secrecy and reliability indexes of UAV-enabled, RIS-assisted communication have been considered in several studies. These studies typically focus on wireless communication systems in the presence of eavesdroppers, with an emphasis on enhancing physical layer security through techniques such as beamforming, artificial noise injection, and signal rerouting. The secrecy performance of integrated satellite UAV-relayed RIS-assisted networks, with multiple vehicle eavesdroppers, has been investigated in [66]. In these systems, the UAV forwards the legitimate signal to the destination user through RIS, which ensures reliable transmission. The maximal ratio combining (MRC) eavesdropping technique is used to intercept the legitimate signal. Based on the proposed secrecy system model and the MRC eavesdropping scheme, the study analyzes the secrecy outage probability (SOP) across various SNRs, evaluating the effects of key parameters on the SOP. The theoretical analysis is validated through Monte Carlo (MC) simulations.
UAV trajectory optimization has been explored for robust and secure RIS-assisted communication in the presence of eavesdroppers [67,68]. The objective function of the joint trajectory and communication optimization problem aims to maximize the worst-case secrecy rate. For the RISeUAV, it has been demonstrated that a well-planned flight path significantly enhances the security gain of physical layer security [69]. Moreover, the flexibility of the RISeUAV is shown to be particularly effective in improving security when the transmission environment is favorable, such as higher transmit power or a weaker wiretap link. Additionally, the 3D positioning of the RISeUAV and the partitioning of the RIS (i.e., dividing the RIS into several sections and controlling the phase shift of each section) have been optimized to increase the physical layer security for legitimate users while enhancing the impact of artificial noise on illegitimate users [70].

3.3. Efficiency with Multiple-Access Technologies and Cognitive Radio Communication

To meet the high-performance demands of future wireless networks, such as high capacity, low latency, and seamless connectivity for IoT sensors and IoVs, it is essential to optimize efficiency [71]. Alongside RISs and STAR-RISs, which enable the creation of smart radio environments, next-generation multiple-access technologies play a crucial role in maximizing connection density and enhancing spectral efficiency [72]. Cognitive radio communication allows smart devices to dynamically detect available channels within the same frequency band, improving spectrum utilization [73]. Common multiple-access technologies include non-orthogonal multiple access (NOMA), rate-splitting multiple access (RSMA), space division multiple access (SDMA), and time division multiple access (TDMA) [74].

3.3.1. Non-Orthogonal Multiple Access

Non-Orthogonal Multiple Access (NOMA) enables simultaneous communication with multiple users using the same physical resources (i.e., time, frequency, and coding) by leveraging superposition coding at the transmitter and successive interference cancelation (SIC) at the receiver [75]. The error probability in RISeUAV-based NOMA systems has been investigated in [76,77], accounting for practical constraints such as hardware impairments (HWI) at the transceivers, inter-cell interference (ICI), and imperfect channel state information (CSI).

3.3.2. Rate-Splitting Multiple Access

RSMA has emerged as a generalized multiple-access technology that effectively manages interference in multi-user communication systems [78]. RSMA is particularly beneficial for UAV-enabled, RIS-assisted communication in multi-user IoV networks, enabling efficient operation within the same spectrum [79]. The optimal RSMA power allocation coefficients for UAV-RIS-IoV links are determined by minimizing the sum of the average outage probability (AOP) across all targeted vehicles.
Table 1. Summarizing list of the literature review.
Table 1. Summarizing list of the literature review.
Refs.Navigation and ControlApplicationCommunicationOptimization Problem
ServiceUAV Type
RIS Tech.
Channel ModelMA
Technique
OFFormulationConstraintsOptimizer
[39]2D Path
RIS-PhSh
Ground UEUAV-BSRician channelMax Ave.
Ach. rate
Convex
Programming
Convex solver CVX
[47]2D Path
RIS-PhSh
multi-cell
multi-mobile-user
RISeUAVRician channelMin Ave.
ergodic rate
SCABS powerConvex solver CVX
[48]2D Path
RIS-PhSh,
Throughput
maximization
RISeUAVDeterministic LoSMax
throughput
Iterative optimizationSpeed, PowerConvex
programming
[50]3D path+speed
RIS-PhSh
IoTsUAV-BSProbabilistic
LoS
Max
Ach. rate
Block coordinate descent- SCAVelocity
Acceleration
Interior-point method
[51]2D Path+Speed
RIS-PhSh
MTCUAV-BSProbabilistic
LoS
EESCAQoS
Latency
Convex solver CVX
[52]2D Path
RIS-PhSh
Ground nodesRISeUAVProbabilistic LoSMax
Ach. rate
MINPElevation angleInterior point CVX solver
[69]2D Path
RIS-PhSh,
SecurityRISeUAVFree space lossEE
Ach. rate
MDPPowerGradient
DRL-DDPG
[70]2D Path
RIS-PhSh,
Physical layer
security
RISeUAVProbabilistic
LoS
Ergodic
Secrecy
Non-convexQoS, SINRConvex solver CVX, PSO, SA
[75]3D Placement,
RIS-PhSh,
Multiple UEsRISeUAVLoS path lossNOMAMax
Achi rate
SCA
SDP
CVX solver,
PSO
[77]2D Path
RIS-PhSh,
Ground UERISeUAVProbabilistic
LoS
NOMAAch. rateBlock coordinate descentRiemannian
gradient
[78]3D Placement,
RIS-PhSh
GUsT-UAVRician
ProbabilisticLoS
RSMAWSDRSCAMin Rate and PowerAO and SCP
[80]3D Placement,
RIS-PhSh,
Blocked GUsUAV-BSRician fadingEE (BF) + SRMINPMin SR, PowerBCD: Adam+GA
[81]3D Placement,
RIS-PhSh,
Security
Anti-eavesdroppers
anti-jamming
RISeUAVsmall-scale
Rician fading
Min Max WCSRMDPMin DR, Power
QoS
DRL-DQN-FFM
[82]3D Placement,
RIS-PhSh
Anti-
eavesdroppers
RISeUAV
STAR-RIS
Rician fading NOMAMin SEESCAMin DR,DRL-DDQN
[83]3D Placement,
RIS-PhSh, EH
Maritime
anti-jamming
RISeUAVLAP
Probabilistic
LoS
AR + AEHModel-freeSNR and PowerDRL
SoftMax DDPG
[84]3D Placement,
RIS-PhSh,
Active BF
Static GUsMAT
UAV-BS
Rician channel modelNOMAEESCAMin DR and Power
QoS
MRT
GRP
[85]3D Placement,
RIS-PhSh,
Active BF
Multiple UEsMulti
RISeUAV
Rician channelMax WSRSCA
SDP
PowerInterior point method
[86]3D Placement,
RIS-PhSh,
Active BF
Multiple UEsSwarm
RISeUAV
Rician channel
Probabilistic
LoS
Max WSRAO
Biconvex
Programming
PowerLagrangian dual method
[87]2D path+speed
RIS-PhSh
Video
streaming
UAV-BSRician
channel
QoSAO
SCA
QoS
Time delay
P-BCD
Taylor approx.
[88]3D TrajectoryGround targetUAV-BSProbabilistic
LoS
EEKinodynamic
piece-wise
approx.
UAV
Dynamics
Gradient
[89]3D Path+Speed
RIS-PhSh
Ground UEUAV-BSProbabilistic
LoS
EE
Ach. rate
Model free3D
borders
DRL
DDPG
[90]2D Path
RIS-PhSh,
Ground
vehicles
RISeUAVLoS
path loss
NOMAEE
Ach. rate
MDPPowerDRL
DDPG
[91]2D Path
RIS-PhSh,
Covering hotspotsRISeUAVProbabilistic
LoS
Max
Ach. rate
Energy-aware
MAB
EnergyMAB
[92]2D Path
RIS-PhSh,
IoT devicesUAV-BSRician
channel
TDMAMax
sum-rate
SCA,
Stackelberg game
Power
Energy price
CVX solver
BCD
[93]2D Path
RIS-PhSh
Ground
Vehicles
RISeUAVfree space
path loss
Max
Ach. rate
Mixed integer
SCA
PowerConvex solver CVX
[94]2D Path
RIS-PhSh
V2VRISeUAVLoS
path loss
Max
Ach. rate
AO
SCA
Convex solver CVX
[95]Aerial
backhauling
Traffic
monitoring
LAP UAV-BS
HAP RISeUAV
FSPL
AR of ULA
EE, SNRAOFHREWeiszfeld
[96]2D path
IOS-PhSh
UAV Downlink
Rate Enhancement
UAV-BS
IOS
Rician
Channel
MAX SNRAOConvex solver CVX
[97]2D Path+Speed
RIS-PhSh
Mobile Edge ComputingRISeUAVRician
Channel
EESCACPU
frequency
Dinkelbach
[98]2D Path
STAR-RIS-PhSh
Multiple
Ground UEs
STAR-RISRician
Channel
Rayleigh
fading
Max SRMDPMin DR
Power
DRRL
[99]2D Path
RIS-PhSh
MTC for
IoTs
RISeUAVRician ChannelNOMAMax Min RateSCAMin SNRConvex solver CVX
[100]2D PathIoVsMulti
UAV-BS
Rician
Channel
EE
Max
Ach. rate
SCAMin
Ach. rate
Convex solver CVX
[101]2D Path+Speed
RIS-PhSh
IoVsRISeUAVLoS
path loss
Max
Ach. rate
MDPMin
Ach. rate
DRl
DDPG
[102]2D Path
RIS-PhSh
Secrecy,
Cognitive
communication
RISeUAVRician fadingMax
Ach. rate
MDPMin
Ach. rate
DRl
DDPG, DCCN
[103]2D Path
RIS-PhSh
AoI
IoTs
RISeUAVRician fadingMin AoIIterative
BCD
Min
Ach. rate
Convex solver CVX
[104]2D Path+Speed
RIS-PhSh
MEC
IoTs
UAV-BS
RISeUAV
Rician
Channel
EE
CPU allocation
Mixed
nonconvex
CPU
frequency
Double DQN
[105]2D Path
RIS-PhSh
Power transmit
Secure
MEC
UAV-BS
IOS
Rician fadingEE
Ach. rate
AO, SCA, LP, SDRCPU
frequency
CVX
Branc and bound
[106]2D Path
RIS-PhSh
Improve QoSUAV-BS
IOS
Rician fadingTDMAEE
Ach. rate
Mixed integer non-convex
SCA, BCD
Min
Ach. rate
Convex solver CVX
[107]2D Path
RIS-PhSh
Dynamic BS-BF
V2V
IoVs
UAV-BSEE
Ach. rate
MDPPowerDRL
DDPG
[108]2D Path
RIS-PhSh
MECRISeUAVProbabilistic LoSEEMDPCPU
frequency
DRL
[109]2D Path
RIS-PhSh
Covert
communication
RISeUAVRician fadingEE
Ach. rate
AO
SCA
PowerConvex solver CVX
[110]2D Path+Speed
RIS-PhSh
Power transmit
Aerial LoS links for UEsRISeUAVRician fadingEE
Ach. rate
AO
SCA
Power
Min
Ach. rate
Convex
DRL
Heuristics (WOA)
[111]2D Path
RIS-PhSh
BS-BF
Satellite-UAV-
Terrestrial
RISeUAVRician fadingErgodic rateMDPUAV
Energy
DRL
LSTM-DDQN
[112]2D Path+Speed
RIS-PhSh
BS-BF
Multiple UEs RISeUAV
Active RIS
Rician fadingRSMAEE
Rate/Power
MDPEEMeta DRL
SAC
DDPG
[113]2D Path
RIS-PhSh
Maritime Anti-jammingRISeUAVProbabilistic LoSEEMDPQoS for
Maritime UE
DRL
PPO
[114]2D Path
RIS-PhSh
Disaster
management
UAV-BS
STAR-RIS
Rician fadingNOMA MDPMin
Ave.Rate
DRL
PPO

4. UAV Navigation and Control

The channel model and communication performance indices of the UAV-aided communication depend on the UAV position in the 3D coordinates. Also, when it comes to multiuser scenarios or remote areas, the UAV path impacts communication performance. However, the onboard battery capacity is limited, and energy consumption for hovering and propulsion must be considered to obtain a minimum path with minimum energy consumption for the endurance of the navigation. Nevertheless, in the context of UAV-enabled communication support for mobile nodes, such as IoVs, the UAV speed should be taken into account in the path-planning technique. Moreover, in dense urban areas with buildings and skyscrapers appearing as obstacles, obstacle-free trajectory optimization for crash-avoidance navigation is necessary where motion constraints such as speed, acceleration, and nonholonomic must be considered [20,115]. The nonholonomic constraint, which is explained as the heading change limit of fixed-wing UAVs, has been considered in a few works in the wireless communication community, e.g., as curvature-constrained trajectory [116]. Nevertheless, quadrotor drones possess rotational limitations that can be modeled as nonholonomic constraints. In this light, the UAV dynamic-aware kinematic (kinodynamic) motion model should be used [117], which is the main shortcoming in the wireless communication community.
Although these motion constraints with kinodynamic models have been extensively used in the robotic and control communities [118,119], UAV navigation in the context of wireless communication brings other objectives and constraints to the optimization problem which makes it computationally more complicated. Notably, for autonomous navigation, the trajectory optimization, including both channel performance and navigation indices, must be solved in real-time and without relying on external resources. We review relevant works and highlight the shortcomings from this critical perspective for dense urban areas.

4.1. UAV Placement

In most studies, UAVs are deployed to deliver wireless communication coverage for stationary or quasi-stationary UEs [120]. Examples are on-demand coverage when the terrestrial cellular network is not available or congested due to natural disasters or social events [121]. Further, a team of UAVs may be adopted to create an aerial cellular network [122], where RISs are deployed on uneven terrains to assist the UAV-BSs in eliminating coverage blind spots and extending coverage. In such situations, the 3D allocation and placement of the UAV(s) are important factors in enhancing the coverage and channel performance [75], e.g., there is a compromise between channel gain and coverage [49].
The placement of the RIS-assisted UAV-BS has been considered in [80] to provide wireless channels for blocked ground users. The UAV-BS placement problem is solved using the Adam optimizer, a gradient-based optimization, which is a popular optimization algorithm for solving stochastic optimization problems in machine (deep) learning [80]. The RISeUAV takes advantage of both UAVs and RISs simultaneously to improve future WCNs by reflecting signals in the sky. However, high-quality aerial LoS links, imperfect CSI in highly dynamic environments, etc., make the RISeUAV-assisted channel links more vulnerable to both adversarial eavesdropping and malicious jamming. In [81], a secure communication strategy for RISeUAV was proposed to maximize secrecy rates while meeting QoS requirements against eavesdroppers and jammers. The method jointly optimized transmit beamforming, artificial noise, RISeUAV placement, and RIS phase shift to handle mixed-attack scenarios. To solve the non-convex optimization problem in dynamic environments, a post-decision state deep Q-network (DQN) with Fourier feature mapping (DQN-FFM) was introduced for robust anti-attack transmission
With STAR-RISs, the coverage of the RISs is extended to 360 degrees by simultaneous transmission and reflection [123]. RISeUAV with STAR-RIS can increase transmission security by reducing interference and controlling unfavorable environments for signal eavesdropping. Therefore, the placement of RISeUAV with STAR-RIS has been studied [82]. An iterative method was used for UAV placement in static scenarios, with fractional programming, SCA for power control, semidefinite relaxation for transmission/reflection design, and a search-based approach for STAR-RIS positioning. For mobile scenarios, a double DQN (DDQN) algorithm was employed to learn an online UAV path design policy from a long-term perspective.
Further, RISeUAV can be beneficial in a maritime communication system against jamming attacks [83]. The RISeUAV placement and RIS phase shift are determined using the DRL technique targeting energy efficiency, BS transmit power constraints, energy harvesting in simultaneous wireless information and power transfer (SWIPT), and QoS requirements for maritime UEs.
To obviate concerns regarding the limited onboard energy and payload, the application of a tethered UAV as an airborne BS has been proposed [78], where the tether provides a stable power supply and backhauling [124]. The limitation imposed by the limited length of the tether, particularly of cell-edge UEs, can be compensated by mounting RIS on the surrounding buildings. The placement of the tethered UAV along with the RIS phase shift, is optimally determined in [78] to maximize the weighted sum data rate (WSDR) of ground users by using RSMA as communication technology.
The coverage area may be large and one UAV cannot cover all UEs; therefore, a network of UAVs can be employed [84]. In these situations, the hovering position of UAVs is determined by taking the inter-UAV distance as a constraint.

4.2. Path Planning and Trajectory Design

Based on the existing papers and practical considerations, we have classified the literature that has considered UAV navigation into three categories:
(1)
Two-dimensional path planning where UAV flies at a fixed altitude and the UAV waypoints are optimized through the path in a horizontal plane.
(2)
Two-dimensional path-plus-speed considering the UAV energy consumption for propulsion.
(3)
Three-dimensional trajectory optimization [125] while considering practical UAV navigation factors and motion constraints such as:
(i)
Obstacle-free trajectory planning for crash avoidance navigation [126].
(ii)
Considering kinematic motion constraints such as speed, acceleration and nonholonomic constraints [127,128].
(iii)
Dynamic-aware motion primitives or input jerks of the trajectory to eliminate path tracking controller [129].
Remark 8.
From the practical point of view, a path-tracking controller is required for path-planning optimization methods that determine waypoints of the UAV path rather than UAV motion inputs.
Remark 9.
The difference in path planning (in the first group of works) with trajectory design is that, in the latter, time is an extra factor that is considered in the optimization problem. Therefore, in addition to the waypoint, the UAV speed along the path should be optimally determined (second group). Nevertheless, when it comes to obstacle-free UAV navigation in dense environments (e.g., for IoVs support in smart cities) kinodynamic-aware motion constraints and motion primitives should be determined to make the trajectory practically feasible (third group).
Remark 10.
In the majority of relevant works in the wireless communication community, obstacle-free navigation considering motion constraints has been overlooked [36,40,130], which makes it impractical from the robotic navigation perspective in practice. Additionally, in some works in the wireless communication community, the path planning is called trajectory, which is misleading from the robotic and UAV motion perspectives.

4.2.1. Two-Dimensional Path Planning

Basically, in the 2D path planning, the optimization variables are the UAV-BS or RISeUAV waypoints p R U = x [ k ] y [ k ] z F i x e d at consecutive time samples (slots) to maximize the achievable rate and throughput of UEs. Therefore, based on the achievable rate formula in (9) and (10), the optimization problem is defined as follows:
P 1 : O F 1 . m a x P R U       log 2 1 + M p R U p B S 2 d B S R U p R U p U E 2 d R U U E s. t. C 1 1 . p R U k + 1 p R U k 2 2 < D
where P R U = p R U k ,   k 1 ~ K denotes the path including waypoints corresponding to discretized samples times from 1 to K ; D = δ V m a x denotes the maximum distance the UAV can fly at each sample time based on its maximum linear speed V m a x .
Based on Remark 3, the objective function OF1 is nonconvex, which is studied in Section 6. Constraint C 1 1 imposes the speed constraints. However, as can be seen in P 1 , the UAV motion constraints, including velocity/acceleration/nonholonomic constraints, as well as obstacle-free navigation, have not been considered. Moreover, an extra control loop is required for path tracking. Therefore, the produced path may not be feasible for practical applications, unless it is for long obstacle-free paths.
The 2D trajectory optimization of the RISeUAV has been studied in [48] by considering power transmit and RIS phase shift as joint objectives. The joint optimization problem is solved with iterative optimization and decomposing the OF into three optimization problems. Only UAV speed has been considered as a constraint, and motion constraints and obstacle-free navigation have not been considered. The finite flying time has been discretized into N ; some time slots and the waypoints of the 2D trajectory are obtained for each sample time that maximizes the objective function, which is the throughput of UEs. It is almost the case in many relevant works in 2D path planning, see Table 1.

4.2.2. Two-Dimensional Path-Plus-Speed

Along with the UAV 2D path, the UAV speed is optimized based on the UAV energy consumption for propulsion which consumes a major part of the overhead energy. The propulsion energy consumption of a rotary-wing UAV is obtained based on the UAV speed [131]:
E U A V = δ P 0 1 + 3 v 2 r 2 ϖ 2 + d 0 ρ s A r 2 v 3 + P i 1 + v 4 4 v 0 v 2 2 v 0 1 2 ,
where E U A V denotes propulsion energy consumption at sample time δ as a function of the UAV linear speed v . Physical parameters of the quadrotor impacting the energy consumption are given in Table 2. The propulsion energy consumption formula given in (24) has been used as the objective function to optimize the UAV speed [87], and some other works that studied 2D path-plus-speed (or acceleration [132]), are given in Table 1.
However, there are several critical issues with this model. First, it imposes significant computational overhead due to the need to solve the optimization function, including the non-convex formulation in (24). Additionally, using this model for optimizing the UAV’s 3D trajectory in dense urban areas with obstacles is computationally prohibitive and inefficient. In environments with mobile vehicles and IoVs, the UAV’s speed must be adaptable to maintain LoS paths for vehicles, as a fixed speed is impractical. Furthermore, when the UAV hovers, its speed and energy consumption are fixed and known. Therefore, this model may be useful for obstacle-free long-distance flight at fixed speed (optimal speed) but is not practical in dynamic urban areas with mobile UEs.

4.2.3. No-Fly Zone

The 2D path planning and the 2D path-plus-speed optimization techniques are suitable for stationary, quasi-stationary UEs in wide and non-dense areas. However, these methods are not effective for UAV navigation in dense urban areas and, particularly, for mobile UEs and IoVs. Notably, in the RISeUAV or ground RIS-assisted UAV-BS communication, the channel gain of the indirect CLoS link significantly increases when the UAV altitude is high. Therefore, the UAV may be required to fly at lower altitudes among the buildings to provide LoS links for IoVs. It makes the crash avoidance navigation critical which should be considered in the trajectory optimization function [126].
In some works, the concept of no-Fly zones has been considered [130,133] that should not be violated by the UAV path. L. Wang, et al. [89] have considered 3D path-plus-speed optimization for RIS-assisted UAV communication for ground UEs. No-fly zones have been modeled as Min and Max boundaries of 3D Cartesian coordinates. However, when it comes to real-time trajectory optimization for autonomous navigation, the formulation is problematic because modeling obstacles is a mixed-integer programming [134] in the context of convex programming, which imposes computational burdens. Moreover, kinodynamic motion constraints have not been considered. To this end, the third group of works considered 3D trajectory optimization using the UAV kinematic equation of motion.

4.2.4. Three-Dimensional Trajectory

In the third group of works, which includes only a few studies, the UAV kinematic equation of motion has been used for trajectory design [135]. Also, obstacle-free navigation and motion constraints are modeled to make the trajectory feasible. Further, the motion primitives of input jerks generated by the trajectory optimization problem can be used for UAV control without an extra controller required for path tracking. In this section, we consider factors affecting the UAV trajectory design such as obstacle-free path planning for crash avoidance as well as motion constraints to make the generated trajectory feasible in practice.
To the best of our knowledge, [88] is a rare work in wireless communication that has considered dynamic-aware 3D trajectory optimization. In this work, the conversion efficiency of electric motors, associated with quadrotors, has been considered in the trajectory optimization problem. For this reason, the energy consumption of the quadrotor for hovering and flight is obtained based on the power consumption of the rotors that is developed by using electromechanical formulations of rotors. Although accurate, the developed trajectory optimization method in [88] imposes prohibitive computational complexity for solving the trajectory optimization problem in real time, which is required for the autonomous navigation of the UAV. Additionally, the obstacle-free trajectory has not been considered, which makes the proposed technique ineffective for dense urban areas.
We have considered this requirement in our previous works and studied the kinematic-aware crash avoidance RISeUAV trajectory design in dense urban environments for intelligent vehicles [41] and IoVs [33,136]. However, a generic approach is required with a linear kinodynamic model and constraints for computationally efficient and real-time trajectory optimization for autonomous navigation applications. To bridge the gap, we have developed a kinodynamic-modeling-based trajectory optimization for UAV navigation in dense environments [117].
The basic obstacle-free trajectory optimization problem for a UAV-BS while satisfying kinodynamic motion constraints is modeled as P 2 for each sampling time k :
P 2 : O F 2 . m i n U k       w 1 1 U k 2 2 O F 2 1 + w 1 2 I V = 1 I o V s γ U A V _ I V L o S p U A V k p I V I o V [ k ] 2 2 O F 2 2 s. t. C 1 1 . X k + 1 = G X k + H U [ k ] C 1 2 . ξ k P O b s t a c l e = C 1 3 . Z m i n z [ k ] Z m a x C 1 4 . v x y k = v x k , v y [ k ] 2 V m a x ,         u z k U m a x γ 1 v x y k ; C 1 5 . a 2 A m a x ; C 1 6 . ψ k ψ m a x
where U k = u 1 k , u 2 k , u 3 [ k ] denotes the input jerks to the UAV motion control system; the objective function O F 2 1 minimizes the energy effort for navigation; objective function O F 2 2 minimizes the average distance between UAV position at sample time k (i.e., p U A V k ) and positions of the intelligent vehicle IV in IoVs (i.e., p I V I o V k ,       I V I o V s ) that have valid LoS links with the UAV, where γ U A V _ I V L o S 0,1 is the binary variable which is 1 for valid LoS links and 0 otherwise; C 1 1 models kinodynamic equation of motion; C 1 2 satisfies obstacle-free navigation, where P O b s t a c l e denotes the 3D coordinates of obstacles (i.e., buildings and skyscrapers); C 1 3 limits the UAV altitude; C 1 4,5 impose speed and acceleration constraints; and C 1 6 imposes heading change nonholonomic constraint, where ψ k = tan 1 v y k / v x k , with v x k and v y k denoting the linear horizontal velocity along the X and Y axes, respectively. The following points can be observed from P 2 .
  • P 2 is non-convex for C 1 2 and C 1 6 . The solutions are discussed in Section 6.
  • The motion primitives in U k can be input speed or acceleration based on the density of the environment, see [117]. For example, as per Figure 4a, the input can be given as U = u , v x = v cos θ , v y = v sin θ .
  • A linear kinodynamic model should be used for modeling C 1 1 to make the trajectory optimization problem computationally feasible for real-time, particularly for use in the context of model predictive control [117].
  • In the context of wireless communication support for IoVs in dense urban environments, modeling probabilistic LoS links modeled in (22) is not effective and reliable for safe autonomous driving. Therefore, deterministic LoS links modeling is considered in the optimization problem by embedding γ U A V _ I V L o S 0,1 , which makes the trajectory optimization a mixed-integer programming [93] and NP-hard optimization problem for modeling LoS links, which is highlighted in Lemma 1.
  • O F 2 2 minimizes the UAV-IoVs distances which based on the channel model in (2), maximizes the channel gain. However, for the RISeUAV, based on the channel model in (9), the cascaded double LoS paths should be used as follows:
    O F 2 3 = n = 1 N I V = 1 I o V s γ R U _ X n L o S p n X [ k ] p R U k 2 2 γ R U _ I V L o S p R U k p I V I o V [ k ] 2 2 ,
    or
    O F 2 4 = I V = i I o V s I V = j I V i I o V s γ R U _ I V i L o S p i I o V p R U k 2 2 γ R U _ I V j L o S p R U k p j I o V [ k ] 2 2 ,
    where O F 2 3 can be used for RISeUAV (RU), providing aerial CLoS link for V2X communication (with p n X [ k ] denoting the position of X that can be BS, pedestrian, ….); O F 2 4 can be used for RISeUAV (RU) to facilitate V2V communication [94].
  • In the case of the RISeUAV, where O F 2 3 and O F 2 4 may be used, the objective function is nonconvex, which is discussed in the solution in Section 6.
  • In formulating the m i n optimization problem P 2 , we have used the following technique. Instead of using a max problem for achievable rate maximization in (9) and (10) with double CLoS path model in the denominator, we used the m i n optimization problem by using O F 2 2 , O F 2 3 , and O F 2 4 with the double CLoS path model in the nominator. These two min and max problems are equivalent, see the solutions in Section 6.
  • The optimization variables in P 2 are input jerks (motion primitives) to the UAV motion system. Therefore, they can be directly used for UAV navigation without the requirement of an extra path-tasking or path-following controller.
  • Constraints related to channel performance and QoS (e.g., the minimum achievable rate for each UE or IoV) are not considered in P 2 . However, it is typical in alternating optimization methods (such as SCP and SCA) for problem objectives to be solved iteratively by relaxing other objectives or constraints.
Lemma 1.
UAV trajectory optimization with valid LoS paths between UAV and target nodes, which are randomly obstructed (e.g., by building), is an NP-hard problem for convex programming.
Proof of Lemma 1.
When UAV waypoints experience LoS link obstructions due to obstacles (e.g., buildings), these obstructions can be modeled as fictitious obstacles that must be avoided. However, validating LoS links in such scenarios is computationally expensive. Specifically, it involves processes such as linear interpolation and checking whether the interpolated points lie within the set of obstacles, P O b s t a c l e Furthermore, the UAV’s goal position is uncertain and depends on the movements of IoVs (ground vehicles). This means that the optimal UAV trajectory is dynamically affected by IoV movements, as described in O F 2 2.3,4 . As a result, the validation process requires checking an infinite number of potential (random) paths, which leads to the NP-hardness of the trajectory optimization problem in the context of wireless communication support for IoVs in future B5G and 6G networks. □
Remark 11.
Lemma 1 highlights an open research question that has not been thoroughly investigated in the literature.

5. Applications and Services

In this Section, we explore RIS-assisted, UAV-enabled communication from the perspectives of applications, services, aerial packages, UAV design, and RIS technologies. We briefly highlight some works and their methods, with a comprehensive list of relevant studies provided in Table 1.

5.1. Services

One of the promising applications is utilizing UAVs as aerial support for ground vehicles in dense environments, heavy roads, and traffic jams. In traffic monitoring, the UAV-BS can be deployed for malfunction or congestion relaxation for terrestrial cellular networks. However, the ground backhauling through direct LoS links for UAV-BSs may be randomly blocked by buildings due to the UAV-BS movement, whereas the backhaul rate must be high enough to support the traffic. Therefore, aerial backhaul system has been proposed through a high-altitude aerial platform (HAP) balloon RISeUAV [95], as shown in Figure 6. The passivity of the RIS element facilitates energy-efficient aerial LoS backhauling. The other advantage is that the aerial balloon RISeUAV can provide isotropic ( 0 ~ 360 ° ) reflection to cover a wider area, which is energy efficient from the UAV propulsion perspective. The 3D placement as well as phase alignment of aerial RISs are optimized so that the source transmit power is minimized. The optimization problem is solved through alternating optimization and using Weiszfeld’s algorithm [137].
As another application, the UAV-relayed, RIS-assisted link was used to enhance satellite-terrestrial communication [138], accounting for hardware impairments and interference when direct LoS links were unavailable. A closed-form expression for the outage probability was derived to assess the impact of RIS and key parameters on system performance. RISeUAV also has been utilized for covert communication [109] to transmit information secretly.

5.1.1. IoTs Sensor Networks

UAVs are effective for enabling timely and reliable data delivery in remote IoT sensor networks. RISeUAV has been used to minimize the average age of information (AoI) of the IoT data received by the BS over time [103]. A time-constrained model-predictive-control-based algorithm, with a mathematically rigorous proof of the optimality, has been proposed for 3D UAV navigation for RIS-assisted data collection from sensor networks on uneven terrain [139].

5.1.2. Internet of Vehicles (IoVs)

Machine-type communications (MTCs) aim to establish a wireless network with low latency, high reliability, energy efficiency, and scalability to support the upcoming IoT applications [99]. The most promising application of UAV-enabled, RIS-assisted wireless communication is for intelligent vehicles and IoVs [136,140]. Enabling reliable V2X connectivity with low-latency communication is a big step toward realizing autonomous driving in smart cities [32,141,142].
The multi-UAV trajectory design has been studied for providing a quick wireless connection for IoVs [100]. The proposed techniques use SCA to handle nonconvexity and decompose the problem into three communication scheduling, power allocation and UAV trajectory optimization sub-problems. A conformal RIS array is mounted on ground vehicles as a relay [107]. To handle dynamic beamforming and complexities associated with adaptively controlling intelligent reflecting surfaces, DRL techniques have been used.

5.1.3. Mobile Edge Computing

UAV-enabled, RIS-assisted communication has been recently applied in the field of MEC [143]. A RISeUAV-assisted MEC is deployed to assist the communication between the ground users [97]. The joint UAV trajectory, RIS passive beamforming and MEC resource allocation design are developed to maximize the energy efficiency of the system. To tackle the intractable non-convex problem, this is decomposed into two subproblems and solved iteratively based on SCA and the Dinkelbach method. The same study is conducted for the UAV-BS MEC assisted with ground RIS [51].

5.2. UAV Design

Depending on the applications, communication technologies, available resources, and UAV navigation objectives, the aerial UAV package can be designed as an aerial base station (UAV-BS) or equipped with an RIS to form a RISeUAV.

5.2.1. UAV-BS

Probably the common form of UAV-enabled wireless communication is utilizing UAVs as airborne BS. See Table 1 for the paper that studied the deployment of UAV-BS. However, the application of UAV-BS as active aerial BS can be computationally prohibitive, expensive, and inefficient in future B5G and 6G networks [144]. Because equipping UAVs with massive MIMO antennas for beamforming capability requires complex baseband processing and channel estimation. This seems impractical, as it makes the aerial package expensive and heavy. Notably, it is against UAV agility which is required to provide aerial LoS communication for intelligent vehicles [145]. Therefore, equipping UAVs with RIS as RISeUAV can be an alternative and cost-effective solution [41].

5.2.2. RISeUAV

RISeUAV, as an emerging integrated approach, has gained significant popularity in the community due to its ability to combine the advantages of both UAVs and RIS [145,146]. RISeUAV can be utilized in various applications such as joint wireless power transfer (WPT) and wireless information transfer (WIT) [83], for ergodic communication [147], mobile ground nodes [148], IoTs [149], vehicles [93], multi-layer MEC [150], disaster management [121], anti-jamming maritime [113], free-space optical communications [151], and aerial LoS links for intelligent vehicles [33,41,136]. See Table 1 for more papers that have used RISeUAV.
A theoretical model for analyzing the uplink performance of RISeUAV communication systems with a random 3D mobile pattern is presented in [152]. In this model, a random 3D mobility pattern for UAVs is considered, incorporating both random waypoint and uniform mobility models. Subsequently, an end-to-end transmission model for the RISeUAV communication system is developed, accounting for the effects of channel fading, RIS configuration, UAV mobility, and association policies. By combining these models, analytical expressions for uplink transmission metrics are derived, along with a performance-bound analysis.
The RISeUAV may experience random fluctuations due to wind disturbances and propeller rotations, leading to misalignment of reflected signal phases [54]. A 3D RISeUAV channel model, proposed in [153], simulates UAV fluctuations using random processes. Key statistics, including the temporal correlation function (TCF), Doppler power spectral density (PSD), and ergodic achievable rate, are derived. The results indicate that even minor vibrations can introduce additional Doppler frequency components, significantly reducing the temporal correlation and achievable rate of the RISeUAV-assisted channel, particularly when operating at high-frequency bands.
The RISeUAV may experience random fluctuations due to wind disturbances and propeller rotations. This leads to the misalignment of reflected signal phases [54]. A 3D RISeUAV channel model has been proposed in [153] where UAV fluctuations are simulated by random processes. Statistics including temporal correlation function (TCF), Doppler power spectral density (PSD), and ergodic achievable rate are obtained. Results show that even for a minor vibration, the UAV wobbling can introduce extra Doppler frequency components and significantly reduce the temporal correlation and achievable rate of the RISeUAV-assisted channel when systems operating at high-frequency bands.

5.2.3. Solar-Powered UAVs

Toward more sustainable and carbon-neutral environments, solar energy has been extensively utilized in the energy sector [154], as well as in solar-charged batteries [155]. Solar-powered UAVs are expected to see increased usage in the future due to advancements in solar panels and microcontrollers [156]. The solar-powered RISeUAV has also garnered attention in the wireless communication community as a means of providing supplementary propulsion power [157]. The optimal joint active and passive beamforming, along with the energy-constrained RISeUAV trajectory, is derived in closed form, while also optimizing the UAV’s size, weight, power limitations, reflecting elements, and flying/hovering time.

5.3. RIS Technologies

Different RIS technologies and variant types have been studied in the literature.

5.3.1. Intelligent Omni Surface

Different from the RIS which only reflects signals to the same side of the incident signal, the intelligent omni-surface (IOS) can also reflect and refract the signals to both sides of the surface [158], thereby providing full-dimensional rate enhancement [159,160]. The joint UAV trajectory and phase shift of IOS has been optimized in [96,105] by maximizing the achievable rate in the context of MEC.

5.3.2. STAR-RIS

Unlike conventional RIS, which only reflects incident signals, STAR-RIS transmits and reflects signals, enabling 360-degree coverage but requiring more complex coefficient design. In [98], a sum-rate maximization problem is addressed through joint optimization of UAV trajectory, active beamforming at the UAV, and passive beamforming at the STAR-RIS, using RL for decision-making to manage unknown obstacles. To bolster system robustness against environmental uncertainties, a distributionally robust RL (DRRL) algorithm is introduced, providing reliable worst-case performance. Results show that STAR-RIS enhances sum-rate performance compared to traditional RIS and that DRRL ensures more stable and robust outcomes than existing RL methods.

5.3.3. Holographic Surface

The reconfigurable holographic surface (RHS) is a type of RIS [161]. The RHS performance is very similar to that of RIS, with two major differences in the operation and application: (1) RHS consists of metamaterial elements with tunable radiation amplitude, which makes it feasible to tune the radiation pattern of the planar surface. Therefore, beamforming is implemented by controlling the radiation pattern of RHS elements rather than controlling the phase shifts [162], which makes it energy-efficient. (2) The RHS can function as a transceiver rather than only reflecting signals. UAV may be equipped with RHS as RHSeUAV that propagates communication signals generated by the UAV rather than reflecting external signals [12]. This results in two main advantages: (1) compared with UAV-BS, the onboard package of the RHSeUAV is energy efficient as the RHS adjusts the radiation patterns through the holographic surface that obviates active/passive beamforming [162]; (2) compared with the RISeUAV, the RHSeUAV’s flight becomes independent of the ground MIMO BSs which adds more freedom for optimal navigation [163].

6. Solutions to Optimization Problems

In UAV-enabled, RIS-assisted communication, various objectives are considered, such as UAV placement and trajectory design, UAV energy consumption for communication and beamforming, BS power transmission, RIS ON/OFF status, phase shifts, and resource allocation. These objectives are typically formulated as optimization problems. Convex programming is the most widely used solution due to its optimality and reduced time complexity. However, due to the complexity of the multilateral optimization problem, real-time solutions may not always be feasible, and the optimization process may converge to a sub-optimal solution after applying multiple convex relaxations. In such cases, heuristics and machine learning methods can be employed

6.1. Convex Programming

Convex programming is an effective technique for real-time optimization. However, nonconvexity in the optimization problems, including both objective functions and constraints, is common in UAV-enabled, RIS-assisted communication. As a result, alternating optimization (AO) and iterative optimization methods, such as SCP and SCA, are typically used to address the nonconvexity of these problems [100]. The nonconvexity in RIS-assisted UAV-enabled communication arises primarily from two sources: the channel modeling of the CLoS link and the nonholonomic constraints involved in trajectory optimization. Depending on the specific system and problem setup, additional nonconvexity terms may also be introduced into the optimization problem
To tackle the complexity, the optimization problem is normally decomposed into three sub-optimization problems: (P1) power allocation for communication; (P2) beamforming and phase shift design; and (P3) path-planning and trajectory optimization; in each of which other optimization variables are constant.
For example, by considering a fixed trajectory and phase shift design the power transmission problem P1 in the achievable rate formula in (10) is solved using a standard convex programming solver such as CVX [48]. Then, the phase shift design rule is given in Equation (8). However, the trajectory optimization problem P3 is nonconvex as we highlighted in Remark 3. To tackle this issue, slack convex objective function is utilized as per the convex relaxations technique presented in Lemma 2 given from [164].
Lemma 2.
With given Q1, Q2, Q3, 𝜏 and κ all positive values, function  f ( x , y ) is convex with respect to x > 0 and y > 0
f ( x , y ) = log 2 Q 1 + Q 2 x τ 2 y κ 2 + Q 3 x τ y κ ,
See the proof in [164].
Since f ( x , y ) is convex with respect to x and y , it can be linearized by applying the first-order Taylor expansion at a given point [164].
Other useful tools are the following inequalities:
a · b   a b
a 2 + b 2 1 2   a + b
For instance, to handle the nonconvexity of the optimization problem, after applying the phase shift rule (8), the equivalent formula of the achievable rate in (10) is obtained by using inequality (28) and applying Euler’s formula in [96]. Then, by the first-order Taylor approximation, the convex model is developed and solved by a standard convex (CVX) solver. Also, the nonconvexity of the UAV linear speed optimization formula in (24) has been tackled by applying the inequality (29) in [97] to obtain the convex upper bound of (24).
Alternative methods are defining convex slack variables. For example, (9) is formulated as
max g C L o S T R max α β ,
where α and β are slack variables corresponding to d T _ R I S and d R I S _ R in (9), respectively. Then, the following constraints are applied:
α p T x p R I S 2 d T _ R I S             &             β   p R I S p R x 2 d R I S _ R ,
Then, it is proved that the relaxed recasting problem is equivalent to the original problem [94]. The maximization problem in (30) is globally lower-bounded by calculating the first-order Taylor expansion of (31) at the local point. The nonconvexity of the (30) itself can be handled by defining a new slack variable ξ and imposing additional constraint ξ α β , which can be linearized by applying the logarithm function to the formula ( ln ξ ln α + ln β ) and linearizing it by using the first-order Taylor expansion [94].
The solution to nonconvexity of nonholonomic heading constraint C 1 6 in P 2 can be found in Lemma 1 in [117].

6.2. Heuristics Algorithms

Metaheuristic optimization methods, such as evolutionary algorithms including genetic algorithms (GA), particle swarm optimization (PSO), quantum PSO (QPSO), and simulated annealing (SA), are popular techniques in the engineering field [165,166,167]. These methods are useful for solving optimization problems that are highly nonlinear, nonconvex, and complex. They can also be applied when the system’s mathematical model is unclear or too complex to develop.
PSO and SA have been used in a hybrid algorithm for RISeUAV deployment and RIS elements allocation [70]. The authors of [75,168] have used the PSO technique as the benchmark to evaluate their proposed RISeUAV path planning method. Further, GA has been used to solve subproblems of RISeUAV path planning [80]. To tackle the computational complexity of the multilateral optimization problem the blocked coordinate descent (BCD) alternating optimization approach is used. The optimization problem is regarded as mixed integer nonlinear programming (MINP), and different objectives are solved using a combination of heuristic and gradient-based techniques. A combination of binary and continuous GA is used to solve the UAV beamforming and RIS ON/OFF and phase shift optimization problem.
Although heuristic optimization methods are easy to formulate and solve, they suffer from the risk of being trapped in sub-optimal solutions and require extremely long runtimes. Additionally, these methods lack learning capabilities, making them unsuitable for real-time optimization. As a result, machine learning (especially deep reinforcement learning, or DRL) techniques have gained popularity in recent years.

6.3. Machine (Deep) Learning

Machine learning and AI-assisted techniques have gained increased attention for handling the nonlinearity, nonconvexity, and computational complexity of complex engineering problems [169]. In addition to the nonconvex formulation associated with UAV-enabled, RIS-assisted communication and trajectory optimization, challenges such as imperfect CSI, dynamic environments, and uncertain channel conditions further complicate the problem. As a result, machine learning techniques have been increasingly considered in the wireless communication community.
Aiming to improve the performance of RISeUAV communication channels, the authors in [170] proposed a machine learning-based beamforming policy for UAV-RIS by employing prioritized experience replay (PER) based deep Q-Network (DQN). Further, they used a DDPG-based beamforming approach for secure UAV-RIS beamforming under imperfect channel estimation [171].

Deep Reinforcement Learning (DRL)

Among AI-based machine learning techniques, DRL is the most popular one in the community, see Table 1. DRL works based on Markov decision process (MDP) and dynamic programming for estimating future reward in the MDP for training DQN [136].
The most common DRL agent is the actor-critic deep deterministic policy gradient (DDPG) agent. A schematic of the DDPG DRL agent including actor-critic deep networks is illustrated in Figure 7. Based on the MDP, the actor network π ϕ A receives the current state S [ k ] (e.g., positions of the RISeUAV and IoVs) and takes action A [ k ] = π ϕ A S [ k ] in the permitted action space (e.g., the action may include UAV motion speed inputs or motion primitives as well as RIS-PhSh). Based on the taken action A [ k ] , the rewards R [ k ] and new state S [ k + 1 ] are determined based on the simulated environment. For example, the RISeUAV takes the given action and moves through the path or generated trajectory. Then, the channel gain and communication performance indexes are obtained to calculate the reward. The new state S [ k + 1 ] is the new positions of the RISeUAV and IoVs. The critic networks Q ϕ c S k , A [ k ] , is embedded to predict future rewards, and is trained by minimizing the error function of the calculated actual reward R k and its estimated rewards Q ϕ c S k + 1 , π ϕ A S k + 1 . Therefore, critic Q ϕ c S , A is a Q-value function based on the recursive Bellman equation:
Q ϕ c S k , A k = E R k + γ Q ϕ c S k + 1 , π ϕ A S k + 1
where γ is the discount factor for the future award, and E denotes expectation.
The critic parameters ϕ c are updated by minimizing the loss function L given by all sampled experiences out of M random mini-batch of experiences (trial-and-error episodes)
L = 1 M i = 1 M y i k Q ϕ c S k , A i k 2
where
y k = R k + γ E R k + 1 = R k + γ Q ϕ c t S k + 1 , π ϕ A t S k + 1 ;
The actor parameters ϕ A are updated using the sampled policy gradient by applying the chain rule to the expected return that maximizes the expected discounted reward:
ϕ A   J = 1 M i = 1 M ϕ A   Q ϕ c S k , π ϕ A S k ; = 1 M i = 1 M π   Q ϕ c S k , π ϕ A S k ϕ A   π ϕ A S k
However, the design of the DRL structure, including the deep networks and the architecture of the actor-critic, the method of observing the system state, the action-taking process, reward functions, and the training algorithm of the deep neural network, all significantly impact the performance of the DRL agents. In [136] we have trained two DRL agents, i.e., RU-LoSNet and RU-PixelNet for the trajectory design of RISeUAV for IoVs in dense urban areas. The RU-PixelNet, with convolutional neural networks (CNN) architecture, showed promising performance by receiving pixels of aerial images as the input. Pixels indicate the IoVs’ positions and RIseUAV’s current position as the state input. However, it was trained offline by developing the occupancy map of the dense urban area and detailed channel modeling.
Nevertheless, there are critical issues with the DRL agent. Its dependency on MDP and randomness of the environment (e.g., random obstruction of LoS paths) makes the training process challenging. Specifically, frequent terminating the trial-and-error episodes, due to violating constraints, may make the training process unstable. Tuning the algorithm and hyperparameters to achieve stable results may lead to a conservative non-optimal solution. Soft actor-critic (SAC) DRL agent seems to be the most effective agent by considering the policy entropy (i.e., policy uncertainty) to promote more exploration while training the actor-critic in a stochastic environment [136]. Another problem is that the DRL training is based on dynamic programming to estimate future commutative rewards, see (32). On the other hand, the UAV’s final position is uncertain depending on the IoVs routes. Therefore, training DRL agents as UAV path planners in the Markovian process of a random environment can be problematic.
As an alternative solution, for the first time, we have proposed training generative adversarial networks (GANs) offline to generate random trajectories in real-time [172]. GANs are very popular in computer and data science to create fake data (e.g., images) when the source data are not sufficient for training. We have used this feature for real-time trajectory generation for RISeUAV or UAV-BS in dense urban environments. Since GANs do not rely on MDP, the GANs path planner can achieve more optimal results compared to DRL agents.
Federating learning is a popular technique for training multi-DRL agents where data privacy is a matter of concern [173].

6.4. Game Theory

The joint communication performance and energy-efficient (RISeUAV or UAV-BS) trajectory optimization can be regarded as the (bandit or Stackelberg) game theory approaches [91,174]. Because the UAV may navigate more spaces to improve communication performance, it consumes more energy for propulsion. Other game players can be bandwidth split, energy trading for communication, RIS allocation, etc.
The RISeUAV navigation for WiGig communication is modeled as a contextual multi-armed bandit (MAB) game [91], where the UAV acts as the learner. It aims to maximize its rate (reward) by serving various trajectory hotspots, considered as the bandit’s arms. The joint optimization of received signal strength at the UAV and users’ energy efficiency is modeled as a single-leader/multiple-followers Stackelberg game [175]. The UAV, as the leader, optimizes phase shifts for improved signal quality, while users, as followers, engage in a non-cooperative game to maximize their energy efficiency by adjusting uplink transmission power.
In RIS-assisted UAV communication for IoT sensor networks, IoT devices use energy from various providers, prompting an energy trading mechanism via a hierarchical Stackelberg game [92]. IoT devices aim to maximize their rate benefit minus payment for wireless charging, while energy providers balance revenue and energy costs. To assess fairness, objective functions based on sum-rate and minimum-rate maximization are defined, optimizing UAV trajectory, BS transmit power, and RIS phase shift.

6.5. Time (Computational) Complexity

An important consideration in the trajectory optimization of UAVs for IoVs is the time complexity associated with the formulated optimization problem and its solution. UAVs are designed to navigate autonomously and support IoT and IoV systems [117]. This necessitates that the optimization process be executed in real-time to enable UAVs to perform their missions autonomously, without reliance on external computation or memory resources. While convex programming solutions offer the advantage of real-time implementation, they do so at the expense of solution optimality. As demonstrated by Lemma 1, trajectory optimization involving valid LoS paths is NP-hard, making real-time solutions computationally prohibitive.
Sampling-based techniques, such as rapidly exploring random trees (RRT), are widely used in the robotics field for trajectory optimization in complex environments [148]. However, the computational cost of these methods is significant when applied to wireless communication scenarios, where each sample must be evaluated against multiple objectives. This further complicates their real-time applicability, especially for dense urban environments where maintaining LoS links for IoV support is crucial. Therefore, AI-based agents, if properly trained offline, can be the best candidates for real-time trajectory generation and communication control. Alternatively, they can be deployed to address the nonconvexity of the optimization problem, thereby overcoming the limitations of convex programming, such as sub-optimality.

7. Integrated Localization and Communication

This section focuses on the importance of localization for communication and autonomous navigation of unmanned vehicles and studies the joint localization and communication in future mmWave networks [176,177].

7.1. Joint Localization and Communication

From the wireless communication perspective, localization is important for improved connectivity and communication [177]. Localization of UEs helps in CSI estimation [178], UE allocation to cellular networks and avoiding intercell interference, secure communication against eavesdropping, etc. [179]. Notably, lately, position-aware beamforming with directional beam-steering is essential for dynamic environments with mobile UEs such as intelligent vehicles and vehicular networks [180]. Further, object sensing and detection using RF signals [181] is a practical technology as being used in radar sensors in intelligent vehicles [182]. In this context, the integrated sensing and communication (ISAC) concept has been introduced to maximize the energy and spectral efficiency of wireless channels [183].
On the other hand, from the vehicular navigation perspective, accurate localization is critical for autonomous navigation and unmanned driving for intelligent vehicles [184,185]. In outdoor environments, localization is implemented with the aid of a global positioning system (GPS). However, the meter-scale accuracy of the GPS signals is not sufficient for the safe driving of unmanned vehicles. Particularly, GPS signals are not available in indoor areas and their interruptions in dense environments, such as urban areas, pose fatal autonomous-vehicles safety risks. Therefore, sensor fusion base localization is performed to achieve more robust and reliable localization for safe unmanned driving [185].
Autonomous mobile robots and vehicles normally rely on onboard sensors for localization such as inertial navigation systems and odometry, radar, light detection and ranging (LiDAR), and cameras, among others. To minimize localization errors, the simultaneous localization and mapping (SLAM) concept has been very popular in the robotic community [186]. In SLAM, by combining the localization information given by the inertial navigation system (odometry) with the sensing and measurement data given by sensors, the localization error due to odometry drift or sensor inaccuracy is minimized. Also, simultaneously, a map of the environment is created. Lidar-based SLAM, although more accurate, is expensive and suffers from its dependency on mechanical processes to send light signals in the 360-degree direction. Recently, visual SLAM using pixels has become very popular, particularly in autonomous vehicles, thanks to the developments in computer vision and deep learning techniques for extracting geometry information from pixels [187]. Nevertheless, still, visual-based localization is not robust [188], as it is impacted by weather conditions and technical aspects such as depth detection [189].

7.2. RIS-Assisted mmWave Localization

Therefore, mmWave signals, which are ubiquitous in future wireless networks, can be used for accurate localization as complementary to visual SLAM in the robotic community for autonomous vehicles [190]. In this light, MIMO beamforming for sending narrow-beam directional waves with angular resolution is very effective in promoting mmWave-based localization [191]. In this context, the RIS technology is effective in enhancing energy-efficient mmWave localization [192]. For example, the combination of MIMO-active beamforming and RIS-passive beamforming for vehicular localization is studied [193]. Following the employment of RIS for localization, the meta-radar and meta-SLAM concepts have been proposed [194]. Furthermore, RIS-assisted mmWave radar SLAM has been proposed for autonomous vehicles [195].
Many works can be found in the wireless community literature that studied RIS-assisted localization for stationary and quasi-stationary UEs [196,197]. However, the application of RIS for localization in dynamic environments with UAVs and IoVs is a trending research topic [198,199], particularly by using deep learning techniques to tackle practical problems [200].

7.3. Localization for RISeUAVs

The localization-oriented study for UAV-enabled, RIS-assisted communication can be considered from two perspectives:
(1)
Positioning-aware beamforming of the aerial RIS in the RISeUAV.
(2)
Accurate localization of RISeUAV and ground vehicles.

7.3.1. Positioning-Based Beamforming

As highlighted in Remark 5, beamforming optimization and CSI estimation in dynamic environments are computationally prohibitive. Notably, it is difficult to retain beam alignment for moving vehicles as the channel state is changing not only due to the vehicle movement but also due to changing the signature of the environment. Therefore, the CLoS links in the BS-RISeUAV-UE paths (e.g., in an indirect V2V link through RISeUAV) are fragile and prone to instability. Therefore, positioning-based beamforming (i.e., directional beam-steering) through codebook design has been suggested [63,201].

7.3.2. RISeUAV Localization

RISeUAV is energy-efficient and cost-effective for various applications as we have discussed in this paper. Also, the RISeUAV can help ground vehicles with accurate localization and communication [202]. However, for RISeUAV to accomplish its tasks, particularly for aerial RIS phase shift design, the UAV’s accurate position must be known, which is a non-trivial task. As stated, GPS signals are not accurate for RISeUAVs for beam-steering for autonomous crash-avoidance flights in dense environments. To this end, we have proposed the SLAPS technique [46] for simultaneous localization and phase shift of RISeUAV. In the SLAPS, the localization estimation and RIS phase shift are iteratively modified and optimized so both converge to the optimal solution, which is accurate localization-based communication. The SLAPS mechanism has been illustrated in Figure 8.
The SLAPS principle is as follows: Suppose that the actual RISeUAV pose (i.e., position and heading) is denoted with X ^ . The mMIMO BS beamforming and RIS-PhSh are implemented based on the RISeUAV’s estimated pose (denoted as X ). Then, the estimated pose and consequence BS-BF and RIS-PhSh are iteratively updated and optimized so that the received signal at the receiver (e.g., an anchor point) is maximized, indicating that X converges to X ^ , where the maximum channel gain is achieved.

8. Future Research Directions

Despite significant advancements in UAV and RIS-assisted wireless communication systems, several areas require further exploration to fully realize the potential of these technologies in future B5G/6G networks. Below, we outline key open research topics:
  • Obstacle-free trajectory optimization in smart cities: Navigating complex, obstacle-rich environments in smart cities demands advanced optimization techniques. Future research should focus on developing robust algorithms that ensure obstacle-free trajectories while maintaining energy efficiency and communication reliability. Addressing this challenge is vital for safe and seamless UAV operations in urban settings.
  • Channel modeling for RISeUAV systems: The impact of UAV fluctuations due to disturbances such as wind or misalignment must be accounted for in channel modeling for RIS-assisted UAVs. Developing accurate models that consider these variables and incorporate UAV motion primitives adaptable to UAV dynamics will improve the resilience and effectiveness of communication links.
  • AI-based path planning with visual inputs: While AI and machine learning techniques have been employed for UAV path planning, more attention is needed on learning-based end-to-end methods [203], particularly those leveraging visual inputs. These approaches can enable UAVs to make complex navigation decisions in real time, which is crucial for applications in dense urban environments where dynamic obstacles and complex terrains are common.
  • Modern AI and transformer neural networks for trajectory optimization and RIS control: The use of modern AI architectures, such as transformer neural networks and visual transformers (ViT), present promising avenues for optimizing UAV trajectories and RIS phase shift control. Transformers can process large datasets and capture long-term dependencies effectively, making them suitable for real-time decision-making in UAV navigation and RIS configuration.
  • Integrated localization and communication: The integration of localization and communication functions is critical for enhancing the reliability and efficiency of UAV-based systems. Future works should explore methods to synergize these functions, ensuring accurate positioning while maintaining robust communication links. Open research areas include joint algorithm development, hardware design, and real-time implementation strategies.
  • Computationally feasible solutions for autonomous navigation: Developing algorithms that balance computational efficiency with performance accuracy is essential for enabling real-time autonomous UAV navigation. Current methods often struggle to incorporate kinodynamic and motion constraints while maintaining obstacle-free trajectories, especially in complex urban environments. Future research should focus on creating lightweight, scalable algorithms capable of handling high-dimensional data and constraints without excessive computational demands. Strategies such as model predictive control with simplified dynamics [204], hybrid offline-online approaches, and leveraging advanced AI techniques could provide a path forward to achieving real-time, reliable autonomous navigation.
  • Satellite-aided communication: Leveraging satellite communications for enhancing connectivity in RIS-UAV-assisted IoT and vehicular networks should be explored. This includes multi-layered communication frameworks that combine terrestrial, aerial, and satellite links for improved coverage and reliability.
  • Security and privacy concerns: Ensuring the security and privacy of data transmission in UAV-assisted, RIS-enabled IoT and vehicular networks is another area that needs further investigation. Techniques for protecting against eavesdropping, jamming, and spoofing, as well as secure protocols for data exchange, remain essential topics for future research.

9. Conclusions

UAV-enabled, RIS-assisted wireless communication offers a transformative solution for enhancing the efficiency and reliability of future B5G and 6G networks, particularly for the Internet of Vehicles (IoVs). By harnessing the unique capabilities of UAVs and RIS, these systems effectively address mmWave signal propagation challenges, such as attenuation and blockage, while significantly improving spectral and energy efficiency. Insightful channel modeling, real-time energy-efficient UAV trajectory optimization, and innovative optimization techniques contribute to robust and sustainable communication networks. The diverse applications of UAV base stations and RIS-enabled UAVs in IoT sensor data collection, V2X communication, mobile edge computing, and smart city infrastructure demonstrate their versatility and essential role in modern wireless networks. Additionally, integrated localization and communication are vital for future dynamic vehicular networks, with UAVs and RISs overcoming practical barriers. Through this comprehensive review, this paper provided valuable insights into current directions, existing challenges, and emerging research topics, highlighting the potential of UAV-enabled, RIS-assisted communication systems to pave the way for more resilient and high-performance wireless networks.

Author Contributions

Conceptualization, M.E. and A.V.S.; methodology, M.E.; software, M.E.; validation, M.E. and A.V.S.; formal analysis, M.E.; investigation, M.E.; writing—original draft preparation, M.E.; writing—review and editing, M.E. and A.V.S.; visualization, M.E.; supervision, A.V.S.; project administration, A.V.S.; funding acquisition, A.V.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Australian Research Council. Also, this work received funding from the Australian Government, via grant AUSMURIB000001 associated with ONR MURI grant N00014-19-1-2571.

Data Availability Statement

No new data were created or analyzed in this study.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

MRTMaximum ratio transmission
AEHAdaptive energy harvestingMTCMachine-type communication
A2GAir-to-groundNLoSNon-line-of-sight
AoIAge of informationNOMANon-orthogonal multiple access
AOAlternating optimizationOFObjective function
ARArrey responsePPOProximal policy optimization
BCDBlocked coordinate descentPSOParticle swarm optimization
BFBeamformingP-BCDPenalty-based block coordinate descent
BSBase stationRHSReconfigurable holographic surface
CDFCumulative distribution functionRISReconfigurable intelligent surface
CLoSCascaded line-of-sightRISeUAVRIS-equipped UAV
DDPGDeep deterministic policy gradientRIS-PhShRIS Phase Shift
DDQNDouble deep Q-networkRSMARate-splitting multiple access
DFTDiscrete Fourier transformSASimulated annealing
DQNDeep Q-networkSDPSemi-definite programming
DRData rateSEESecrecy energy efficiency
DRLDeep reinforcement learningSICSuccessive interference cancelation
EEEnergy-EfficiencySINRSignal-to-interference-plus noise ratio
EHEnergy harvestingSCPSequential convex programming
FFMFourier feature mappingSCASuccessive convex approximation
FSPLFree Space pathlossSDMASpace division multiple access
FHREFronthaul-rate-ensuringSNRSignal-to-noise ratio
HAPHigh-altitude aerial platformSTAR-RISsSimultaneously transmitting and reflecting RISs
GAGenetic algorithmSWIPTSimultaneous wireless information and power transfer
GRPGaussian randomization procedureT-UAVTethered-UAV
G2GGround-to-groundUAVUnmanned aerial vehicle
GUGround usersUAV-BSUAV as BS
LAPLigh-altitude aerial platformUEUser equipment
LoSLine-of-sightULAUniform linear array
IOSIntelligent omni-surfaceUPAUniform planar array
MABMulti-armed banditWCSRWorst-case secrecy rate
MATMultiple antennaWITWireless information transfer
MDPMarkov decision processWOAWales optimization algorithm
MECMobile edge computingWPTWireless power transfer
MIMOMulti-input multi-outputWSDRWeighted sum data rate
MINPMixed integer nonlinear programWSRWeighted sum-rate

Appendix A

The coordinates of m t h RIS element is calculated as follows (see Figure 4):
p m R I S = p R I S + Γ 1 θ U A V l m w m 0 ,
where
l m = d l M o d m 1 , M l M l 1 2 ;
w m = d w M w + 1 2 m M l ;
Γ θ R U = cos θ U A V sin θ U A V 0 sin θ U A V cos θ U A V 0 0 0 1 ;
M l and M w are the number of elements along with the length and width of the RIS, respectively; and d l and d w denote the length and width sizes of the elements, respectively. Also, Γ θ U A V R 3 × 3 transforms the coordinates from the global reference frame to the local reference frame of the UAV, and θ U A V denotes the UAV heading with respect to the x-axis.

Appendix B

Assuming that 2D coordinates of the T x is taken as the origin of the local reference frame, i.e., p T x = 0 0 z T x R 3 , the azimuth angle of the T x R I S path, is measured clockwise from the x-axis to the line between RIS position (i.e., p R I S ) and the T x position, and is obtained as follows (see Figure 4):
φ T _ R I S = cos 1 x R I S / x R I S , y R I S 2 ;
The elevation angle between the horizontal plane and T x R I S LoS link is obtained as
ζ T _ R I S = tan 1 z T x z R I S / x R I S , y R I S 2 ;
Similarly, the azimuth and elevation angles of the reflected signal from RIS can be obtained as
φ R I S _ R = cos 1 x R x x R I S x B S R x x R V , y B S R x y R V 2 ;
ζ R I S _ R = tan 1 z T x z R I S x R x x R I S , y R x y R I S 2 .

Appendix C

Supposing that the UPA of the mMIMO BS is aligned in the YZ plane (see Figure 5), the coordinates of the n t h antenna of the mMIMO BS is obtained as follows:
p n B S = p B S + 0 d c M o d n , N c 1 2 d r n N c 1 2 ,
where N r and N c denote the number of horizontal and vertical antennas of the mMIMO BS; d r and d c denotes the horizontal and vertical sizes of each antenna (including the antenna spacing).

References

  1. Mehmood, Y.; Ahmad, F.; Yaqoob, I.; Adnane, A.; Imran, M.; Guizani, S. Internet-of-Things-Based Smart Cities: Recent Advances and Challenges. IEEE Commun. Mag. 2017, 55, 16–24. [Google Scholar] [CrossRef]
  2. Alavi, A.H.; Jiao, P.; Buttlar, W.G.; Lajnef, N. Internet of Things-enabled smart cities: State-of-the-art and future trends. Measurement 2018, 129, 589–606. [Google Scholar] [CrossRef]
  3. Talari, S.; Shafie-khah, M.; Siano, P.; Loia, V.; Tommasetti, A.; Catalão, J.P.S. A Review of Smart Cities Based on the Internet of Things Concept. Energies 2017, 10, 421. [Google Scholar] [CrossRef]
  4. Gustavsson, U.; Frenger, P.; Fager, C.; Eriksson, T.; Zirath, H.; Dielacher, F.; Studer, C.; Pärssinen, A.; Correia, R.; Matos, J.N.; et al. Implementation Challenges and Opportunities in Beyond-5G and 6G Communication. IEEE J. Microw. 2021, 1, 86–100. [Google Scholar] [CrossRef]
  5. Kedar, D.; Arnon, S. Urban optical wireless communication networks: The main challenges and possible solutions. IEEE Commun. Mag. 2004, 42, S2–S7. [Google Scholar] [CrossRef]
  6. Wang, X.; Kong, L.; Kong, F.; Qiu, F.; Xia, M.; Arnon, S.; Chen, G. Millimeter Wave Communication: A Comprehensive Survey. IEEE Commun. Surv. Tutor. 2018, 20, 1616–1653. [Google Scholar] [CrossRef]
  7. Niu, Y.; Li, Y.; Jin, D.; Su, L.; Vasilakos, A.V. A survey of millimeter wave communications (mmWave) for 5G: Opportunities and challenges. Wirel. Netw. 2015, 21, 2657–2676. [Google Scholar] [CrossRef]
  8. Busari, S.A.; Huq, K.M.S.; Mumtaz, S.; Dai, L.; Rodriguez, J. Millimeter-Wave Massive MIMO Communication for Future Wireless Systems: A Survey. IEEE Commun. Surv. Tutor. 2018, 20, 836–869. [Google Scholar] [CrossRef]
  9. Tariq, S.; Naqvi, S.I.; Hussain, N.; Amin, Y. A Metasurface-Based MIMO Antenna for 5G Millimeter-Wave Applications. IEEE Access 2021, 9, 51805–51817. [Google Scholar] [CrossRef]
  10. Rao, L.; Pant, M.; Malviya, L.; Parmar, A.; Charhate, S.V. 5G beamforming techniques for the coverage of intended directions in modern wireless communication: In-depth review. Int. J. Microw. Wirel. Technol. 2021, 13, 1039–1062. [Google Scholar] [CrossRef]
  11. Chen, R.; Zhou, H.; Long, W.X.; Moretti, M. Spectral and energy efficiency of line-of-sight OAM-MIMO communication systems. China Commun. 2020, 17, 119–127. [Google Scholar] [CrossRef]
  12. You, L.; Xiong, J.; Ng, D.W.K.; Yuen, C.; Wang, W.; Gao, X. Energy Efficiency and Spectral Efficiency Tradeoff in RIS-Aided Multiuser MIMO Uplink Transmission. IEEE Trans. Signal Process. 2021, 69, 1407–1421. [Google Scholar] [CrossRef]
  13. Jian, M.; Alexandropoulos, G.C.; Basar, E.; Huang, C.; Liu, R.; Liu, Y.; Yuen, C. Reconfigurable intelligent surfaces for wireless communications: Overview of hardware designs, channel models, and estimation techniques. Intell. Converg. Netw. 2022, 3, 1–32. [Google Scholar] [CrossRef]
  14. Huang, H.; Savkin, A.V. Deployment of Heterogeneous UAV Base Stations for Optimal Quality of Coverage. IEEE Internet Things J. 2022, 9, 16429–16437. [Google Scholar] [CrossRef]
  15. Huang, M.; Liu, A.; Xiong, N.N.; Wu, J. A UAV-Assisted Ubiquitous Trust Communication System in 5G and Beyond Networks. IEEE J. Sel. Areas Commun. 2021, 39, 3444–3458. [Google Scholar] [CrossRef]
  16. Sharma, V.; Bennis, M.; Kumar, R. UAV-Assisted Heterogeneous Networks for Capacity Enhancement. IEEE Commun. Lett. 2016, 20, 1207–1210. [Google Scholar] [CrossRef]
  17. Xie, L.; Xu, J.; Zhang, R. Throughput Maximization for UAV-Enabled Wireless Powered Communication Networks. IEEE Internet Things J. 2019, 6, 1690–1703. [Google Scholar] [CrossRef]
  18. Zhan, C.; Zeng, Y. Aerial–Ground Cost Tradeoff for Multi-UAV-Enabled Data Collection in Wireless Sensor Networks. IEEE Trans. Commun. 2020, 68, 1937–1950. [Google Scholar] [CrossRef]
  19. Liu, Y.; Xie, S.; Zhang, Y. Cooperative Offloading and Resource Management for UAV-Enabled Mobile Edge Computing in Power IoT System. IEEE Trans. Veh. Technol. 2020, 69, 12229–12239. [Google Scholar] [CrossRef]
  20. Mahony, R.; Kumar, V.; Corke, P. Multirotor Aerial Vehicles: Modeling, Estimation, and Control of Quadrotor. IEEE Robot. Autom. Mag. 2012, 19, 20–32. [Google Scholar] [CrossRef]
  21. Su, C.; Ye, F.; Wang, L.C.; Wang, L.; Tian, Y.; Han, Z. UAV-Assisted Wireless Charging for Energy-Constrained IoT Devices Using Dynamic Matching. IEEE Internet Things J. 2020, 7, 4789–4800. [Google Scholar] [CrossRef]
  22. Granda, F.; Azpilicueta, L.; Vargas-Rosales, C.; Celaya-Echarri, M.; Lopez-Iturri, P.; Aguirre, E.; Astrain, J.J.; Medrano, P.; Villandangos, J.; Falcone, F. Deterministic Propagation Modeling for Intelligent Vehicle Communication in Smart Cities. Sensors 2018, 18, 2133. [Google Scholar] [CrossRef] [PubMed]
  23. Menouar, H.; Guvenc, I.; Akkaya, K.; Uluagac, A.S.; Kadri, A.; Tuncer, A. UAV-Enabled Intelligent Transportation Systems for the Smart City: Applications and Challenges. IEEE Commun. Mag. 2017, 55, 22–28. [Google Scholar] [CrossRef]
  24. Rani, P.; Sharma, R. Intelligent transportation system for internet of vehicles based vehicular networks for smart cities. Comput. Electr. Eng. 2023, 105, 108543. [Google Scholar] [CrossRef]
  25. Storck, C.R.; Duarte-Figueiredo, F. A Survey of 5G Technology Evolution, Standards, and Infrastructure Associated With Vehicle-to-Everything Communications by Internet of Vehicles. IEEE Access 2020, 8, 117593–117614. [Google Scholar] [CrossRef]
  26. Cheng, X.; Zhang, R.; Yang, L. Wireless Toward the Era of Intelligent Vehicles. IEEE Internet Things J. 2019, 6, 188–202. [Google Scholar] [CrossRef]
  27. Zhu, H.; Yuen, K.V.; Mihaylova, L.; Leung, H. Overview of Environment Perception for Intelligent Vehicles. IEEE Trans. Intell. Transp. Syst. 2017, 18, 2584–2601. [Google Scholar] [CrossRef]
  28. Lu, H.; Liu, Q.; Tian, D.; Li, Y.; Kim, H.; Serikawa, S. The Cognitive Internet of Vehicles for Autonomous Driving. IEEE Netw. 2019, 33, 65–73. [Google Scholar] [CrossRef]
  29. Mozaffari, M.; Saad, W.; Bennis, M.; Nam, Y.H.; Debbah, M. A Tutorial on UAVs for Wireless Networks: Applications, Challenges, and Open Problems. IEEE Commun. Surv. Tutor. 2019, 21, 2334–2360. [Google Scholar] [CrossRef]
  30. Abbasi, I.A.; Shahid Khan, A. A Review of Vehicle to Vehicle Communication Protocols for VANETs in the Urban Environment. Future Internet 2018, 10, 14. [Google Scholar] [CrossRef]
  31. Zeadally, S.; Guerrero, J.; Contreras, J. A tutorial survey on vehicle-to-vehicle communications. Telecommun. Syst. 2020, 73, 469–489. [Google Scholar] [CrossRef]
  32. Noor-A-Rahim, M.; Liu, Z.; Lee, H.; Khyam, M.O.; He, J.; Pesch, D.; Moessner, K.; Saad, W.; Poor, H.V. 6G for Vehicle-to-Everything (V2X) Communications: Enabling Technologies, Challenges, and Opportunities. Proc. IEEE 2022, 110, 712–734. [Google Scholar] [CrossRef]
  33. Eskandari, M.; Savkin, A. Trajectory Planning for UAVs Equipped with RISs to Provide Aerial LoS Service for Mobile Nodes in 5G/Optical Wireless Communication Networks. IEEE Trans. Veh. Technol. 2023, 72, 8216–8221. [Google Scholar] [CrossRef]
  34. Pogaku, A.C.; Do, D.T.; Lee, B.M.; Nguyen, N.D. UAV-Assisted RIS for Future Wireless Communications: A Survey on Optimization and Performance Analysis. IEEE Access 2022, 10, 16320–16336. [Google Scholar] [CrossRef]
  35. Ye, J.; Qiao, J.; Kammoun, A.; Alouini, M.S. Nonterrestrial Communications Assisted by Reconfigurable Intelligent Surfaces. Proc. IEEE 2022, 110, 1423–1465. [Google Scholar] [CrossRef]
  36. Samir, M.; Sharafeddine, S.; Assi, C.M.; Nguyen, T.M.; Ghrayeb, A. UAV Trajectory Planning for Data Collection from Time-Constrained IoT Devices. IEEE Trans. Wirel. Commun. 2020, 19, 34–46. [Google Scholar] [CrossRef]
  37. Anjinappa, C.K.; Guvenc, I. Millimeter-Wave V2X Channels: Propagation Statistics, Beamforming, and Blockage. In Proceedings of the 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall), Chicago, IL, USA, 27–30 August 2018; pp. 1–6. [Google Scholar]
  38. Tang, W.; Chen, M.Z.; Chen, X.; Dai, J.Y.; Han, Y.; Renzo, M.D.; Zeng, Y.; Jin, S.; Cheng, Q.; Cui, T.J. Wireless Communications with Reconfigurable Intelligent Surface: Path Loss Modeling and Experimental Measurement. IEEE Trans. Wirel. Commun. 2021, 20, 421–439. [Google Scholar] [CrossRef]
  39. Ge, L.; Dong, P.; Zhang, H.; Wang, J.B.; You, X. Joint Beamforming and Trajectory Optimization for Intelligent Reflecting Surfaces-Assisted UAV Communications. IEEE Access 2020, 8, 78702–78712. [Google Scholar] [CrossRef]
  40. Wei, Z.; Cai, Y.; Sun, Z.; Ng, D.W.K.; Yuan, J.; Zhou, M.; Sun, L. Sum-Rate Maximization for IRS-Assisted UAV OFDMA Communication Systems. IEEE Trans. Wirel. Commun. 2021, 20, 2530–2550. [Google Scholar] [CrossRef]
  41. Eskandari, M.; Huang, H.; Savkin, A.V.; Ni, W. Model Predictive Control-Based 3D Navigation of a RIS-Equipped UAV for LoS Wireless Communication with a Ground Intelligent Vehicle. IEEE Trans. Intell. Veh. 2023, 8, 2371–2384. [Google Scholar] [CrossRef]
  42. Garcia, N.; Wymeersch, H.; Larsson, E.G.; Haimovich, A.M.; Coulon, M. Direct Localization for Massive MIMO. IEEE Trans. Signal Process. 2017, 65, 2475–2487. [Google Scholar] [CrossRef]
  43. Yang, D.; Yang, L.L.; Hanzo, L. DFT-Based Beamforming Weight-Vector Codebook Design for Spatially Correlated Channels in the Unitary Precoding Aided Multiuser Downlink. In Proceedings of the 2010 IEEE International Conference on Communications, Cape Town, South Africa, 23–27 May 2010; pp. 1–5. [Google Scholar]
  44. Shi, E.; Zhang, J.; Du, H.; Ai, B.; Yuen, C.; Niyato, D.; Letaief, K.B.; Shen, X. RIS-Aided Cell-Free Massive MIMO Systems for 6G: Fundamentals, System Design, and Applications. Proc. IEEE 2024, 112, 331–364. [Google Scholar] [CrossRef]
  45. Buzzi, S.; Grossi, E.; Lops, M.; Venturino, L. Foundations of MIMO Radar Detection Aided by Reconfigurable Intelligent Surfaces. IEEE Trans. Signal Process. 2022, 70, 1749–1763. [Google Scholar] [CrossRef]
  46. Eskandari, M.; Savkin, A.V. SLAPS: Simultaneous Localization and Phase Shift for a RIS-Equipped UAV in 5G/6G Wireless Communication Networks. IEEE Trans. Intell. Veh. 2023, 8, 4722–4733. [Google Scholar] [CrossRef]
  47. Zhang, H.; Liu, J. Dynamic Aerial Reconfigurable Intelligent Surface Aided Multi-Cell Multi-User Communications. IEEE Trans. Wirel. Commun. 2024, 23, 16453–16465. [Google Scholar] [CrossRef]
  48. Liu, X.; Yu, Y.; Li, F.; Durrani, T.S. Throughput Maximization for RIS-UAV Relaying Communications. IEEE Trans. Intell. Transp. Syst. 2022, 23, 19569–19574. [Google Scholar] [CrossRef]
  49. Al-Hourani, A.; Kandeepan, S.; Lardner, S. Optimal LAP Altitude for Maximum Coverage. IEEE Wirel. Commun. Lett. 2014, 3, 569–572. [Google Scholar] [CrossRef]
  50. Meng, A.; Gao, X.; Zhao, Y.; Yang, Z. Three-Dimensional Trajectory Optimization for Energy-Constrained UAV-Enabled IoT System in Probabilistic LoS Channel. IEEE Internet Things J. 2022, 9, 1109–1121. [Google Scholar] [CrossRef]
  51. Mei, H.; Yang, K.; Shen, J.; Liu, Q. Joint Trajectory-Task-Cache Optimization With Phase-Shift Design of RIS-Assisted UAV for MEC. IEEE Wirel. Commun. Lett. 2021, 10, 1586–1590. [Google Scholar] [CrossRef]
  52. Liu, Y.; Duo, B.; Wu, Q.; Yuan, X.; Li, J.; Li, Y. Elevation Angle-Dependent 3D Trajectory Design for Aerial RIS-Aided Communication. IEEE Trans. Intell. Transp. Syst. 2024, 25, 2696–2702. [Google Scholar] [CrossRef]
  53. Chen, L.; Zhang, W.; Kishk, M.A.; Alouini, M.S. Correlation of Line-of-Sight Probabilities in Aerial-Terrestrial Communications: Modeling, Analysis, and Application. IEEE Trans. Veh. Technol. 2024, 73, 7049–7065. [Google Scholar] [CrossRef]
  54. Xiong, B.; Zhang, Z.; Pan, C.; Wang, J. Performance Analysis of Aerial RIS Auxiliary mmWave Mobile Communications With UAV Fluctuation. IEEE Wirel. Commun. Lett. 2024, 13, 1183–1187. [Google Scholar] [CrossRef]
  55. Bithas, P.S.; Ropokis, G.A.; Karagiannidis, G.K.; Nistazakis, H.E. UAV-Assisted Communications With RIS: A Shadowing-Based Stochastic Analysis. IEEE Trans. Veh. Technol. 2024, 73, 10000–10010. [Google Scholar] [CrossRef]
  56. Hanbay, E.; Altın, G. UAV-Assisted Wireless Communication System with Reconfigurable Intelligent Surfaces: Outage Probability Approach. In Proceedings of the 2022 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT), Online, 20–21 November 2022; pp. 112–116. [Google Scholar]
  57. Guan, K.; He, D.; Ai, B.; Matolak, D.W.; Wang, Q.; Zhong, Z.; Kürner, T. 5-GHz Obstructed Vehicle-to-Vehicle Channel Characterization for Internet of Intelligent Vehicles. IEEE Internet Things J. 2019, 6, 100–110. [Google Scholar] [CrossRef]
  58. Bansal, A.; Agrawal, N.; Singh, K.; Li, C.P.; Mumtaz, S. RIS Selection Scheme for UAV-Based Multi-RIS-Aided Multiuser Downlink Network with Imperfect and Outdated CSI. IEEE Trans. Commun. 2023, 71, 4650–4664. [Google Scholar] [CrossRef]
  59. Wang, J.; Zhu, K.; Hossain, E. Green Internet of Vehicles (IoV) in the 6G Era: Toward Sustainable Vehicular Communications and Networking. IEEE Trans. Green. Commun. Netw. 2022, 6, 391–423. [Google Scholar] [CrossRef]
  60. Polyanskiy, Y.; Poor, H.V.; Verdu, S. Channel Coding Rate in the Finite Blocklength Regime. IEEE Trans. Inf. Theory 2010, 56, 2307–2359. [Google Scholar] [CrossRef]
  61. Agrawal, N.; Bansal, A.; Singh, K.; Li, C.P.; Mumtaz, S. Finite Block Length Analysis of RIS-Assisted UAV-Based Multiuser IoT Communication System with Non-Linear EH. IEEE Trans. Commun. 2022, 70, 3542–3557. [Google Scholar] [CrossRef]
  62. Song, J.; Lee, J.H.; Noh, S.; Choi, J. Millimeter Wave Reflection Pattern Codebook Design for RIS-Assisted V2V Communications. IEEE Trans. Veh. Technol. 2022, 71, 6819–6824. [Google Scholar] [CrossRef]
  63. Nor, A.M.; Fratu, O.; Halunga, S.; An, J.; Zaharis, Z.; Velanas, P. Position based Near-Field Codebook Design and Beam Training for Extremely Large-Scale ARIS. In Proceedings of the 2024 IEEE International Mediterranean Conference on Communications and Networking (MeditCom), Madrid, Spain, 8–11 July 2024; pp. 215–220. [Google Scholar]
  64. Shang, S.; Xu, D.; Yu, K.; Mumtaz, S. Beam Training and Codebook Design for RIS Assisted UAV Communications in Emergency Rescue. In Proceedings of the GLOBECOM 2023—2023 IEEE Global Communications Conference, Kuala Lumpur, Malaysia, 4–8 December 2023; pp. 795–800. [Google Scholar]
  65. Shang, S.; Xu, D. Beamforming Design for Double-RIS Assisted UAV Communication with Limited Feedback in Disaster Scenarios. In Proceedings of the 2023 IEEE 97th Vehicular Technology Conference (VTC2023-Spring), Florence, Italy, 20–23 June 2023; pp. 1–5. [Google Scholar]
  66. Zhou, F.; Li, X.; Alazab, M.; Jhaveri, R.H.; Guo, K. Secrecy Performance for RIS-Based Integrated Satellite Vehicle Networks with a UAV Relay and MRC Eavesdropping. IEEE Trans. Intell. Veh. 2023, 8, 1676–1685. [Google Scholar] [CrossRef]
  67. Li, S.; Duo, B.; Renzo, M.D.; Tao, M.; Yuan, X. Robust Secure UAV Communications with the Aid of Reconfigurable Intelligent Surfaces. IEEE Trans. Wirel. Commun. 2021, 20, 6402–6417. [Google Scholar] [CrossRef]
  68. Hailong, H.; Eskandari, M.; Savkin, A.V.; Ni, W. Energy-efficient joint UAV secure communication and 3D trajectory optimization assisted by reconfigurable intelligent surfaces in the presence of eavesdroppers. Def. Technol. 2024, 31, 537–543. [Google Scholar] [CrossRef]
  69. Tang, X.; Jiang, T.; Liu, J.; Li, B.; Zhai, D.; Yu, F.R.; Han, Z. Secure Communication With UAV-Enabled Aerial RIS: Learning Trajectory with Reflection Optimization. IEEE Trans. Intell. Veh. 2023, 1–10. [Google Scholar] [CrossRef]
  70. Arzykulov, S.; Celik, A.; Nauryzbayev, G.; Eltawil, A.M. Aerial RIS-Aided Physical Layer Security: Optimal Deployment and Partitioning. IEEE Trans. Cogn. Commun. Netw. 2024, 10, 1867–1882. [Google Scholar] [CrossRef]
  71. Munochiveyi, M.; Pogaku, A.C.; Do, D.T.; Le, A.T.; Voznak, M.; Nguyen, N.D. Reconfigurable Intelligent Surface Aided Multi-User Communications: State-of-the-Art Techniques and Open Issues. IEEE Access 2021, 9, 118584–118605. [Google Scholar] [CrossRef]
  72. Guo, K.; Liu, R.; Alazab, M.; Jhaveri, R.H.; Li, X.; Zhu, M. STAR-RIS-Empowered Cognitive Non-Terrestrial Vehicle Network with NOMA. IEEE Trans. Intell. Veh. 2023, 8, 3735–3749. [Google Scholar] [CrossRef]
  73. Li, J.; Yang, L.; Wu, Q.; Lei, X.; Zhou, F.; Shu, F.; Mu, X.; Liu, Y.; Fan, P. Active RIS-Aided NOMA-Enabled Space-Air-Ground Integrated Networks with Cognitive Radio. IEEE J. Sel. Areas Commun. 2024, 1. [Google Scholar] [CrossRef]
  74. Clerckx, B.; Mao, Y.; Jorswieck, E.A.; Yuan, J.; Love, D.J.; Erkip, E.; Niyato, D. A Primer on Rate-Splitting Multiple Access: Tutorial, Myths, and Frequently Asked Questions. IEEE J. Sel. Areas Commun. 2023, 41, 1265–1308. [Google Scholar] [CrossRef]
  75. Zhao, H.; Kong, Z.; Shi, S.; Huang, H.; Ni, Y.; Gui, G.; Gacanin, H.; Sari, H.; Adachi, F. Air Reconfigurable Intelligent Surface Enhanced Multiuser NOMA System. IEEE Internet Things J. 2024, 11, 29–39. [Google Scholar] [CrossRef]
  76. Khennoufa, F.; Abdellatif, K.; Kara, F.; Yanikomeroglu, H.; Rabie, K.; Elganimi, T.Y.; Beddiaf, S. Error Performance Analysis of UAV-Mounted RIS for NOMA Systems with Practical Constraints. IEEE Commun. Lett. 2024, 28, 887–891. [Google Scholar] [CrossRef]
  77. Singh, S.K.; Agrawal, K.; Singh, K.; Li, C.P.; Ding, Z. NOMA Enhanced Hybrid RIS-UAV-Assisted Full-Duplex Communication System with Imperfect SIC and CSI. IEEE Trans. Commun. 2022, 70, 7609–7627. [Google Scholar] [CrossRef]
  78. Rivera, M.; Jaafar, W.; Yanikomeroglu, H. Optimization of RIS-Assisted RSMA-Enabled Tethered-UAV Communications. In Proceedings of the 2023 IEEE Globecom Workshops (GC Wkshps), Kuala Lumpur, Malaysia, 4–8 December 2023; pp. 227–232. [Google Scholar]
  79. Bansal, A.; Agrawal, N.; Singh, K. Rate-Splitting Multiple Access for UAV-Based RIS-Enabled Interference-Limited Vehicular Communication System. IEEE Trans. Intell. Veh. 2023, 8, 936–948. [Google Scholar] [CrossRef]
  80. Javad-Kalbasi, M.; Al-Abiad, M.S.; Valaee, S. Energy Efficient Communications in RIS-Assisted UAV Networks Based on Genetic Algorithm. In Proceedings of the GLOBECOM 2023–2023 IEEE Global Communications Conference, Kuala Lumpur, Malaysia, 4–8 December 2023; pp. 5901–5906. [Google Scholar]
  81. Yang, H.; Liu, S.; Xiao, L.; Zhang, Y.; Xiong, Z.; Zhuang, W. Learning-Based Reliable and Secure Transmission for UAV-RIS-Assisted Communication Systems. IEEE Trans. Wirel. Commun. 2024, 23, 6954–6967. [Google Scholar] [CrossRef]
  82. Guo, L.; Jia, J.; Chen, J.; Wang, X. Secure Communication Optimization in NOMA Systems With UAV-Mounted STAR-RIS. IEEE Trans. Inf. Forensics Secur. 2024, 19, 2300–2314. [Google Scholar] [CrossRef]
  83. Yang, H.; Lin, K.; Xiao, L.; Zhao, Y.; Xiong, Z.; Han, Z. Energy Harvesting UAV-RIS-Assisted Maritime Communications Based on Deep Reinforcement Learning Against Jamming. IEEE Trans. Wirel. Commun. 2024, 23, 9854–9868. [Google Scholar] [CrossRef]
  84. Feng, W.; Tang, J.; Wu, Q.; Fu, Y.; Zhang, X.; So, D.K.C.; Wong, K.K. Resource Allocation for Power Minimization in RIS-Assisted Multi-UAV Networks With NOMA. IEEE Trans. Commun. 2023, 71, 6662–6676. [Google Scholar] [CrossRef]
  85. Ge, L.; Zhang, H.; Wang, J.B.; Li, G.Y. Reconfigurable Wireless Relaying with Multi-UAV-Carried Intelligent Reflecting Surfaces. IEEE Trans. Veh. Technol. 2023, 72, 4932–4947. [Google Scholar] [CrossRef]
  86. Shang, B.; Bentley, E.S.; Liu, L. UAV Swarm-Enabled Aerial Reconfigurable Intelligent Surface: Modeling, Analysis, and Optimization. IEEE Trans. Commun. 2023, 71, 3621–3636. [Google Scholar] [CrossRef]
  87. Liao, J.; Zhan, C.; Zeng, B.; Yan, H. Energy-Efficient Optimization for IRS-Enabled Multiantenna UAV Video Streaming. IEEE Internet Things J. 2024, 11, 9522–9535. [Google Scholar] [CrossRef]
  88. Li, B.; Li, Q.; Zeng, Y.; Rong, Y.; Zhang, R. 3D Trajectory Optimization for Energy-Efficient UAV Communication: A Control Design Perspective. IEEE Trans. Wirel. Commun. 2022, 21, 4579–4593. [Google Scholar] [CrossRef]
  89. Wang, L.; Wang, K.; Pan, C.; Aslam, N. Joint Trajectory and Passive Beamforming Design for Intelligent Reflecting Surface-Aided UAV Communications: A Deep Reinforcement Learning Approach. IEEE Trans. Mob. Comput. 2023, 22, 6543–6553. [Google Scholar] [CrossRef]
  90. Guo, K.; Wu, M.; Li, X.; Song, H.; Kumar, N. Deep Reinforcement Learning and NOMA-Based Multi-Objective RIS-Assisted IS-UAV-TNs: Trajectory Optimization and Beamforming Design. IEEE Trans. Intell. Transp. Syst. 2023, 24, 10197–10210. [Google Scholar] [CrossRef]
  91. Mohamed, E.M.; Hashima, S.; Hatano, K. Energy Aware Multiarmed Bandit for Millimeter Wave-Based UAV Mounted RIS Networks. IEEE Wirel. Commun. Lett. 2022, 11, 1293–1297. [Google Scholar] [CrossRef]
  92. Zhai, L.; Zou, Y.; Zhu, J.; Jiang, Y. RIS-Assisted UAV-Enabled Wireless Powered Communications: System Modeling and Optimization. IEEE Trans. Wirel. Commun. 2024, 23, 5094–5108. [Google Scholar] [CrossRef]
  93. Yu, Y.; Liu, X.; Leung, V.C.M. Fair Downlink Communications for RIS-UAV Enabled Mobile Vehicles. IEEE Wirel. Commun. Lett. 2022, 11, 1042–1046. [Google Scholar] [CrossRef]
  94. Wang, P.; Li, D.; Zhang, Y.; Chen, X. UAV-Assisted Vehicular Communication System Optimization with Aerial Base Station and Intelligent Reflecting Surface. IEEE Trans. Intell. Veh. 2023, 1–12. [Google Scholar] [CrossRef]
  95. Jeon, H.B.; Park, S.H.; Park, J.; Huang, K.; Chae, C.B. An Energy-Efficient Aerial Backhaul System with Reconfigurable Intelligent Surface. IEEE Trans. Wirel. Commun. 2022, 21, 6478–6494. [Google Scholar] [CrossRef]
  96. Liu, Y.; Duo, B.; Wu, Q.; Yuan, X.; Li, Y. Full-Dimensional Rate Enhancement for UAV-Enabled Communications via Intelligent Omni-Surface. IEEE Wirel. Commun. Lett. 2022, 11, 1955–1959. [Google Scholar] [CrossRef]
  97. Zhai, Z.; Dai, X.; Duo, B.; Wang, X.; Yuan, X. Energy-Efficient UAV-Mounted RIS Assisted Mobile Edge Computing. IEEE Wirel. Commun. Lett. 2022, 11, 2507–2511. [Google Scholar] [CrossRef]
  98. Zhao, J.; Zhu, Y.; Mu, X.; Cai, K.; Liu, Y.; Hanzo, L. Simultaneously Transmitting and Reflecting Reconfigurable Intelligent Surface (STAR-RIS) Assisted UAV Communications. IEEE J. Sel. Areas Commun. 2022, 40, 3041–3056. [Google Scholar] [CrossRef]
  99. Lv, S.; Xu, X.; Han, S.; Zhang, P. UAV-RIS-Assisted Coordinated Multipoint Finite Blocklength Transmission for MTC Networks. IEEE Internet Things J. 2023, 10, 20323–20341. [Google Scholar] [CrossRef]
  100. Liu, X.; Lai, B.; Lin, B.; Leung, V.C.M. Joint Communication and Trajectory Optimization for Multi-UAV Enabled Mobile Internet of Vehicles. IEEE Trans. Intell. Transp. Syst. 2022, 23, 15354–15366. [Google Scholar] [CrossRef]
  101. Zhao, H.; Sun, W.; Ni, Y.; Xia, W.; Gui, G.; Zhu, C. Deep Deterministic Policy Gradient-Based Rate Maximization for RIS-UAV-Assisted Vehicular Communication Networks. IEEE Trans. Intell. Transp. Syst. 2024, 25, 15732–15744. [Google Scholar] [CrossRef]
  102. Liu, Y.; Huang, C.; Chen, G.; Song, R.; Song, S.; Xiao, P. Deep Learning Empowered Trajectory and Passive Beamforming Design in UAV-RIS Enabled Secure Cognitive Non-Terrestrial Networks. IEEE Wirel. Commun. Lett. 2024, 13, 188–192. [Google Scholar] [CrossRef]
  103. Jiang, W.; Ai, B.; Li, M.; Wu, W.; Shen, X. Average Age-of-Information Minimization in Aerial IRS-Assisted Data Delivery. IEEE Internet Things J. 2023, 10, 15133–15146. [Google Scholar] [CrossRef]
  104. Duo, B.; He, M.; Wu, Q.; Zhang, Z. Joint Dual-UAV Trajectory and RIS Design for ARIS-Assisted Aerial Computing in IoT. IEEE Internet Things J. 2023, 10, 19584–19594. [Google Scholar] [CrossRef]
  105. Wang, W.; Ni, W.; Tian, H.; Song, L. Intelligent Omni-Surface Enhanced Aerial Secure Offloading. IEEE Trans. Veh. Technol. 2022, 71, 5007–5022. [Google Scholar] [CrossRef]
  106. Lei, Y.; Liu, Y.; Wu, Q.; Yuan, X.; Ning, J.; Duo, B. Enhancing UAV-Enabled Communications via Multiple Intelligent Omni-Surfaces. IEEE Commun. Lett. 2023, 27, 655–660. [Google Scholar] [CrossRef]
  107. Xie, W.; Qi, F. DRL Enhanced Reconfigurable Intelligent Surface for Efficient Air-Ground Vehicle Communications. IEEE Wirel. Commun. 2024, 1–6. [Google Scholar] [CrossRef]
  108. Shang, B.; Poor, H.V.; Liu, L. Aerial Reconfigurable Intelligent Surfaces Meet Mobile Edge Computing. IEEE Wirel. Commun. 2022, 29, 104–111. [Google Scholar] [CrossRef]
  109. Li, M.; Tao, X.; Li, N.; Wu, H. Energy-Efficient Covert Communication with the Aid of Aerial Reconfigurable Intelligent Surface. IEEE Commun. Lett. 2022, 26, 2101–2105. [Google Scholar] [CrossRef]
  110. Aung, P.S.; Park, Y.M.; Tun, Y.K.; Han, Z.; Hong, C.S. Energy-Efficient Communication Networks via Multiple Aerial Reconfigurable Intelligent Surfaces: DRL and Optimization Approach. IEEE Trans. Veh. Technol. 2024, 73, 4277–4292. [Google Scholar] [CrossRef]
  111. Wu, M.; Guo, K.; Li, X.; Lin, Z.; Wu, Y.; Tsiftsis, T.A.; Song, H. Deep Reinforcement Learning-Based Energy Efficiency Optimization for RIS-Aided Integrated Satellite-Aerial-Terrestrial Relay Networks. IEEE Trans. Commun. 2024, 72, 4163–4178. [Google Scholar] [CrossRef]
  112. Faramarzi, S.; Javadi, S.; Zeinali, F.; Zarini, H.; Mili, M.R.; Bennis, M.; Li, Y.; Wong, K.K. Meta Reinforcement Learning for Resource Allocation in Aerial Active-RIS-Assisted Networks with Rate-Splitting Multiple Access. IEEE Internet Things J. 2024, 11, 26366–26383. [Google Scholar] [CrossRef]
  113. Lin, K.; Yang, H.; Zheng, M.; Xiao, L.; Huang, C.; Niyato, D. Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming. IEEE Trans. Veh. Technol. 2024, 73, 15768–15773. [Google Scholar] [CrossRef]
  114. Lei, J.; Zhang, T.; Mu, X.; Liu, Y. NOMA for STAR-RIS Assisted UAV Networks. IEEE Trans. Commun. 2024, 72, 1732–1745. [Google Scholar] [CrossRef]
  115. Mellinger, D.; Kumar, V. Minimum snap trajectory generation and control for quadrotors. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; pp. 2520–2525. [Google Scholar]
  116. Yang, M.; Jeon, S.W.; Kim, D.K. Optimal Trajectory for Curvature-Constrained UAV Mobile Base Stations. IEEE Wirel. Commun. Lett. 2020, 9, 1056–1059. [Google Scholar] [CrossRef]
  117. Eskandari, M.; Savkin, A.V.; Deghat, M. Kinodynamic Model-Based UAV Trajectory Optimization for Wireless Communication Support of Internet of Vehicles in Smart Cities. Drones 2024, 8, 574. [Google Scholar] [CrossRef]
  118. Dolgov, D.; Thrun, S.; Montemerlo, M.; Diebel, J. Path Planning for Autonomous Vehicles in Unknown Semi-structured Environments. Int. J. Robot. Res. 2010, 29, 485–501. [Google Scholar] [CrossRef]
  119. Hehn, M.; D’Andrea, R. Quadrocopter Trajectory Generation and Control. IFAC Proc. Vol. 2011, 44, 1485–1491. [Google Scholar] [CrossRef]
  120. Zeng, Y.; Zhang, R.; Lim, T.J. Wireless communications with unmanned aerial vehicles: Opportunities and challenges. IEEE Commun. Mag. 2016, 54, 36–42. [Google Scholar] [CrossRef]
  121. Ghosh, S.; Bhowmick, A.; Roy, S.D.; Kundu, S. UAV-RIS Enabled NOMA Network for Disaster Management with Hardware Impairments. IEEE Trans. Aerosp. Electron. Syst. 2024, 1–13. [Google Scholar] [CrossRef]
  122. Savkin, A.V.; Huang, C.; Ni, W. On-Demand Deployment of Aerial Base Stations for Coverage Enhancement in Reconfigurable Intelligent Surface-Assisted Cellular Networks on Uneven Terrains. IEEE Commun. Lett. 2023, 27, 666–670. [Google Scholar] [CrossRef]
  123. Xu, J.; Liu, Y.; Mu, X.; Dobre, O.A. STAR-RISs: Simultaneous Transmitting and Reflecting Reconfigurable Intelligent Surfaces. IEEE Commun. Lett. 2021, 25, 3134–3138. [Google Scholar] [CrossRef]
  124. Kishk, M.A.; Bader, A.; Alouini, M.S. On the 3-D Placement of Airborne Base Stations Using Tethered UAVs. IEEE Trans. Commun. 2020, 68, 5202–5215. [Google Scholar] [CrossRef]
  125. Zhou, B.; Gao, F.; Wang, L.; Liu, C.; Shen, S. Robust and Efficient Quadrotor Trajectory Generation for Fast Autonomous Flight. IEEE Robot. Autom. Lett. 2019, 4, 3529–3536. [Google Scholar] [CrossRef]
  126. Gao, F.; Lin, Y.; Shen, S. Gradient-based online safe trajectory generation for quadrotor flight in complex environments. In Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, Canada, 24–28 September 2017; pp. 3681–3688. [Google Scholar]
  127. Vanegas, G.; Samaniego, F.; Girbes, V.; Armesto, L.; Garcia-Nieto, S. Smooth 3D path planning for non-holonomic UAVs. In Proceedings of the 2018 7th International Conference on Systems and Control (ICSC), Valencia, Spain, 24–26 October 2018; pp. 1–6. [Google Scholar]
  128. Rathinam, S.; Sengupta, R.; Darbha, S. A Resource Allocation Algorithm for Multivehicle Systems With Nonholonomic Constraints. IEEE Trans. Autom. Sci. Eng. 2007, 4, 98–104. [Google Scholar] [CrossRef]
  129. Mueller, M.W.; Hehn, M.; Andrea, R.D. A Computationally Efficient Motion Primitive for Quadrocopter Trajectory Generation. IEEE Trans. Robot. 2015, 31, 1294–1310. [Google Scholar] [CrossRef]
  130. Liu, Y.; Xiong, K.; Ni, Q.; Fan, P.; Letaief, K.B. UAV-Assisted Wireless Powered Cooperative Mobile Edge Computing: Joint Offloading, CPU Control, and Trajectory Optimization. IEEE Internet Things J. 2020, 7, 2777–2790. [Google Scholar] [CrossRef]
  131. Zeng, Y.; Xu, J.; Zhang, R. Energy Minimization for Wireless Communication with Rotary-Wing UAV. IEEE Trans. Wirel. Commun. 2019, 18, 2329–2345. [Google Scholar] [CrossRef]
  132. Karegar, P.A.; Al-Hamid, D.Z.; Chong, P.H.J. UAV-enabled software defined data collection from an adaptive WSN. Wirel. Netw. 2024, 1–22. [Google Scholar] [CrossRef]
  133. Gao, Y.; Wang, S.; Liu, M.; Hu, Y. Multi-Agent Reinforcement Learning for UAVs 3D Trajectory Designing and Mobile Ground Users Scheduling with No-Fly Zones. In Proceedings of the 2023 IEEE/CIC International Conference on Communications in China (ICCC), Dalian, China, 10–12 August 2023; pp. 1–6. [Google Scholar]
  134. Schouwenaars, T.; Moor, B.D.; Feron, E.; How, J. Mixed integer programming for multi-vehicle path planning. In Proceedings of the 2001 European Control Conference (ECC), Porto, Portugal, 4–7 September 2001; pp. 2603–2608. [Google Scholar]
  135. Zhang, X.; Zhu, Q.; Poor, H.V. Multiple-Access Based UAV Communications and Trajectory Tracking Over 6G Mobile Wireless Networks. In Proceedings of the 2022 IEEE Wireless Communications and Networking Conference (WCNC), Austin, TX, USA, 10–13 April 2022; pp. 2429–2434. [Google Scholar]
  136. Eskandari, M.; Savkin, A.V. Deep-Reinforcement-Learning-Based Joint 3-D Navigation and Phase-Shift Control for Mobile Internet of Vehicles Assisted by RIS-Equipped UAVs. IEEE Internet Things J. 2023, 10, 18054–18066. [Google Scholar] [CrossRef]
  137. Weiszfeld, E.; Plastria, F. On the point for which the sum of the distances to n given points is minimum. Ann. Oper. Res. 2009, 167, 7–41. [Google Scholar] [CrossRef]
  138. Guo, K.; An, K. On the Performance of RIS-Assisted Integrated Satellite-UAV-Terrestrial Networks with Hardware Impairments and Interference. IEEE Wirel. Commun. Lett. 2022, 11, 131–135. [Google Scholar] [CrossRef]
  139. Savkin, A.V.; Huang, C.; Ni, W. Collision-Free 3-D Navigation of a UAV Team for Optimal Data Collection in Internet-of-Things Networks with Reconfigurable Intelligent Surfaces. IEEE Syst. J. 2023, 17, 4070–4077. [Google Scholar] [CrossRef]
  140. Savkin, A.V.; Huang, C. Joint Communication and Safe 3D Path Optimization for Multi-UAV Assisted Mobile Internet of Vehicles on an Uneven Terrain. IEEE Trans. Autom. Sci. Eng. 2024, 1–10. [Google Scholar] [CrossRef]
  141. Rajkumar, Y.; Santhosh Kumar, S.V.N. A comprehensive survey on communication techniques for the realization of intelligent transportation systems in IoT based smart cities. Peer Peer Netw. Appl. 2024, 17, 1263–1308. [Google Scholar] [CrossRef]
  142. Duan, X.; Zhao, Y.; Tian, D.; Zhou, J.; Zhang, L. Transmission-Efficient RIS-Carrying UAV’s Auxiliary Communication Systems for Intelligent Connected Vehicle Platoons at the Unsignalized Intersection in Smart Cities. IEEE Internet Things J. 2023, 10, 18609–18621. [Google Scholar] [CrossRef]
  143. Savkin, A.V.; Huang, C.; Ni, W. Joint Multi-UAV Path Planning and LoS Communication for Mobile-Edge Computing in IoT Networks With RISs. IEEE Internet Things J. 2023, 10, 2720–2727. [Google Scholar] [CrossRef]
  144. Nguyen, M.H.T.; Garcia-Palacios, E.; Do-Duy, T.; Dobre, O.A.; Duong, T.Q. UAV-Aided Aerial Reconfigurable Intelligent Surface Communications with Massive MIMO System. IEEE Trans. Cogn. Commun. Netw. 2022, 8, 1828–1838. [Google Scholar] [CrossRef]
  145. Eskandari, M.; Huang, H.; Savkin, A.V.; Ni, W. Autonomous Guidance of an Aerial Drone for Maintaining an Effective Wireless Communication Link with a Moving Node Using an Intelligent Reflecting Surface. In Proceedings of the 2022 14th International Conference on Computer and Automation Engineering (ICCAE), Brisbane, Australia, 25–27 March 2022; pp. 195–199. [Google Scholar]
  146. Rahmatov, N.; Baek, H. RIS-carried UAV communication: Current research, challenges, and future trends. ICT Express 2023, 9, 961–973. [Google Scholar] [CrossRef]
  147. Lin, S.; Zou, Y.; Ng, D.W.K. Ergodic Throughput Maximization for RIS-Equipped-UAV-Enabled Wireless Powered Communications with Outdated CSI. IEEE Trans. Commun. 2024, 72, 3634–3650. [Google Scholar] [CrossRef]
  148. Eskandari, M.; Savkin, A.V.; Ni, W. Consensus-Based Autonomous Navigation of a Team of RIS-Equipped UAVs for LoS Wireless Communication with Mobile Nodes in High-Density Areas. IEEE Trans. Autom. Sci. Eng. 2023, 20, 923–935. [Google Scholar] [CrossRef]
  149. Khoshafa, M.H.; Gadallah, Y.; Ngatched, T.M.N.; Ahmed, M.H. Aerial Reconfigurable Intelligent Surface-Assisted LPWANs for IoT: A Cross-Layer Analysis. IEEE Wirel. Commun. Lett. 2024, 13, 2912–2916. [Google Scholar] [CrossRef]
  150. Zhou, Y.; Ma, Z.; Liu, G.; Zhang, Z.; Yeoh, P.L.; Vucetic, B.; Li, Y. Secure Multi-Layer MEC Systems With UAV-Enabled Reconfigurable Intelligent Surface Against Full-Duplex Eavesdropper. IEEE Trans. Commun. 2024, 72, 1565–1577. [Google Scholar] [CrossRef]
  151. Ata, Y.; Vegni, A.M.; Alouini, M.S. RIS-embedded UAVs communications for multi-hop fully-FSO backhaul links in 6G networks. IEEE Trans. Veh. Technol. 2024, 73, 14143–14158. [Google Scholar] [CrossRef]
  152. Hao, S.; Fan, X.; Li, X.; Zhen, L.; Cui, J. Uplink Performance Analysis of RIS-Assisted UAV Communication Systems with Random 3-D Mobile Pattern. IEEE Internet Things J. 2024, 11, 28153–28168. [Google Scholar] [CrossRef]
  153. Wang, Z.; Bian, J.; Wang, C.X.; Liu, Y.; Tian, J. Aerial Reconfigurable Intelligent Surface-Assisted Channel Modeling Incorporating the Effect of UAV Fluctuations. IEEE Commun. Lett. 2024, 28, 1599–1603. [Google Scholar] [CrossRef]
  154. Mohammadyari, M.; Eskandari, M. Stochastic Convex Cone Programming for Joint Optimal BESS Operation and Q-Placement in Net-Zero Microgrids. Energies 2024, 17, 4292. [Google Scholar] [CrossRef]
  155. Yadasu, S.; Awaar, V.K.; Jetti, V.R.; Eskandari, M. Sensor Fusion-Based Pulsed Controller for Low Power Solar-Charged Batteries with Experimental Tests: NiMH Battery as a Case Study. Batteries 2024, 10, 335. [Google Scholar] [CrossRef]
  156. Li, S.; Fang, Z.; Verma, S.C.; Wei, J.; Savkin, A.V. Navigation and Deployment of Solar-Powered Unmanned Aerial Vehicles for Civilian Applications: A Comprehensive Review. Drones 2024, 8, 42. [Google Scholar] [CrossRef]
  157. Xiao, Y.; Tyrovolas, D.; Tegos, S.A.; Diamantoulakis, P.D.; Ma, Z.; Hao, L.; Karagiannidis, G.K. Solar Powered UAV-Mounted RIS Networks. IEEE Commun. Lett. 2023, 27, 1565–1569. [Google Scholar] [CrossRef]
  158. Zhang, H.; Zeng, S.; Di, B.; Tan, Y.; Renzo, M.D.; Debbah, M.; Han, Z.; Poor, H.V.; Song, L. Intelligent Omni-Surfaces for Full-Dimensional Wireless Communications: Principles, Technology, and Implementation. IEEE Commun. Mag. 2022, 60, 39–45. [Google Scholar] [CrossRef]
  159. Wu, Q.; Lin, T.; Liu, M.; Zhu, Y. BIOS: An Omni RIS for Independent Reflection and Refraction Beamforming. IEEE Wirel. Commun. Lett. 2022, 11, 1062–1066. [Google Scholar] [CrossRef]
  160. Yue, S.; Zeng, S.; Zhang, H.; Lin, F.; Liu, L.; Di, B. Intelligent Omni-Surfaces Aided Wireless Communications: Does the Reciprocity Hold? IEEE Trans. Veh. Technol. 2023, 72, 8181–8185. [Google Scholar] [CrossRef]
  161. Wan, Z.; Gao, Z.; Gao, F.; Renzo, M.D.; Alouini, M.S. Terahertz Massive MIMO With Holographic Reconfigurable Intelligent Surfaces. IEEE Trans. Commun. 2021, 69, 4732–4750. [Google Scholar] [CrossRef]
  162. Deng, R.; Di, B.; Zhang, H.; Niyato, D.; Han, Z.; Poor, H.V.; Song, L. Reconfigurable Holographic Surfaces for Future Wireless Communications. IEEE Wirel. Commun. 2021, 28, 126–131. [Google Scholar] [CrossRef]
  163. Zhang, J.; Xu, W.; Gao, H.; Pan, M.; Han, Z.; Zhang, P. Codebook-Based Beam Tracking for Conformal Array-Enabled UAV mmWave Networks. IEEE Internet Things J. 2021, 8, 244–261. [Google Scholar] [CrossRef]
  164. Li, S.; Duo, B.; Yuan, X.; Liang, Y.C.; Renzo, M.D. Reconfigurable Intelligent Surface Assisted UAV Communication: Joint Trajectory Design and Passive Beamforming. IEEE Wirel. Commun. Lett. 2020, 9, 716–720. [Google Scholar] [CrossRef]
  165. Zheng, C.; Eskandari, M.; Li, M.; Sun, Z. GA−Reinforced Deep Neural Network for Net Electric Load Forecasting in Microgrids with Renewable Energy Resources for Scheduling Battery Energy Storage Systems. Algorithms 2022, 15, 338. [Google Scholar] [CrossRef]
  166. Asadi, A.H.; Eskandari, M.; Delavari, H. Accurate Surge Arrester Modeling for Optimal Risk-Aware Lightning Protection Utilizing a Hybrid Monte Carlo–Particle Swarm Optimization Algorithm. Technologies 2024, 12, 88. [Google Scholar] [CrossRef]
  167. Eskandari, M.; Li, L.; Moradi, M.H.; Siano, P.; Blaabjerg, F. Optimal Voltage Regulator for Inverter Interfaced Distributed Generation Units Part I: Control System. IEEE Trans. Sustain. Energy 2020, 11, 2813–2824. [Google Scholar] [CrossRef]
  168. İren, K.T.; Gün, A.; Girici, T. Optimal Deployment of UAV-Mounted Reconfigurable Intelligent Surfaces for Millimeter-Wave Transmission. In Proceedings of the 2024 7th International Balkan Conference on Communications and Networking (BalkanCom), Ljubljana, Slovenia, 3–6 June 2024; pp. 48–52. [Google Scholar]
  169. Eskandari, M.; Savkin, A.V. AI-based Navigation and Communication Control for a Team of UAVs with Reconfigurable Intelligent Surfaces Supporting Mobile Internet of Vehicles. In Proceedings of the 2023 IEEE Conference on Control Technology and Applications (CCTA), Bridgetown, Barbados, 16–18 August 2023; pp. 234–238. [Google Scholar]
  170. Ahmad, I.; Narmeen, R.; Becvar, Z.; Guvenc, I. Machine Learning-Based Beamforming for Unmanned Aerial Vehicles Equipped with Reconfigurable Intelligent Surfaces. IEEE Wirel. Commun. 2022, 29, 32–38. [Google Scholar] [CrossRef]
  171. Narmeen, R.; Almadhor, A.; Alkhayyat, A.; Ho, P.H. Secure Beamforming for Unmanned Aerial Vehicles Equipped Reconfigurable Intelligent Surfaces. IEEE Internet Things Mag. 2024, 7, 30–37. [Google Scholar] [CrossRef]
  172. Eskandari, M.; Savkin, A.V. GANs the UAV Path Planner: UAV-Based RIS-Assisted Wireless Communication for Internet of Autonomous Vehicles. In Proceedings of the 2024 IEEE 19th Conference on Industrial Electronics and Applications (ICIEA), Kristiansand, Norway, 5–8 August 2024; pp. 1–6. [Google Scholar]
  173. Yang, K.; Shi, Y.; Zhou, Y.; Yang, Z.; Fu, L.; Chen, W. Federated Machine Learning for Intelligent IoT via Reconfigurable Intelligent Surface. IEEE Netw. 2020, 34, 16–22. [Google Scholar] [CrossRef]
  174. Diamanti, M.; Charatsaris, P.; Tsiropoulou, E.E.; Papavassiliou, S. The Prospect of Reconfigurable Intelligent Surfaces in Integrated Access and Backhaul Networks. IEEE Trans. Green. Commun. Netw. 2022, 6, 859–872. [Google Scholar] [CrossRef]
  175. Diamanti, M.; Tsampazi, M.; Tsiropoulou, E.E.; Papavassiliou, S. Energy Efficient Multi-User Communications Aided by Reconfigurable Intelligent Surfaces and UAVs. In Proceedings of the 2021 IEEE International Conference on Smart Computing (SMARTCOMP), Irvine, CA, USA, 23–27 August 2021; pp. 371–376. [Google Scholar]
  176. Kwon, G.; Conti, A.; Park, H.; Win, M.Z. Joint Communication and Localization in Millimeter Wave Networks. IEEE J. Sel. Top. Signal Process. 2021, 15, 1439–1454. [Google Scholar] [CrossRef]
  177. Kwon, G.; Liu, Z.; Conti, A.; Park, H.; Win, M.Z. Integrated Localization and Communication for Efficient Millimeter Wave Networks. IEEE J. Sel. Areas Commun. 2023, 41, 3925–3941. [Google Scholar] [CrossRef]
  178. Lu, Z.; Zhao, Y.; Xu, C.Z. RCSIL: RIS-Assisted Cooperative Channel State Information Localization for V2X System. IEEE Internet Things J. 2024, 1. [Google Scholar] [CrossRef]
  179. Conti, A.; Morselli, F.; Liu, Z.; Bartoletti, S.; Mazuelas, S.; Lindsey, W.C.; Win, M.Z. Location Awareness in Beyond 5G Networks. IEEE Commun. Mag. 2021, 59, 22–27. [Google Scholar] [CrossRef]
  180. Abu-Shaban, Z.; Wymeersch, H.; Abhayapala, T.; Seco-Granados, G. Single-Anchor Two-Way Localization Bounds for 5G mmWave Systems. IEEE Trans. Veh. Technol. 2020, 69, 6388–6400. [Google Scholar] [CrossRef]
  181. Savkin, A.V.; Ni, W.; Eskandari, M. Effective UAV Navigation for Cellular-Assisted Radio Sensing, Imaging, and Tracking. IEEE Trans. Veh. Technol. 2023, 72, 13729–13733. [Google Scholar] [CrossRef]
  182. Greisman, A.; Hashtrudi-Zaad, K.; Marshall, J.A. Detection of Conductive Lane Markers using mm Wave FMCW Automotive Radar. In Proceedings of the 2021 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), Karlsruhe, Germany, 23–25 September 2021; pp. 1–6. [Google Scholar]
  183. Singh, J.; Gupta, A.; Jagannatham, A.K.; Hanzo, L. Multi-Beam Object-Localization for Millimeter-Wave ISAC-Aided Connected Autonomous Vehicles. IEEE Trans. Veh. Technol. 2024, 1–6. [Google Scholar] [CrossRef]
  184. Li, L.; Yang, M.; Guo, L.; Wang, C.; Wang, B. Hierarchical Neighborhood Based Precise Localization for Intelligent Vehicles in Urban Environments. IEEE Trans. Intell. Veh. 2016, 1, 220–229. [Google Scholar] [CrossRef]
  185. Li, L.; Yang, M.; Li, H.; Wang, C.; Wang, B. Robust Localization for Intelligent Vehicles Based on Compressed Road Scene Map in Urban Environments. IEEE Trans. Intell. Veh. 2023, 8, 250–262. [Google Scholar] [CrossRef]
  186. Cadena, C.; Carlone, L.; Carrillo, H.; Latif, Y.; Scaramuzza, D.; Neira, J.; Reid, I.; Leonard, J.J. Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age. IEEE Trans. Robot. 2016, 32, 1309–1332. [Google Scholar] [CrossRef]
  187. Nguyen, T.-H.; Le, V.-H.; Do, H.-S.; Te, T.-H.; Phan, V.-N. TQU-SLAM Benchmark Dataset for Comparative Study to Build Visual Odometry Based on Extracted Features from Feature Descriptors and Deep Learning. Future Internet 2024, 16, 174. [Google Scholar] [CrossRef]
  188. Li, Y.; Hu, Z.; Cai, Y.; Wu, H.; Li, Z.; Sotelo, M.A. Visual Map-Based Localization for Intelligent Vehicles from Multi-View Site Matching. IEEE Trans. Intell. Transp. Syst. 2021, 22, 1068–1079. [Google Scholar] [CrossRef]
  189. Song, J.; Jo, H.; Jin, Y.; Lee, S.J. Uncertainty-Aware Depth Network for Visual Inertial Odometry of Mobile Robots. Sensors 2024, 24, 6665. [Google Scholar] [CrossRef]
  190. Kong, H.; Huang, C.; Yu, J.; Shen, X. A Survey of mmWave Radar-Based Sensing in Autonomous Vehicles, Smart Homes and Industry. IEEE Commun. Surv. Tutor. 2024, 1. [Google Scholar] [CrossRef]
  191. Fang, X.; Feng, W.; Chen, Y.; Ge, N.; Zhang, Y. Joint Communication and Sensing Toward 6G: Models and Potential of Using MIMO. IEEE Internet Things J. 2023, 10, 4093–4116. [Google Scholar] [CrossRef]
  192. Wang, Z.; Liu, Z.; Shen, Y.; Conti, A.; Win, M.Z. Location Awareness in Beyond 5G Networks via Reconfigurable Intelligent Surfaces. IEEE J. Sel. Areas Commun. 2022, 40, 2011–2025. [Google Scholar] [CrossRef]
  193. Feng, Z.; Wang, B.; Chang, Z.; Hämäläinen, T.; Zhao, Y.; Hu, F. Joint Active and Passive Beamforming for Vehicle Localization with Reconfigurable Intelligent Surfaces. IEEE Trans. Intell. Transp. Syst. 2024, 25, 16704–16718. [Google Scholar] [CrossRef]
  194. Yang, Z.; Zhang, H.; Zhang, H.; Di, B.; Dong, M.; Yang, L.; Song, L. MetaSLAM: Wireless Simultaneous Localization and Mapping Using Reconfigurable Intelligent Surfaces. IEEE Trans. Wirel. Commun. 2023, 22, 2606–2620. [Google Scholar] [CrossRef]
  195. Zhang, H.; Yang, Z.; Tian, Y.; Zhang, H.; Di, B.; Song, L. Reconfigurable Holographic Surface Aided Collaborative Wireless SLAM Using Federated Learning for Autonomous Driving. IEEE Trans. Intell. Veh. 2023, 8, 4031–4046. [Google Scholar] [CrossRef]
  196. Dardari, D.; Decarli, N.; Guerra, A.; Guidi, F. LOS/NLOS Near-Field Localization With a Large Reconfigurable Intelligent Surface. IEEE Trans. Wirel. Commun. 2022, 21, 4282–4294. [Google Scholar] [CrossRef]
  197. Elzanaty, A.; Guerra, A.; Guidi, F.; Alouini, M.S. Reconfigurable Intelligent Surfaces for Localization: Position and Orientation Error Bounds. IEEE Trans. Signal Process. 2021, 69, 5386–5402. [Google Scholar] [CrossRef]
  198. Meles, M.; Rajasekaran, A.; Mela, L.; Jäntti, R. RIS-Assisted Three-Dimensional Drone Localization and Tracking Under Hardware Impairments. IEEE Access 2024, 12, 81348–81361. [Google Scholar] [CrossRef]
  199. Li, M.; Zhang, S.; Ge, Y.; Li, Z.; Gao, F.; Fan, P. STAR-RIS Aided Integrated Sensing and Communication Over High Mobility Scenario. IEEE Trans. Commun. 2024, 72, 4788–4802. [Google Scholar] [CrossRef]
  200. Zhao, Y.; Chen, P.; Cao, Z. NFLnet: A Deep Neural Network-Based Localization Method for Near-Field Vehicles. IEEE Trans. Instrum. Meas. 2024, 73, 1–12. [Google Scholar] [CrossRef]
  201. Varshney, N.; De, S. AoA-Based Low Complexity Beamforming for Aerial RIS Assisted Communications at mmWaves. IEEE Commun. Lett. 2023, 27, 1545–1549. [Google Scholar] [CrossRef]
  202. Luo, J.; Liang, T.; Chen, C.; Zhang, T. A UAV mounted RIS aided communication and localization integration system for ground vehicles. In Proceedings of the 2022 IEEE International Conference on Communications Workshops (ICC Workshops), Seoul, Republic of Korea, 16–20 May 2022; pp. 139–144. [Google Scholar]
  203. Teng, S.; Hu, X.; Deng, P.; Li, B.; Li, Y.; Ai, Y.; Yang, D.; Li, L.; Xuanyuan, Z.; Zhu, F.; et al. Motion Planning for Autonomous Driving: The State of the Art and Future Perspectives. IEEE Trans. Intell. Veh. 2023, 8, 3692–3711. [Google Scholar] [CrossRef]
  204. Eskandari, M.; Savkin, A.V.; Deghat, M. Integrated Path Planning and Localization for an Ocean Exploring Team of Autonomous Underwater Vehicles with Consensus Graph Model Predictive Control. IEEE Trans. Intell. Veh. 2024; to be published. [Google Scholar]
Figure 1. Organization of the paper based on the taxonomy of the UAV-enabled, RIS-assisted communication into quintuple studied and topics.
Figure 1. Organization of the paper based on the taxonomy of the UAV-enabled, RIS-assisted communication into quintuple studied and topics.
Futureinternet 16 00433 g001
Figure 2. Illustration of direct LoS path and multi-path.
Figure 2. Illustration of direct LoS path and multi-path.
Futureinternet 16 00433 g002
Figure 3. UAV-enabled, RIS-assisted communication: (a) RISeUAV with a UPA of the RIS aligned in the XY plane facing the ground; (b) UAV-BS as an active aerial (airborne) BS.
Figure 3. UAV-enabled, RIS-assisted communication: (a) RISeUAV with a UPA of the RIS aligned in the XY plane facing the ground; (b) UAV-BS as an active aerial (airborne) BS.
Futureinternet 16 00433 g003
Figure 4. Schematic of RISeUAV-assisted communication for channel modeling: (a) geometry of system in 3D coordinates; (b) UPA of the RIS in XY plane; v R U and u R U denote UAV’s horizontal and vertical linear velocities, respectively; ω R U denotes the UAV’s horizontal rotational velocity and θ R U denotes the UAV heading (angle) with respect to the X-axis. The UAV motion is studied in Section 4.
Figure 4. Schematic of RISeUAV-assisted communication for channel modeling: (a) geometry of system in 3D coordinates; (b) UPA of the RIS in XY plane; v R U and u R U denote UAV’s horizontal and vertical linear velocities, respectively; ω R U denotes the UAV’s horizontal rotational velocity and θ R U denotes the UAV heading (angle) with respect to the X-axis. The UAV motion is studied in Section 4.
Futureinternet 16 00433 g004
Figure 5. Schematic of UAV-enabled, RIS-assisted wireless communication for intelligent vehicles (IVs) in IoVs with mMIMO BSs. Notice that, for the sake of illustration, the sizes of the mMIMO BS and RISeUAV are exaggerated compared with the distances.
Figure 5. Schematic of UAV-enabled, RIS-assisted wireless communication for intelligent vehicles (IVs) in IoVs with mMIMO BSs. Notice that, for the sake of illustration, the sizes of the mMIMO BS and RISeUAV are exaggerated compared with the distances.
Futureinternet 16 00433 g005
Figure 6. Aerial backhauling through the RISeUAV to UAV-BSs.
Figure 6. Aerial backhauling through the RISeUAV to UAV-BSs.
Futureinternet 16 00433 g006
Figure 7. The schematic of the actor-critic deep deterministic policy gradient DRL agent.
Figure 7. The schematic of the actor-critic deep deterministic policy gradient DRL agent.
Futureinternet 16 00433 g007
Figure 8. The geometry of the SLAPS for RISeUAV.
Figure 8. The geometry of the SLAPS for RISeUAV.
Futureinternet 16 00433 g008
Table 2. Rotary-wing physical parameters affect the propulsion energy consumption.
Table 2. Rotary-wing physical parameters affect the propulsion energy consumption.
SymbolParameterUnit
v 0 The mean rotor velocity in hoveringm/s
P 0 Blade profile power in hoveringW
P i Induced power in hoveringW
ϖ Rotor angular velocityRadian/seconds
d 0 Fuselage drag ratio
A r Rotor disk aream2
r Rotor radiusm
s Rotor soliditym3
ρ Air densityKg/m2
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Eskandari, M.; Savkin, A.V. Integrating UAVs and RISs in Future Wireless Networks: A Review and Tutorial on IoTs and Vehicular Communications. Future Internet 2024, 16, 433. https://doi.org/10.3390/fi16120433

AMA Style

Eskandari M, Savkin AV. Integrating UAVs and RISs in Future Wireless Networks: A Review and Tutorial on IoTs and Vehicular Communications. Future Internet. 2024; 16(12):433. https://doi.org/10.3390/fi16120433

Chicago/Turabian Style

Eskandari, Mohsen, and Andrey V. Savkin. 2024. "Integrating UAVs and RISs in Future Wireless Networks: A Review and Tutorial on IoTs and Vehicular Communications" Future Internet 16, no. 12: 433. https://doi.org/10.3390/fi16120433

APA Style

Eskandari, M., & Savkin, A. V. (2024). Integrating UAVs and RISs in Future Wireless Networks: A Review and Tutorial on IoTs and Vehicular Communications. Future Internet, 16(12), 433. https://doi.org/10.3390/fi16120433

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop