Open AccessArticle

Model Predictive Collision Avoidance Control for Object Transport of Unmanned Underwater Vehicle-Dual-Manipulator Systems

Yingxiang Wang

and

Jian Gao

School of Marine Science and Technology, Northwestern Polytechnical University, Xi’an 710072, China

Author to whom correspondence should be addressed.

J. Mar. Sci. Eng. 2024, 12(6), 926; https://doi.org/10.3390/jmse12060926

Submission received: 10 May 2024 / Revised: 28 May 2024 / Accepted: 29 May 2024 / Published: 31 May 2024

(This article belongs to the Special Issue Track Planning with Automatic Obstacle Recognition and Avoidance for Maritime Vessels)

Download

Browse Figures

Figure 1
Coordinate frames and joint configuration of the UVDMS. "> Figure 2
Definition of the minimum distances to avoid collisions. "> Figure 3
Distance between two non-coplanar links. "> Figure 4
Coordinates and forces of the object. "> Figure 5
Model predictive collision avoidance tracking control scheme. "> Figure 6
Moments of collisions and corresponding results improved by collision avoidance. "> Figure 7
End-effector position of Case 1: (a) Positions of the left end effector; (b) Positions of the right end effector. "> Figure 8
End-effector position of Case 2: (a) Positions of the left end effector; (b) Positions of the right end effector. "> Figure 9
Comparison of the minimum distances of certain links: (a) The fluctuation of the minimum distance from link 5 of the right manipulator to the left manipulator; (b) The fluctuation of the minimum distance from link 3 of the right manipulator to corresponding frames. "> Figure 10
Display of the object trajectory tracking in Unity. "> Figure 11
Object pose: (a) Positions of the object; (b) Euler angles of the object. "> Figure 12
UUV poses: (a) Positions of the vehicle; (b) Euler angles of the vehicle. "> Figure 13
Joint angles: (a) Joints of the left manipulator; (b) Joint of the right manipulator. "> Figure 14
Object and UUV velocities: (a) Velocity of the object; (b) Velocity of the vehicle. "> Figure 15
Joint velocities and manipulators input: (a) Joint angular velocities of both manipulators; (b) Torques of the manipulators. "> Figure 16
UUV torques input and compensation signals from the neural network: (a) Torques of the UUV; (b) NN compensation signals. ">

Versions Notes

Abstract

Unmanned underwater vehicle-dual-manipulator systems (UVDMSs) have attracted much research due to their humanoid operation capabilities, which have the advantage of cooperative manipulations and transporting underwater objects. Meanwhile, collision avoidance of UVDMSs is more challenging than that of unmanned underwater vehicle-dual manipulator systems (UVMSs). In this work, a model predictive control (MPC) approach is proposed for collision avoidance in objects transporting tasks of UVDMSs. The minimum distances of mutual manipulators and frame obstacles are handled as velocity constraints in the optimization of the UVDMS’s object tracking control. The command velocity generated by the model predictive kinematic controller is tracked by a dynamic inversion control scheme while model uncertainties are compensated by a neural network. Moreover, the tracking errors of the proposed dynamic controller are proved to be convergent by the Lyapunov method. At last, a three-dimensional (3D) UVDMS simulation platform is developed to verify the effectiveness of the proposed control strategy in the tasks of collision avoidance and object transport.

Keywords:

unmanned underwater vehicle; underwater vehicle-dual-manipulator system; collision avoidance; model predictive control; trajectory tracking; neural network

1. Introduction

Unmanned underwater vehicles (UUVs), including autonomous underwater vehicles (AUVs) and remotely operated vehicles (ROVs), have played a significant role in exploring the deep sea. However, human interest in underwater research is not only limited to observation but also requires a certain degree of intervention [1], a capability that classical UUVs lack. Therefore, UUVs equipped with underwater manipulators, named underwater vehicle-manipulator systems (UVMSs), are widely used in marine energy and architecture industries [2,3]. To achieve a larger work range and certain cooperation abilities, UVMSs often assemble two manipulators for specific tasks. This type of UVMS is called underwater vehicle-dual-manipulator systems (UVDMSs), which have the intuitive advantage of dealing with precise tasks since they are expected to be substitutes for human bodies underwater.

Research related to dual arms has always been a hot topic in the field of robotics, including but not limited to space robotics [4], medical robotics [5], drones [6], wheeled robotics [7], and humanoid robotics [8]. An obvious advantage of dual-arm robots is their ability to capture and transport target objects. An adaptive hybrid control scheme is designed to capture unknown objects by dual arms cooperatively in [9]. Refs. [10,11] propose an integrated multi-agent global planning and central strategy for reactive dual arm manipulation while modeling the dual arm cooperative control by dual qualifications, which performs perfectly in transporting objects. Compared to single-arm robots, the problem of mutual collisions between the two arms is a significant constraint for motion planning of dual-arm robots. Therefore, collision avoidance is essential for the cooperative control of dual manipulators. Ref. [12] describes a control scheme to avoid conflicts between dual manipulators with high accuracy in tracking the desired path while regarding distances of obstacles as constraints in the optimization model. The obstacle avoidance strategy in [11], using the artificial potential field method, can avoid obstacles in the transporting task effectively. In terms of UVDMSs, cooperative control, and obstacle avoidance are more complicated due to the complex dynamics, limited workspace, and lack of obstacle information. In [13], a multiple impedance dual-arm control for the task of object manipulation is proposed with reliable performance when contacting the environment. Ref. [14] introduces the coordination control problems of UVMSs and discusses the application of the proposed framework to transportation problems of UVDMSs at the end. Their later research [15] improves the previous framework to adapt to more scenarios.

UVDMSs are composed of multiple rigid bodies, which result in complicated modeling with couplings and uncertainties, so the motion planning and control of UVDMSs are challenging. The motion redundancy caused by multiple degrees of freedom makes it difficult to obtain an inversion solution from Cartesian space. The most common method to solve the redundancy problem is the task priority strategy [15], which decomposes tasks into several sub-tasks in forms of target velocities and executes them in order. The sub-tasks are projected into the zero space of the main task, which will not be affected. Although this method fully utilizes the freedoms of UVDMS, selecting a proper task priority is not so easy, in that inappropriate configurations may lead to task failures. Optimization methods that regard the kinematic control as an optimization problem perform effectively in the motion planning of UVDMSs by limiting the solution to a small range through appropriate constraints. Extensive research on dual-arm robotics uses the quadratic programming scheme to deal with redundancy control [16,17,18]. On this basis, the model predictive control (MPC), which has better dynamic performance, is suitable for the control of systems with high degrees of freedom. Static obstacles involved in a constrained workspace for multiple UVMSs’ cooperative transportation control are studied by [19], which considers the kinematic singularities, obstacles, joint limits, and input saturation. The effectiveness of their results has been proved in both simulations and real experiments. Ref. [20] developed a model predictive kinematic visual servoing control strategy by decoupling the control of the UVMS to separated vehicle and manipulator controls. For trajectory tracking of UVMSs, ref. [21] proposes a fast MPC method with the extended Kalman filter (EKF) to compensate for model uncertainties and disturbances. A fast tube MPC scheme for moving target tracking of UVMSs is proposed in [22], with an EKF to overcome the sensor noise. Similarly, to deal with noises, disturbances, and model uncertainties, ref. [23] presents a sliding mode MPC strategy for coordinated control of the UVMS. Model uncertainties are also studied by other researchers, with robust and adaptive controls. In [24], a robust controller, which performs well in trajectory tracking in the presence of system uncertainties and disturbances, is introduced. The adaptive control scheme and observer-based method for uncertainties of the UVMS are studied in [25], utilizing the neural network (NN) to approximate the unknown dynamics. An NN is also used in [26] as both a disturbance observer and state predictor. By this operation, a composite control scheme consisting of an NN and MPC is established to generate optimal control actions in the presence of uncertainties and input saturation.

Based on the previous research, this work focuses on the collision avoidance and trajectory tracking of UVDMS. Both mutual collision and frame collision are considered by defining constraints of the minimum distance velocities of all manipulator links. A model predictive kinematic control scheme is proposed to track the reference trajectory of the grasped object. Then, a neural network-based dynamic inversion control framework is used to track the command velocity generated by the kinematic controller. At last, a 3D UVDMS platform is established to test the performances of the proposed control strategy.

This work is organized as follows. Section 2 provides a brief mathematical model of the UVDMS and formulates the collision avoidance constraints, as well as the object transport model. In Section 3, the kinematic MPC tracking scheme and neural network-based dynamic inversion controller with stability analysis are established. Finally, simulation experiments are tested on the platform based on Creo 10.0.1.0, Unity 2022.3.15f1c1, and Matlab R2023b in Section 4.

2. Problem Formulation

In this section, the kinematic and dynamic models of UVDMS are described briefly. Initially, the kinematic model is given by defining relevant coordinates and variables. Then, the collision avoidance method is established as constraints in the control system. Moreover, the object transport model is established.

2.1. UVDMS Model

Figure 1 shows the necessary coordinates and variables that describe the motions of UVDMSs. The vehicle moves in the inertial frame

Σ_{i}

, which is always fixed on the ground with the z-axis downward. In

Σ_{i}

, positions of the vehicle and end effectors are defined as

η = {[x, y, z, ϕ, θ, ψ]}^{T}

(including the global position

η_{1} = {[x, y, z]}^{T}

and Euler angles

η_{2} = {[ϕ, θ, ψ]}^{T}

) and

η_{e e} = {[{η_{e e l}}^{T}, {η_{e e r}}^{T}]}^{T}

with

η_{e e l} = {[x_{l}, y_{l}, z_{l}, φ_{l}, θ_{l}, ψ_{l}]}^{T}

for the left end effector and

η_{e e r} = {[x_{r}, y_{r}, z_{r}, φ_{r}, θ_{r}, ψ_{r}]}^{T}

for the right one. The vehicle velocity, in frame

Σ_{b}

fixed with the vehicle body, is

v = {[u, v, w, p, q, r]}^{T}

, which contains the linear velocity

v_{1} = {[u, v, w]}^{T}

and the angular velocity

v_{2} = {[p, q, r]}^{T}

. The joint angles of both underwater manipulators are

q = {[q_{l}^{T}, q_{r}^{T}]}^{T}

where

q_{l} = {[q_{l 1}, q_{l 2}, q_{l 3}, q_{l 4}, q_{l 5}, q_{l 6}]}^{T}

is the angle vector of the left manipulator and

q_{r} = {[q_{r 1}, q_{r 2}, q_{r 3}, q_{r 4}, q_{r 5}, q_{r 6}]}^{T}

for the right one. And the joint velocities

\dot{q} = {[{\dot{q}}_{l}^{T}, {\dot{q}}_{l}^{T}]}^{T}

have the same forms. In addition,

Σ_{0 r}

and

Σ_{e r}

, in Figure 1, represent the right manipulator base frame and the right end-effector frame, respectively.

By defining the system velocity as

ζ = {[v^{T}, {\dot{q}}^{T}]}^{T} \in ℜ^{18}

, the rotation matrix

R_{B}^{I} \in ℜ^{3 \times 3}

from

Σ_{b}

Σ_{i}

, and the Jacobian matrix

J_{k, o} (η) \in ℜ^{3 \times 3}

of the vehicle angular velocity we obtain the system velocity in the frame

Σ_{i}

, as follows.

ζ = [\begin{matrix} R_{I}^{B} & 0_{3 \times 3} & 0_{3 \times 12} \\ 0_{3 \times 3} & J_{k, o} (η) & 0_{3 \times 12} \\ 0_{12 \times 3} & 0_{12 \times 3} & I_{12} \end{matrix}] [\begin{matrix} {\dot{η}}_{1} \\ {\dot{η}}_{2} \\ \dot{q} \end{matrix}] = J_{k} [\begin{matrix} {\dot{η}}_{1} \\ {\dot{η}}_{2} \\ \dot{q} \end{matrix}],

(1)

Then, the relationship between the system velocity and the end effector velocity can be formulated as

{\dot{η}}_{e e} = [\begin{matrix} {\dot{η}}_{e e l} \\ {\dot{η}}_{e e r} \end{matrix}] = [\begin{matrix} J_{l} (R_{B}^{I}, q_{l}) \\ J_{r} (R_{B}^{I}, q_{r}) \end{matrix}] ζ = [\begin{matrix} J_{p o s l} (R_{B}^{I}, q_{l}) \\ J_{o r l} (R_{B}^{I}, q_{l}) \\ J_{p o s r} (R_{B}^{I}, q_{r}) \\ J_{o r r} (R_{B}^{I}, q_{r}) \end{matrix}] ζ = J ζ,

(2)

where the Jacobian matrix

J \in ℜ^{12 \times 18}

transfors the system velocity to the end effector velocity, contains the linear velocity transfomation

J_{p o s l}, J_{p o s r} \in ℜ^{3 \times 18}

, and the angular velocity transformation

J_{o r l}, J_{o r r} \in ℜ^{3 \times 18}

According to [27,28], the dynamic model of UVDMS is expressed as follows.

M (q) \dot{ζ} + C (q, ζ) ζ + D (q, ζ) ζ + g (q, η_{2}) = τ,

(3)

where

M (q) \in ℜ^{18 \times 18}

is the inertial matrix in which the diagonal elements include the inertial of both the vehicle and the manipulators while other elements represent the couplings.

C (q, ζ) \in ℜ^{18 \times 18}

is the added Coriolis and centripetal matrix while

D (q, ζ) \in ℜ^{18 \times 18}

is the damping and hydrodynamic lift matrix. It should be noted that the current velocity is ignored in this model because UVDMS usually works in stable environments. The system input (torques of the vehicle and joints) and gravity are denoted by the vectors

τ = {[τ_{v}, τ_{q}]}^{T}

and

g (q, η_{2})

. Thus, the UVDMS model can be represented by

{\begin{matrix} [\begin{matrix} \dot{η} \\ \dot{q} \\ {\dot{η}}_{e e} \end{matrix}] = [\begin{matrix} J_{k}^{- 1} \\ J \end{matrix}] ζ \\ \dot{ζ} = f (τ, ζ, q, η_{2}) \end{matrix},

(4)

where the dynamic model is written in a general function form as

f (τ, ζ, q, η_{2}) = M^{- 1} (q) τ - C (q, ζ) ζ - D (q, ζ) ζ - g (q, η_{2})

to simplify the control formulation.

2.2. Collision Avoidance

The collision avoidance study of UVDMSs differs significantly from the manipulators on land. Firstly, UVDMSs are always designed in the form of ROVs with outer frames which limit the workspace severely. Secondly, the limited space may result in a close distance between two manipulators so that the probability of interference increases. Moreover, the thick watertight joint shells further reduce the available workspace. At last, collision monitoring using global information (i.e., the visual system) is difficult underwater. In this section, a collision avoidance strategy considering the UVDMS configurations is established.

In this study, the manipulators’ mutual collisions and the outer frame collisions are discussed. Both of them are handled by calculating their minimum distances to develop velocity constraints. It is reasonable that when one manipulator (i.e., the right one without loss of generality) is working, another one is regarded as an obstacle. The purpose of collision prevention is to ensure that the minimum distance between the manipulators does not exceed the limit. The minimum distance is defined in Figure 2 where the i-th link of the right manipulator is represented by the line segment AB with A and B being the endpoints of the link. The distance between AB and the left manipulator is defined by the minimal one among the distances between AB and all the links of the left manipulator. In this way, the line segment PE in Figure 2 is computed as the distance between AB and the left manipulator. After calculating all 6 right links, one obtains the distances from them to the left manipulator as d(1)~d(6).

Algorithm 1 provides a numerical method to obtain the approximate value which is higher than the actuate value.

Algorithm 1 Manipulators Distances Calculation Algorithm
Manipulators Minimum Distances Calculation Algorithm
1.	Load DH_l(q), DH_r(q), A(0), C(0);
2.	Calculate transforms T_l(1~7) and T_r(1~7) using DH(q);
3.	A(1)←T_r(1)(A(0)), C(1)←T_l(1)(C(0));
4.	for k = 1 : 6
5.	A(k+1)←T_r(k + 1)(A(0))
6.	AB(k)←vector(A(k), A(k + 1))
7.	Initialize D’(0)
8.	for i = 1 : n
9.	Initialize D(i, 0)
10.	P’(i)←A(k) + i/n*AB(k)
11.	for m = 1 : 6
12.	C(m+1)←T_l(m + 1)(C(0))
13.	CD(m)←line segment(C(m), C(m + 1))
14.	D(i,m)←distance(P’(i), CD(m))
15.	if Di(i,m) < D(i, m − 1)
16.	D’(i)←D(i, m)
17.	Generate E’(i)
18.	end if
19.	end for
20.	if D’(i) < D’(i − 1)
21.	d(k)←D’(i), P(k)←P’(i), E(k)←E’(i)
22.	end if
23.	end for
24.	end for
25.	Output d(1)~d(6), P(1)~P(6), E(1)~E(6)

Theorem 1.

With d’(k) = d(k) − r as the modified distance, where r is the maximum interval when sampling P(i) and d(k) is the approximate distance calculated by Algorithm 1, the inequality d’(k) < d*(k) holds.

Proof.

Obviously, the above inequality holds once the two links are coplanar. The non-coplanar case is shown in Figure 3 where it is assumed that P(i)E is the computed distance between link AB(k) and link CD(m). The actual closest point is marked as P* between P(i) and P(i + 1) without loss of generality (P* cannot be out of the adjacent intervals of P(i) otherwise the algorithm would output another P(i′) and d(k′)). Thus, we have r + d*(k) = r + P*E* > P(i)P* + P*E* > P(i)E* > P(i)E = d(k), that is d’(k) = d(k) − r < d*(k). □

On the other hand, the outer frames are considered as several planar obstacles. In this case, these planes are the front frame, the left frame, the right frame, and the bottom frame, while other frames cannot be reached by the manipulators (or be reached after the former planes). The right-hand links are taken as an example in Figure 2 to define the link-plane distances. As before, the i-th link AB has the nearest distance, represented by the line segment MN, to plane F. After calculating the other 5 link-plane distances, as well as the left-hand distances, one obtains the distances from both manipulators’ links to the nearest plane as dr(1)~dr(6) and dl(1)~dl(6). The link-plane distances can also be calculated using Algorithm 1 by replacing the point-line-segment distance with the point-plane distance. Similarly, the modified dr^ = dr − r and dl^ = dl − r are defined and the inequality similar to Theorem 1 still holds. In addition, it should be noted that the accuracy of the algorithm depends on r. In this case, considering the length of all links, the error is within 1cm while more than n = 20 critical points are sampled for each link.

Summarizing the results above, we obtain

σ_{i} = \frac{d_{σ i}^{T}}{‖ d_{σ i} ‖} J_{σ i} ζ, π_{i} = \frac{d_{π i}^{T}}{‖ d_{π i} ‖} J_{π i} ζ, ω_{i} = \frac{d_{ω i}^{T}}{‖ d_{ω i} ‖} J_{ω i} ζ, i = 1, 6,

(5)

where,

d_{σ i}

is the i-th link-manipulator distance vector (PE(i)) of the right manipulator,

d_{π i}

is the i-th link-plane distance vector (MNr(i)) of the right manipulator, and

d_{ω i}

is the i-th link-plane distance vector (MNl(i)) of the left manipulator.

J_{σ i}, J_{π i}

and

J_{ω i}

are the Jacobian matrices for the velocities of points P(i), Mr(i), and Ml(i).

σ_{i}, π_{i}

and

ω_{i}

indicate the velocities of the critical points toward the obstacles. The distance velocities can be written in a compact form as

\begin{array}{l} σ = J_{σ} ζ, π = J_{π} ζ, ω = J_{ω} ζ \\ J_{σ} = [\begin{matrix} \frac{d_{σ 1}^{T}}{‖ d_{σ 1} ‖} J_{σ 1} \\ ⋮ \\ \frac{d_{σ 6}^{T}}{‖ d_{σ 6} ‖} J_{σ 6} \end{matrix}], J_{π} = [\begin{matrix} \frac{d_{π 1}^{T}}{‖ d_{π 1} ‖} J_{π 1} \\ ⋮ \\ \frac{d_{π 6}^{T}}{‖ d_{π 6} ‖} J_{π 6} \end{matrix}], J_{ω} = [\begin{matrix} \frac{d_{ω 1}^{T}}{‖ d_{ω 1} ‖} J_{ω 1} \\ ⋮ \\ \frac{d_{ω 6}^{T}}{‖ d_{ω 6} ‖} J_{ω 6} \end{matrix}] \end{array},

(6)

and

v_{d i s} = [\begin{matrix} σ \\ π \\ ω \end{matrix}] = [\begin{matrix} J_{σ} \\ J_{π} \\ J_{ω} \end{matrix}] ζ = J_{d i s} ζ .

(7)

The objective of collision avoidance is to limit

v_{d i s}

so that the corresponding minimum distances will not decrease. However, direct collision avoidance will have a negative effect once the obstacles are far away or where the UVDMS’ motion is not encumbered. Therefore, the collision detection area, shown in Figure 2, is divided into three zones by the threshold d1 and d2. When the obstacle reaches the red zone (the distance lower than d1), there is a high probability of collision, so the controller must stop the motion or generate a large escape velocity. When the obstacle (as the orange obstacle shown in Figure 2) is in the anti-collision zone (the distance between d1 and d2), the normal avoidance velocity is generated to drive the manipulators away. While obstacles are in the safe area (distance higher than d2) no special movement needs to be implemented. According to [29], a gradually changing operation is defined as

\begin{array}{l} v_{\lim} = S (d) \max {v_{d i s} |_{d = d_{2}}, 0} \\ S (d) = {\begin{matrix} \begin{array}{l} 1, \\ \sin^{2} (\frac{π}{2} \cdot \frac{d - d_{1}}{d_{2} - d_{1}}), \\ 0, \end{array} & \begin{matrix} \begin{array}{l} i f \\ i f \\ i f \end{array} & \begin{array}{l} d \geq d_{2} \\ d_{1} < d \leq d_{2} \\ d \leq d_{1} \end{array} \end{matrix} \end{matrix} \end{array} .

(8)

It should be noted that the operation above is not a strict form of a vector function and the scalar variable

d

represents each component of the distance vectors

d_{σ}, d_{ω}

and

d_{π}

to simplify the formulation. Thus, the constraints for collision avoidance are given as follows.

v_{d i s} (i) \leq v_{\lim} (i), i = 1 ~ 18,

(9)

2.3. Object Transport Model

Before modeling the object, it is assumed that the object has already been captured by the end effectors with rigid body connections. As shown in Figure 4, the cylinder object is gripped by two clamps fixed with the end effectors. The object’s kinematic is provided as

\begin{array}{l} η_{o} = {[x_{o}, y_{o}, z_{o}, φ_{o}, θ_{o}, ψ_{o}]}^{T} = [\begin{matrix} η_{o 1} \\ η_{o 2} \end{matrix}] = T_{r}^{o} T_{b}^{r} (η) \\ {\dot{η}}_{o} = [\begin{matrix} {\dot{η}}_{o 1} \\ {\dot{η}}_{o 2} \end{matrix}] = J_{o e r} {\dot{η}}_{e e r} = J_{o e r} J_{r} ζ = J_{o} ζ \end{array},

(10)

where

J_{o e r}

is the Jacobian matrix from the right end effector velocity to the object velocity in the inertial frame.

T_{r}^{o}

and

T_{b}^{r}

are the homogeneous transformations that can be obtained by the DH parameters.

Similar to the vehicle model, the underwater object dynamic is described as

M_{o} {\ddot{η}}_{o} + C_{o} ({\dot{η}}_{o}) {\dot{η}}_{o} + D_{o} ({\dot{η}}_{o}) {\dot{η}}_{o} + g_{o} (η_{o}) = F_{o},

(11)

where

M_{o}

is the inertial matrix,

C ({\dot{η}}_{o})

is the added Coriolis and centripetal matrix,

D ({\dot{η}}_{o})

is the damping and hydrodynamic lift matrix, and

g_{o} (η_{o})

is the gravity vector. The force

F_{o}

(force and torque) comes from the end effectors as

F_{o} = J_{g r a} F_{e} = J_{g r a} [\begin{matrix} F_{e l} \\ F_{e r} \end{matrix}],

(12)

where

J_{g r a}

is the force Jacobian matrix from frame

Σ_{e l}

and

Σ_{e r}

to frame

Σ_{o}

(the object coordinate frame) and

F_{e l}

and

F_{e r}

are the forces affected by the two end effectors. By adding the reaction force from the end effectors to the UVDMS dynamic model, we obtain

\begin{array}{l} M (q) \dot{ζ} + C (q, ζ) ζ + D (q, ζ) ζ + g (q, η_{2}) = τ - J_{e} F_{e} \\ J_{e} = [\begin{matrix} J_{e l} & J_{e r} \end{matrix}] \end{array},

(13)

where

J_{e l}, J_{e r} \in ℜ^{18 \times 6}

are the force Jacobian matrices from the end effectors frame to the vehicle body frame. By substituting Equations (11) and (12), and

{\ddot{η}}_{o} = {\dot{J}}_{o} ζ + J_{o} \dot{ζ}

into Equation (13), we obtain the dynamic of the whole transport system as

{\begin{cases} {\dot{η}}_{o} = J_{o} ζ \\ M_{w} \dot{ζ} + H_{w} ζ + g_{w} = τ \end{cases},

(14)

where

\begin{array}{l} M_{w} = M (q) + J_{e} J_{g r a}^{+} M_{o} J_{o} \\ H_{w} = C (q, ζ) + D (q, ζ) ζ + J_{e} J_{g r a}^{+} M_{o} {\dot{J}}_{o} + J_{e} J_{g r a}^{+} C_{o} (η_{o}) J_{o} + J_{e} J_{g r a}^{+} D_{o} (η_{o}) J_{o} \\ g_{w} = g (q, η_{2}) + J_{e} J_{g r a}^{+} g (η_{o}) \end{array} .

(15)

Thus, the whole UVDMS-object system model is converted to a compact Lagrange model. The objective is to design a controller to track the reference trajectory of the object.

3. Object Tracking Control

In this section, the control strategy, shown in Figure 5, is studied to track the desired trajectory of the object, while considering the collision avoidance problem and the dynamic uncertainties. The control scheme in Figure 5 includes two parts: kinematic and dynamic controls. In the kinematic control, the command velocity is produced by the model predictive controller with certain constraints, including the obstacle velocities limit. Then, the radial basis function (RBF) neural network-based dynamic inversion control framework for the transport task is developed to track the command velocity and compensate for the model uncertainties. At last, the stability of the dynamic control is analyzed briefly.

3.1. Model Predictive Kinematic Tracking Control

The desired objective tracking problem can be solved by an MPC approach once the object kinematic is converted to the discrete-time model as

η_{o} (k + 1) = η_{o} (k) + T_{c} \cdot J_{o} ζ (k) = f_{o} (η_{o} (k), ζ (k), η (k), q (k)),

(16)

where

η_{o} (k), ζ (k), η (k),

and

q (k))

represent the object pose, system velocity, vehicle pose, and joint angles at time step

k

, respectively. The sampling period is

T_{c}

. To establish the MPC optimization model, necessary constraints should be satisfied.

Joint angles and velocities of the underwater manipulators are strictly limited as

\begin{array}{l} q_{l, i}^{\min} \leq q_{l, i} \leq q_{l, i}^{\max}, q_{r, i}^{\min} \leq q_{r, i} \leq q_{r, i}^{\max} \\ \max ({\dot{q}}_{l, i}^{\min}, ε_{v} (q_{l, i}^{\min} - q_{l, i})) \leq {\dot{q}}_{l, i} \leq \min (ε_{v} ({\dot{q}}_{l, i}^{\max}, q_{l, i}^{\max} - q_{l, i})) \\ \max ({\dot{q}}_{r, i}^{\min}, ε_{v} (q_{r, i}^{\min} - q_{r, i})) \leq {\dot{q}}_{r, i} \leq \min (ε_{v} ({\dot{q}}_{r, i}^{\max}, q_{r, i}^{\max} - q_{r, i})) \\ i = 1 ~ 6 \end{array},

(17)

where

q_{l, i}^{\min}

and

q_{l, i}^{\max}

are the minimum and maximum angle values of the i-th joint of the left manipulator while the right one has the same definitions. Similarly,

{\dot{q}}_{l, i}

and

{\dot{q}}_{r, i}

are the joints velocities with their limits represented by the current joint angles, where

ε_{v}

is a positive scale parameter and

{\dot{q}}_{l / r, i}^{\min} / {\dot{q}}_{l / r, i}^{\max}

is the physical velocity limit. These conditions can be noted as

q \in Ω_{q}, \dot{q} \in Ω_{\dot{q}} .

(18)

Velocities of the vehicle are also bounded as

| v_{1} (i) | \leq v_{1}^{\max} (i), | v_{2} (i) | \leq v_{2}^{\max} (i), i = 1 ~ 3

due to the thruster limits and the water resistance. Combining them with the joint velocity limits, we obtain

ζ \in U_{ζ} .

(19)

The obstacle approaching velocity is provided in Section 2.2 and the collision avoidance constraints can be written as

v_{d i s} \in Ω_{o a} = {v_{d i s} | v_{d i s} (i) \leq v_{\lim} (i)}, i = 1 ~ 18 .

(20)

Then, the model predictive object tracking kinematic control is formulated as: Given the UVDMS object transport model in Equation (14), find the optimized kinematic inputs by solving the optimization problem

\min_{U_{ζ} (k)} J (k, η_{o} (k), U (k)),

(21)

with

\begin{array}{l} J (k, η_{o} (k), U (k)) = \sum_{j = 1}^{N_{p}} {(η_{o d} (j, k) - {\bar{η}}_{o} (j, k))}^{T} Q_{η} (η_{o d} (j, k) - {\bar{η}}_{o} (j, k)) \\ + \sum_{j = 1}^{N_{c} - 1} {\bar{ζ}}^{T} (j, k) R_{ζ} \bar{ζ} (j, k) \end{array},

(22)

subject to

\begin{array}{l} {\bar{η}}_{o} (j, k + 1) = f_{o} ({\bar{η}}_{o} (j, k), \bar{ζ} (j, k), \bar{η} (j, k), \bar{q} (j, k)) \\ \bar{q} (j, k + 1) = \bar{q} (j, k) + T_{c} \bar{\dot{q}} (j, k) \\ {\bar{η}}_{1} (j, k + 1) = {\bar{η}}_{1} (j, k) + T_{c} {\bar{v}}_{1} (j, k) \\ {\bar{η}}_{2} (j, k + 1) = {\bar{η}}_{2} (j, k) + T_{c} J_{k, o}^{- 1} {\bar{v}}_{2} (j, k) \\ \bar{q} (j, k) \in Ω_{q} \\ J_{d i s} \bar{ζ} (j, k) \in Ω_{o a} \\ \bar{ζ} (j, k) \in U_{ζ} \end{array},

(23)

where

J (k, η_{o} (k), U (k))

is the cost function of the object tracking error and candidate velocity inputs

U (k) = [\bar{ζ} (0, k), \dots, \bar{ζ} (N_{c} - 1, k)] \in ℜ^{18 \times N_{c}}

{\bar{η}}_{o} (j, k), \bar{η} (j, k),

and

\bar{q} (j, k)

are the predicted the pose of the object, pose of the vehicle, and joint angles.

{\bar{v}}_{d i s} (j, k)

is the predicted value of the obstacle distance velocity. The prediction and control horizons are

N_{p}

and

N_{c}

with

N_{c} \leq N_{p}

. The positive defined

Q_{η}

and

R_{ζ}

are weighting matrices.

Once the optimization problem of Equation (21) is solved with the input sequence

U^{*} (k) = [{\bar{ζ}}^{*} (0, k), \dots, {\bar{ζ}}^{*} (N_{c} - 1, k)]

at time

k

, the first element

{\bar{ζ}}^{*} (0, k)

will be applied to the tracking control as the command velocity

ζ_{c m d}

3.2. Dynamic Inversion and Neural Network-Based Control

The control law of the dynamic system in (14) is designed as

τ = {\bar{M}}_{w} a + {\bar{H}}_{w} ζ + {\bar{g}}_{w},

(24)

with the virtual control

a

as the expected acceleration of the system.

{\bar{M}}_{w}, {\bar{H}}_{w},

and

{\bar{g}}_{w}

are the estimates of

M_{w}, H_{w},

and

g_{w}

. The control equation can be written as

a = {\bar{M}}_{w}^{- 1} τ - {\bar{H}}_{w} ζ - \bar{g} = \bar{f} (τ, ζ, q, η_{2}) .

(25)

Similarly, the origin dynamic system can be denoted as

\dot{ζ} = f (τ, ζ, q, η_{2})

with

Δ (τ, ζ, q, η_{2}) = f (τ, ζ, q, η_{2}) - \bar{f} (τ, ζ, q, η_{2})

as the modeling error. Then, we obtain

\dot{ζ} = a + Δ (τ, ζ, q, η_{2}) .

(26)

A one-order inertial system

a_{r m} = K_{r m} (ζ_{c m d} - ζ_{r m})

(

K_{r m}

is a positive diagonal matrix) is designed as the reference model (having the initial conditions as the origin system) to track the command velocity. Then, the tracking error of the reference velocity

ζ_{r m}

is defined as follows.

e = [\begin{matrix} \int_{0}^{t} (ζ_{r m} - ζ) d_{τ} \\ ζ_{r m} - ζ \end{matrix}] .

(27)

By defining the virtual control as

a = a_{r m} + a_{l c} + a_{n n}

the error system is formulated as

\begin{array}{l} \dot{e} = [\begin{matrix} ζ_{r m} - ζ \\ a_{r m} - \dot{ζ} \end{matrix}] = [\begin{matrix} 0 & I \\ - K i & - K p \end{matrix}] e + [\begin{matrix} 0 \\ I \end{matrix}] (a_{n n} - Δ (τ, ζ, q, η_{2})) \\ = Λ e + B (a_{n n} - Δ (τ, ζ, q, η_{2})) \end{array},

(28)

where

a_{l c}

is a PI controller with

K p

and

K i

as the control parameters and

a_{n n}

is output of the neural network to be designed later.

The RBF neural network

a_{n n} = {\hat{W}}^{T} h (x)

is used to compensate the model uncertainties for its arbitrary approximation ability with

x = {[τ, ζ, q, η_{2}]}^{T}

\hat{W}

and

h (x)

are the estimated weighting matrix and Gauss function with the adaptive law as

\dot{\hat{W}} = - κ e^{T} P B h (x) .

(29)

3.3. Stability Analysis

It is assumed that an ideal weighting matrix

W^{*}

exists so that the system uncertainties can be approximated as

Δ = W^{* T} h (x) - ε,

(30)

where

ε

is the approximation error. The ideal network can be represented by

W^{*}

and

\tilde{W} = \hat{W} - W^{*}

Δ = (\hat{W} - \tilde{W})^{T} h (x) - ε = a_{n n} - {\tilde{W}}^{T} h (x) - ε .

(31)

Substituting (31) into (28), we obtain

\dot{e} = Λ e + B ({\tilde{W}}^{T} h (x) + ε) .

(32)

A Lyapunov candidate can be defined as

V = \frac{1}{2} e^{T} P e + \frac{1}{2 κ} {\tilde{W}}^{T} \tilde{W},

(33)

where

P > 0

is the solution of

Λ^{T} P + P Λ = - Q, Q > 0

V

can be derived as

\begin{array}{l} \dot{V} = \frac{1}{2} {\dot{e}}^{T} P e + \frac{1}{2} e^{T} P \dot{e} + \frac{1}{κ} {\tilde{W}}^{T} \dot{\hat{W}} \\ = \frac{1}{2} e^{T} (Λ^{T} P + P Λ) e + \frac{1}{2} {(B ({\tilde{W}}^{T} h (x) + ε))}^{T} P e + \frac{1}{2} e^{T} P B ({\tilde{W}}^{T} h (x) + ε) + \frac{1}{κ} {\tilde{W}}^{T} \dot{\hat{W}} \\ = - \frac{1}{2} e^{T} (Q) e + e^{T} P B ({\tilde{W}}^{T} h (x) + ε) + \frac{1}{κ} {\tilde{W}}^{T} \dot{\hat{W}} \\ = - \frac{1}{2} e^{T} (Q) e + e^{T} P B {\tilde{W}}^{T} h (x) + e^{T} P B ε + \frac{1}{κ} {\tilde{W}}^{T} \dot{\hat{W}} \\ = - \frac{1}{2} e^{T} (Q) e + e^{T} P B ε + {\tilde{W}}^{T} e^{T} P B h (x) + \frac{1}{κ} {\tilde{W}}^{T} \dot{\hat{W}} \\ = - \frac{1}{2} e^{T} (Q) e + e^{T} P B ε + {\tilde{W}}^{T} (e^{T} P B h (x) + \frac{1}{κ} \dot{\hat{W}}) \\ \leq - \frac{1}{2} λ_{\min} (Q) {‖ e ‖}^{2} + λ_{\max} (P) ‖ e ‖ ε \\ = - \frac{1}{2} ‖ e ‖ (λ_{\min} (Q) ‖ e ‖ - 2 λ_{\max} (P) ε) \end{array} .

(34)

It can be seen that when

‖ e ‖ \geq \frac{2 λ_{\max} (P) ε_{\max}}{λ_{\min} (Q)}

\dot{V} \leq 0

, where

| ε | \leq ε_{\max}

λ_{\max} (P)

and

λ_{\min} (Q)

are the maximum and minimum eigenvalues of

P

and

Q

\dot{V} = 0

if and only if

‖ e ‖ = \frac{2 λ_{\max} (P) ε_{\max}}{λ_{\min} (Q)}

, so

‖ e ‖ \to \frac{2 λ_{\max} (P) ε_{\max}}{λ_{\min} (Q)}

when

t \to \infty

, the convergence rate depends on

λ_{\min} (Q)

\tilde{W}

is bounded since

V

is bounded; however, its convergence cannot be guaranteed due to the adaptive mechanism.

4. Simulation Experiments

In this section, the 3D UVDMS simulation platform is developed using Creo 10.0 (designing the 3D model and calculating part dynamic parameters), Matlab R2023b (modeling and control), and Unity 2022 (visualization) to evaluate the performance of the proposed control strategy. The necessary dynamic model parameters, UUV geometry parameters (shown in Table 1), and DH parameters of the manipulator (shown in Table 2) are listed as follows.

\begin{array}{l} M_{R B} = d i a g {106, 106, 106, 9.5, 10.2, 12} \\ M_{A M} = d i a g {63, 32.2, 31.3, 5.6, 3.7, 3.4} \\ D (v) = d i a g {110 + 90 | v |, 90 + 90 | v |, 140 + 110 | v |, 20 + 8 | v |, 13 + 10 | v |, 17 + 12 | v |} \end{array}

4.1. Collision Avoidance

In this section, the MPC for collision avoidance is tested by tracking certain trajectories. The initial conditions of the vehicle and joint angles are

{[2, 0, 3, 0, 0, 0]}^{T}

and

{[10^{\circ}, 50^{\circ}, - 15^{\circ}, 50^{\circ}, 15^{\circ}, - 10^{\circ}, 20^{\circ}, 60^{\circ}, - 20^{\circ}, 55^{\circ}, 20^{\circ}, - 25^{\circ}]}^{T}

. The first case is to track two circles by the end effectors with centers of

{[2.4, - 0.25, 3.08]}^{T}

and

{[2.4, 0.25, 3.08]}^{T}

and radius of 0.18 m. Circle centers and radius of the second case are

{[2.5, - 0.2, 3.1]}^{T}

{[2.5, 0.2, 3.1]}^{T}

, and 0.14 m. Figure 6 shows the screenshots of the moments that collisions occur during the trajectory tracking, with Case 1 in the upper left image and Case 2 in the lower left one. It can be seen that the 3rd and 5th links of the right manipulator have touched the right frame and the 3rd link of the left manipulator, respectively. The same moments with collision avoidance control in the right images show better performances in the same areas. It is shown in Figure 7 and Figure 8 that the proposed control can track the desired trajectories successfully under the influence of collision avoidance operation, although there is a slight decrease in performance compared to the MPC without collision avoidance constraints. The minimum distances for link 3 and link 5 of the right manipulator in Figure 9 are taken for further study while other links are ignored since their distances to obstacles are mostly safe all the time. In both cases, thresholds of the collision zone and anti-collision zone are 0.05 m (the link radius is considered) and 0.12 m. The comparison between the MPC and CAMPC indicates that the proposed constraints prevent the minimum distance curves from passing through the collision threshold so that the UVDMS succeeds in avoiding frame and mutual collisions.

4.2. Object Transport

In this section, a task in which the UVDMS transports a cylinder object (after being grasped) using the proposed control strategy is simulated. Figure 10 shows the UVDMS movement from the start point

{[2, 1, 30, 0, 0, 0]}^{T}

to end point

{[3, 0.5, 28, 0, 0, 90^{\circ}]}^{T}

following a reference trajectory, which is generated by the polynomial trajectory module in Matlab R2023b. The initial joint configuration is

{[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]}^{T}

, which means the vehicle position is also fixed. The length and radius of the cylinder are 0.6 m and 0.05 m with a uniformly distributed mass and a density of 1.1 g/cm³. The green, purple, and red lines represent the reference trajectory, object trajectory, and vehicle trajectories, respectively. It can be seen that the proposed control method shows a good performance in tracking certain trajectories.

States of positions are shown in Figure 11 and Figure 12. The poses and Euler angles in Figure 11 record both trajectories (traveling from the start point to the endpoint through several waypoints and being stable finally) of the object and the reference. In this case, the pitch and roll angles of the vehicle are controlled to zero. The pose of the vehicle is in Figure 12 and Figure 13 provides the joint angles of the manipulators. It should be noted that both manipulators have the same joint angles because their end effectors are fixed with the objective, which reduces the degrees of freedom.

Velocities in Figure 14 and Figure 15a are all within the system limits and stable at zero finally. Similarly, to the joint angles, the joint velocities of both manipulators are the same due to reduced degrees of freedom. Figure 15b and Figure 16a provide input torques for the vehicle and manipulators. It can be seen that it takes more energy to obtain equilibrium in roll and pitch control. Moreover, as long as the manipulators’ configurations are not stable, the actuators continue to work. Figure 16b shows the signals to compensate for the model uncertainties, which are generated by the RBF neural networks with 80 hidden nodes.

5. Conclusions

A model predictive control for collision avoidance and grasped object transport of UVDMSs is developed in this paper. Collisions caused by the outer frames and the dual manipulators are considered distance velocity constraints, where a minimum link distances algorithm is proposed to calculate the distance to the obstacle of each link. The kinematic tracking based on MPC generates command velocity for the dynamic control, which is built using the model reference dynamic inversion structure. Uncertainties of the UVDMS-object model are compensated by the neural network for better performance. The stability of the velocity tracking control is analyzed by the Lyapunov theory and the error is ultimately bounded. In addition, simulations of an 18-dof UVDMS in different scenes show good performance of the control strategy for avoiding collisions and object transport.

The obstacles considered in this work are vehicle frames and mutual manipulator links with few perceptions of the environment. Outer obstacles, especially the non-static ones, are another challenge for UVDMSs. In addition, the proposed control scheme deals with objects that are fixed with the end effectors which reduces the degrees of freedom and ability of collaboration. Therefore, outer obstacle avoidance and cooperative control will be the focus of our future work.

Author Contributions

Conceptualization, Y.W. and J.G.; methodology, Y.W.; software, Y.W.; investigation, Y.W.; resources, J.G; writing—original draft preparation, Y.W.; writing—review and editing, Y.W. and J.G.; visualization, Y.W.; supervision, J.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China, grant numbers 51979228 and 52102469.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflicts of interest.

References

Ridao, P.; Carreras, M.; Ribas, D.; Sanz, P.J.; Oliver, G. Intervention AUVs: The next challenge. Annu. Rev. Control 2015, 40, 227–241. [Google Scholar] [CrossRef]
Youakim Isaac, D.N.; Ridao Rodríguez, P.; Palomeras Rovira, N.; Spadafora, F.; Ribas Romagós, D.; Muzzupappa, M. MoveIt!: Autonomous Underwater Free-Floating Manipulation. IEEE Robot. Autom. Mag. 2017, 24, 41–51. [Google Scholar] [CrossRef]
Marani, G.; Choi, S.K.; Yuh, J. Underwater autonomous manipulation for intervention missions AUVs. Ocean. Eng. 2009, 36, 15–23. [Google Scholar] [CrossRef]
Thi, H.L.; Nguyen, T.L. A Lyapunov-based model predictive control strategy with a disturbances compensation mechanism for dual-arm manipulators. Eur. J. Control. 2024, 75, 100913. [Google Scholar]
Bai, W.; Wang, Z.; Cao, Q.; Yokoi, H.; Fujie, M.G.; Yeatman, E.M.; Yang, G.-Z. Anthropomorphic dual-arm coordinated control for a single-port surgical robot based on dual-step optimization. IEEE Trans. Med. Robot. Bionics 2022, 4, 72–84. [Google Scholar] [CrossRef]
Kong, F.; Zambella, G.; Monteleone, S.; Grioli, G.; Catalano, M.G.; Bicchi, A. A Suspended Aerial Manipulation Avatar for Physical Interaction in Unstructured Environments. IEEE Access 2024, 12, 48108–48125. [Google Scholar] [CrossRef]
Yuan, W.; Liu, Y.-H.; Su, C.-Y.; Zhao, F. Whole-body control of an autonomous mobile manipulator using model predictive control and adaptive fuzzy technique. IEEE Trans. Fuzzy Syst. 2022, 31, 799–809. [Google Scholar] [CrossRef]
Qin, Y.; Escande, A.; Kanehiro, F.; Yoshida, E. Dual-arm mobile manipulation planning of a long deformable object in industrial installation. IEEE Robot. Autom. Lett. 2023, 8, 3039–3046. [Google Scholar] [CrossRef]
Jiao, C.; Yu, L.; Su, X.; Wen, Y.; Dai, X. Adaptive hybrid impedance control for dual-arm cooperative manipulation with object uncertainties. Automatica 2022, 140, 110232. [Google Scholar] [CrossRef]
Laha, R.; Vorndamme, J.; Figueredo, L.F.; Qu, Z.; Swikir, A.; Jähne, C.; Haddadin, S. Coordinated motion generation and object placement: A reactive planning and landing approach. In Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic, 16 December 2021; pp. 9401–9407. [Google Scholar]
Laha, R.; Becker, M.; Vorndamme, J.; Vrabel, J.; Figueredo, L.F.; Müller, M.A.; Haddadin, S. Predictive Multi-Agent based Planning and Landing Controller for Reactive Dual-Arm Manipulation. IEEE Trans. Robot. 2023, 40, 864–885. [Google Scholar] [CrossRef]
Zhang, Z.; Zheng, L.; Chen, Z.; Kong, L.; Karimi, H.R. Mutual-collision-avoidance scheme synthesized by neural networks for dual redundant robot manipulators executing cooperative tasks. IEEE Trans. Neural Netw. Learn. Syst. 2020, 32, 1052–1066. [Google Scholar] [CrossRef]
Farivarnejad, H.; Moosavian, S.A.A. Multiple impedance control for object manipulation by a dual arm underwater vehicle–manipulator system. Ocean. Eng. 2014, 89, 82–98. [Google Scholar] [CrossRef]
Simetti, E.; Casalino, G.; Torelli, S.; Sperindé, A.; Turetta, A. Underwater floating manipulation for robotic interventions. IFAC Proc. Vol. 2014, 47, 3358–3363. [Google Scholar] [CrossRef]
Simetti, E.; Casalino, G. Whole body control of a dual arm underwater vehicle manipulator system. Annu. Rev. Control 2015, 40, 191–200. [Google Scholar] [CrossRef]
Zhang, Z.; Yang, S.; Chen, S.; Luo, Y.; Yang, H.; Liu, Y. A vector-based constrained obstacle avoidance scheme for wheeled mobile redundant robot manipulator. IEEE Trans. Cogn. Dev. Syst. 2020, 13, 465–474. [Google Scholar] [CrossRef]
Luo, W.; Chen, J.; Ebel, H.; Eberhard, P. Time-optimal handover trajectory planning for aerial manipulators based on discrete mechanics and complementarity constraints. IEEE Trans. Robot. 2023, 39, 4332–4349. [Google Scholar] [CrossRef]
Zhao, T.; Deng, M.; Li, Z.; Hu, Y. Cooperative manipulation for a mobile dual-arm robot using sequences of dynamic movement primitives. IEEE Trans. Cogn. Dev. Syst. 2018, 12, 18–29. [Google Scholar] [CrossRef]
Heshmati-Alamdari, S.; Karras, G.C.; Kyriakopoulos, K.J. A predictive control approach for cooperative transportation by multiple underwater vehicle manipulator systems. IEEE Trans. Control. Syst. Technol. 2021, 30, 917–930. [Google Scholar] [CrossRef]
Gao, J.; Liang, X.; Chen, Y.; Zhang, L.; Jia, S. Hierarchical image-based visual serving of underwater vehicle manipulator systems based on model predictive control and active disturbance rejection control. Ocean. Eng. 2021, 229, 108814. [Google Scholar] [CrossRef]
Dai, Y.; Yu, S.; Yan, Y. An adaptive EKF-FMPC for the trajectory tracking of UVMS. IEEE J. Ocean. Eng. 2019, 45, 699–713. [Google Scholar] [CrossRef]
Dai, Y.; Yu, S.; Yan, Y.; Yu, X. An EKF-based fast tube MPC scheme for moving target tracking of a redundant underwater vehicle-manipulator system. IEEE/ASME Trans. Mechatron. 2019, 24, 2803–2814. [Google Scholar] [CrossRef]
Oliveira, É.L.; Orsino, R.M.; Donha, D.C. Disturbance-observer-based model predictive control of underwater vehicle manipulator systems. Ifac-Papersonline 2021, 54, 348–355. [Google Scholar] [CrossRef]
Xu, B.; Abe, S.; Sakagami, N.; Pandian, S.R. Robust nonlinear controller for underwater vehicle-manipulator systems. In Proceedings of the 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Monterey, CA, USA, 24–28 July 2005; pp. 711–716. [Google Scholar]
Wang, J.; Perkins, E.; Hung, J.Y. Trajectory tracking control for an underwater vehicle manipulator system using a neural-adaptive network. In Proceedings of the 2019 SoutheastCon, Huntsville, AL, USA, 11–14 April 2019; pp. 1–6. [Google Scholar]
Cai, M.; Wang, Y.; Wang, S.; Wang, R.; Tan, M. Autonomous manipulation of an underwater vehicle-manipulator system by a composite control scheme with disturbance estimation. IEEE Trans. Autom. Sci. Eng. 2023, 21, 1012–1022. [Google Scholar] [CrossRef]
Antonelli, G. Modelling of underwater robots. In Underwater Robots; Springer: Berlin/Heidelberg, Germany, 2018; pp. 33–110. [Google Scholar]
Fossen, T.I. Nonlinear Modelling and Control of Underwater Vehicles; Universitetet i Trondheim: Trondheim, Norway, 1991. [Google Scholar]
Zhang, Y.; Wang, J. Obstacle avoidance for kinematically redundant manipulators using a dual neural network. IEEE Trans. Syst. Man Cybern. Part B 2004, 34, 752–759. [Google Scholar] [CrossRef] [PubMed]

Figure 1. Coordinate frames and joint configuration of the UVDMS.

Figure 2. Definition of the minimum distances to avoid collisions.

Figure 3. Distance between two non-coplanar links.

Figure 4. Coordinates and forces of the object.

Figure 5. Model predictive collision avoidance tracking control scheme.

Figure 6. Moments of collisions and corresponding results improved by collision avoidance.

Figure 7. End-effector position of Case 1: (a) Positions of the left end effector; (b) Positions of the right end effector.

Figure 8. End-effector position of Case 2: (a) Positions of the left end effector; (b) Positions of the right end effector.

Figure 9. Comparison of the minimum distances of certain links: (a) The fluctuation of the minimum distance from link 5 of the right manipulator to the left manipulator; (b) The fluctuation of the minimum distance from link 3 of the right manipulator to corresponding frames.

Figure 10. Display of the object trajectory tracking in Unity.

Figure 11. Object pose: (a) Positions of the object; (b) Euler angles of the object.

Figure 12. UUV poses: (a) Positions of the vehicle; (b) Euler angles of the vehicle.

Figure 13. Joint angles: (a) Joints of the left manipulator; (b) Joint of the right manipulator.

Figure 14. Object and UUV velocities: (a) Velocity of the object; (b) Velocity of the vehicle.

Figure 15. Joint velocities and manipulators input: (a) Joint angular velocities of both manipulators; (b) Torques of the manipulators.

Figure 16. UUV torques input and compensation signals from the neural network: (a) Torques of the UUV; (b) NN compensation signals.

Table 1. Parameters of the UUV.

Variable	Value	Unit	Description
$L, W, H$	0.92, 0.62, 0.56	m	Length, width, height
$m$	106	kg	Weight
$B$	1058	N	Buoyancy
$r_{B}$	${[0, 0, 0.1]}^{T}$	m	Center of buoyancy
$r_{G}$	${[0, 0, - 0.1]}^{T}$	m	Center of gravity
$T_{B}^{r}$	${[0.2, 0.2, 0.1]}^{T}$	m	Transform to base-r
$T_{B}^{l}$	${[- 0.2, 0.2, 0.1]}^{T}$	m	Transform to base-l

Table 2. DH parameters of the underwater manipulator.

i	Alpha	d	$θ$	Length/Weight
0	90	0	0	0.116 m/2.8 kg
1	−90	0.193 m	q1	0.077 m/1.3 kg
2	90	0	q2	0.0805 m/1.2 kg
3	−90	0.2805 m	q3	0.2 m/1.6 kg
4	90	0	q4	0.0805 m/1.2 kg
5	−90	0.2805 m	q5	0.2 m/1.6 kg
6	90	0	q6	0.19/1.5 kg

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

Share and Cite

MDPI and ACS Style

Wang, Y.; Gao, J. Model Predictive Collision Avoidance Control for Object Transport of Unmanned Underwater Vehicle-Dual-Manipulator Systems. J. Mar. Sci. Eng. 2024, 12, 926. https://doi.org/10.3390/jmse12060926

AMA Style

Wang Y, Gao J. Model Predictive Collision Avoidance Control for Object Transport of Unmanned Underwater Vehicle-Dual-Manipulator Systems. Journal of Marine Science and Engineering. 2024; 12(6):926. https://doi.org/10.3390/jmse12060926

Chicago/Turabian Style

Wang, Yingxiang, and Jian Gao. 2024. "Model Predictive Collision Avoidance Control for Object Transport of Unmanned Underwater Vehicle-Dual-Manipulator Systems" Journal of Marine Science and Engineering 12, no. 6: 926. https://doi.org/10.3390/jmse12060926

APA Style

Wang, Y., & Gao, J. (2024). Model Predictive Collision Avoidance Control for Object Transport of Unmanned Underwater Vehicle-Dual-Manipulator Systems. Journal of Marine Science and Engineering, 12(6), 926. https://doi.org/10.3390/jmse12060926

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Menu

Model Predictive Collision Avoidance Control for Object Transport of Unmanned Underwater Vehicle-Dual-Manipulator Systems

Abstract

1. Introduction

2. Problem Formulation

2.1. UVDMS Model

2.2. Collision Avoidance

2.3. Object Transport Model

3. Object Tracking Control

3.1. Model Predictive Kinematic Tracking Control

3.2. Dynamic Inversion and Neural Network-Based Control

3.3. Stability Analysis

4. Simulation Experiments

4.1. Collision Avoidance

4.2. Object Transport

5. Conclusions

Author Contributions

Funding

Institutional Review Board Statement

Informed Consent Statement

Data Availability Statement

Conflicts of Interest

References

Share and Cite

Article Metrics

Article Access Statistics

Further Information

Guidelines

MDPI Initiatives

Follow MDPI