Background technology
And have man-machine compared with, unmanned plane has that volume is little, cost is low, maneuverability, easy to use and to plurality of advantages such as requirement for environmental conditions are lower.From being born from unmanned plane, its just constantly progress along with improving constantly of scientific and technological level, and be progressively widely used in the various fields such as military, civilian, police, performed task comprises: target reconnaissance, trace and monitor, target hit, injure assessment, rescue and relief work, personnel's search and rescue, terrain prospecting etc.The function of unmanned plane in daily life, value are shown up prominently; Effect in modernized war, status just progressively improve, and have become indispensable tactical weapon, and by means of the unique advantage of battlefield zero injures and deaths, its important air armament becoming future battlefield is unquestionable.Therefore in recent years, the growth momentum of domestic and international unmanned air vehicle technique is very swift and violent.
The location of maneuvering target and tracking are that unmanned plane scouts one of critical function followed the tracks of.Target localization is exactly by unmanned plane during flying parameter and load information, calculates the coordinate figure of impact point under earth coordinates; Target following is then according to locating information, is locked in all the time among unmanned plane load visual field by maneuvering target, and calculates the movable information of target by design con-trol strategy.The technology utilizing view data to carry out target identification reaches its maturity, and how to utilize the positioning result of target identification design servo control strategy carry out efficient target tracking be still domestic and international unmanned plane research focus and difficult point.
Due to small-sized limited with Small and micro-satellite load-carrying ability, in reconnaissance mission, general use carries out imaging reconnaissance without monopod video camera, video camera itself does not have tracking power, to realize target following function, need to utilize image information design con-trol algorithm, the position of control unmanned plane and attitude, by target lock-on heart region in the picture, realize location and the tracking of the maneuvering target of view-based access control model servo.
The inventive method can in military operation, and realize target is accurately located, the task such as surveillance and tracking and precision strike; In Multi computer cooperation, be conducive to collaborative finishing the work; In disaster relief, realize rapid rescue and treatment of the wounded etc.Therefore, the accurate locating and tracking of maneuvering target has important Research Significance and wide application prospect.
Summary of the invention
The present invention proposes a kind of Visual servoing control method in UAV Maneuver target locating, by carrying out Visual servoing control to unmanned plane, by target lock-on among camera field of view, reaching precision target location and tracking effect.
Concrete technical scheme of the present invention is as follows: the first step, determine the equipment states such as unmanned plane, GPS, Inertial Measurement Unit, video camera, determines camera intrinsic parameter and setting angle; Vector of unit length i on definition optical axis, obtains vector of unit length in the earth coordinates { expression under G} by coordinate system relation
gp
i, the optical axis asked by aircraft altitude and collinear image formation principle and ground intersection point A are in { the expression under G}
gp
a, and then try to achieve the expression of A under body axis system
bp
a;
Second step, according to scouting imaging select target point, by impact point t coordinate figure in the picture (
ix
t,
iy
t) and camera intrinsic parameter, obtain impact point at the camera coordinate system { coordinate figure under C}
cp
t, in conjunction with camera installation locations, angle, the current longitude of aircraft, latitude, height and attitude angle, obtain impact point at the earth coordinates { coordinate of G}
gp
t, then resolved by earth model and obtain impact point longitude and latitude, realize target is accurately located;
3rd step, in conjunction with target localization result last time, according to the flight information of the time interval, aircraft, obtain the motion state that target is current, and estimate maneuvering target subsequent time position
4th step, with picture centre
ip
afor maneuvering target desired locations in the picture
ip
tr, then target is at { the desired locations under G}
gp
trfor
gp
a, according to error delta
gp
t=
gp
tr-
gp
tequation obtains attitude angle set-point θ
t, φ
tand ψ
t;
5th step, by aircraft desired locations in flight track
with aircraft current location
gp
bOerror delta
gp
bO, obtain attitude angle set-point φ respectively according to horizontal side direction control law and Longitudinal Control Law
rand θ
r.In conjunction with attitude angle set-point in task weight and the 4th step, obtain the total specified rate of each attitude angle, with each relevant rudder face of this servocontrol unmanned plane, the maximized Visual servoing control of stability margin in realize target locating and tracking process.
Beneficial effect: the present invention only needs to use single fixed camera to target imaging, by controlling UAV position and orientation, realize following the tracks of the high precision consecutive tracking of maneuvering target, the method is without the need to following the tracks of The Cloud Terrace and Laser Distance Measuring Equipment, significantly reduce volume and the cost of load, improve the disguise of scouting.The method is generally applicable to the target localization and tracking system of unmanned plane, is especially loaded with the SUAV (small unmanned aerial vehicle) of fixed cameras and the UAS of The Cloud Terrace motion failures.The method has important practical significance and having broad application prospects to unmanned plane (with other similar topworkies) high precision target locating, opens up certain guiding function to new location method.
Embodiment
Below in conjunction with accompanying drawing, the UAV Maneuver target locating method embodiment of a kind of view-based access control model servo that the present invention proposes is described in detail.
1 unmanned aerial vehicle platform and coordinate system definition
For scouting UAS, unmanned aerial vehicle platform involved in the present invention comprises the parts such as aircraft subsystem, flight-control computer, pattern process computer, video camera, aircraft subsystem includes the equipment such as Inertial Measurement Unit and GPS, is used for measuring UAV Attitude and position.Main device connection diagram as shown in Figure 1.
In Positioning and Tracking of Maneuvering Target process, as shown in Figure 2, each coordinate system is defined as follows each coordinate system used:
{ G}: start to carry out the target locating moment with unmanned plane, the projection of center of gravity on ground is as overall changeless geodetic coordinates origin, and X-axis is parallel to warp, and Y-axis is parallel to parallel, and Z axis points to the earth's core perpendicular to XOY plane for earth coordinates.
Body axis system { B}: with unmanned plane center of gravity for initial point, be connected on unmanned plane, X-axis is parallel to design orientation of its axis head in unmanned plane symmetrical plane, and Y-axis is pointed on the right side of body perpendicular to unmanned plane symmetrical plane, and Z axis points to below fuselage perpendicular to X-axis in symmetrical plane.
{ C}: with video camera photocentre for initial point, X-axis and Y-axis are parallel to the vertical and horizontal straight line of image to camera coordinate system respectively, and Z axis is camera optical axis, vertical with the plane of delineation.Definition camera optical axis is with { the XOY plane angle of B} is angular altitude α, and optical axis is just on plane; Optical axis is with { the XOZ plane included angle of B} is azimuthal angle beta, and optical axis is just on the right side of plane.
{ I}: with image upper left angle point for initial point two-dimensional coordinate system, X-axis is parallel to the longitudinal pixel line in the image leftmost side to image coordinate system, and Y-axis is parallel to pixels across line, and coordinate figure x and y represents line number and the columns of pixel respectively.
{ GB}: with unmanned plane center of gravity for initial point, each axle of X, Y, Z is parallel to earth coordinates { G} in body the earth interim coordinate system.
In unmanned plane reconnaissance flight process, any time body axis system { relative to earth coordinates, { pose of G} represents B}, is uniquely determined by the longitude of aircraft, latitude, height and attitude angle.According to earth coordinates, { { longitude of B}, latitude and height, earth model can solve that { B} initial point is at { the coordinate under G} as shown in Figure 3 for G} and body axis system
gp
bO=(
gx
bO,
gy
bO,
gz
bO)
t, can obtain in conjunction with the pitching angle theta of body, crab angle ψ, roll angle φ that { B} is in { the expression under G}
{ B} is in { the expression under G}
Defined can be drawn by coordinate system, { B} is in { the expression under GB}
{ B} is in { the expression under GB}
for:
{ C} is relative to { pose of B} is by video camera fixed position for camera coordinate system
bp
cO=(
bx
cO,
by
cO,
bz
cO)
t, current angular altitude α and azimuthal angle beta determine, after setting angle is fixing, and C} the expression under B} immobilizes:
Image coordinate system and camera coordinate system relation are determined by camera intrinsic parameter, and camera intrinsic parameter comprises picture centre coordinate
ip
icent=(
ix
icent,
iy
icent, 1)
t, focal distance f, proportionality factors lambda etc.From perspective projection model, at camera coordinate system, { under C}, coordinate is expressed as picture centre pixel coordinate
cp
icent=(0,0, f)
t, then I} being expressed as under C}:
According to the relation between above-mentioned each coordinate system, under can obtaining a certain coordinate system easily, arbitrfary point represents at the coordinate of other coordinate systems.
2 maneuvering targets are accurately located
When unmanned plane flies to scouting region, open load video camera and start to scout, the intersection point on note optical axis and ground is A.According to the relation between each coordinate system mentioned above, vector of unit length i on definition camera light axis, then its at camera coordinate system, { homogeneous coordinates under C} are
cp
i=(0,0,1,1)
t, according to the pose of video camera by formula (5), the body axis system { expression under B} can be obtained
bp
i:
According to the pose of aircraft by formula (1), try to achieve the earth coordinates { expression under G}
gp
i:
According to perspective imaging principle and imaging triangular relationship, calculated by aircraft altitude and obtain optical axis and ground intersection point A at the { coordinate under G}
gp
a.Obtain according to formula (2) again
bp
a, use in subsequent calculations.(by earth model and the current longitude and latitude of aircraft, by
bp
aa point longitude and latitude can be obtained.The initial point of earth coordinates can be got a certain moment platform information according to the method and calculate, also desirable known point.)
After unmanned plane finds target, select interesting target point, by selected impact point t in the image coordinate system { homogeneous coordinates under I} according to reconnaissance mission
ip
t=(
ix
t,
iy
t, 1,1)
t, draw according to formula (6)
cp
t, then can obtain successively
bp
t,
gp
t:
By earth model and longitude and latitude relation, obtain the longitude and latitude high information of impact point t, realize target is accurately located.For maneuvering target, the method can according to twice positioning states estimating target motion information.Usual pattern process computer processing speed quickly, according to the time interval of twice target localization, the flight information of aircraft, obtains the motion state that target is current, and estimates maneuvering target subsequent time position
thus system hit rate is improved in maneuvering target hits.
Maneuvering target tracking under 3 unmanned plane Visual servoing control
In unmanned plane autonomous surveillance flight course, it is desirable to keep impact point in the center of image, to obtain maximum stability margin.For the scouting load having The Cloud Terrace, after providing unmanned plane reconnaissance route or trajectory planning, tracking and positioning can rely on the servocontrol lock onto target heart position in the picture of The Cloud Terrace.When load The Cloud Terrace motion failures or when there is no The Cloud Terrace, maximizing for realizing stability margin, can realize by controlling UAV Attitude, specific as follows:
According to the derivation of formula (7) and (8), convolution (3) and above required by
bp
a, can try to achieve respectively
gp
twith
gBp
tr=
gp
a, then error is Δ
gp
t=
gp
tr-
gp
t, system of equations obtains attitude angle set-point θ thus
t, φ
tand ψ
t;
By aircraft desired locations in flight track
with aircraft current location
gp
bOerror
roll angle set-point φ is obtained according to horizontal side direction control law
r
Angle of pitch set-point θ is obtained respectively according to Longitudinal Control Law
r
In conjunction with task weight λ
mdistribute the attitude angle set-point of target following and course line tracking, always exported
θ=λ
mθ
t+(1-λ
m)φ
r
φ=λ
mφ
t+(1-λ
m)φ
r(12)
ψ=ψ
t
The inner ring controlled in this, as flight is given, each relevant rudder face of servocontrol unmanned plane, the maximized Visual servoing control of stability margin in realize target locating and tracking process.