Aerial Manipulation Using A Quadrotor With A Two DOF Robotic Arm
Aerial Manipulation Using A Quadrotor With A Two DOF Robotic Arm
q = [pT ΦT η T ]T (1) d ∂L ∂L
− = τ + τext (16)
dt ∂ q̇ ∂q
The time derivative of p represents the translational ve-
locity of the center of mass of the quadrotor, and the L=K−U (17)
translational velocity in the body-fixed frame is denoted as
where K and U are the total kinetic and potential energy of
ṗb . They are related by the rotation matrix Rt ∈ SO(3) as
the combined system and τ represents the generalized force.
ṗ = Rt ṗb (2) τext indicates external disturbance applied to the system.
4991
The total kinetic energy is the sum of the kinetic energy Generalized torque related to the joint variable η can
of individual components, which are the quadrotor and two be actuated directly through joint actuators, such as servo
links. The total kinetic energy K and its components are as motors. However, the generalized torque corresponding to p
follows: and Φ need to be transformed to be usable as the quadrotor
2
X input. The actual quadrotor inputs are given in the PWM
K = Kb + Ki (18) signals to motors, and those signals are mixed to generate
i=1 thrust or torques. But for the description in this paper, we
1 T 1 can treat the input to the quadrotor as the following four
Kb = ṗ mb ṗ + Φ̇T T T Rt Ib RtT T Φ̇ (19)
2 2 values: F , the total thrust value of the four propellers of
1 T 1 the quadrotor, and τx , τy and τz , the torque values applied
Ki = ṗ mi ṗi + ωiT (Rt Ri )Ii (Rt Ri )T ωi (20)
2 i 2 to the quadrotor body coordinate in x, y and z direction,
where m is the mass and I is the inertia matrix. The respectively.
subscripts b and i indicate the corresponding values are with Later, in section II.C, an adaptive sliding mode controller
respect to Ob and Oi respectively. will be described to design the τ . Then the computed control
Likewise, the total potential energy is the sum of potential signal τ can be converted to the input values of the quadrotor
energy of each component. The total potential energy U and and joint actuators. Let τη ∈ R2×1 denote the joint torque
its components are described by the equations below: values of the manipulator, and the numbers in parenthesis
indicate the element in the corresponding matrix or vector.
2
X Then,
U = mb geT3 p + mi geT3 (p + Rt pbi ) (21)
i=1 F −1 τ (3)
where the first and last terms are the potential energies of τx R (3, 3) 0 0
t
the quadrotor and link i, respectively. e3 is the unit vector τy =
0 Q−1 0 ... (26)
[0 0 1]T and g is the gravity. τz 0 0 I2×2 τ (8)
By substituting equations (17),(18) and (21) in equation τη
(16), the dynamics equation which includes all components
as one system can be derived as the following The other two elements of τ , i.e. τ (1) and τ (2), are modu-
lated to the desired φd and θd of a quadrotor as
M (q)q̈ + C(q, q̇)q̇ + G(q) = τ + τext (22)
θd 1 cos ψ sin ψ τ (1)
where M (q) ∈ R8×8 is the inertia matrix which is positive = (27)
φd F sin ψ − cos ψ τ (2)
definite and symmetric. C(q, q̇) is the Coriolis matrix and
C(q, q̇)q̇ represents the Coriolis and centrifugal force terms. This relation is derived based on the small roll and pitch
In addition, G(q) includes gravity effects at each joint [1]. angle assumption.
The total kinetic energy can be calculated using the inertia
matrix M (q) as C. Adaptive Sliding Mode Controller
1
K = q̇ T M (q)q̇ (23) This subsection describes the control design of the com-
2
bined system (22). In this research, aerial manipulation
By substituting equations (12), (13), (14) and (15) into
includes motions involving both picking and releasing an
equation (23), the inertia matrix M (q) is computed as the
object during hovering flight. Position holding, one of the
following equation.
most important functions for accurate manipulation, can be
T T
M (q) = Mt,b mb Mt,b + Mr,b Rt Ib RtT Mr,b (24) significantly disturbed by a sudden quadrotor attitude change
2 due to the additional torque caused by grabbing or releasing
X
+ T
Mt,i T
mi Mt,i + Mr,i (Rt Ri )Ii (Rt Ri )Tt Mr,i an object. In other words, robustness of the controller is a
i=1 key issue for using the aerial vehicle to manipulate an object
as desired. Also, the controller should be able to handle
where Ri is the coordinate transformation matrix from link
problems such as battery drains, miscalculated mechanical
i of the manipulator to the quadrotor body-fixed coordinate.
properties, measurement bias or noise. To cope with these
The Coriolis matrix C(q, q̇) can be derived by calculating
uncertainties, the controller needs to be adaptive. In this
each element with the following relation [1].
paper, to control the combined system, an adaptive sliding
X8 mode controller is used.
1 ∂mkj ∂mki ∂mij
ckj = + − To design a controller for equation (22), the error e and
i=1
2 ∂qi ∂qj ∂qk
sliding surface s are defined as the following:
where mαβ indicates the element αβ of the inertia matrix
M (q). G(q) is calculated with the following partial derivative e = q − qd (28)
∂U s = ė − Λe (29)
G(q) = (25) q̇r = q̇ − s = q̇d − Λe (30)
∂q
4992
where λ is a positive diagonal matrix. With these definitions, The shape of each link is shown in fig. 3. The length of the
the proposed control law for τ is arm when it is fully stretched is 0.32 meter and the total
ˆ − As − Ksgn(s) weigh is about 0.370 kg. The ground station and robot arm
τ = M̂ q̈r + Ĉ q̇r + Ĝ + ∆ (31)
communicate via bluetooth. To grab a small object, a parallel
Here, M̂ , Ĉ and Ĝ represent the estimation of each matrix. gripper connected with an AX-12 servomotor is used [17].
A and K are positive gain matrices. Also, ∆ ˆ describes the Also, each servomotor has an encoder which measures joint
estimated uncertainty. By substituting the proposed control angles. Vicon [19], an indoor GPS system, is used to estimate
law to the dynamics equation (22), we can derive the
following relations:
M ṡ + Cs + As = ˆ − Ksgn(s) + τext (32)
−∆ + ∆
M ṡ + (C + A)s = ˜ − Ksgn(s) + τext
∆ (33)
where
∆ = −M̃ q̈r − C̃ q̇r − G̃ (34)
and ˜ indicates the estimation error of the corresponding
matrices and vectors. With these equations, stability analysis Fig. 3: Specification of each link of the robotic manipulator
can be performed as the following.
Proof. Let a Lyapunov candidate function be the position and attitude of the quadrotor. With this device,
1 1 ˜T ˜ the estimated position, attitude and their derivatives are
V = sT M s + ∆ ∆>0 (35) computed up to 100Hz. Measured quadrotor and joint states
2 2
with directional time derivative are used in the adaptive sliding mode controller. The desired
configuration qd is obtained by solving inverse kinematics
1 T ˜˙
˜T∆
V̇ = s Ṁ s + sT M ṡ + ∆ (36) with the known position of the object for grasping and
2 releasing.
= sT (−As + ∆ ˜ − Ksgn(s) + τext )
Overall hardware configuration is summarized in fig. 4.
+∆ ˜T∆ ˜˙ (37)
T T
= −s As − s (Ksgn(s) − τext )
+∆ ˜˙
˜ T (s + ∆) (38)
T T
= −s As − s (Ksgn(s) − τext ) (39)
< 0
In the derivation, skew symmetricity of Ṁ − 2C is used.
Negative definitiveness of equation (39) can be satisfied with
arbitrarily large matrices A and K.
˜˙ = 0. From this
In equation (38), it is assumed that s + ∆
relation, the following adaptation law can be derived.
ˆ˙ − ∆
∆ ˙ = −s (40) Fig. 4: Configuration of the overall system.
4993
where only a two or higher DOF robot arm can reach. After
5
completing the above missions, the quadrotor goes back to
φ (deg)
the place where it took off and lands.
0
IV. R ESULTS (1) (2)
−5
The proposed aerial manipulation using the adaptive slid- 0 10 20 30 40 50 60
ing mode controller is validated by an experiment. The time (sec)
results are summarized in figs. 5-9. 5
θ (deg)
0
1
−5
0 10 20 30 40 50 60
x (m)
0 time (sec)
(1) (2) 5
−1
ψ (deg)
0 10 20 30 40 50 60
time (sec) 0
0.2 −5
0 10 20 30 40 50 60
y (m)
0 time (sec)
−0.2
−0.4
0 10 20 30 40 50 60 Fig. 6: Attitude history of the quadrotor. Solid-green line is
time (sec)
the desired attitude and dashed-black line is the measured
0.8
attitude. (1): pick-up phase, (2): release phase
z (m)
0.6
0.4
0.2
0 10 20 30 40 50 60 0.25
time (sec) 0.2
xb (m)
0.1
quadrotor position and attitude, and manipulator’s position
0.2
follow the reference trajectory precisely during the pick-up
0.3
phase. Even though no information such as mass and moment −0.4 −0.2 0 0.2 0.4 0.6 0.8
of inertia about the wood block is given to the adaptive xb (m)
sliding mode controller, overall manipulation is successful
because of robustness of the sliding mode controller. During
Fig. 7: End effector position history in the quadrotor body
the pick-up phase, root-mean-square error of the quadrotor
fixed frame. The third figure is plotted for full flight duration.
position is only 2.08 cm. In fig. 8, a sequence of images
Solid-green line is the desired position and dashed-black line
taken in the pick-up task is shown.
is the measured positionm (1): pick-up phase, (2): release
The second mission is releasing the wood block inside
phase
a shelf. The size of the gap of shelf is about (H)16 ×
(W )22cm. To lay the wood block down inside the shelf,
most part of the second link with gripper needs to be put
into the shelf. Again, given the size of the second link with From the entire trajectory histories in figs. 5-7, it
respect to the size of the shelf, it is a difficult task that is shown that the quadrotor and robotic arm are con-
demands exact control of the combined system. As shown in trolled as desired during the full flight including ma-
fig. 9, the task is smoothly completed. In the release phase, nipulations of an object. These results also means that
root-mean-square error of the quadrotor is 2.56 cm. the provided approach can be utilized in expanded ma-
4994
(a) Quadrotor is approaching the (b) Robot arm is grabbing the (c) The wood block is picked up and
designated position wood block quadrotor moves to the next position
Fig. 8: Pictures taken during pick-up phase
(a) Quadrotor is approaching the (b) The robot arm is releasing the (c) Robot arm is retreating to go
designated position wood block at the desired spot back to the origin position
Fig. 9: Pictures taken during release phase
nipulation and transportation applications. A video clip [6] M. Bisgaard, A. la Cour-Harbo, and J. Bendtsen, ”Adaptive control
of the experiment is posted on the following URL: system for autonomous helicopter slung load operations,” Control
Engineering Practice, vol. 18, no. 7, pp. 800811, 2010.
http://icsl.snu.ac.kr/video/iros2013/aerialManipulation.mp4. [7] I. Palunko, R. Fierro, and P. Cruz, ”Trajectory generation for swing-
free maneuvers of a quadrotor with suspended payload: A dy-
V. C ONCLUSION namic programming approach,” in IEEE International Conference on
This paper presents a successful application of a quadrotor Robotics and Automation, pp. 2691-2697, May 2012.
[8] N. Michael, J. Fink and V. Kumar, ”Cooperative manipulation and
with a two-DOF robot arm attached for picking up and transportation with aerial robots,” Autonomous Robots, 30(1), pp. 73-
delivering an object. Kinematic and dynamic models for the 86, 2011.
combined system are analysed and an adaptive sliding mode [9] M. Bernard, K. Kondak, I. Maza, and A. Ollero, ”Autonomous
transportation and deployment with aerial robots for search and rescue
controller is designed to control them all together. This is missions,” Journal of Field Robotics, vol. 28, no. 6, pp. 914931, 2011.
demonstrated in an experiment with a scenario consisting [10] A. Torrem, D. Mengoli, R. Naldi, F. Forte, A. Macchelli, and L.
of picking up an object, moving, and releasing it inside of Marconi, ”A prototype of aerial manipulator,” IEEE/RSJ International
Conference on Intelligent Robots and Systems, Algarve, Portugal, pp.
a shelf. The experimental results demonstrates satisfactory 2653-2654, Oct 2012.
performance to perform the designed tasks. [11] A. Albers, S. Tautmann, T. Joward, T. A. Nguyen, M. Frietsch, and
C. Sauter, ”Semi-autonomous flying robot for physical interaction
ACKNOWLEDGMENT with environment,” IEEE conference on Robotics Automation and
Mechatronics, pp. 441-446, 2010.
This work was supported by the National Research Foun- [12] C. M. Korpela, T. W. Danko, and P. Y. Oh, ”MM-UAV:Mobile
dation of Korea(NRF) grant funded by the Korea govern- manipulating unmanned aerial vehicle,” Journal of Intelligent and
ment(MEST)(No. 20110001276, 2013013911). Robotic Systems, 1-9, 2012.
[13] V. Lippiello and F. Ruggiero, ”Cartesian impedance control of a UAV
R EFERENCES with a robotic arm,” in 10th International IFAC Symposium on Robot
Control, Dubrovnik, Croatia, Sep 2012.
[1] R. M. Murray, Z.Li, and S. S. Sastry, A Mathematical Introduction to [14] V. Lippiello and F. Ruggiero, ”Exploiting redundancy in Cartesian
Robotic Manipulation. Boca Raton, FL: CRC, 1994. impedance control of UAVs equipped with a robotic arm,” IEEE/RSJ
[2] Q. Lindsey, D. Mellinger, and V. Kumar, ”Construction of cubic International Conference on Intelligent Robots and Systems, Vilam-
structures with quadrotor teams,” in Proc. Robotics: Science and oura, Portugal, Oct 2012.
Systems (RSS), Los Angeles, CA, June 2011. [15] M. Orsag, C. Korpela, P. Oh, ”Modeling and control of MM-UAV:
[3] J. Willmann, F. Augugliaro, T. Cadalbert, R. DAndrea, F. Gramazio, Mobile manipulating unmanned aerial vehicle,” J Intell Robot System,
and M. Kohler, ”Aerial robotic construction towards a new field of pp. 227-240, 2013.
architectural research,” International Journal of Architectural Comput- [16] M. Orsag, ”Mobile manipulating unmanned aerial vehicle(MM-UAV):
ing, 10(3), pp. 439-460, Sep. 2012. Towards aerial manipulators,” System, 13, 14
[4] D. Mellinger, M. Shomin, N. Michael, and V. Kumar, ”Cooperative [17] Gripper, http://www.trossenrobotics.com/p/phantomx-parallel-ax12-
grasping and transport using multiple quadrotors,” Distributed Au- gripper.aspx
tonomous Robotic Systems, 2010, 545-558 [18] Bioloid Frame and Dynamixel, http://www.robotis.com/xe
[5] P. Pounds, D. Bersak, and A. Dollar Grasp from the air: hovering [19] VICON, http://www.vicon.com
capture and load stability, IEEE/RSJ International Conference on [20] Smart Xcopter, http://www.xcopter.com
Intelligent Robots and Systems 2011, San Francisco, CA Sep 2011.
4995