See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/238559146

Remote control of a standard ABB robot system in real time using the
Robot Application Protocol (RAP)

Article · January 2002

CITATIONS READS

12 1,254

3 authors, including:

Gunnar Bolmsjö
Linnaeus University
96 PUBLICATIONS   847 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Sweden Robot Hack 2016 View project

Robotics Laboratory View project

All content following this page was uploaded by Gunnar Bolmsjö on 22 January 2014.

The user has requested enhancement of the downloaded file.

 Remote control of a standard ABB robot system in real time
using the Robot Application Protocol (RAP)
Per Cederberg Magnus Olsson
Gunnar Bolmsjö
{pcederberg, molsson, gbolmsjo}@robotics.lu.se
Div. of Robotics, Lund University, P.O. Box 118, S-221 00 Lund, SWEDEN

ABSTRACT Robot Application Protocol allows a remote program

to control the robot in real-time (although with limited
Sensor equipped robots should benefit from using a bandwidth), i.e. to create motion on the fly by inter-
world model when process-dependent decisions such acting with the running RAPID program on the robot
as collision control have to be taken in real-time. The controller.
world model can quite easily be represented and up-
Important work in this area is presented in [1] where
dated in a CAR (Computer Aided Robotics) applica-
RAP is used to implement remote access to the robot
tion. A missing link, however, is the ability to remotely
controller, including programming and monitoring in a
control the robot motion during execution. This paper
Windows-centered environment. Application examples
shows that the Robot Application Protocol, RAP, which
using the proposed solution are also briefly presented.
provides an interface to standard ABB S4 robot con-
A different approach is presented in [2] where a Mat-
trollers, can be utilized to let a remote program control
lab toolbox has been created which interfaces RAP and
the robot in 10 Hz, i.e. to create motion on the fly in
demonstrates the setup with an ABB robot equipped
joint space by interacting with the running RAPID pro-
with a force/torque sensor.
gram on the robot controller. The results are currently
used in ongoing welding experiments focused on pro- This paper gives a brief overview of major RAP
cess control. functionality, limitations and applicability to situa-
tions where robot motion cannot be limited to pre-
Keywords: robotics, remote control, real-time, sensor,
programmed motions in a RAPID program. An oper-
simulation, CAR
ating system independent method to access a running
RAPID program is described. It differs somewhat from
1 INTRODUCTION the strategy used in [1, 2]. Especially sensor guided
robot systems should benefit from using RAP. We have
The current trend towards fast product changes along
previously shown how to guide an ABB robot which
with customization and optimized design using new
allowed remote control in real-time and in joint space
materials and manufacturing processes put greater de-
[3, 4, 5, 6, 7]. In the experiment, Envision, a sophis-
mand on manufacturing operations with respect to con-
ticated CAR application from Delmia, controlled an
trol performance and the resulting productivity and
ABB IRB2000 robot with an attached ServoRobot M-
quality. Considering the number of robots used in in-
Spot laser scanner. The system performed a straight
dustrial automation, the use of advanced sensors is still
fillet joint weld on a workpiece of which position and
small. One area where sensors are important is arc
orientation differed from the original nominal pose. In
welding where products based on new materials de-
ongoing research, similar experiments are planned, now
crease the overall dimension (plate thickness) and in-
utilizing an unmodified ABB IRB2400/16, RAP and the
crease the general need for keeping tight tolerances dur-
communication tools described in this paper. As a posi-
ing welding. The use of industrial robots in this context
tive side effect of the research, a “compiler tool”, based
generally requires an integrated approach where prod-
on RAP and developed during the evaluation process,
uct data defined within a CAD (Computer Aided De-
is described. The tool lets the user edit, compile and
sign) environment is taken as input and applied within
run RAPID programs from a remote workstation using
a CAR software that enables modeling, simulation and
emacs (a standard UNIX editor) and the developed error
programming of robot operations.
formating can easily be adjusted to work together with
The Robot Application Protocol, RAP, provided by other editors.
ABB is an interface to the S4 robot controllers. Four
major groups of services are covered: general manage-
2 MATERIALS AND METHODS
ment, variable access, file management and program
control. Despite a few cavities, including sparse doc- The experimental setup consists of a master that con-
umentation, the RPC (Remote Procedure Call) based trols a virtual and a real slave robot. The master cre-
 Proceedings of the 33rd ISR (International Symposium on Robotics) October 7-11, 2002

Master 2.1 RAPID language

application
Joint value creation
The program consists of a number of instructions which
describe the work of the robot in a Pascal like syn-
tax. There are specific instructions for the various com-
mands, such as to move the robot or to set an output, etc.
Router
application There are three types of routines: procedures, functions
and trap routines and three kinds of data: constants,
Joint value redirection
variables and persistents. Persistents are variables that
can be reached from the outside world. Other features
in the language are: routine parameters, arithmetic and
Virtual Slave Physical Slave logical expressions, automatic error handling, modular
IRB2400/16 IRB2400/16 programs and multitasking [8].
Simulation running The running RAPID program
in CAR application is controlled via RAP/RPC
2.2 Remote Procedure Call and External Data
Representation
Figure 1: Experimental setup. Joint values created by
the master are routed to either the physical or virtual Remote procedure calls are a high-level communication
slave. RAP/RPC-based messaging are utilized between paradigm that allows programmers to write client/server
router and the running RAPID program on the physical network applications using procedure calls that hide the
robot controller. The double directed arrow shows the details of the underlying network. The RPC model
handshaking process between the slave program and is similar to the local procedure call model where
the router. the caller places arguments to a procedure in a well-
specified location (such as a result register) and trans-
fers control to the procedure. When the caller eventu-
Router Application ABB S4 Controller ally regains control, it extracts the results of the pro-
cedure from the location and continues execution [9].
RPC uses XDR to establish uniform representations for
Robot Application Protocol Robot Application Protocol
(client implementation) (server implementation) data types in order to transfer message data between
machines [10]. Sun’s RPC and XDR are freely avail-
Remote Procedure Call Remote Procedure Call
able on numerous platforms.
2.3 Robot Application Protocol (RAP)
Network (Ethernet)
The Robot Application Protocol provides a set of ser-
vices that makes it possible to monitor and control the
Figure 2: The different levels of APIs when the router robot from an external computer. These are grouped
is invoked by the master application. RAP uses TCP/IP into four classes: general management, variable access,
as transport protocol. file management and program control services. The
general management services are support services for
all other services, e.g. open and close a connection to
a specified server and restart of the controller. RAP is
ates joint values by interpolating between pre-defined using named variable objects to get information from
tag-points. Two different master applications have been the robot-system or affect the robot system, e.g. to read
tested, Envision, a CAR application from Delmia in and write RAPID defined and predefined system vari-
which three tag-points in a triangle defined the task, ables and event handling. An event in the system can
and a simple application that read pre-created joint val- be subscribed for and as a result of that subscription,
ues from a file, values that earlier was created by mov- a spontaneous message will asynchronously be sent to
ing along the triangle shaped path in the CAR applica- the external computer when the event occurs. RAP file
tion. These values are sent to the slave robot through a management provides the functionality to access files
router application. The router re-direct the joint values on the memory devices in the robot system, e.g. to open,
to either the physical or virtual robot. RAP/RPC-based read, write, close, rename and delete a file [11, 12, 13].
messaging are utilized between router and the running
RAPID program on the physical robot controller, see 2.4 High-level remote motion control
Figure 1.
Normally, a RAPID program needs no invocation from
The router is based on RAP which uses Sun’s RPC the outside world after execution has been initiated. It
and the External Data Representation (XDR) protocol is only possible to send data with RAP (as oppose to in-
to transfer requests and replies to/from the remote robot structions; a limitation that has been circumvented in
controller where the RAPID language is executed. The [1] by introducing a switch statement in the RAPID
different communication levels are shown in Figure 2 program where each selector defines a predefined and
and are explained below.
 Proceedings of the 33rd ISR (International Symposium on Robotics) October 7-11, 2002

possibly complex service). A special RAPID program asynchronous, there is need for a mechanism to be cer-
with a designated sequence of move instructions has to tain that a particular variable holds the data previously
be down-loaded to the controller. The RAPID program written to it. This handshaking problem has been re-
needs to be carefully designed to be able to let a remote solved by using busy wait (a polling method) in the
application control the robot’s motion in a master-slave RAPID code as well as in the router. The pnum vari-
fashion. The relevant part of the program consists of a able in the running RAPID program is continuously
loop where a set of move instructions continuously are monitored and when it eventually becomes updated in
executed as shown below. the RAPID program, the next robtarget structure update
is sent from the router to the robot controller.
!RAPID program executing on
!robot controller /* Router pseudo code to handle */
... /* routing of data and handshaking */
PERS num pnum := -1; /* between master and slave */
PERS num p0set := 0;
... static int pnum = -1;
PERS robtarget p0:=[...];
... int pnumChanged()
WHILE NOT aborted DO {
WaitUntil p1set <> 0; RAPVAR_DATA_TYPE data;
p1set := 0;
pnum := 0; readRAPIDVar("pnum", data);
MoveL p0, v, z, tool0; if (data.RAPVAR_DATA_TYPE_u.num != pNum) {
pNum = data.RAPVAR_DATA_TYPE_u.num;
WaitUntil p2set <> 0; return 1;
p2set := 0; }
pnum := 1; return 0;
MoveL p1, v, z, tool0; }

WaitUntil p3set <> 0; void routeRobTarget(ROBTARGET robTarget)

p3set := 0; {
pnum := 2; /* set two pnum’s ahead, i.e. */
MoveL p2, v, z, tool0; /* if pnum = 0, set p2set = 1 */
/* in RAPID program */
WaitUntil p0set <> 0; int pXset = (pnum + 2) MODULUS 4;
p0set := 0; writeRobTarget(robTarget, pXset);
pnum := 3; writepXset(pXset);
MoveL p3, v, z, tool0; }
ENDWHILE
...
void routeJoints()
{
The loop represents a circular buffer of n robtarget ROBTARGET robTarget;
JOINTVALUES joints;
structures p0 :::pn 1 which contains position, orienta-
do {
tion of tool center point (tcp) and configuration of robot if (pnumChanged()) {
and external axes. The variables are declared as per- joints = sendJointRequestToMaster();
sistent. During execution, these structures are dynami- robTarget = kinematicCalculation(joints);
cally set (with some latency) with joint values provided routeRobTarget(robTarget);
}
by the master. The router keeps track of which move
} while (!aborted);
instruction that is to be executed by the robot controller, }
i.e. which robtarget structure to update at a specific
time. void main()
The MoveL directive refers to a via movement and v and {
if (compileProgram() == SUCCESS) {
z denotes tcp speed and the zonedata structure respec-
connectMaster();
tively. Zonedata is used to specify how a position is to /* initialize first two robtargets */
be terminated, i.e. how close to the programmed posi- initializeRobTargets();
tion the axes must be before moving towards the next startRAPIDExecution();
position. For instance, at some point of time during the routeJoints();
move from p1 to p2, both p2 and p3 must be known to }
else
the robot control system. To be able to prepare for the displayErrors();
next movement a fourth point is needed. }
Even though a RAP call returns synchronously, there
is no guarantee that the robtarget structure in RAPID To avoid having the speed of the master exceeding the
is updated when writeRobTarget() returns. Since RAP speed of the slave, the master only sends joint values
calls that write data to RAPID variables in practice are after receiving a request message from the router. If the
 Proceedings of the 33rd ISR (International Symposium on Robotics) October 7-11, 2002

master is unable to send values upon a request, the slave used to send both single and array variables from the
robot will come to a temporary stop until the master is RAPID program to the client. To receive the values, the
ready to resume delivery of joint values. client has to act as a RPC server, either as a thread or as
a separate application. However, since the instruction
2.5 The router as a RAP application example
itself is asynchronous, it is not suited for handshaking
Some of the strengths of RAP are shown in the support- purposes.
ing parts of the router. Besides handling the real-time RAPID executes in a low prioritized thread on the ABB
issues of routing values from master to slave, the router robot controller. Latencies measured as time between
provides a RAPID compile environment within emacs, data request and response varies dependent of the task
a well known LISP based editor. By issuing a compile the robot currently handles. Latencies has not been
command in emacs, the RAPID program will get syntax specifically measured in this paper but [1] reports 15
checked and any errors will be shown with row, column to 20 ms on average.
and error message in a second window. By clicking on It is for some reason not possible to send jointtarget
the error, the cursor will mark the offending line in the structure values directly using RAP even though the
RAPID program, see Figure 3. structure is defined in the RAPID language. As a work
Behind the scene, the actual compilation is performed around, a kinematic model of the robot and some simple
remotely on the robot system. By using RAP, the calculations to represent the rotation with quarternions,
RAPID program is sent to the robot controller and is easily create a robtarget structure from joint values. A
loaded and checked. The errors are saved in a log file second method could be to define a jointtarget structure
on the robot controller and are transferred back to the in RAPID where the different joint values are simple
router and displayed to the user in an user-friendly fash- floating point variables, and make a RAP call for each
ion. If the RAPID program passes the syntax check, the of the individual variables. A third method might be
user may choose to automatically run it. to define an array of floats in RAPID and use the array
indices as the joint values in the jointtarget structure.
2.6 Using a virtual slave robot
This would be advantageous to the second method in
When a virtual robot is used as slave it is modeled in a that only one RAP call would be needed to send all six
CAR session and the same API (Application Program- array values. In this paper the first method has been
ming Interface) as for the physical slave is used. To used in order to minimize the number of RAP calls and
mimic the speed deficiencies caused by RAP-RAPID to add as little overhead as possible to the RAP server
interaction in the real system, latencies and speed limits and to the RAPID interpreter.
can be specified. Because of the precise timing needed in the handshak-
ing process, the choice of master becomes important.
3 RESULTS The master has to be able to provide new joint values
when asked for by the router. Since a CAR applica-
It is possible to control a standard robot system on-line tion normally defines simulated time, it has turned out
from a remote workstation using RAP, RPC and a care- to be difficult to correlate simulated time with “real”
fully designed rapid program and handshaking routines. time provided by the robot controller. As a result, the
A transfer limit of approximately 10 Hz has been mea- physical robot’s lag behind the virtual increased during
sured using a local Ethernet-based network. An envi- motion. The problem was eliminated using the simple
ronment for remote editing and compilation of RAPID master which provided joint values timely. Needless to
programs is provided as an example of benefits of RAP say, the difference between the router and the master is
utilization. purely conceptual; they could of course be built as one
application.
4 DISCUSSION Even if motion has been in focus in this paper, RAP of-
fers a wide range of other services such as reading and
RAP is an add-on to the robot control system that has writing of several variables using only one RAP call,
been designed for monitoring purposes more than heavy advanced file management services and device access.
interaction with the RAPID program. As mentioned be- Some services are missing, however. As mentioned be-
fore, when a robtarget structure is sent from the router fore, the RAPID variables of jointtarget structure type
to affect a variable in the RAPID program, the RAP cannot be read or written without a workaround. Also
call responds (with no error) at some time before the mentioned, the asynchronous RAPID function SCWrite
variable in the RAPID program is updated and useful cannot be used for effective handshaking purposes. Fur-
in a move instruction. In practice, neither RAP nor thermore, [12] states that the function might fail if the
RAPID give any choice but to use busy wait (a polling SCWrite messages comes “so close that they cannot be
method) to synchronize the router and the RAPID pro- sent to the external computer”, a characteristic that does
gram. Based on these prerequisites, a transfer limit of not relate well with performance. A more reliable write
approximately 10 Hz has been measured using our lo- function would be helpful. A third desirable function
cal network. The SCWrite RAPID instruction can be would be an atomic test and set. Then the two lines
 Proceedings of the 33rd ISR (International Symposium on Robotics) October 7-11, 2002

Figure 3: The router provides an emacs compile environment which allows the user to remotely edit and execute RAPID
programs (the program in the figure is just provided as an example, please disregard from details). After an unsuccessful
compile, the error is shown in a second window. By clicking on the error, the cursor will mark the offending line in the
RAPID program.
 Proceedings of the 33rd ISR (International Symposium on Robotics) October 7-11, 2002

... Robotics, Department of Mechanical Engineering,

WaitUntil p1set <> 0; Lund University, 2002.
p1set := 0;
... [5] K. Nilsson, Industrial Robot Programming. Lund,
Sweden: Dept. of Automatic Control, Lund Uni-
could be exchanged to one safe function where a single versity, 1996. Ph.D. Thesis.
RAPID operation reads, tests and writes a variable.
In the ongoing experiments with a sensor guided robot, [6] “QuickTime movie of virtual system, see our
a master has been developed which includes parts of the website http://www.robotics.lu.se,” Division of
virtual model needed for motion. This simplified nom- Robotics, Lund University, 2001.
inal world model is exported from the CAR application
[7] “The thinking machine, part 3 (video record-
before execution. During execution, other applications
ing),” in Autonomous Industrial Robotics.
may subscribe to dynamic changes to the virtual model
Demonstration performed by Magnus Olsson.
caused by sensor information. A subscribing CAR ap-
Also published and narrated in English on
plication should for instance be able to use its sophis-
http://www.robotics.lu.se, NUTEK, 1999.
ticated world model to monitor changes, perform colli-
sion checks and propose error recovery strategies. [8] “ABB Rapid Reference Version 3.2, RAPID Sum-
mary,” ABB Flexible Automation.
5 CONCLUSIONS
[9] “IRIX Network Programming Guide,” SGI.
By using the RAP based router and a carefully de-
[10] “AIX Version 4.3 Communications Programming
signed RAPID program, it has been proven possible to,
Concepts,” IBM, 1997.
in real-time and from a remote computer, control mo-
tion in a standard robot system. The update rate of the [11] “ABB RAP Protocol Specification 1.05,” ABB
RAPID program via RAP has been measured to 10 Hz. Flexible Automation.
The solution should be of value in situations when it
is desired to control the robot without having to rely [12] “ABB RAP Service Specification 1.05,” ABB
on pre-programmed motion or actions such as for in- Flexible Automation.
stance when non-trivial sensors are used. RAP has also
[13] “ABB Ethernet Services 3.0,” ABB Flexible Au-
proved to allow remote editing, compilation and load-
tomation.
ing of robot programs.

ACKNOWLEDGMENTS

The authors would like express our gratitude to our col-

leagues Mr. Mathias Haage and Dr. Klas Nilsson, De-
partment of Computer Science, Dr. Anders Robertsson,
Department of Automatic Control, all at Lund Univer-
sity and to Dr. Torgny Brogårdh and Mr. Valter Maco-
vac at ABB Robotics, Västerås, Sweden.

REFERENCES

[1] J. N. Pires and J. M. G. S. da Costa, “Object-

oriented and distributed approach for program-
ming robotic manufacturing cells,” IFAC Journal
Robotics and Computer Integrated Manufactur-
ing, no. 16, pp. 29–42, 2000.
[2] J. N. Pires, “Interfacing robotic and automation
equipment with Matlab,” IEEE Automation and
Robotics Magazine, September 2000.
[3] P. Cederberg et al., “Virtual triangulation sensor
development, behavior simulation and CAR inte-
gration applied to robotic arc-welding,” Submitted
to Journal of Intelligent & Robotic Systems 2001.
Accepted, waiting for publication, 2001.
[4] M. Olsson, Simulation and execution of au-
tonomous robot systems. PhD thesis, Division of

View publication stats