Sensors Used in Robot
Sensors Used in Robot
1
What is Sensing ?
• Collect information about the world
• Sensor - an electrical/mechanical/chemical
device that maps an environmental attribute to a
quantitative measurement
• Each sensor is based on a transduction
principle - conversion of energy from one form
to another
Transduction to electronics
• Thermistor: temperature-to-resistance
• Electrochemical: chemistry-to-voltage
• Photocurrent: light intensity-to-current
• Pyroelectric: thermal radiation-to-voltage
• Humidity: humidity-to-capacitance
• Length (LVDT: Linear variable differential
transformers) : position-to-inductance
• Microphone: sound pressure-to-<anything>
Human sensing and organs
• Vision: eyes (optics, light)
• Hearing: ears (acoustics, sound)
• Touch: skin (mechanics, heat)
• Odor: nose (vapor-phase chemistry)
• Taste: tongue (liquid-phase chemistry)
Counterpart?
Extended ranges and modalities
• Vision outside the RGB spectrum
– Infrared Camera, see at night
• Active vision
– Radar and optical (laser) range measurement
• Hearing outside the 20 Hz – 20 kHz range
– Ultrasonic range measurement
• Chemical analysis beyond taste and smell
• Radiation: a, b, g-rays, neutrons, etc
Electromagnetic Spectrum
Visible Spectrum
700 nm 400 nm
Sensors Used in Robot
Gas Sensor
Accelerometer Gyro
Metal Detector
Pendulum Resistive
Tilt Sensors Piezo Bend Sensor
Gieger-Muller
Radiation Sensor
Pyroelectric Detector
UV Detector
Resistive Bend Sensors
CDS Cell
Resistive Light Sensor
Digital Infrared Ranging
Pressure Switch
Miniature Polaroid Sensor
Limit Switch Touch Switch
Mechanical Tilt Sensors
IR Modulator
Lite-On IR Radio Shack Solar Cell
Receiver
Remote Receiver Remote Receiver
Compass Compass
Piezo Ultrasonic Transducers
Sensors used in robot
navigation
• Resistive sensors
– bend sensors, potentiometer, resistive photocells, ...
• Tactile sensors
– contact switch, bumpers…
• Infrared sensors
– Reflective, proximity, distance sensors…
• Ultrasonic Distance Sensor
• Inertial Sensors (measure the second derivatives of position)
– Accelerometer, Gyroscopes,
• Orientation Sensors
– Compass, Inclinometer
• Laser range sensors
• Vision
• Global Positioning System
Classification of Sensors
• Internal state (proprioception) v.s. external state
(exteroceptive)
– feedback of robot internal parameters, e.g. battery
level, wheel position, joint angle, etc,
– observation of environments, objects
• Active v.s. non-active
– emitting energy into the environment, e.g., radar,
sonar
– passively receive energy to make observation, e.g.,
camera
• Contact v.s. non-contact
• Visual v.s. non-visual
– vision-based sensing, image processing, video
camera
Robotic Sensor Classification
• In general, robotic sensors can be divided into two classes:
11
Sensor Selection/Sensing Taxonomy
• There are many different types of robot sensors available and
there are many different parameter measured by these sensors.
• The application process, should be carried out in a top down
manner, starting with task requirements, and going through
several levels of analysis, eventually leading to the selection of a
specific device.
• A taxonomy for sensing to aid this process consists of five levels of
refinement leading to sensor selection:
1. Specification of task requirements :eg localization, slippage detection,
size confirmation, inspection, defect testing.
2. Choice of modality :eg,vision, force, tactile
3. Specification on sensor attributes :eg,output, complexity, discrete or
continuous variable, imaging or non-imaging, local or global
4. Specification of operational parameters :eg size, accuracy, cost
5. Selection of mechanism :eg switching devices, inductive sensors, CCD
vision imaging
12
•Some tasks requirements features:
•Insertion Monitoring
•Assembly Verification
•Detection of Reject Parts
•Recognition of Part Types
•Assembly Test Operations
•Check Gripper/Tool Operation
•Location & Orientation of Parts
•Workspace Intrusion Detection
•Check Correct Manipulation of Parts
•Analysis of Spatial Relations Between Parts
13
Some typical sensor
operational data:
• Ultrasonics
• Resistive Effects Primary physical mechanisms
• Capacitive Efects employed in sensors:
• Piezo-Electric Effects
• Visible Light Imaging Cost
• Photo-Electric & Infrared Range
Accuracy
• Mechanical Switching
Repeatability
• Inductive Effects Power Requirements
• Thermal Effects Output Signal Specification
• Hall Effect Processing Reuirements
Sensitivity
Reliability
Weight
Seze
14
SENSORS FOR INDUSTRIAL
ROBOTS
Proximity and Range Sensors
Tactile Sensors
Vision Sensors
Miscellaneous Sensors
PROXIMITY AND RANGE
SENSORS
I
17
Resistive Sensors
Bend Sensors
• Resistance = 10k to 35k
• As the strip is bent, resistance increases
Resistive Bend Sensor
Potentiometers
• Can be used as position sensors for
sliding mechanisms or rotating shafts
• Easy to find, easy to mount
Potentiometer
Light Sensor (Photocell)
• Good for detecting direction/presence of
light
• Non-linear resistance
• Slow response to light changes Photocell
R is small when brightly
illuminated
Applications Sensor
Comparator:
If voltage at + is greater than
at -, digital high out
Infrared Sensors
• Intensity based infrared
– Reflective sensors
– Easy to implement
– susceptible to ambient light
• Modulated Infrared
– Proximity sensors
– Requires modulated IR signal
– Insensitive to ambient light
• Infrared Ranging
– Distance sensors
– Short range distance measurement
– Impervious to ambient light, color and reflectivity of object
Intensity Based Infrared
Break-Beam sensor
Reflective Sensor
Increase in ambient light
raises DC bias
voltage
• Easy to implement (few components) time
• Works very well in controlled environments voltage
time
IR Reflective Sensors
• Reflective Sensor:
– Emitter IR LED + detector photodiode/phototransistor
– Phototransistor: the more light reaching the phototransistor, the
more current passes through it
– A beam of light is reflected off a surface and into a detector
– Light usually in infrared spectrum, IR light is invisible
• Applications:
– Object detection,
– Line following, Wall tracking
– Optical encoder (Break-Beam sensor)
• Drawbacks:
– Susceptible to ambient lighting
• Provide sheath to insulate the device from outside lighting
– Susceptible to reflectivity of objects
– Susceptible to the distance between sensor and the object
Modulated Infrared
• Modulation and Demodulation
– Flashing a light source at a particular frequency
– Demodulator is tuned to the specific frequency of light flashes.
(32kHz~45kHz)
– Flashes of light can be detected even if they are very week
– Less susceptible to ambient lighting and reflectivity of objects
– Used in most IR remote control units, proximity sensors
Negative true
logic:
Detect = 0v
No detect = 5v
IR Proximity Sensors
amplifier bandpass filter integrator
limiter demodulator comparator
• Proximity Sensors:
– Requires a modulated IR LED, a detector module with built-in modulation
decoder
– Current through the IR LED should be limited: adding a series resistor in
LED driver circuit
– Detection range: varies with different objects (shiny white card vs. dull
black object)
– Insensitive to ambient light
• Applications:
– Rough distance measurement
– Obstacle avoidance
– Wall following, line following
IR Distance Sensors
• Basic principle of operation:
– IR emitter + focusing lens + position-sensitive detector
Modulated IR
light
D =v*t
D = round-trip distance
v = speed of propagation(340 m/s)
t = elapsed time
Bat, dolphin, …
Ultrasonic Sensors
http://www.acroname.com/robotics/info/articles/sonar/sonar.html
Operation with Polaroid Ultrasonic
• The Electronic board supplied has the following I/0
– INIT : trigger the sensor, ( 16 pulses are transmitted )
– BLANKING : goes high to avoid detection of own
signal
– ECHO : echo was detected.
– BINH : goes high to end the blanking (reduce blanking
time < 2.38 ms)
– BLNK : to be generated
t if multiple echo is required
Ultrasonic Sensors
• Applications:
– Distance Measurement
– Mapping: Rotating proximity scans (maps the
proximity of objects surrounding the robot)
Doorway
Robot
Length of Echo
chair chair
http://www.sick.de/de/products/categories/safety/
TACTILE SENSORS
• Tactile sensing includes any form of sensing which
requires physical touching between the sensor and
the object to be sense.
• The need for touch or tactile sensors occurs in many
robotic applications, from picking oranges to loading
machines. Probably the most important application
currently is the general problem of locating,
identifying, and organizing parts that need to be
assembled.
• Tactile sensor system includes the capability to detect such things as:
1. Presence
2. Part shape, location, orientation, contour examination
3. Contact are pressure and pressure distribution
4. Force magnitude, location, and direction
5. Surface inspection : texture monitoring, joint checking, damage detection
38
6. Object classification : recognition, discrimination
• The major components of a tactile/touch
sensor system are:
1. A touch surface
2. A transduction medium, which
convert local forces or moments
into electrical signals.
3. Structure
4. Control/interface
39
Resistive
• It is the transduction method in
tactile sensor design which has
received the most attention. It
is concerned with the change in
resistance of a conductive
material under applied
pressure.
40
• Advantages:
1. Wide dynamic range
2. Durability
3. Good overload tolerance
4. Compatibility with integrated
circuitry, particularly VLSI.
• Disadvantages:
1. Hysteresis in some designs.
2. Elastromer needs to be optimized
for both mechanical and electrical
properties.
3. Limited spatial resolution
compared with vision sensors.
4. Larger numbers of wires may have
to be brought away from the Resistive Tactile Element –
sensor.
Resistance Measured Across the rubber
5. Monotonic response but often not
linear.
41
Piezoelectric & Pyroelectric Effects
• Piezoelectric effect is the
generation of a voltage across a
sensing element when pressure
applied to it. The voltage generated
is proportionally related to the
applied pressure. No external
voltage is required, and a
continuous analogue output is
available from such sensor.
• A pyroelectric effect is the
generation of a voltage when the
sensing element is heated or
cooled.
• Polymeric materials with
piezoelectric and pyroelectric
properties are appropriate for use Piezoelectric/Pyroelectric
with sensors.
Effects Tactile element
42
• Advantages:
1. Wide dynamic range
2. Durability
3. Good mechanical properties of piezoelectric from pyroelectric materials
4. Temperature as well as force sensing capabilities
• Disadvantages:
1. Difficult of separating piezoelectric from pyroelectric effects
2. Inherently dynamic - output decay to zero for constant load
3. Difficult of scanning elements
4. Good solution are complex
43
CAPACITIVE TECHNIQUE
• Tactile sensors within this category are concerned with measuring
capacitance, which made to vary under applied load.
44
Capacitive Tactile Element
45
• Advantages:
1. Wide dynamic range
2. Linear response
3. Robust
• Disadvantages:
1. Susceptible to noise
2. Some dielectrics are temperature sensitive
3. Capacitance decreases with physical size ultimately limiting spatial
resolution.
46
Mechanical Transduction
• A Linear Potentiometer
• Advantages:
1. Well known Technology
2. Good for probe application
• Disadvantages:
1. Limited spatial resolution
2. Complex for array construction
Mechanical Transducer
A linear Potentiometer
47
Magnetic Transduction Methods
• Sensors using magnetic
transduction are divided into two
basic categories:
Groups together sensors which use
mechanical movement to
produce change in magnetic flux.
• Advantages:
1. Wide dynamic range
2. Large displacements possible
3. Simple
• Disadvantages:
1. Poor spatial resolution
2. Mechanical problems when Magnetic tactile Element
sensing on slopes.
48
2. Concerns magnetoelastic
materials which show a change
in magnetic field when
subjected to mechanical stress.
• Advantages:
1. Wide dynamic range
2. Linear response
3. Low hysteresis
4. Robust
• Disadvantages:
1. Susceptible to stray field and Magneto resistive tactile Element
noise.
2. A.C. circuit required
49
Optical Transduction Methods
• Advantages:
1. Very high resolution
2. Compatible with vision
sensing technology
3. No electrical interference
problems
4. Processing electronics can
be remote from sensor
5. Low cabling requirements
• Disadvantages: Optical Tactile Element
1. Dependence on elastomer Pressure to light Transduction
in some designs – affects
robustness
2. Some hysteresis
50
VISION SENSORS
• Vision is the most powerful robot sensory capabilities.
Enables a robot to have a sophisticated sensing mechanism
that allows it to respond to its environment in intelligent and
flexible manner. Therefore machine vision is the most
complex sensor type.
• Robot vision may be defined as the process of extracting,
characterizing, and interpreting information from images of
a three-dimensional world. This process, also known as
machine or computer vision may be subdivided into six
principle areas. These are:
1. Sensing : the process that yields visual image
2. Preprocessing : deals with techniques such as noise reduction and
enhancement of details
3. Segmentation : the process that partitions an image into objects of
interest
4. Description: deals with that computation of features for example size or
shape, suitable for differentiating one type of objects from another.
5. Recognition: the process that identifies these objects (for example
wrench, bolt, engine block, etc.)
6. Interpretation: assigns meaning to an ensemble of recognized objects.
52
IMAGING COMPONENTS
• The imaging component, the “eye” or sensor, is the first link in
the vision chain. Numerous sensors may be used to observe the
world. There are four type of vision sensors or imaging
components:
• 1. Point sensors
53
Noncontact feeler-point sensor
54
Image scanning using a point sensor
and oscillating deflecting mirrors
55
2. Line Sensor
• Line sensors are one-dimensional
devices used to collect vision
information from a real scene in the
real world.
• The sensor most frequently used is
a “line array” of photodiodes or
charger-couple-device components.
• It operates in a similar manner to
analog shift register, producing
sequential, synchronized output of
electrical signals, corresponding to
the light intensity falling on an
integrated light-collecting cell.
Circular and cross configurations
of light sensors
56
An automated robot sorting
system using
a line scan camera to generate
two-dimensional images.
• Line array may be used to image scene. E.g. by fixing the position of a straight-line
sensor and moving an object orthogonally to the orientation of the array, one may
scan the entire object of interest. 57
3. Planar Sensor
58
4. Volume Sensor
Schematic representation
of a triangulation range finder
59
IMAGE REPRESENTATION
60
Effects of reducing sampling grid size.
a) 512x512.
b) 256x256.
c) 128x128.
d) 64x64.
e) 32x32.
61
Effect produced by reducing the number of intensity levels while maintaining the
spatial resolution constant at 512x512. The 256-, 128- and 64-levels are of
acceptable quality.
a) 256, b) 128, c) 64, d) 32, e) 16, f) 8, g) 4, and h) 2 levels
62
ILLUMINATION TECHNIQUES
• Illumination of a scene is an important factor that often affects the
complexity of vision algorithms.
• A well designed lighting system illuminates a scene so that the complexity
of the resulting image is minimised, while the information required for
object detection and extraction is enhanced.
• Arbitrary lighting of the environment is often not acceptable because it
can result in low contras images, specular reflections, shadows and
extraneous details.
63
ILLUMINATION TECHNIQUES
1. DIFFUSE-LIGHTING
• This technique is for smooth, regular
surface object. It is used where surface
characteristic are important.
• Example:
Diffuse-lighting technique
64
ILLUMINATION TECHNIQUES
2. BACKLIGHTING
• Produce black and white image.
This technique suited for
applications in which silhouettes
of object are sufficient for
recognition or other
measurement.
• Example:
Backlighting technique
65
ILLUMINATION TECHNIQUES
3. STRUCTURED LIGHTING
66
(a) Top view of two light planes
intersecting in a line sight
3. STRUCTURED LIGHTING (cont.)
4. DIRECTIONAL LIGHTING
68
ROBOT VISION SYSTEM
• There are several commercial packages that can be bought for vision processing work.
A typical hardware configuration is shown below.
• Based on the technique used, the robotic vision systems can be grouped into the
following major types:
1. Binary vision systems 4.Structured light vision systems
2. Gray-level vision systems 5.Character recognition vision systems
3. Ad hoc special-purpose vision systems
69
• A typical system will have facilities for controlling the camera remotely and perhaps
interfaces for remote lighting control.
• The main problem with commercial vision packages is that they have to be general purpose
in order to be applicable in many situations. This very requirement sometimes means that
they are not suitable or are over complicated for a particular robot task in hand.
• In industrial robot world, vision is not used in an exploratory sense but is used to confirm or
measure or refine existing known data.
• Whichever commercial vision system one purchases, one is likely to use it for applications
such as those listed in the next section.
70
Vision Dev. Tools: Survey
• Commercial products • Free tools
– Matrox: MIL, Inspector – Intel: Open Source Computer
– Coreco Imaging: Sapera, Vision
MVTools, WiT – Microsoft: Vision SDK
– MVTec: Halcon – XMegaWave: XMegaWave
– Euresys: eVision, EasyAccess
– UTHSCSA: ImageTool
– AAI: Aphlion
73
MISCELLANEOUS SENSORS
POSITION, VELOCITY&
ACCELERATION SENSORS
74
Potentiometer
(a) Potentiometer
(b) (b) Schematic diagram of the potentiometer
75
Linear Variable Differential Transformer (LVDT)
76
Force & Torque Sensors
77
This figure illustrate a tension load cell.
It can be used to measure the force
required to pick up heavy load in industry
78
Force & Torque Sensors
79
Force & Torque Sensors
80
Motor Encoder
Incremental Optical Encoders
• Incremental Encoder:
light sensor
- direction
decode - resolution
light emitter circuitry
grating
B A leads B
Absolute Optical Encoders
• Used when loss of reference is not possible.
• Gray codes: only one bit changes at a time ( less uncertainty).
• The information is transferred in parallel form (many wires are
necessary).
001 001
010 011
011 010
100 110
101 111
110 101
111 100
Other Odometry Sensors
• Resolver
• Potentiometer
= varying resistance
Inertial Sensors
• Gyroscopes
– Measure the rate of rotation independent of the
coordinate frame
– Common applications:
• Heading sensors, Full Inertial Navigation systems (INS)
• Accelerometers
– Measure accelerations with respect to an inertial frame
– Common applications:
• Tilt sensor in static applications, Vibration Analysis, Full INS
Systems
Accelerometers
• They measure the inertia force generated
when a mass is affected by a change in
velocity.
• This force may change
– The tension of a string
– The deflection of a beam
– The vibrating frequency of a mass
Accelerometer
• Main elements of an accelerometer:
1. Mass 2. Suspension mechanism 3. Sensing element
2
d x dx
F m 2 c kx
d t dt
Space Segment
http://www.cnde.iastate.edu/staff/swormley/gps/gps.h
Global Positioning System (GPS)
24 satellites (+several spares)
Space Segment
http://www.cnde.iastate.edu/staff/swormley/gps/gps.h
Noise Issues