Proprioception

Tracking

Proprioception and Tracking systems

BYRON ALFONSO PÉREZ-GUTIÉRREZ

Virtual Reality Center

Universidad Militar Nueva Granada
[email protected]

February 2019

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Outline I

1 Proprioception

2 Tracking

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Proprioception

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

What is Proprioception?
Sherrington called proprioception to the ability to perceive the
position of limbs in space, and to detect the force of movements
and resistance that opposes them.

Sherrington CS. The integrative action of the nervous system, 1906. New
Haven, CTYale University Press.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Postures

http://www-sop.inria.fr/orion/personnel/Francois.Bremond/Img/posture-set.jpg

The sense of posture is that allows us, with eyes closed, to know
with great precision the position in which the fingers are in relation
to the palm of the hand, this relative to the arms or arms in
relation to the body.
Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems
 Proprioception
Tracking

Kinesthesia

The sense of movement or

kinesthetic enables the individual
to evaluate, without visual
control, the direction and speed
of the limb or trunk displacement.

Geoffrey M. Gluckman. Muscle Balance and

Function Development

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Sense of Force

http://piwee.net/1operation-marketing-cidre-machine-bras-de-fer180414/

The sense of force allows us to estimate the resistance that opposes

the movement of a part of the body.
Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems
 Proprioception
Tracking

Nervous system

The joints are innervated by different types of mechanoreceptor

fibers, which provide information to the CNS about the
displacements that occur in the various structures of the joint
during its movements.
Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems
 Proprioception
Tracking

Tracking

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Tracking systems

Tracking system
It allows to know the position and / or orientation of one or more
points in space related with a user in a virtual reality system.

N. Stefanov, A. Galata, R. Hubbold. A Real-time

Hand Tracker Using Variable-Length Markov
https://www.naturalpoint.com/trackir/trackir5/
Models of Behaviour. http://www.cs.man.ac.uk/
~agalata/V4HCI-handtracking.html

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Degrees of Freedom - DOF

Translations and rotations

Tx , Ty , Tz , Rx , Ry , Rz

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Tracker characteristics

Measurement rate – Readings/sec

Sensing latency
Sensor noise and drift
Measurement accuracy (errors)
Measurement repeatability
Tethered or wireless
Work envelope
Sensing degradation
Price

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Accuracy

Burdea. Virtual Reality Technology. wiley, 2003.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Noise

Burdea. Virtual Reality Technology. wiley, 2003.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Drift

Burdea. Virtual Reality Technology. wiley, 2003.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Latency

Burdea. Virtual Reality Technology. wiley, 2003.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Update rate

Burdea. Virtual Reality Technology. wiley, 2003.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Classification

Contact
Mechanical
No contact
Magnetic
Ultrasonic
Optical
Inertial
Hybrid

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Mechanical tracking

Characteristics
Serial or parallel kinematic structure with encoders.
Pros:
Low latency
Use sensors imbedded in exoskeletons to measure position
Have extremely low latencies
Are immune to interference from magnetic fields and large
metal objects
Cons:
But limit the user’s freedom of motion;
Can be heavy is worn on the body

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

HMD with mechanical tracking

Ivan Sutherland. The sword of Damocles. 1966.

https://www.youtube.com/watch?v=NtwZXGprxag
Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems
 Proprioception
Tracking

HMD with mechanical tracking

Puppetworks. Burlington, Ontario. Canada.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems
 Proprioception
Tracking

Digitizer with mechanical tracking

Microscribe G2. http://www.3d-microscribe.com/

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Haptic arm with mechanical tracking

Geomagic Touch (formerly Sensable Phantom Omni)

http://www.geomagic.com/en/products/phantom-omni/overview

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Exoskeleton with mechanical tracking

Wearable battery powered

exoskeleton with motors at the
hip and knee joints.
http://rewalk.com/rewalk-personal-3/

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Magnetic tracking

Characteristics
A magnetic tracker is a non-contact position measurement device
that uses a low-frequency magnetic field produced by a stationary
TRANSMITTER to determine the real-time position of a moving
RECEIVER element.
Fields are produced by a fixed source
Size of source grows with the tracker work envelope
The receiver is attached to the tracked object
Has three perpendicular antennas
Distance is inferred from the voltages induced in the antennas

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Magnetic tracking

Burdea. Virtual Reality Technology. wiley, 2003.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Magnetic tracking sensing degradation

Burdea. Virtual Reality Technology. wiley, 2003.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Flock of Birds used in medical simulation

UMNG. VR Center

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Razer hydra

https://www2.razerzone.com/es-es/gaming-controllers/razer-hydra-portal-2-bundle
Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems
 Proprioception
Tracking

Polhemus Magnetic tracking

http://polhemus.com/

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Ultrasound tracking

Characteristics
A non-contact position measurement device that uses an ultrasonic
low-frequency signal produced by a stationary transmitter to
determine the real-time position/orientation of a moving receiver.
Sound produced by a fixed triangular source (speakers)
Number of sources grows with the tracker work envelope
The receiver is triangular and attached to the tracked object
and has three microphones
Distance is inferred from the sound time of flight
Sensitive to air temperature and other noise sources
Requires “direct line of sight"
Slower than magnetic trackers (max 50 updates/sec).

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Ultrasound tracking

Burdea. Virtual Reality Technology. wiley, 2003.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems
 Proprioception
Tracking

Ultrasound tracking

http://www.logitech.com/

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Optical tracking

Characteristics
A non-contact position measurement device that uses optical
sensing to determine the real-time position/orientation of an object.
Can use several cameras in order to increase coverage
Infrared and solar light affect it measures
Requires “direct line of sight"

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Optical tracking

Burdea. Virtual Reality Technology. wiley, 2003.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

AR Tracking System

http://www.ar-tracking.com/typo3temp/pics/Application_BARCO_33c485f0bf.jpg

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

AR Tracking System

http://www.ar-tracking.com/products/interaction/flystick3/

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Microsoft Kinect

http://poweruser.pt/analises/microsoft-xbox-one-precos-caracteristicas-tecnicas-jogos/

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Microsoft Kinect

http://www.mcs.csueastbay.edu/~grewe/CS6825/Projects/Project3_CPS_SkeletonTracking.html

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Webcam hand recognition

Manresa, C., Varona, J., Mas, R., & Perales, F. J. (2005). Hand
tracking and gesture recognition for human-computer interaction.
ELCVIA Electronic Letters on Computer Vision and Image Analysis,
5(3), 96-104.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Mocap - Motion capture

Vicon Systems. IEEE VR Conference 2010.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

TrackIR 5

https://www.naturalpoint.com/trackir/trackir5/

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Inertial tracking

Characteristics
They use Newton’s laws of motion to determine the position and
orientation of an object. Consists of accelerometers to measure the
linear acceleration vectors with respect to the inertial reference
system and and gyroscopes to measure the rate of rotation
concerning changes of orientation.
No interference from metallic objects
No interference from magnetic fields
Large-volume tracking;
“Source-less” orientation tracking;

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Inertial tracking

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

MPU 9150

https://www.sparkfun.com/products/retired/11486

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Inertial tracking

http://www.intersense.com/pages/18/234

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Inertial tracking

Intersense. IEEE VR Conference 2010.

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems
 Proprioception
Tracking

Hybrid tracking

Characteristics
Combination of two or more tracking systems technologies.
Inertial - optical
Inertial - ultrasound

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Nintendo Wii remote control

http://wii.scenebeta.com/tutorial/uso-de-wii-sismo

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Wii remote control

Burdea. http://www.vrtechnology.org

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Inertial - ultrasound tracking

Burdea. http://www.vrtechnology.org

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems

 Proprioception
Tracking

Questions?

EALIDA
ER D
D

V
O

IR
CENTR

T UA L
U.M .G.
.N

Byron Alfonso Pérez-Gutiérrez Proprioception and Tracking systems