Behavioral Assessment and Diagnosis of Disorders of Consciousness
Behavioral Assessment and Diagnosis of Disorders of Consciousness
Abstract Behavioral assessment is a critical step for the detection of signs of con-
sciousness and, hence, for diagnosis of states of altered consciousness. However,
because of the presence of compromising factors such as severe functional and cog-
nitive impairment, accurate diagnosis is a challenging enterprise, leading to serious
consequences on the patient’s ongoing care but also on the patient’s end of care. In
this review, we will describe the behavioral characteristics of the main clinical enti-
ties through which severely brain-injured patients transit before fully recovering
from coma, we will describe methods for assessing consciousness at the bedside,
and we will discuss the existing tools that help clinicians formulating an accurate
diagnosis.
Introduction
During these last years, there has been increasing fascination for the field of disor-
ders of consciousness. Due to progress in intensive care, more and more severely
brain-injured patients survive their initial brain insult, but many of these will go
through various states of impaired consciousness. The prevalence of these patients
is estimated at 46 per million in the United States, 14 per million in Great Britain [1],
and 36 per million in Belgium [2]. Many patients will remain in a vegetative state for
a more or less extended period of time before regaining some level of consciousness
(minimally conscious state). Some of these cases have received important coverage
by the media, such as the case of Terri Schiavo (1963–2005) who stayed in a vegeta-
tive state for 15 years after a cardiac arrest or the case of Terry Wallis who emerged
from a minimally conscious state 19 years (1984–2003) after a severe traumatic
brain injury [3]. At the same time, prolonged hospitalization is expensive. In the
United States, the costs are estimated at 600,000–1,875,000 dollars per year per
patient with severe traumatic injury [4]. Questions regarding end-of-life decisions
are critical here, particularly in chronic vegetative patients. In a recent European
survey (n = 2475), the majority of medical and paramedical professionals (66%)
agreed to withdraw life support for chronic vegetative patients, while only 28%
agreed for patients in a chronic minimally conscious state. Many clinicians reported
that they would not want to be life-supported if they happened themselves to be in a
chronic vegetative state (82%) or if they were in a chronic minimally conscious state
(67%) [5]. The social, economic, and ethical consequences associated with disor-
ders of consciousness, and particularly the vegetative state, are huge.
The term vegetative indicates preserved physiological functions (cardiac, respi-
ratory, sleep/wake cycles) without clear signs of consciousness of either the self or
the environment. In a sense, the body works without the mind. One of the few ways
we have to differentiate patients in a vegetative state from conscious patients is to
observe their spontaneous behaviors and their reactions to stimuli occurring in their
environment. This behavioral assessment requests thorough expertise on behalf of
the clinician. It also depends on the physical and mental capacities (particularly, the
vigilance level) of the patient at the time of assessment. Missing signs of conscious-
ness is not a rare fact, and diagnostic errors are frequent (i.e., around 40%) [6–8].
The diagnosis is, however, crucial. It influences the way the patient’s care will be
oriented and the way end-of-life decisions will be considered with the patient’s fam-
ily. Developing valid and sensitive behavioral scales to detect the presence of signs
of consciousness, even subtle, therefore, represents a real challenge.
Disorders of Consciousness
Coma
Patients who survive a severe brain injury can remain unconscious for several
weeks, being neither awake nor conscious. They are in a state called coma, defined
as “a pathological state marked by severe and prolonged dysfunction of vigilance
and consciousness” [9] (Fig. 1.1 and Table 1.1). This state usually results either
from a lesion limited to the brainstem (involving the reticular activating system) or
from a global brain dysfunction (most often caused by diffuse axonal injury after
traumatic brain injury). The distinguishing features of coma are the continuous
absence of eye opening (spontaneously or after stimulation) and the absence of
oriented or voluntary motor or verbal (including vocalization) responses. There is
no evidence of visual fixation or pursuit, even after manual eye opening. This state
must last at least 1 h to be differentiated from a transient state such as syncope, acute
1 Behavioral Assessment and Diagnosis of Disorders of Consciousness 3
Conscious
Non-Conscious
Light
sleep MCS
Ability to produce
motor behavior
Deep
sleep
General
Non-behavioral
Anesthesia
Coma Aware
Content of
VS consciousness
(awareness)
Non-awake Non-aware
Level of
Awake
consciousness
(wakefulness)
Fig. 1.1 The conundrum of consciousness. Disorders of consciousness are defined by two main
components: the level of consciousness and the content of consciousness. This figure illustrates
where different states (i.e., coma; vegetative state, VS; minimally conscious state, MCS, but also
states related to sleep and anesthesia) are placed on both continuum. It also represents where
patients with covert cognition would be placed (adapted from Monti et al., 2012)
Table 1.1 Comparison of the behavioral features of coma, VS, MCS−, MCS+, emergence from
MCS (EMCS), and LIS
Coma VS MCS− MCS+ EMCS LIS (classic)
Eye opening None Spontaneous Spontaneous Spontaneous Spontaneous Spontaneous
Movement None Reflexive/ Automatic/ Automatic/ Functional Reflexive/
patterned object object object use patterned
manipulation manipulation
Response to Posturing/ Flexion Localization Localization N/A Flexion
pain none withdrawal/ withdrawal/
posturing posturing
Visual response None Startle Object Object Object Object
localization/ recognition recognition recognition
pursuit/
fixation
Affective None Random Contingent Contingent Contingent Random
response (presence of
pathological
laughs/tears)
Response to None None None Reproducible Consistent/ Consistent
command reproducible (using
eye-related
commands)
Verbalization None None Random Intelligible Intelligible None
vocalization/ words words
none
Communication None None Unreliable Unreliable Reliable Reliable (using
alphabetical
board)
Vegetative State
In 1972, the term vegetative state (VS) was first introduced by Jennet and Plum to
describe “an organic body capable of growth and development but devoid of sensa-
tion and thought” [13] (Fig. 1.1 and Table 1.1). This new clinical entity was identi-
fied following the implementation of artificial breathing techniques in intensive care
units. Since then, the number of scientific studies performed on VS patients has
continuously increased. More precisely, less than ten articles were published from
1975 to 1985, compared with more than five hundreds of articles from 2010 to 2015
(Fig. 1.2).
Behaviorally, patients in VS open their eyes spontaneously or in response to
stimulation and present preserved autonomic functions (e.g., breathing, cardiovas-
cular regulation, thermoregulation), but they are not conscious and show only
reflexive behaviors [10]. The VS often results from an injury involving the white
matter or bilateral lesions of the thalamus (i.e., intralaminar nuclei) [14, 15]. How
can doctors explain to the family such a state? These patients breathe normally and
have their eyes open. They even have prolonged periods with eyes closed, leading
to the impression that the patient is sleeping. We now know that this impression may
1 Behavioral Assessment and Diagnosis of Disorders of Consciousness 5
536
284
109
66
50
28
7 8
Fig. 1.2 Annual number of publications on vegetative state between 1975 and 2015. Results of a
PubMed search using the terms vegetative state, consciousness, and awareness
(1993), Terri Schiavo in the United States (2005), and Eluana Englaro in Italy
(2009) [22–24]. Thorough examinations had been conducted for each of these
patients; the extreme decision of end of life was considered. The distinction between
conscious and unconscious states is very difficult to make given that patients can
present subtle behavioral signs which can easily be missed and which differentiate
the vegetative state from the minimally conscious state.
The minimally conscious state (MCS) was identified more recently than the VS
and the coma. It was defined in 2002 by the Aspen Workgroup as being character-
ized by the presence of inconsistent but clearly discernible behavioral signs of
consciousness (Fig. 1.1 and Table 1.1) [25]. Patients evolving from a VS to an
MCS are still awake but begin to show oriented behaviors such as visual pursuit.
The earlier this behavior appears, the better the outcome will be. The presence of
oriented eye movements is therefore crucial, but it is also one of the most difficult
signs of consciousness to detect and requires the use of sensitive diagnostic tools
[8, 26, 27]. More globally, signs of consciousness in MCS patients may be hard to
observe because they are inconsistent in time, due to high vigilance fluctuations.
They must be replicated within a given examination to meet the diagnostic criteria
for MCS. It is generally necessary to conduct serial examinations before an accu-
rate diagnosis can be made. Complicating further the diagnosis is the fact that
patients may fluctuate between VS and MCS before the level of consciousness
stabilizes [28].
MCS is diagnosed when there is clear evidence of one or more of the following
behaviors: simple command-following (e.g., “shake my hand”), gestural or verbal
yes/no responses (regardless of accuracy), intelligible verbalization, and move-
ments or affective behaviors that occur in contingent relation to relevant environ-
mental stimuli and are not attributable to reflexive activity. Examples of contingent
motor and affective responses include (1) episodes of crying, smiling, or laughter
produced by the linguistic or visual content of emotional but not neutral stimuli, (2)
vocalizations or gestures that occur in direct response to verbal prompts, (3) reach-
ing for objects with a clear relationship between object location and direction of
reach, (4) touching or holding objects in a manner that accommodates the size and
shape of the object, and (5) visual pursuit or sustained fixation in response to mov-
ing or salient stimuli. As different functional neuroanatomical features have been
observed, the MCS has recently been subdivided in two clinical entities, MCS+ and
MCS−, based on the presence or absence of receptive and expressive language (i.e.,
response to command and intelligible verbalization) [29]. The specific behaviors
required to fulfill the criteria for MCS+ and MCS− remain a matter of debate and
require further empirical investigation before they can be incorporated into clinical
practice.
1 Behavioral Assessment and Diagnosis of Disorders of Consciousness 7
Locked-In Syndrome
The locked-in syndrome (LIS) is marked by tetraplegia and anarthria in the con-
text of preserved consciousness and a near-normal to normal cognitive function-
ing [34, 35] (Table 1.1). This state is caused by a lesion involving the ventral
pons and, in 60% of cases, is due to basilar thrombosis. Functional neuroimaging
typically shows preserved supratentorial areas (with hypometabolism in the cer-
ebellum). Interestingly, significant hyperactivity has been observed bilaterally in
the amygdala of acute LIS patients, likely reflecting anxiety generated by the
inability to move or speak (stressing the importance of appropriate anxiety treat-
ment soon after diagnosis) [36]. Because patients with LIS have spontaneous
eyes opening, but are unable to speak or move the extremities, this state can be
confused with VS. On average, the diagnosis of LIS is not established until 2.5
months post-onset. There is evidence that family members tend to detect signs of
consciousness (55% of cases) prior to medical staff (23% of cases) [36]. Classic
LIS consists of complete paralysis of the orobuccal musculature and all four
extremities; however, vertical eye movements are spared, allowing nonverbal
communication through directional gaze. Perceptual functions are also usually
spared given that ascending corticospinal axons remain intact [34]. Bauer has
described multiple varieties of LIS, including the incomplete form in which
8 C. Schnakers and S. Majerus
there is residual motor activity (frequently, finger or head movements), and total
LIS, in which there is complete immobility including both horizontal and verti-
cal eye movements [37]. Total LIS cases have previously been reported but are
rare and request the use of neuroimaging or electrophysiological methods to
establish the diagnosis [38]. Data on life expectancy suggest that some patients
with LIS can live for more than 12 years while remaining in LIS. Surprisingly,
chronic LIS patients rate their quality of life similarly to the healthy population
[39]. In the absence of other structural or functional brain abnormalities, patients
with LIS are generally able to make independent decisions and communicate
their preferences through augmentative communication devices [36].
A different group of patients who are unable to show any behavioral sign of con-
sciousness but are able to respond mentally to active neuroimaging or electrophysi-
ological paradigms has been identified more recently (Fig. 1.1). In 2006, Owen and
colleagues reported the case of a non-communicative young woman with severe
brain injury. When performing a mental imagery task, her brain activity was similar
to the one observed in healthy controls [40]. Following this study, Monti and col-
leagues have tested 54 patients using the same paradigm. Only two patients diag-
nosed as being in a VS and three patients diagnosed as being in an MCS were able
to perform the task (9% of the group). One of these patients was able to answer
“yes” or “no” to autobiographical questions by using either motor or spatial imag-
ery [41]. Since then, a series of studies has been published about the detection of
willful brain activity in patients diagnosed as being in a VS, confirming the exis-
tence of patients with covert cognition [42].
It is tempting to think that these patients are with a severe form of LIS. However,
unlike LIS patients, patients with covert cognition present impaired connectivity
between subcortical and cortical, such as connections between the thalamus and the
primary motor cortex which will prevent the execution of willful motor actions [43].
According to a recent meta-analysis, covert cognition seems rare in VS (14% of
cases) but is more frequent in patients with traumatic brain injury than non-traumatic
brain injury (32% vs. 19%) [42]. Future studies will nevertheless have to be multi-
centric in order to gather a sufficient amount of data to establish the profile of this
possibly new clinical entity.
As previous findings have shown the presence of communication in some
patients with covert cognition, recent studies have been trying to investigate the
interest of brain-computer interfaces (BCIs) in severely brain-injured patients
which may help those patients to communicate using neuroimaging or electro-
physiology [41, 44–47]. BCI paradigms should not be used for diagnostic pur-
pose. The tasks used to communicate are complex and could lead some patients
1 Behavioral Assessment and Diagnosis of Disorders of Consciousness 9
to be unable to respond even though they are conscious. Future studies will most
likely have to better understand residual cognitive functioning in those patients
before implementing successfully those augmentative communication tech-
niques [48].
Bedside Assessment
Diagnostic Accuracy
Behavioral Scales
In light of the behavioral fluctuations that commonly occur in this population, eval-
uations should be repeated over time, and measures should be sensitive enough to
detect subtle but clinically meaningful changes in neurobehavioral responsiveness.
Conventional bedside assessment procedures and neurosurgical rating scales such
as the Glasgow Coma Scale [50] (GCS) have limited utility when used to monitor
progress in patients with prolonged disturbance in consciousness. These procedures
detect relatively gross changes in behavior and are not designed to distinguish ran-
dom or reflexive behaviors from those that are volitional. The Full Outline of
UnResponsiveness score (FOUR score) has greater sensitivity than the GCS for
detecting different levels of brainstem function in the acute stage of severe brain
injury [51], but because the FOUR score does not include a systematic assessment
of signs of consciousness [25], it may not capture the transition from VS to MCS
[52, 53]. Standardized rating scales have been devised for chronic disorders of con-
sciousness (DOC) to address these shortcomings, to assess a broad range of neu-
robehavioral functions, and to rely on fixed administration and scoring procedures.
Standardized neurobehavioral assessment measures tailored for DOC patients
include the Coma Recovery Scale – Revised (CRS-R) [54], the Coma-Near Coma
Scale (CNC) [55], the Western Neurosensory Stimulation Profile (WNSSP) [56],
the Western Head Injury Matrix (WHIM) [57], and the Sensory Modality Assessment
and Rehabilitation Technique (SMART) [58]. Although item content varies across
measures, all evaluate behavioral responses to a variety of auditory, visual, motor,
and communication prompts. All of these instruments have been shown to have
adequate reliability and validity; however, there is considerable variability in their
psychometric integrity and clinical utility. Of these measures, the CRS-R is the only
one that directly incorporates the existing diagnostic criteria for coma, VS, and
MCS into the administration and scoring scheme (Table 1.2). Giacino and col-
leagues (2004) compared the CRS-R to the DRS in 80 patients with DOC and found
that although the two scales produced the same diagnosis in 87% of cases, the
CRS-R identified ten patients in MCS who were classified as VS on the DRS [28].
There were no cases in which the DRS detected features of MCS missed by the
CRS-R. Schnakers and colleagues (2006) administered the GCS, CRS-R, and
FOUR score to 60 patients with acute (i.e., trauma center) and subacute (i.e., reha-
bilitation center) brain injury resulting in disturbance in consciousness [52]. Among
the 29 patients diagnosed with VS on the GCS, four were found to have at least one
sign of consciousness on the FOUR. However, the CRS-R detected evidence of
MCS in seven additional patients diagnosed with VS on the FOUR. All seven of
these patients showed sustained oriented eye movements, a clinical sign heralding
recovery from VS.
In 2010, the American Congress of Rehabilitation Medicine published the results
of the first evidence-based review of neurobehavioral rating scales designed specifi-
cally for patients with DOC [59]. Six of the 13 scales that qualified for the review
were recommended for use in clinical practice. The CRS-R received the strongest
1 Behavioral Assessment and Diagnosis of Disorders of Consciousness 11
Clinicians involved in the care of MCS patients often encounter situations in which
the patients’ behavioral responses are ambiguous or occur too infrequently to clearly
discern their significance. These problems are often due to injury-related sensory,
motor, and arousal deficits. For this reason, a technique referred to as Individualized
Quantitative Behavioral Assessment (IQBA) was developed by Whyte and col-
leagues [62, 63]. IQBA is intended to address case-specific questions using indi-
vidually tailored assessment procedures, operationally defined target responses, and
controls for examiner and response bias. Once the target behavior (e.g., command-
following, visual tracking) has been operationalized, the frequency of the behavior
is recorded following administration of an appropriate command, following an
incompatible command and during a rest interval. Data are analyzed statistically to
determine whether the target behavior occurs significantly more often in one condi-
tion relative to other conditions. For example, when the frequency of observed
behaviors is greater during the “rest” condition relative to the “command” condi-
tion, it is likely that the behaviors represent random movement rather than a pur-
poseful response to command.
IQBA can be applied across a broad range of behaviors and can address many
different types of clinical question. McMillan (1996) employed an IQBA protocol
to determine whether a minimally responsive, TBI patient could reliably communi-
cate a preference concerning withdrawal of life-sustaining treatment [64]. Responses
to questions were executed using a button press. Results indicated that the number
of affirmative responses to “wish to live” questions was significantly greater than
chance suggesting that the patient could participate in end-of-life decision-making.
McMillan’s findings were subsequently replicated in a second IQBA assessment
conducted by a different group of examiners [65].
population. The visual subscale was subsequently deleted since further analysis
showed that, following the application of noxious versus non-noxious stimuli, sig-
nificantly higher scores were obtained on the motor, verbal, and facial expression
subscales but not on the visual subscale. Using this revised version (NCS-R), a
cutoff score of 4 (sensitivity of 73% and specificity of 97%) has been defined as a
potential clinical threshold for detecting pain in patients with DOC [67]. Recent
findings have also shown a correlation between NCS-R total scores and the activity
in the anterior cingulate cortex (related to pain unpleasantness), reflecting further
the relevance of this scale when monitoring pain in patients with DOC [68]. The
scale has demonstrated good reliability and validity and currently exists in various
languages (i.e., French, English, Italian, Dutch, and Thai) [66, 67, 69–72]. Finally,
the interest of the NCS-R in assessing pain in a clinical setting has been investigated
recently [73]. Thirty-nine patients with potential painful conditions (e.g., due to
fractures, decubitus ulcers, or spasticity) were assessed with the NCS-R and the
GCS during nursing cares before and after the administration of an analgesic treat-
ment tailored to each patient’s clinical status. The NCS-R scores, but not the GCS
scores, were statistically lower during treatment when compared to the scores
obtained before treatment, providing further evidence that the NCS-R is an interest-
ing clinical tool specifically tailored for pain management.
Conclusion
References
1. Jennett B. 30 Years of the vegetative state: clinical, ethical and legal problems. In: Laureys S,
editor. The boundaries of consciousness: neurobiology and neuropathology, vol. 150.
Amsterdam: Elsevier; 2005. p. 541–8.
2. Demotte R. Politique de la santé à mener à l’égard des patients en état végétatif persistant ou
en état pauci-relationnel. Moniteur Belge. 2004;69:334–40.
3. Wijdicks EF. Minimally conscious state vs. persistent vegetative state: the case of Terry
(Wallis) vs. the case of Terri (Schiavo). Mayo Clin Proc. 2006;81(9):1155–8.
14 C. Schnakers and S. Majerus
4. Consensus Conference. Rehabilitation of persons with traumatic brain injury. NIH consensus
development panel on rehabilitation of persons with traumatic brain injury. JAMA.
1999;282(10):974–83.
5. Demertzi A, Ledoux D, Bruno MA, et al. Attitudes towards end-of-life issues in disorders of
consciousness: a European survey. J Neurol. 2011;258:1058–65.
6. Childs NL, Mercer WN, Childs HW. Accuracy of diagnosis of persistent vegetative state.
Neurology. 1993;43(8):1465–7.
7. Andrews K, Murphy L, Munday R, Littlewood C. Misdiagnosis of the vegetative state: retro-
spective study in a rehabilitation unit. BMJ. 1996;313(7048):13–6.
8. Schnakers C, Vanhaudenhuyse A, Giacino J, et al. Diagnostic accuracy of the vegetative and
minimally conscious state: clinical consensus versus standardized neurobehavioral assess-
ment. BMC Neurol. 2009;9:35.
9. Posner J, Saper C, Schiff N, et al. Plum and Posner’s diagnosis of stupor and coma. New York:
Oxford University Press; 2007.
10. The Multi-Society Task Force on Persistent Vegetative State. Medical aspects of the persistent
vegetative state. N Engl J Med. 1994;330(21):1499–508.
11. Bouwes A, Binnekade JM, Kuiper MA, et al. Prognosis of coma after therapeutic hypother-
mia: a prospective cohort study. Ann Neurol. 2012;71(2):206–12.
12. Wijdicks EF, Varelas PN, Gronseth GS, et al., American Academy of Neurology. Evidence-
based guideline update: determining brain death in adults: report of the Quality Standards
Subcommittee of the American Academy of Neurology. Neurology. 2010;74(23):1911–8.
13. Jennett B, Plum F. Persistent vegetative state after brain damage: a syndrome in search of a
name. Lancet. 1972;1:734–7.
14. Fernández-Espejo D, Junque C, Bernabeu M, et al. Reductions of thalamic volume and
regional shape changes in the vegetative and the minimally conscious states. J Neurotrauma.
2010;27(7):1187–93.
15. Newcombe VF, Williams GB, Scoffings D, et al. Aetiological differences in neuroanatomy of
the vegetative state: insights from diffusion tensor imaging and functional implications.
J Neurol Neurosurg Psychiatry. 2010;81(5):552–61.
16. Landsness E, Bruno MA, Noirhomme Q, et al. Electrophysiological correlates of behavioural
changes in vigilance in vegetative state and minimally conscious state. Brain. 2011;134(8):
2222–32.
17. Working Party of the Royal College of Physicians. The vegetative state: guidance on diagnosis
and management. Clin Med. 2003;3(3):249–54.
18. Gosseries O, Demertzi A, Ledoux D, et al. Burnout in healthcare workers managing chronic
patients with disorders of consciousness. Brain Inj. 2012;26(12):1493–9.
19. Leonardi M, Giovannetti AM, Pagani M, et al. Burden and needs of 487 caregivers of patients
in vegetative state and in minimally conscious state: results from a national study. Brain Inj.
2012;26(10):1201–10.
20. Jennett B. The assessment and rehabilitation of vegetative and minimally conscious patients:
definitions, diagnosis, prevalence and ethics. Neuropsychol Rehabil. 2005;15:163–5.
21. Laureys S, Celesia GG, Cohadon F, et al. Unresponsive wakefulness syndrome: A new name
for the vegetative state or apallic syndrome. BMC Med. 2010;8:68.
22. Andrews K. Medical decision making in the vegetative state: withdrawal of nutrition and
hydration. NeuroRehabilitation. 2004;19:299–304.
23. Cohen NH, Kummer HB. Ethics update: lessons learned from Terri Schiavo—the importance
of healthcare proxies in clinical decision-making. Curr Opin Anaesthesiol. 2006;19(2):
122–6.
24. Luchetti M. Eluana Englaro, chronicle of a death foretold: ethical considerations on the recent
right-to-die case in Italy. J Med Ethics. 2010;36(6):333–5.
25. Giacino J, Ashwal S, Childs N, et al. The minimally conscious state: definition and diagnostic
criteria. Neurology. 2002;58(3):349–53.
26. Candelieri A, Cortese MD, Dolce G, et al. Visual pursuit: within-day variability in the severe
disorder of consciousness. J Neurotrauma. 2011;28(10):2013–7.
1 Behavioral Assessment and Diagnosis of Disorders of Consciousness 15
27. Dolce G, Lucca LF, Candelieri A, et al. Visual pursuit in the severe disorder of consciousness.
J Neurotrauma. 2011;28(7):1149–54.
28. Giacino JT, Trott CT. Rehabilitative management of patients with disorders of consciousness:
grand rounds. J Head Trauma Rehabil. 2004;19(3):254–65.
29. Bruno MA, Majerus S, Boly M, et al. Functional neuroanatomy underlying the clinical subcat-
egorization of minimally conscious state patients. J Neurol. 2012;259(6):1087–98.
30. Katz DI, Polyak M, Coughlan D, et al. Natural history of recovery from brain injury after
prolonged disorders of consciousness: outcome of patients admitted to inpatient rehabilitation
with 1-4 year follow-up. Prog Brain Res. 2009;177:73–88.
31. Whyte J, Nakase-Richardson R, Hammond FM, et al. Functional outcomes in traumatic disor-
ders of consciousness: 5-year outcomes from the National Institute on Disability and
Rehabilitation Research Traumatic Brain Injury Model Systems. Arch Phys Med Rehabil.
2013;94(10):1855–60.
32. Estraneo A, Moretta P, Loreto V, et al. Clinical and neuropsychological long-term outcomes
after late recovery of responsiveness: a case series. Arch Phys Med Rehabil. 2014;95(4):
711–6.
33. Fins JJ, Schiff ND, Foley KM. Late recovery from the minimally conscious state: ethical and
policy implications. Neurology. 2007;68:304–7.
34. American Congress of Rehabilitation Medicine. Recommendations for use of uniform nomen-
clature pertinent to persons with severe alterations in consciousness. Arch Phys Med Rehabil.
1995;76:205–9.
35. Schnakers C, Majerus S, Goldman S, et al. Cognitive function in the locked-in syndrome.
J Neurol. 2008;255(3):323–30.
36. Laureys S, Pellas F, Van Eeckhout P, et al. The locked-in syndrome: what is it like to be con-
scious but paralyzed and voiceless? Prog Brain Res. 2005;150:495–511.
37. Bauer G, Gerstenbrand F, Rumpl E. Varieties of the locked-in syndrome. J Neurol.
1979;221(2):77–91.
38. Schnakers C, Perrin F, Schabus M, et al. Detecting consciousness in a total locked-in syn-
drome: an active event-related paradigm. Neurocase. 2009;15(4):271–7.
39. Bruno MA, Bernheim JL, Ledoux D, et al. A survey on self-assessed well-being in a cohort of
chronic locked-in syndrome patients: happy majority, miserable minority. BMJ Open.
2011;1(1):e000039.
40. Owen AM, Coleman MR, Boly M, et al. Detecting awareness in the vegetative state. Science.
2006;313(5792):1402.
41. Monti MM, Vanhaudenhuyse A, Coleman MR, et al. Willful modulation of brain activity in
disorders of consciousness. N Engl J Med. 2010;362(7):579–89.
42. Kondziella D, Friberg CK, Frokjaer VG, et al. Preserved consciousness in vegetative and mini-
mal conscious states: systematic review and meta-analysis. J Neurol Neurosurg Psychiatry.
2015; pii: jnnp-2015-310958.
43. Fernández-Espejo D, Rossit S, Owen AM. A thalamocortical mechanism for the absence of
overt motor behavior in covertly aware patients. JAMA Neurol. 2015;72(12):1442–50.
44. Kübler A, Furdea A, Halder S, et al. A brain-computer interface controlled auditory event-
related potential (p300) spelling system for locked-inpatients. Ann N Y Acad Sci.
2009;1157:90–100.
45. Naci L, Monti MM, Cruse D, et al. Brain-computer interfaces for communication with nonre-
sponsive patients. Ann Neurol. 2012;72(3):312–23.
46. Naci L, Owen AM. Making every word count for nonresponsive patients. JAMA Neurol.
2013;70(10):1235–41.
47. Lulé D, Noirhomme Q, Kleih SC, et al. Probing command following in patients with disorders
of consciousness using a brain-computer interface. Clin Neurophysiol. 2013;124(1):101–6.
48. Schnakers C, Giacino JT, Løvstad M, et al. Preserved covert cognition in noncommunicative
patients with severe brain injury? Neurorehabil Neural Repair. 2015;29(4):308–17.
49. Schnakers C, Bessou H, Rubi-Fessen I, et al. Impact of aphasia on consciousness assessment:
a cross-sectional study. Neurorehabil Neural Repair. 2015;29(1):41–7.
16 C. Schnakers and S. Majerus