Huntetal Manualization
Huntetal Manualization
net/publication/314463127
CITATIONS READS
3 2,099
5 authors, including:
Some of the authors of this publication are also working on these related projects:
Assessing the Relationship Between Tests Examining The Efficacy of Vestibular and Proprioceptive Sensory Systems and Related Motor Functions View project
All content following this page was uploaded by Roseann C Schaaf on 23 January 2019.
Article
Manualization of Occupational
Health
2017, Vol. 37(3) 141–148
© The Author(s) 2017
Therapy Using Ayres Sensory Reprints and permissions:
sagepub.com/journalsPermissions.nav
Abstract
This article reports on the development of a Stage 3 manual (following pilot effectiveness study) for implementing occupational
therapy using Ayres Sensory Integration® (OT/ASI) for children with autism spectrum disorders to enhance participation in
daily occupations. Three stakeholder groups were surveyed to aid in translation of manual from research to practice (i.e.,
Stage 3 manual) and an expert consensus meeting was held to finalize recommendations. Data indicated that the manuals
usability could be improved by including a section on frequently encountered problems and solutions, and by including video
case examples. Also recommended were greater chapter uniformity, improved clarity of forms and charts, and inclusion of a
glossary. Changes were made and subject to expert review and consensus using modified Delphi process. The Stage 3 manual
has been rigorously vetted and is ready for practice and research replication.
Keywords
sensory integration, knowledge translation, autism
more than 25 years. Twelve were educated at the master’s Findings from the OTI survey: One hundred percent of
degree level and four at the bachelor’s degree level. Six the OTIs returned their surveys. The data showed that (a)
completed Certification in Sensory Integration via a 60-hr 75% recommended greater organization and uniformity in
program offered by the University of Southern California chapters; (b) 50% recommended greater clarity in the Goal
and Western Psychological Services® (2015). All the OTPs Attainment Scale (GAS) forms, tables, and charts; and (c)
reported using sensory integration theory frequently and 100% recommended consistent terminology throughout the
four reported using it always, within their practices. manual using a glossary of terms.
OTIs. A second group of participants in step 1 were the Step 2: Revisions Based on Survey Findings From
therapists who participated in the Schaaf et al. (2014) RCT
of OT/ASI (n = 4). These therapists were surveyed to gather
OTP and OTI
their recommendations for the Stage 3 manual. The OTIs The five main suggestions from the survey data, namely, (a)
had an average of 22 years of experience, and all completed video case examples, (b) frequently encountered problems
Certification in Sensory Integration via the University of and suggested solutions, (c) greater uniformity in chapters,
Southern California and Western Psychological Services® (d) greater clarity in GAS forms and tables, and (e) a glos-
(2015) program. Two were educated at the master’s level sary of terms were considered for revision in the Stage 3
and two were educated at the bachelor’s level. manual as described below.
To address the recommendation for frequently encoun-
Instruments. Separate online surveys for the OTP and the tered problems and suggested solutions, reflective questions
OTI groups consisted of targeted, forced-choice questions, and tips were developed for each of the main treatment areas
using a Likert-type scale, and open-ended questions. of the manual. Adult learning theory supports the use of strat-
Response options for the OTP survey were always, fre- egies such as self-reflection questions and tips to enhance
quently, occasionally, seldom, and never for the forced- clinical reasoning and to facilitate transformational learning
choice questions. An example question from the OTP survey in which critical reflection is central to the learning process
was, “I would benefit from a treatment manual that would (Merriam, 2001), and thus adult learning guided the develop-
guide clinical reasoning of OT/ASI.” Open-ended questions ment of these.
then queried the participants about the content that would be To address the recommendation for consistent terminology,
helpful in such a manual. a glossary of terms was developed by identifying terms in the
The response options for the OTI survey were strongly Stage 2 manual that were specific to ASI and not part of the
agree, agree, disagree, and strongly disagree for the forced- usual English lexicon. For example, terms such as sensory per-
choice questions. An example question from the OTI survey ception, sensory reactivity, and praxis were identified, and
was, “Using the manual provided structure in the evaluation then, classic literature on sensory integration and neuroscience
process,” and open-ended questions provided an opportunity was used to define these (e.g., Bundy, Lane, & Murray, 2002;
for respondents to indicate specific content they felt would Kandel, Schwartz, & Jessell, 2000; Parham & Faxio, 1997).
be useful in a manualized protocol. An expert in survey To address the recommendation for greater clarity of
development reviewed the surveys and made recommenda- forms and charts, revisions were made to the organizational
tions to improve clarity and to ensure that the items were structure of the GAS quick tips check sheet, the GAS techni-
clear and relevant to the research area. cal checklist, and the parent interview template for GAS.
Research by Beaumont and Russell (2012); Casati and Bjugn
Data analysis. Summary statistics were compiled and (2012); Kerber, Hofer, Meurer, Fendrick, and Morgenstern
responses were calculated and reported as a percentage. (2011); Mason (2012); and Haynes and colleagues (2009)
Qualitative data from the open-ended questions were ana- reported that templates and checklists have good utility in
lyzed using an inductive reasoning process. standardizing patient care processes and optimizing clinical
assessment by cueing important elements. They also show
Results of Step 1 that templates and checklists are useful strategies for stan-
Findings from OTP survey. Sixteen of the 25 OTPs (64%) dardizing patient care and promoting completeness of
returned the survey. One hundred percent of survey respon- documentation. Thus, recommendations regarding clarity
dents indicated that a manual for ASI would always or fre- and organizational structure from this literature guided revi-
quently aid with consistency in practice, including guiding sions of these forms.
clinical reasoning for assessment and intervention. They rec- The suggestions to include video case examples and
ommended that the Stage 3 manual include case examples greater organization and uniformity of chapters deferred as
to exemplify the treatment process, and description of fre- it was decided that these enhancement would be better
quently encountered problems with suggested solutions to addressed in concert with a publisher and copy editor in the
guide clinical reasoning. development and production of a published manual.
144 OTJR: Occupation, Participation and Health 37(3)
Step 3: Review of Revised Documents by the Step 4: Modified Delphi Meeting With OTE
OTE Participants. A Delphi meeting with the OTEs was held to
Participants. The OTE group was comprised of twelve gain consensus on the manual revisions. Seven of the origi-
experts in OT/ASI who were recruited to review the addi- nal 12 OTEs accepted the invitation to participate in the Del-
tions and revisions to the manual. These individuals were phi meeting. One of the seven members was not able to join
chosen because of their expertise in ASI and OT. Experience the meeting in person, but participated remotely.
ranged from 11 years to more than 25 years in practice, with
70% currently practicing in the area of pediatrics for more Procedures. Delphi methodology was used to consider the
than 25 years in a variety of settings, including private prac- revised items (Hartnett, n.d.). The modified Delphi method-
tice, academia, hospital-based setting and schools. All the ology was utilized because this final step necessitated a
OTEs were educated at the doctoral level and had completed methodology that allowed for determination of the extent to
Certification in Sensory Integration in a recognized program. which the OTEs agreed with the revisions. Following this
Within the group of experts, 60% were involved in teaching methodology, the Delphi meeting had an established time
continuing education courses in sensory integration, and frame; a facilitator, note taker, and time keeper; rules regard-
85% had authored or coauthored in publications on the topic ing time for each item and the entire meeting; rules for facili-
of sensory integration. tating consensus; and strategies for resolution of items that
did not achieve consensus as described below. In keeping
Instruments. An online survey was developed and was sub- with Delphi methodology, the OTEs were asked to maintain
ject to expert validation as described previously. The OTE mutual respect, be open to suggestions, and build on ideas.
survey consisted of targeted forced-choice questions using a The procedures are outlined below:
4-point Likert-type scale with responses of strongly agree,
agree, disagree, and strongly disagree, as well as open-ended •• Total time for the meeting was set at 90 min.
questions. Responses of strongly disagree or disagree trig- •• Time for each topic was 2 min.
gered an open-ended question for responders to provide sug- •• A time keeper tracked the discussion time and called
gestions for improvement. Following are examples of OTE for a vote at the 2 min mark.
survey questions: “The Goal Attainment Scale technical •• When 100% consensus was not reached, another
checklist template provides sufficient structure to guide the round of discussion (2 min) occurred followed by a
technical assessment of the goal attainment scales” and “The second vote.
reflective questions and tips section address useful areas to •• Items that reach consensus were considered resolved,
guide clinical reasoning of the therapist in providing Ayres while unresolved items were deferred.
Sensory Integration.” The criterion for acceptance of manual •• Unresolved items were given to a designated expert
revision was set as a rating of agree or strongly agree by 90% from the group who made the final recommendation.
of expert participants.
Results. Of the thirteen revised glossary terms presented for
Data analysis. Frequency distribution of all responses were review, discussion, and vote, consensus was reached on
analyzed and described with the percentage of total response eight. Five glossary terms were deferred (sensory discrimi-
to each of the Likert-type scale answers. nation, bilateral integration, arousal, self-regulation, and sen-
sory reactivity), and one of the OTEs was chosen by the
Results. Eleven of the 12 (92%) OTEs reached consensus on group to make the final revision based on the panel’s conver-
the revised reflective questions and tips; thus, this section sation and their own expert opinion. A sample of glossary
reached acceptable criterion. An example of the final reflec- terms and definitions is shown in Table 2. The entire glossary
tive questions and tips is shown in Table 1. can be found in the Stage 3 manual publication (Schaaf &
The OTE group also reached consensus on 24 of the 37 Mailloux, 2015).
glossary of terms. For those that did not reach consensus, the
OTEs suggested greater clarity in definitions using literature
Discussion
in neuroscience and ASI. The terms were revised accord-
ingly and then subject to re-review at the Delphi meeting as Manualization of an intervention is an important part of evi-
described below: dence-based practice. Manualization provides a systematic
Two forms did not meet the 90% consensus criterion by description of an intervention so that it can be replicated in
the OTEs, namely, the GAS quick tips form and GAS techni- future studies and utilized in clinical practice. A crucial step
cal quality checklist. Specific suggestions for greater clarity in the manualization process is obtaining input from key
and organization of these forms to provide systematic guid- stakeholders (Westen, 2002). In this study, key stakeholders
ance in developing and rating the GAS goals were made. The were represented by the OTPs, OTIs, and OTEs who
forms were revised accordingly. reviewed and contributed input for manual revisions.
Hunt et al. 145
Praxis
Were the activities utilized rich in somatosensory experiences Assure that the environment contains a variety of materials and
and require that the child plan and execute purposeful props to allow for total body somatosensory experience and
movements as a basis for participation? that facilitates praxis through play.
In what ways did I support and present challenges to the Tap into the child’s interest and then gradually expand their
child’s ability to conceptualize and plan novel motor praxis and play repertoire.
activities, and to organize his or her own behavior in time Provide a model play for the child if needed.
and space? Beware of being too directive; instead, offer opportunities and
What amount and type of structure did I need to provide for wait for child to respond.
the child to execute and/or create new action ideas for play Be mindful of collaborating with the child on activity choices.
and other activities? Consider phrasing verbal cues in form of questions, for
What changes did the child exhibit related to organized example, “What could we use this for?”
behavior for participation? Allow children time to process and figure things out by
themselves.
Adaptive response
“An appropriate action to an environmental demand. Adaptive responses require good sensory integration, and they also further the
sensory integrative process” (Ayres, 1979, p. 181).
Body awareness (body perception)
A person’s perception of his own body, consisting of sensory pictures or “maps” of the body stored in the brain, may also be called
body scheme, body image, or neuronal model of the body (Ayres, 1979).
GAS
Setting up a measurable scale for goals (Kiresuk & Sherman, 1968); a means of individualized, criterion-referenced, quantifiable
measurement of change across time that involves defining a unique set of goals for each child based on their functional needs
(Mailloux et al., 2007); a method of goal setting and objective measurement of individualized functional responses to therapeutic
interventions (Kiresuk, Smith, & Cardillo, 1994).
Gravitational insecurity
A type of sensory hyperreactivity that involves signs of distress in response to movement or change of head position or center of
gravity that is greater than would be expected; anxiety and distress when head position is changed or movement occurs (Ayres, 1979).
Carroll and Nuro (2002) suggested that a manual’s util- that such strategies would enhance the clinician’s clinical
ity can be increased by anticipating and acknowledging reasoning process and assure adherence to the interven-
challenging clients and problem areas. They also recom- tion. Adult learning theory also supports the use of strate-
mended strategies such as trouble shooting guidelines, gies such as self-reflection questions and tips to enhance
templates for organizing complex treatments, brief session clinical reasoning and to facilitate transformational learn-
summaries, and outlines to direct clinicians to the key ing in which critical reflection is central to the learning
points of the intervention. Consistent with this literature, process (Merriam, 2001) and guided the development of
our survey data showed that the OTPs and the OTIs recom- these. Thus, the use of reflective questions and tips for
mended the use of self-reflective questions and tips to elu- each intervention area in the Stage 3 manual may be useful
cidate specific intervention principles and solutions. In strategies to shape clinical reasoning and decision making.
keeping with Carroll and Nuro (2002), they also indicated In particular, these reflective questions help tailor the
146 OTJR: Occupation, Participation and Health 37(3)
Ayres, A. J. (2005). Sensory integration and the child: 25th anni- Inventory (PEDI): Development, standardization and adminis-
versary edition. Los Angeles, CA: Western Psychological tration manual. Boston, MA: PEDI Research Group.
Services. Hartnett, T. (n.d.). The basics of consensus decision-making.
Beaumont, K., & Russell, J. (2012). Standardising for reliability: Retrieved from http://www.groupfacilitation.net/Articles%20
The contribution of tools and checklists. Nursing Standard, for%20Facilitators/The%20Basics%20of%20Consensus%20
26(34), 35-39. doi:10.7748/ns2012.04.26.34.35.c9067 Decision%20Making.pdf
Blanche, E. I., Fogelberg, D., Diaz, J., Carlson, M., & Clark, F. Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat,
(2011). Manualization of occupational therapy interventions: A. S., Dellinger, E. P., . . . Lapitan, M. C. M. (2009). A sur-
Illustrations from the pressure ulcer prevention research pro- gical safety checklist to reduce morbidity and mortality in a
gram. American Journal of Occupational Therapy, 65, 711- global population. New England Journal of Medicine, 360,
719. 491-499.
Bundy, A., Lane, S. J., & Murray, E. A. (2002). Sensory integration Kandel, E. R., Schwartz, J. H., & Jessell, T. M. (2000). Essentials
theory and practice. Philadelphia, PA: Mosby. of neural science and behavior. Stamford, CT: Appleton &
Carroll, K. M., & Nuro, K. F. (2002). One size cannot fit all: A Lange.
stage model for psychotherapy manual development. Clinical Kerber, K. A., Hofer, T. P., Meurer, W. J., Fendrick, A. M., &
Psychology: Science and Practice, 9, 396-406. Morgenstern, L. B. (2011). Emergency department documen-
Casati, B., & Bjugn, R. (2012). Structured electronic template for tation templates: Variability in template selection and associa-
histopathology reporting on colorectal carcinoma resections: tion with physical examination and test ordering in dizziness
Five-year follow-up shows sustainable long-term quality presentations. BMC Health Services Research, 11, Article 65.
improvement. Archives of Pathology & Laboratory Medicine, doi:10.1186/1472-6963-11-65
136, 652-656. Kiresuk, T. J., & Sherman, R. E. (1968). Goal attainment scaling:
Case-Smith, J., Weaver, L. L., & Fristad, M. A. (2015). A sys- A general method for evaluating community mental health pro-
tematic review of sensory processing interventions for chil- grams. Community Mental Health Journal, 4, 443-453.
dren with autism spectrum disorders. Autism, 19, 133-148. Kiresuk, T. J., Smith, A., & Cardillo, J. E. (1994). Goal attainment
doi:10.1177/1362361313517762 scaling: Applications, theory and measurement. Hillsdale, NJ:
Clark, F. (2012). In American Academy of Pediatrics (Ed.), Lawrence Erlbaum.
Response to the American academy of pediatrics’ policy Lopata, C., Thomeer, M. L., Volker, M. A., Nida, R. E., & Lee,
statement on sensory integration therapy. American G. K. (2008). Effectiveness of a manualized summer social
Occupational Therapy Association. Retrieved from https:// treatment program for high-functioning children with autism
www.aota.org/-/media/Corporate/Files/Practice/Children/ spectrum disorders. Journal of Autism and Developmental
ResponseAmericanAcademyPediatricsPolicyStatement Disorders, 38, 890-904.
SensoryIntegrationTherapy.pdf Mailloux, Z., May-Benson, T. A., Summers, C. A., Miller, L. J.,
Clark, F., Park, D. J., & Burke, J. P. (2013). Dissemination: Brett-Green, B., Burke, J. P., . . . Schoen, S. A. (2007). Goal
Bringing translational research to completion. American attainment scaling as a measure of meaningful outcomes for
Journal of Occupational Therapy, 67, 185-189. doi:10.5014/ children with sensory integration disorders. American Journal
ajot.2013.006148 of Occupational Therapy, 61, 254-259.
Des Jarlais, D. C., Lyles, C., Crepaz, N., & TREND Group. (2004). Mailloux, Z., & Smith Roley, S. (2010). Sensory integration. In H.
Improving the reporting quality of nonrandomized evaluations Miller-Kuhaneck & R. Watling (Eds.), Autism: A comprehen-
of behavioral and public health interventions: The TREND sive occupational therapy approach (3rd ed., pp. 469-507).
statement. American Journal of Public Health, 94, 361-366. Bethesda, MD : American Occupational Therapy Association
Dimeff, L. A., Koerner, K., Woodcock, E. A., Beadnell, B., Brown, Press.
M. Z., Skutch, J. M., . . . Harned, M. S. (2009). Which train- Mandell, D. S., Novak, M. M., & Levy, S. (2005, May). Frequency
ing method works best? A randomized controlled trial compar- and correlates of treatment use among a community sample
ing three methods of training clinicians in dialectical behavior of children with autism. International Meeting for Autism
therapy skills. Behaviour Research and Therapy, 47, 921-930. Research, San Diego, CA.
Forsyth, K., Summerfield-Mann, L., & Kielhofner, G. (2005). Mason, M. C. (2012). More than a checklist. Nursing Standard,
Scholarship of practice: Making occupation-focused, theory- 26(20), 20-21. doi:10.7748/ns2012.01.26.20.20.p7323
driven, evidence-based practice a reality. The British Journal May-Benson, T. A., & Koomar, J. A. (2010). Systematic review
of Occupational Therapy, 68, 260-268. of the research evidence examining the effectiveness
Goin-Kochel, R. P., Mackintosh, V. H., & Myers, B. J. (2009). of interventions using a sensory integrative approach for
Parental reports on the efficacy of treatments and therapies children. American Journal of Occupational Therapy, 64,
for their children with autism spectrum disorders. Research 403-414.
in Autism Spectrum Disorders, 3, 528-537. doi:10.1016/j. Merriam, S. B. (2001). The new update on adult learning theory.
rasd.2008.11.001 New York, NY: Jossey-Bass, A Publishing Unit of John Wiley
Green, V. A., Pituch, K. A., Itchon, J., Choi, A., O’Reilly, M., & Sons.
& Sigafoos, J. (2006). Internet survey of treatments used by Miller, L. J., Coll, J. R., & Schoen, S. A. (2007). A randomized
parents of children with autism. Research in Developmental controlled pilot study of the effectiveness of occupational ther-
Disabilities, 27, 70-84. doi:10.1016/j.ridd.2004.12.002 apy for children with sensory modulation disorder. American
Haley, S. M., Coster, W. J., Ludlow, L. H., Haltiwanger, J. T., Journal of Occupational Therapy, 61, 228-238. doi:10.5014/
& Andrellos, P. J. (1992). Pediatric Evaluation of Disability ajot.61.2.228
148 OTJR: Occupation, Participation and Health 37(3)
Murphy, S. L., & Gutman, S. A. (2012). Intervention fidelity: A nec- Schaaf, R. C., Benevides, T. W., Kelly, D., & Mailloux-Maggio, Z.
essary aspect of intervention effectiveness studies. American (2012). Occupational therapy and sensory integration for chil-
Journal of Occupational Therapy, 66, 387-388. dren with autism: A feasibility, safety, acceptability and fidelity
Parham, L. D., Cohn, E. S., Spitzer, S., Koomar, J. A., Miller, study. Autism, 16, 321-327. doi:10.1177/1362361311435157
L. J., Burke, J. P., . . . Summers, C. A. (2007). Fidelity in Schaaf, R. C., & Case-Smith, J. (2014). Sensory interventions for
sensory integration intervention research. American Journal children with autism. Journal of Comparative Effectiveness
of Occupational Therapy, 61, 216-227. doi:10.5014/ajot Research, 3, 225-227. doi:10.2217/cer.14.18
.61.2.216 Schaaf, R. C., & Mailloux, Z. (2015). Clinician’s guide for
Parham, L. D., & Faxio, L. S. (1997). Play in occupational therapy. implementing Ayres sensory integration®: Promoting par-
Philadelphia, PA: Mosby. ticipation for children with autism. Bethesda, MD: American
Parham, L. D., & Mailloux, Z. (2015). Sensory integration. In J. Occupational Therapy Association Press.
Case-Smith & J. C. O’Brien (Eds.), Occupational therapy for Schnyer, R. N., & Allen, J. J. (2002). Bridging the gap in comple-
children and adolescents (7th ed., pp. 258-303). St. Louis, mentary and alternative medicine research: Manualization as a
MO: Mosby. means of promoting standardization and flexibility of treatment
Parham, L. D., Smith Roley, S., May-Benson, T., Koomar, J., in clinical trials of acupuncture. The Journal of Alternative and
Brett-Green, B., Burke, J. P., . . . Schaaf, R. C. (2011). Complementary Medicine, 8, 623-634.
Development of a fidelity measure for research on effec- The Sensory Integration Research Collaborative (Schaaf, R. C.,
tiveness of Ayres sensory Integration®. American Journal Mailloux, Z., Benevides, T., Blanche, E. I., Bodison, S., Burke,
of Occupational Therapy, 65, 133-142. doi:10.5014/ajot. J. P., . . . Smith Roley, S.). (2011). Intervention for Sensory
2011.000745 Integration for Children with Autism (InSInc). Unpublished
Pfeiffer, B. A., Koenig, K., Kinnealey, M., Sheppard, M., & manual.
Henderson, L. (2011). Effectiveness of sensory integration Smith Roley, S., Mailloux, Z., Miller-Kuhaneck, H., & Glennon,
interventions in children with autism spectrum disorders: A T. (2007). Understanding Ayres sensory integration®. OT
pilot study. American Journal of Occupational Therapy, 65, Practice, 12(17), CE-1-CE-8.
76-85. doi:10.5014/ajot.2011.09205 University of Southern California & Western Psychological
Schaaf, R. C. (2015). Creating evidence for practice using data Services®. (2015). Sensory integration certification program.
driven decision making. American Journal of Occupational Retrieved from http://www.wpspublish.com/store/c/340
Therapy, 69, 6902360010p1-6902360010p6. doi:10.5014/ Watling, R., Koenig, K. P., Davies, P. L., & Schaaf, R. C. (2011).
ajot.2015.010561 Occupational therapy practice guidelines for children and
Schaaf, R. C., Benevides, T., Mailloux, Z., Faller, P., Hunt, J., adolescents with challenges in sensory processing and sensory
van Hooydonk, E., . . . Kelly, D. (2014). An intervention for integration. Bethesda, MD: American Occupational Therapy
sensory difficulties in children with autism: A randomized Association Press.
trial. Journal of Autism and Developmental Disorders, 44, Westen, D. (2002). Manualizing manual development. Clinical
1493-1506. doi:10.1007/s10803-013-1983-8 Psychology: Science and Practice, 9, 416-418.