Data Use

Outline
q Importance of Graphing
q Session Notes

Importance of Graphing

Copyright © ABA Technologies, Inc. 2022 1

 Objective
q Graphing and visual analysis of data
a. Identify the importance
b. Describe the role of the RBT as it
relates to data and graphing

A Graph Can Be Worth

A Thousand Words
(and perhaps much more)

The Challenger Disaster*

q On January 28, 1986 the space shuttle
Challenger exploded on take off
q The source of the catastrophic failure:
two failed O-rings on the solid rocket
boosters
q These O-ring seals lost their resiliency
because the shuttle was launched on a
very cold day
* Adapted from Tufte, E.R. (1997) Visual Explanations: Images
and Quantities, Evidence and Narrative

Copyright © ABA Technologies, Inc. 2022 2

 O-Ring Placement and Function

An Overnight Freeze
at the Launch Pad
q The overnight temperature was
forecast to hit 26oF
q It actually fell to 18oF
q Engineers debated until nearly
midnight on January 27 as to whether
or not the O-rings would fail due to cold
weather
q The O-rings were designated as a
“Criticality 1” component

Engineers Review the Data

q Morton-Thiokol engineers developed

13 “charts” to make the case for “no
launch.”

q The following charts were faxed to

NASA officials for an urgent review…

Copyright © ABA Technologies, Inc. 2022 3

 Sample O-Ring Raw “Chart” #1

Sample O-Ring Raw “Chart” #2

The Decision is Made

q By midnight, NASA officials gave the
final go ahead for launch. They felt
the O-ring data were “inconclusive,”
and did not make the case for yet
another delay on a flight already well
behind schedule.

Copyright © ABA Technologies, Inc. 2022 4

 Early Morning, Launch Day

One Last Delay

q That morning, mission control
delayed launch by an hour, giving the
shuttle some extra time to warm up

One Last Delay

q That morning, mission control
delayed launch by an hour, giving the
shuttle some extra time to warm up

q Challenger launched at 11:38 AM

Copyright © ABA Technologies, Inc. 2022 5

 One Last Delay
q That morning, mission control
delayed launch by an hour, giving the
shuttle some extra time to warm up

q Challenger launched at 11:38 AM

q The temperature was 36oF

Launch
q At 0.678 seconds after launch, a
large puff of greyish black smoke
emerged from the aft field joint on the
right side solid rocket booster (SRB),
indicating a failed O-ring seal

The End of the Mission

q 72.5 seconds later, a bright flash was
seen between the external tanks and
the orbiter as the fuel ignited

Copyright © ABA Technologies, Inc. 2022 6

 The End of the Mission
q 72.5 seconds later, a bright flash was
seen between the external tanks and
the orbiter as the fuel ignited

q The Challenger exploded, killing all 7

astronauts

How Did This Happen?

q NASA officials had done the
necessary due diligence
q They had reviewed all the data
q Was this simply an unpredictable
accident?
q What happened?

The Data
q Numbers listed in those tables
showed that the coldest temperature
for any prior launch had been 52o F
q Moreover, the O-rings from that 52o F
launch had sustained the most
erosion damage ever seen on any
launch

Copyright © ABA Technologies, Inc. 2022 7

 The Data
q Numbers listed in those tables
showed that the coldest temperature
for any prior launch had been 52o F
q Moreover, the O-rings from that 52o F
launch had sustained the most
erosion damage ever seen on any
launch
q How did they miss this vital clue?

Taking a Different View

q NASA officials had studied the key
tables of data

Sample O-Ring Raw “Chart” #2

Copyright © ABA Technologies, Inc. 2022 8

 Sample O-Ring Raw “Chart” #2

Sample O-Ring Raw “Chart” #1

Sample O-Ring Raw “Chart” #1

Copyright © ABA Technologies, Inc. 2022 9

 Taking a Different View
q NASA officials had studied the key
tables of data

q But… what if these same officials

had reviewed the exact same data,
presented in a different form?

Analyzing the Challenger Disaster:

A Graphical Display of O-Ring Damage as a
Function of External Temperature

A Graphical Display of O-Ring Damage

Increasing Damage Up the Vertical Y-Axis

Copyright © ABA Technologies, Inc. 2022 10

 A Graphical Display of O-Ring Damage
Increasing External Temperature
along the Horizontal X-Axis

Damage at Moderate Temperatures

(Between 57oF and 82oF) = Minimal

Damage at Moderate Temperatures

Between 57oF and 82oF = Minimal Damage

Copyright © ABA Technologies, Inc. 2022 11

 Damage at Moderate Temperatures
Between 57oF and 82oF = Minimal Damage

One Outlying Data Point: SRM 15

Damage at a Lower Temperature

Launch At About 52oF

Copyright © ABA Technologies, Inc. 2022 12

 Damage at a Lower Temperature
At 52oF: Significantly More Damage

Reasonable Hypothesis
q When the outside temperature goes
below 60 degrees Fahrenheit, the
likelihood of O-ring damage increases,
and the extent of the damage appears to
increase as a function of the
temperature drop
q The lower the temperature, the greater
the damage

The Known Data in Graphical Form

Copyright © ABA Technologies, Inc. 2022 13

 The Projected Temperature on
The Morning of the Launch

? Analyzing the Data the Night Before:

Would You Have Launched?

Possible Alternative Influences on O-Ring

Damage at Higher Temperatures

Copyright © ABA Technologies, Inc. 2022 14

 Alternative Influences on O-Ring Damage

What If This Is the “Best-fit” Trend Line for

Temperature-related O-Ring Failure…

If you are not graphing,

Copyright © ABA Technologies, Inc. 2022 15

 If you are not graphing,
you are not doing
Applied Behavior Analysis

Why?
qGraphs with accurate data
provide an incredibly efficient and
useful tool to solve problems and
prevent potential disasters…

But…
qGraphs with accurate data
provide an incredibly efficient and
useful tool to solve problems and
prevent potential disasters…
qGraphs with inaccurate data
are completely useless – and
sometimes worse than useless

Copyright © ABA Technologies, Inc. 2022 16

 The Role of the RBT
q As a Registered Behavior Technician,
you not only carry out educational
plans that your team has created,
But…
q You are the person who will often
have the primary responsibility for
collecting accurate data and
recording important observations.

Key to Success
q Your team’s success or failure to help
others rests, in a very real way, in
your hands
q Everything you do is vitally important
q This is a professional responsibility,
and what you do will profoundly
affect the lives of many people

Question
q NASA officials may have been able to
better identify the likelihood of O-ring
failure at lower temperatures causing the
1986 Challenger explosion by:
a. Launching at a different time of day
b. Involving more staff to further review
the original chart data
c. Visually inspecting the O-ring to
temperature data in a graph format
d. All of these are correct

Copyright © ABA Technologies, Inc. 2022 17

 Question
q If you are not _____, then you are
not doing Applied Behavior Analysis
(ABA).
a. Guessing
b. Shaping
c. Researching
d. Graphing

Question
q As an RBT, one of your roles may be
to:
a. Collect accurate data
b. Record observations
c. Make data-based treatment
decisions
d. All of these are correct
e. A and B but not C

Question
q It is important to have graphs with
_____ data.
a. Accurate
b. Consistent
c. Variable
d. Positive

Copyright © ABA Technologies, Inc. 2022 18

 Objective
q RBT Ethics Standard 2.02
a. Identify the importance of accuracy in data
b. Identify the role of the RBT in relation to the
ethics standard and client data
c. Identify the type of data an RBT may collect
d. Given a scenario, determine if the ethics
standard being violated
e. Given a scenario, choose an appropriate
course of action

RBT Ethics Code (2.0)

Standard 2.02
q RBTs follow the direction of their
supervisors, accurately implement
behavior-technician services, and
accurately complete all required
documentation (e.g., client data,
billing records).

(BACB, 2021)

Standard 2.02 and the RBT

q Assist with data collection
§ Collect data
§ Graph data
q The data you collect are important!
q These data will likely guide in the
development of the behavior plan

Copyright © ABA Technologies, Inc. 2022 19

 Accuracy When Reporting Data
q This Code standard also applies to reporting
data in clinical practice
q When reporting data, be honest, accurate,
and comprehensive
q If you find an error in reported data, correct it
and inform the relevant parties
q Do NOT:
§ Fabricate data
§ Edit data (e.g., leave out inconvenient data)

Data Manipulation
q Reporting tricks
§ Opportunity data: “non-compliance”
§ Changing observation period
§ E.g., shorten “session” from 1 hr to 30 min
§ 4 hits in 1 hr is same rate as 2 hits in 30
min
q Graphing tricks
§ Altering the Y-axis of the graph
§ Adding breaks in axes

Sample Data
Properly Displayed

Copyright © ABA Technologies, Inc. 2022 20

 Changing the Y-Axis
200
180
160
140
120
100
80
60
40
20
0
1

Da 2
y9

Da 3
14
1
y1

y1

y1
y

y
Da
Da

Da

Da

Da

Da

Da

Da

Da

y
Da

Da

Da

The Y-Axis Range Line Break

Sample Data
Properly Displayed

Copyright © ABA Technologies, Inc. 2022 21

 A Wide Variation in Water Temp!

Important Points
q Data must be easy to collect
q Data must be charted
q Data must be reviewed by the BCBA
on a very regular basis
§ At least weekly is usually best
q Data must be used to track progress,
make program decisions, and even
evaluate medication effects

Important Points (continued)

q No Data? Better than bad data!
q Bad data result in bad programming
and bad decisions
§ May show no change when there is
change, or change when there is none
§E.g., Bad data can make it look like
everything is fine, when actually…

Copyright © ABA Technologies, Inc. 2022 22

 Question
q As an RBT, what should you do if you find an
error in reported data?
a. Change the data so it corresponds with the
data from the previous day
b. Correct the error if possible and immediately
inform your supervisor
c. Eliminate the errored data from the graph
d. Leave it as is; since it already occurred,
there is nothing you do can do about it

Question
q Carol is an RBT who is teaching her client,
Morgan, to mand (request). She collects and
graphs data on the number of mands per
session. The first session is 5 minutes long. The
second session is 2 minutes long. The third
session is 8 minutes long. The fourth session is
10 minutes long. Will the graph accurately
represent change in manding behavior?
a. Yes
b. No

Question
q Given the previous scenario, what might
Carol do differently to obtain accurate
data?
a. Only record instances of non-
compliance during sessions
b. Ensure session length is the same
across days
c. Run multiple social skills sessions
each day
d. Alter the y-axis to ensure data are
consistent

Copyright © ABA Technologies, Inc. 2022 23

 Session Notes

RBT Task E-4

q Generate objective session notes for
service verification by describing
what occurred during the sessions, in
accordance with applicable legal,
regulatory, and workplace
requirements.

Objective
q Session notes
a. Describe
b. List types of information that
should be included
c. List information that should not be
included

Copyright © ABA Technologies, Inc. 2022 24

 Objective
q Objective language
a. Define
b. Identify the importance of using
objective, professional language in
session notes
c. Given examples, identify objective,
professional descriptions, and
subjective descriptions

Session Notes
q Brief, objective notes that are typically
required by insurance companies, funding
agencies, etc. (aka “progress notes”)
§ Some states or agencies may have
specific information that they would like
included
§ The Behavior Analyst may also have
specific instructions/requirements

Objective Session Notes

q Session notes should be objective
§ Base notes on facts (i.e., things that
are directly observed and measured)
§ Do not base on feelings/opinions
§ Example: “Hana ate her entire meal”
§ Non-example: “Hana loved her meal”

Copyright © ABA Technologies, Inc. 2022 25

 Objective vs. Subjective
q Subjective notes are based on one
person’s opinion, interpretation, point of
view, feelings/emotions, etc.
q Objective notes involve observable facts
about which two or more people can
agree
§ Example of objective: We saw two movies
this weekend
§ Example of subjective: We saw two really
great movies this weekend

What to Include
q Generally session notes will include:
§ Date and time of session
§ Brief summary of target behaviors and
progress toward program goals
§ Successful and unsuccessful attempts
at program implementation
§ Relevant ecological variables
§ Note: We will discuss “ecological variables”
in the next section

What to Include (continued)

q Generally notes can also include:
§ Items/activities/interactions used as
reinforcers
§ Any apparent changes in preference
§ Example: a new favorite show, previous
favorite food that they won’t eat anymore
§ Materials that may be needed for future
sessions
Tarbox and Tarbox, 2017

Copyright © ABA Technologies, Inc. 2022 26

 What NOT to Include
q Avoid personal anecdotes or
subjective personal opinions,
especially as related to:
§ The client
§ Family members
§ Other team members

What NOT to Include: Examples

q The client
§ Example: “Giulia hates her clothes” or
“Ishmael was really mad he had to brush his
hair for school”
q Family members
§ Example: “Mom was in an unusually good
mood today.”
q Other team members
§ Example: “This doctor is so unprofessional!”
or “That teacher rocks!”

Professional Language
q Professional language is clearly stated,
objective, and focused on relevant facts.
§ Unprofessional: “Mila was intentionally
trying to get on my nerves”
§ Professional: “This evening, Mila engaged
in higher rates of yelling than usual (most
likely for staff attention)”
q Think of it this way: You are writing news,
not an editorial!

Copyright © ABA Technologies, Inc. 2022 27

 Objective & Professional Notes
q Base reports on data whenever possible
q Describe behavior without judging it or
making guesses about its intent
q Be specific, and as detailed as needed
q Goal: Everyone reading your note would
agree on the behavior it describes, and its
other main points

A Second Type Of Note

q Session notes/progress notes are typically
reviewed by funding agencies.
q However, you may write other notes as well:
Internal communications between team
members
§ Example: Cross-shift Log Books
q Important events, daily information, schedule
changes, etc.
q Professionalism is just as important here

What NOT to Include

q Remember: Unprofessional language and
imprecise, vague descriptions may be
amusing or even entertaining in the
moment – to some readers … but this
type of content in any kind of note can
also be highly offensive to the client,
family members, and other important
stakeholders, including funding agencies.

Copyright © ABA Technologies, Inc. 2022 28

 A good rule to follow
q When it comes to anything you write
in your work as an RBT… in notes,
emails, texts, or any communication
of any kind, you must be prepared…

A good rule to follow

q When it comes to anything you write
in your work as an RBT… in notes,
emails, texts, or any communication
of any kind, you must be prepared…
To see it appear on the cover
of your local newspaper or on
the evening news!

Video Example or Activity

Copyright © ABA Technologies, Inc. 2022 29

 Question
q Short answer
q Based on the previous video, write
objective and professional notes.

Question
q Short answer
q Based on the previous video, write
objective and professional notes.

RBT in the Real World

Copyright © ABA Technologies, Inc. 2022 30

 “Someone who is persistent, patient,
hard-working, forgiving, and kind.
Some days are going to be terrible, but
you have to be able to put aside your
feelings and do what is best for your
client, even if they are making you
angry. Attention to detail, organizational
skills, and multi-tasking are all
important skills to have.”

“Patience and adherence to

procedures and understanding the
importance of good data.”

“Be professional when

communicating with supervisors,
client caregivers, family members,
and coworkers. Use objective
language such as "Today, Jimmy
greeted peers 5 times!" vs "Jimmy
did an awesome job greeting peers
today.”

Copyright © ABA Technologies, Inc. 2022 31

 Question
q The RBT decides whether to write
client session notes objectively or
subjectively.
a. True
b. False

Question
q Subjective or objective?
q Louise is passionate about art.
a. Subjective
b. Objective

Question
q Subjective or objective?
q Tina spent 3 hours drawing and
painting.
a. Subjective
b. Objective

Copyright © ABA Technologies, Inc. 2022 32

 Question
q Multiple select
q Select all that are TRUE of session notes.
Session notes should:
q Include the date and time of session
q Be subjective
q Include personal anecdotes
q Provide session information for the next
RBT or BCaBA
q Be brief
q Be specific

RBT Task E-3

q Report other variables that might
affect the client in a timely manner.

Objective
q Other variables that can affect the
client
a. Describe
b. Identify examples
c. Given a scenario, identify relevant
events that may be affecting a
client’s behavior

Copyright © ABA Technologies, Inc. 2022 33

 Ecological Variables
q Environmental or other non-discrete
conditions that may impact the behavior
of a client.
q These are typically not specific events:
§ Physiological conditions (e.g., medical or
physical conditions, changes in medication,
sleep, or other routines)
§ Physical aspects of the environment (e.g.,
noise level, temperature, staffing)
q Be objective, descriptive.

Examples of Ecological Variables

q The number of persons present in a

situation (e.g., 3 or 20 in a group)
q Where and with whom a person lives,
works, and recreates.
q The variability (diversity), quantity, and
type of activities and tasks in the
environment

Examples of Ecological Variables

(continued)
q Daily, weekly, yearly routines and
rhythms
q Ongoing activities; time of day
q Day of week
q Weather and room temperature
q Physical surroundings

Copyright © ABA Technologies, Inc. 2022 34

 Examples of Ecological Variable
(continued)
q When Tanya is talking to one or two
friends, she may seriously discuss
her feelings and worries. When
Tanya is in a large group of friends,
she always acts silly and makes
jokes. Tanya’s behavior appears to
be affected by the number of friends
around her.

Question
q Which of the following is an
“ecological variable” that should likely
be included in session notes?
a. Shozo was in a bad mood
b. Lupe’s lunchroom was noisy
c. Ezra seemed distant
d. Kelly’s friends don’t like her

Scenario
q An RBT works with Jon four times a
week. When the RBT arrives in the
morning, Jon is wearing a worn out t-shirt
and black dress pants with suspenders.
Mom reports that he did not sleep well.
He has a runny nose, and mom gave him
some Benadryl® this morning to help with
his congestion. Jon tells the RBT he liked
his breakfast.

Copyright © ABA Technologies, Inc. 2022 35

 Question
q Multiple select
q Select all ecological variables that
are relevant for session notes.
q Jon is wearing a mismatched outfit
q Jon has a runny nose
q Jon did not sleep well last night
q Jon has taken Benadryl
q Jon said he liked his breakfast

Importance of Biological Conditions

q If a biological or medical issue arises,

ensure the client receives relevant
medical attention
§ E.g., illness, seizure, excessive thirst
§ These should be reported in session
notes
§ Follow the procedures indicated by
your place of work

Reporting “Variables”
q E-3: “Report other variables that
might affect the client in a timely
manner.”
q What is a “variable”?
§ Any environmental or physical
condition or unusual event that might
affect the client’s behavior.

Copyright © ABA Technologies, Inc. 2022 36

 In A Timely Manner
q Timeliness depends on the variable
§ Certain things must be reported right
away
• E.g., Signs of abuse, certain illnesses,
injuries, threats, dangerous or unhealthy
situations
§ Other things can wait to be reported (a
bit later) and evaluated (even later)
• E.g., Noise, crowded setting, unexpected
events, fire alarm test, preferred peers

RBT Task E-1

q Effectively communicate with a
supervisor in an ongoing manner.

Objective
q Communicating with one’s supervisor
regarding data
a. Identify why this is important
b. List proper ways to communicate
data
c. Identify possible problems related
to data collection and ways to
resolve those problems

Copyright © ABA Technologies, Inc. 2022 37

 Importance of Team
Communication
q Everyone on the team must feel
comfortable communicating the truth
to each other
q Generally, these communications
should occur away from, not in front
of, the client
q Good charts are only the beginning
of good communication

Proper Ways to Communicate

Regarding Data
q Review specific data sheets with
your supervisor
q Discuss session notes/progress
notes
q Monitor graphical displays
q Discuss data issues in face-to-face
meetings
q Use e-mail? Be very careful…

Maintaining Confidentiality
qData sheets and graphs are
confidential records!
qTreat them as you would any
confidential material
§ Secure completed data sheets and
graphs in locked location when not
in use
§ Share electronically only via
encrypted files

Copyright © ABA Technologies, Inc. 2022 38

 Question
q Short answer
q Potential issues with data
q As the RBT, you feel that you need
more training– e.g., you do not
understand parts of the data system.
What should you do?

Question
q Short answer
q Potential issues with data
q The data sheet is not capturing some
actual problems you are seeing.
What should you do?

Question
q Short answer
q Potential issues with data
q Data being collected are not being
used for decision making. What
should you do?

Copyright © ABA Technologies, Inc. 2022 39

 Question
q Short answer
q Potential issues with data
q You missed collecting some data.
What should you do?

Data and Progress Reports

q The bottom line: You are in a profession
where honest data drives the process
q We track what we do, we report on
progress (or lack of it), and this allows
us to make mid-course corrections
q This promotes effectiveness, which
makes you so valuable to those you
serve. What you do changes lives!

References
q Behavior Analyst Certification Board (2014).
Professional and ethical compliance code for
behavior analysts. Retrieved from:
http://bacb.com/wp-
content/uploads/2016/03/160321-compliance-
code-english.pdf
q Behavior Analyst Certification Board
(2018). RBT Ethics Code. Retrieved
from: https://www.bacb.com/wp-
content/uploads/RBT-Ethics-Code_190227.pdf

Copyright © ABA Technologies, Inc. 2022 40

 References (continued)
q Behavior Analyst Certification Board
(2018). RBT Task List (2nd Ed). Retrieved
from: https://www.bacb.com/wp-
content/uploads/RBT-2nd-Edition-Task-
List_181214.pdf
q Cooper, J. O., Heron, T. E., & Heward, W. L.
(2007). Applied behavior analysis (2nd Ed.).
Pearson: Upper Saddle River, NJ.

References (continued)
q Tarbox, J. & Tarbox, C. (2017). Training manual
for behavior technicians working with individuals
with autism. Academic Press: Cambridge, MA.
q Tufte, E. R. (1997). Visual explanations: Images
and quantities, evidence and narrative.
Graphics Press: Cheshire, CT.

Copyright © ABA Technologies, Inc. 2022 41