Psych 2022031716035093
Psych 2022031716035093
https://www.scirp.org/journal/psych
ISSN Online: 2152-7199
ISSN Print: 2152-7180
Keywords
Psychometric Properties, Emotion Regulation Scale, Nigeria
1. Introduction
Emotion dysregulation has been defined as a multidimensional construct en-
compassing maladaptive responses to negative affective states. Emotion dysre-
gulation is described by a lack of emotional awareness and understanding, no
acceptance or avoidance of emotions, an unwillingness to experience negative
affective states as part of achieving desired goals, difficulties controlling beha-
viour in the face of emotional distress, and deficits in the modulation of emo-
tional arousal (Glenn & Klonsky, 2010; Gratz & Roemer, 2004). Emotion dysre-
gulation has been linked to suicidal behaviour (Gomez-Exposito et al., 2016; Pi-
setsky, Haynos, Lavender, Crow, & Peterson, 2017). It is characterized by diffi-
culties in emotional awareness, clarity, and acceptance and difficulties managing
emotions and refraining from impulsive behaviours when in distress (Gratz &
Roemer, 2004). The diagnosis and symptoms of emotional dysregulation are
linked to an increased risk of future suicide attempts (Smith, Velkoff, Ribeiro, &
Franklin, 2019). According to Rania, Monell, Sjolander and Bulik (2020), emo-
tion dysregulation was linked to suicidality in Swedish participants. Suicide, ac-
cording to some popular beliefs, is an attempt to flee, motivated by severe nega-
tive emotional experiences and occurring with little to no planning (e.g., Mann,
Waternaux, Haas, & Malone, 1999).
Some theories which emphasize the significant emotional (e.g., fear) and
physical (e.g., pain) distress associated with suicide attempts contend that people
must gradually develop the capacity to commit lethal self-harm and that they are
more likely to do so through deliberate attempts to die rather than frantic at-
tempts to escape aversive states (Joiner, 2005). It might be stated that if suicide
attempts are attempts to escape painful affective states, emotion dysregulation
could be a credible motivating force behind this behaviour.
Distress Tolerance (DT), the ability to experience, tolerate, and function in the
context of negative affective states (Simons & Gaher, 2005), and negative urgen-
cy (NU), the tendency to act rashly in the context of negative affective states
(Whiteside & Lynam, 2001), are two more specific affect-related constructs that
are included in Emotion Dysregulation. ED has been linked to a number of
harmful behaviours, including substance abuse (Buckner, Keough, & Schmidt
2007), binge eating (Anestis, Selby, & Joiner, 2007), and unsafe sexual behaviour
(Messman-Moore, Walsh, & DiLillo, 2010; Tull, Weiss, Adams, & Gratz, 2012).
The Difficulties in Emotion Regulation Scale (DERS) (Gratz & Roemer, 2004)
is a widely used but controversial self-report tool that assesses emotion dysregu-
lation in a broad sense. To date, the original validation document has been cited
approximately 3000 times, translated into various languages, and inspired the
creation of several short forms (DERS-16; DERS-SF; DERS-18) (Bjureberg et al.,
2016; Kaufman et al., 2016; Victor & Klonsky, 2016). The DERS’ theoretical pa-
radigm (Gratz & Roemer, 2004) is based on “third-wave” cognitive behavioural
therapy approaches, which argue that experiential avoidance plays a fundamen-
tal role in the genesis and maintenance of most forms of emotional disturbance.
Tull, 2010). Internal consistency in the current sample was good for the overall
scale (α = .93) and subscales (αs = .80 - .89) (Weiss, Gratz, & Lavender, 2015).
Some recent studies also showed adequate psychometric properties in adults and
adolescents with Emotional Dysregulation (Monell, Bjureberg, Nordgren, Hess-
er, & Birgegård, 2020; Nordgren, Monell, Birgegård, Bjureberg, & Hesser, 2019).
For instance, Monell et al. (2020) reported excellent internal consistency for
goals and impulse (Cronbach αs = .90 and .91, respectively) and good internal
consistency for the remaining four subscales (αs = .81 - .90). DERS also has ac-
ceptable validity coefficients (Egan et al., 2011; Sloan et al., 2017).
Statistical Analysis
Descriptive statistics, including mean and standard deviation, were used to
determine demographic characteristics of the participants. The internal consis-
tency/reliability of DERS, Cronbach’s alpha, Spearman-Brown coefficient and
Guttman Split-Half coefficient was calculated and obtained to determine the ex-
tent to which items in DERS were interrelated. To determine the concurrent va-
lidity Pearson’s Correlation Analysis was used to correlate DERS with Structured
Interview for Disorders of Extreme Stress (SIDES) Affect Dysregulation Scale
(Brown, Houck, Lescano, Donenberg, Tolou-Shams, & Mello, 2012). The item-
total correlations were also obtained to test the relationship between each item
and the composite/total score.
3. Results
The demographic distribution of respondents by sex indicated that 512 (38.3%)
of the respondents were male while 826 (61.7%) were female. Distribution by age
shows that the respondents’ mean ± standard deviation age was 19.86 ± 2.95,
with their age ranging between 15 and 30 years. Distribution by institutions of
learning revealed that 505 (37.7%) were students of Osun State University
(UNIOSUN), 374 (28%) were students of Redeemers’ University Ede, Osun State
(RUN), 189 (14.1%) were students of Fountain University Oshogbo, Osun State,
lastly 270 (20.2%) were students of Oduduwa University Ipetumodu Osun State
(OUI). Distribution of respondents by level of study showed that 409 (30.6%)
were 100 level students, 241 (18.0%) were 200 level students, 363 (27.1%) were
300 level students, 276 (20.6%) were 400 level students, 49 (3.7), while 500 level
students. Also 1302 (97.3%) were single, 33 (2.5%) were married while 3 (.2%)
were engaged.
Measure of Reliability of DERS
To determine the reliability coefficient and verify the internal consistency of
the items and the factors of DERS on Nigerian population, Cronbach’s alpha (or
alpha coefficient), Spearman-Brown coefficient and Guttman Split-Half coeffi-
cient were used. As summarized in Table 1, the internal consistency measured
by Cronbach’s coefficient was =.90. The scale also has a Spearman-Brown coefficient
of .80 and Guttman Split-Half coefficient of .80. Cronbach’s alpha if item is de-
leted ranges from .86 to .88. The result of this analysis shows that DERS is
Reliability Statistics
Cronbach’s alpha = .90
Item-Total Statistics
Scale Scale
Corrected Cronbach’s
Mean if Variance if
Item-Total Alpha if
Item Item
Correlation Item Deleted
Deleted Deleted
I experience my emotions as overwhelming and out of control. 90.44 398.045 .393 .87
I have difficulty making sense out of my feelings. 90.50 399.302 .367 .87
When I’m upset, I become angry with myself for feeling that way. 90.39 393.372 .461 .86
When I’m upset, I become embarrassed for feeling that way. 90.57 389.975 .526 .86
When I’m upset, I have difficulty getting work done. 90.41 392.952 .491 .86
When I’m upset, I become out of control. 90.66 387.762 .585 .86
When I’m upset, I believe that I will remain that way for a long time. 90.66 391.306 .522 .86
When I’m upset, I believe that I will end up feeling very depressed. 90.68 388.609 .563 .86
When I’m upset, I believe that my feelings are valid and important. 90.17 424.981 −.106 .88
When I’m upset, I have difficulty focusing on other things. 90.30 395.786 .439 .86
When I’m upset, I feel out of control. 90.60 388.293 .570 .86
When I’m upset, I can still get things done. 90.09 415.627 .066 .87
When I’m upset, I feel ashamed at myself for feeling that way. 90.58 394.285 .477 .86
When I’m upset, I know that I can find a way to eventually feel better. 90.29 413.347 .106 .87
When I’m upset, I feel like I am weak. 90.49 393.558 .477 .86
When I’m upset, I feel like I can remain in control of my behaviours. 90.15 415.931 .058 .87
When I’m upset, I feel guilty for feeling that way. 90.57 391.487 .514 .86
When I’m upset, I have difficulty concentrating. 90.42 390.545 .523 .86
When I’m upset, I have difficulty controlling my behaviours. 90.71 390.086 .538 .86
When I’m upset, I believe there is nothing I can do to make myself feel better. 90.83 388.285 .587 .86
When I’m upset, I become irritated at myself for feeling that way. 90.74 392.965 .509 .86
Continued
When I’m upset, I start to feel very bad about myself. 90.77 390.492 .557 .86
When I’m upset, I believe that wallowing in it is all I can do. 90.84 387.388 .604 .86
When I’m upset, I lose control over my behaviour. 90.84 386.398 .637 .86
When I’m upset, I have difficulty thinking about anything else. 90.61 389.521 .569 .86
When I’m upset, I take time to figure out what I’m really feeling. 89.85 437.844 −.335 .88
When I’m upset, it takes me a long time to feel better. 90.42 394.016 .459 .86
When I’m upset, my emotions feel overwhelming. 90.40 393.935 .452 .86
N = 1338
reliable for the Nigerian population. Also, the items that measure Awareness of
emotion (items 2, 6, 10, 17, and 34) have weak corrected item-total correlation.
Put together, all items in the scale resulted in acceptable goodness-of-fit meas-
ures.
Table 2 reveals that each of the factors in the scale has a significant positive
correlation with the composite score of DERS.
Cronbach’s alpha was also used to measure the unidimensionality and homo-
geneity of the factors of DERS. The observed Cronbach αs are: nonacceptance α
= .81, goals α = .65, impulse α = .70, awareness α = .74, strategies α = .78 and
Clarity α = .54. Except for lack of emotional clarity, all the factors of DERS have
a good and adequate internal consistency (Deepa-Enlighten, 2017).
The Measure of Validity of DERS
In previous studies, significant validity coefficients was found between DERS and
related constructs. For instance in determining the convergent validity between
DERS and the Anxiety and Depression sub-dimensions of the Symptom Check-
list-90-R (SCL-90) (Derogatis, 1994), Egan et al. (2011) and Sloan et al. (2017) re-
ported direct associations [r(114) = .52, p < .01] for anxiety and [r(114) = .63, p
< .01] for depression. Also, Balaguer-Pich et al. (2018) reported a significant rela-
tionship between scores on the DERS and the Rosenberg Self-Esteem scale scores.
This validation exercise employed concurrent validity to show how well DERS
compares to other standardized related tests. Using Pearson’s correlations, the
observed correlation coefficient (r) between DERS and Structured Interview for
Disorders of Extreme Stress (SIDES) Affect Dysregulation Scale (Brown et al.,
2012) was .622, p = .000. This result showed that DERS is valid for the Nigerian
population.
Norms for DERS
The 95% confidence interval (CI) was used to determine the cutoff points for
DERS. The derived CI based on a sample of 481 male participants was between a
range of 92.7 and 96.0. On the other hand, the derived CI for females based on
780 samples was between a range of 90.6 and 93.7. The mean plus one standard
deviation of ≥113.15 and ≥114.07 was considered the cutoff points (norm) for
the male and female samples. Scores above the norm implied emotion dysregu-
lation. This is summarized in Table 3.
As summarized in Table 4, the score of the mean plus 1 standard deviation of
each of the subscales of the DERS was used to determine the cutoff for the subs-
cales.
4. Discussion
The focus of this study is to obtain a psychometric property for the difficulties in
emotion regulation scale (DERS) for the Nigerian adolescent population. Consis-
tent with previous findings (Gratz & Tull, 2010; Nordgren et al., 2019; Monell et
al., 2020), the DERS on Nigerian samples has excellent internal consistency, showing
a Cronbach’s alpha of .90. This, by implication, shows a good inter-relatedness of
the items of the DERS, unidimensionality and homogeneity of the construct
(Cortina, 1993; Bland & Altman, 1997) among the Nigerian population. The alpha
score is also not too high to render some items redundant as the alpha values did
not exceed the maximum value of .90 (Streiner, 2003; DeVellis, 2003).
Our study’s high Cronbach’s alpha score shows that DERS has a strong internal
Table 3. 95% confidence interval of cutoff point determination for DERS by gender.
Male Female
95% confidence interval 94.34 (95% CI 92.7 to 96.0) 92.14 (95% CI 90.6 to 93.7)
able and valid for the Nigerian population. Also, the items that measure aware-
ness of emotion had a weak corrected item-total correlation. However, the items
that measure the Awareness dimension did not discriminate well and thus were
ambiguous and confusing to participants. Hence authors recommend that the
awareness subscale be re-worked to fit with the construct of emotional regula-
tion or expunged altogether from the scale. Norms for the composite and di-
mensions of DERS were established, and DERS is observed to be gender-sensitive
based on this.
The DERS is recommended for use in clinical settings, especially among people
with emotional disorders such as anxiety disorders, mood disorders, obsessive-
compulsive disorders, psychotic disorders, eating disorders, conduct disorders
and trauma-related disorders to assess emotion regulation. Also, the associations
between emotion regulation, impulsivity and suicidal behaviours can be properly
assessed using the DERS. Using the DERS could help make the proper diagnosis
and the correct treatment procedure. Also, researchers’ DERS can be used in re-
search settings to provide information on the factors of Emotion Dysregulation
across people in the general public and clinical settings.
Ethical Approval
Human subjects were used in this work; hence research ethics for human sub-
jects were followed in accordance with the Helsinki Declaration. The Internal
Research Ethics Committee of Redeemer’s University in Nigeria reviewed the
research purpose and recommended procedures. The National Code of Health
Research Ethics and the Nigerian National Health Research Ethics Committee
(NHREC) do not apply to this type of research.
Informed Consent
Prior to administering the instruments, respondents’ consent was requested.
Respondents were permitted to quit at any point throughout the survey because
participation was optional and confidentiality was guaranteed.
Conflicts of Interest
The authors declare no conflicts of interest regarding the publication of this pa-
per.
References
Aldao, A. (2013). The Future of Emotion Regulation Research: Capturing Context. Pers-
pectives on Psychological Science, 8, 155-172.
Anestis, M. D., Selby, E. A., & Joiner, T. E. (2007). The Role of Urgency in Maladaptive
Behaviours. Behaviour Research and Therapy, 45, 3018-3129.
Balaguer Pich, N., Sánchez Gómez, M., & García-Palacios, A. (2018). Relación entre la
regulación emocional y la autoestima. Ágora de Salut, 5, 273-380.
Bardeen, J. R., Fergus T. A., & Orcutt, H. K. (2012). An Examination of the Latent Struc-
Goubet, K. E., & Chrysikou, E. G. (2019). Emotion Regulation Flexibility: Gender Differ-
ences in Context Sensitivity and Repertoire. Frontiers in Psychology, 10, Article No.
935. https://doi.org/10.3389/fpsyg.2019.00935
Gratz, K. L., & Roemer, L. (2004). Multidimensional Assessment of Emotion Regulation
and Dysregulation: Development, Factor Structure, and Initial Validation of the Diffi-
culties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral As-
sessment, 26, 41-54.
Gratz, K. L., & Tull, M. T. (2010). The Relationship between Emotion Dysregulation and
Deliberate Self-Harm among Inpatients with Substance Use Disorders. Cognitive Thera-
py and Research, 34, 544-553.
Gross, J. J. (2015). Emotion Regulation: Current Status and Future Prospects. Psycholog-
ical Inquiry, 26, 1-26. https://doi.org/10.1080/1047840X.2014.940781
Gross, J. J., & Jazaieri, H. (2014). Emotion, Emotion Regulation, and Psychopathology:
An Affective Science Perspective. Clinical Psychological Science, 2, 387-401.
Hallion, L. S., Steinman, S. A., Tolin, D. F., & Diefenbach, G. J. (2018). Psychometric
Properties of the Difficulties in Emotion Regulation Scale (DERS) and Its Short Forms
in Adults with Emotional Disorders. Frontiers in Psychology, 9, Article No. 539.
https://doi.org/10.3389/fpsyg.2018.00539
Hayes, S. C., Wilson, K. G., Gifford, E. V., Follette, V. M., & Strosahl, K. (1996). Expe-
riential Avoidance and Behavioral Disorders: A Functional Dimensional Approach to
Diagnosis and Treatment. Journal of Consulting and Clinical Psychology, 64, 1152-1168.
https://doi.org/10.1037/0022-006X.64.6.1152
Hyde, J. S., Mezulis, A. H., & Abramson, L. Y. (2008). The ABCs of Depression: Integrat-
ing Affective, Biological, and Cognitive Models to Explain the Emergence of the Gend-
er Difference in Depression. Psychological Review, 115, 291-313.
https://doi.org/10.1037/0033-295X.115.2.291
Joiner, T. E. (2005). Why People Die by Suicide. Harvard University Press.
Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E.
(2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Valida-
tion and Replication in Adolescent and Adult Samples. Journal of Psychopathology and
Behavioral Assessment, 38, 443-455.
Keenan, K., & Hipwell, A. E. (2005). Preadolescent Clues to Understanding Depression in
Girls. Clinical Child and Family Psychology Review, 8, 89-105.
Kökönyei, G., Urbán, R., Reinhardt, M., Józan, A., & Demetrovics, Z. (2014). The Diffi-
culties in Emotion Regulation Scale: Factor Structure in Chronic Pain Patients. Journal
of Clinical Psychology, 70, 589-600.
Mann, J. J., Waternaux, C., Haas, G. L., & Malone, K. M. (1999). Toward a Clinical Model
of Suicidal Behaviour in Psychiatric Patients. American Journal of Psychiatry, 156,
181-189.
Messman-Moore, T. L., Walsh, K. L., & DiLillo, D. (2010). Emotion Dysregulation and
Risky Sexual Behaviour in Revictimisation. Child Abuse & Neglect, 34, 967-976.
https://doi.org/10.1016/j.chiabu.2010.06.004
Monell, E., Bjureberg, J., Nordgren, L., Hesser, H., & Birgegård, A. (2020). Factor Struc-
ture and Clinical Correlates of the Original and Short-Form of the Difficulties in Emo-
tion Regulation Scale (DERS) in Adolescents with Eating Disorders. Journal of Psy-
chopathology and Behavioral Assessment, 42, 111-126.
https://doi.org/10.1007/s10862-019-09765-8
Neumann, A., van Lier, P. A., Gratz, K. L., & Koot, H. M. (2010). Multidimensional As-