Teenagers' Stress Detection Based On Time-Sensitive Micro-Blog Comment/Response Actions
Teenagers' Stress Detection Based On Time-Sensitive Micro-Blog Comment/Response Actions
on Time-Sensitive Micro-blog
Comment/Response Actions
1 Introduction
The increasingly faster life pace in the competitive society often makes people
stressful, especially for teenagers who are too immature to deal with psycholog-
ical pressures. Currently, 20% teenagers have psychological illness around the
world [2]. An online survey of 1018 U.S. teens (aged 13-17) made by the Amer-
ican Psychological Association in August, 2013 found that teens suffered stress
in all areas of their lives, from school to friends, work and family, which nega-
tively affected every aspect of their lives, and about 27% of the teens experienced
extreme stress and 55% experienced moderate stress in the past school year [4].
If such pressures cannot get properly relieved in time, the teenagers will suf-
fer severe physical and mental problems under accumulated pressures, such as
clinical depressions, insomnia, and even committing suicide. According to China
Center for Disease Control and Prevention [1], suicide has become the top cause
of death among Chinese youth, and excessive stress is considered to be a major
factor of suicide. Also in Korea, suicide has become teenagers’ No.1 killer in
c IFIP International Federation for Information Processing 2015
T. Dillon (Ed.): IFIP AI 2015, IFIP AICT 465, pp. 26–36, 2015.
DOI: 10.1007/978-3-319-25261-2 3
Teenagers’ Stress Detection Based on Time-Sensitive Micro-blog 27
the past two years [3]. Annual increase of adolescent suicide rate has become a
world-wide common problem.
As adolescence is a critical period for one’s growth and development, it has
significant value to pay attention to teenagers’ psychological status and dis-
cover their suffering pressures in time. With the popularity of social networks,
micro-blog offers another low-cost sensing channel to analyze teenagers’ psycho-
logical pressures through their tweets, since more and more teenagers turn to
micro-blog for information acquisition, personal interaction, self-expression, and
emotion release. Some research work has already made efforts to detect user’s
stress and depression through micro-blog by analyzing their tweeting behav-
iors [8,9,13,15,18]. Leveraging tweeting contents such as linguistic and visual
features to analyze user’s stress has been proven feasible [11,16]. However, a
tweet faces the limitation of only 140 characters, which is too short to provide
enough content information to figure out stress and sometimes users may not
express their stress so directly. To address the limitation, we propose to further
involve comment/response acts under the tweet (comments, responses, likes and
forwards) to better supplement stress detection. Such interactions are attached
with unique timestamps. Considering time sensitivity, we select the interactions
within a certain time gap right after the tweet is posted and construct a time-
sensitive feature space for stress detection together with content of the tweet.
Based on [16], we combine the content of both the tweet and time-sensitive com-
ment/response acts under the tweet to extract content features for the four stress
categories (academic, affection, interpersonal, self-cognition), respectively. From
the observations that stressful tweets often receive more comments from friends,
especially comments with care, comfort and encourage, and the psychological
study [5] that users get inactive when suffering stress, we extract several novel
interacting behavior features such as effective comment rate, reply rate, effective
reply rate, and average interaction depth to help improve the stress detection.
Our user study of 36 high school teenagers shows that time sensitivity of com-
ment/response acts plays a significant role in stress detection and such acts in
30 minutes after the tweet posted are proved to be the most effective. Involving
such interaction acts improves the detection performance by 23.5%.
To the best of our knowledge, this is the first work combining tweet contents
and time-sensitive comment/response acts under the tweet for stress detection.
There are also no previous stress detection work, specifying features for different
stress categories.
The remainder of the paper is organized as follows. We review the related
work in Section 2. Section 3 analyzes and extracts features from time-sensitive
comment/response acts for teens’ stress detection. Experimental performance
through a real user study is evaluated in Section 4. Finally, we conclude the
paper in Section 5.
2 Related Work
Computer-aided sentiment analysis and applications in social network has drawn
much attention in recent years [10,11,16,19]. Many studies focus on the sin-
28 L. Zhao et al.
user’s responses. When Δt is big enough, then SI Δt contains all the comments,
replies, likes and forwards under p.
As in [16], let Category ={academic, affection,interpersonal,self-cognition} be
the set of teenagers’ stress categories involved in the study, and Level ={null,
light, moderate,strong} be the set of stress levels, where null means no-stress. For
a single tweet p, we leverage time-sensitive interaction acts SI Δt together with
content of p to form a feature space. Exploiting classification methods, the stress
detection result of p is represented as Stress(p) = ((Ci , Lv1 ), . . . , (C4 , Lv4 )),
where Ci ∈ Category and Lvi ∈ Level . If ∀Lvi = null (i = 1, . . . , 4), then Stress(p)
is a zero vector and p is a non-stressful tweet. Without loss of generality, we call
those tweets with non-zero stress vector stressful posts.
dialog as a whole, and regard it as an item piece of CCont(p, Δt). For each item
piece in CCont(p, Δt), we leverage a graph-based Chinese parser [6,7] to analyze
linguistic associations, including the correspondence between stress categories
and negative emotion words, and the grammatical relation between adverbs of
degree and the modified negative emotion words, etc. A single tweet may con-
vey several kinds of stress at the same time. Thus, for each stress category in
Category , we specify content features from CCont(p, Δt) as in [16]. i.e., number
of negative emotion words, number of positive and negative emoticons, number
of exclamation and question marks, emotional degree, etc.
Commenting Features from Crowd. Comments, likes and forwards are basic
commenting features and always show the social attention to a tweet.
Number of Comments from Friends. The set of all the comments under the
tweet p within [t0 , t0 + Δt] is
Comments (F, p, Δt) = Comm (f, p, Δt)
f ∈F
Number of Likes. People always put a like seal on a tweet to show their
positive emotion or attitude to the tweet. Compared with those positive tweets,
stressful tweets (negative tweets) obtain much less likes, even no like. We take
the number of likes under a tweet as an indicator of potential stress, denoted as
|Likes (F, p, Δt)|.
Number of Forwards. Users tend to forward public information such as news,
advertisements and jokes, and seldom retweet personalized stressful tweets of
another user. So stressful tweets enjoy less possibility to be forwarded by friends.
The number of forwards here is denoted as |Fwrds (F, u, p, Δt)|.
Number of Effective Comments. Among all the comments from friends,
we further check the details of the comments and distinguish those contain-
ing care, comfort, or encourage (e.g., “What’s up?”, “Don’t worry”, “Every-
thing will be OK”, or hug emoticon, etc.). Such comments are considered as
effective comments. The set of effective comments under tweet p is denoted as
EComments (F, p, Δt). A lexicon with 132 such Chinese phrases, sentences and
emoticons is constructed to identify effective comments. A tweet with more effec-
tive comments is more likely to be stressful.
Teenagers’ Stress Detection Based on Time-Sensitive Micro-blog 31
Replying Features of the User. Besides the social behaviors of the crowd
(friends), behaviors of the user himself also make sense in stress detection. Psy-
chological study [5] shows that a user in stress may perform low activeness
in social networks. Such inactiveness can be revealed from user’s reactions to
the comments from friends. Three features corresponding to the user’s replying
behaviors are identified.
Reply Rate. If a user is absorbed in big stress, s/he tends to be inactive, which
can be revealed from his/her activeness of reply to the comments. The reply rate
(short for RR, denoted as RR(u, p, Δt)) is calculated by the rate of replies over
total number of comments. Assume Replies (u, F, p, Δt) = f ∈F Rep (u, f, p, Δt)
is the set of user replies to all the friends under p, then
|Replies (u, F, p, Δt)|
RR(u, p, Δt) =
|Comments (F, p, Δt)| + 1
A lower reply rate suggests that the user is not so active and it is highly
possible that s/he is suffering stress. Similarly, among the three features (number
of comments/replies, and reply rate), we can deduce the other one with any two.
Effective Reply Rate. Effective replies are those responses to the effective
comments. The set of effective replies under p within [t0 , t0 + Δt] is
EReplies (u, F, p, Δt) = {r|r.c ∈ EComments (F, p, Δt), r.tr ∈ [t0 , t0 + Δt]}
We measure the effective reply rate (short for ERR, denoted as ERR(p, Δt)) by
the proportion of effective reply over the total number of effective comments.
|EReplies (u, F, p, Δt)|
ERR(p, Δt) =
|EComments (F, p, Δt)| + 1
comment-reply dialog under tweet p, then the interaction depth between f and
u in tweet p within [t0 , t0 + Δt] is calculated as
iDep(f, u, p, Δt) = min(|Comm (f, p, Δt)|, |Rep (u, f, p, Δt)|)
For all the friends who comment the tweet, the average interaction depth is
computed by
1
avg iDep(F, u, p, Δt) = iDep(f, u, p, Δt)
|F |
f ∈F
The average interaction depth reveals the user’s activeness as well. The smaller
the average interaction depth is, the less active the user performs, so that s/he
has a higher risk of stress suffered.
4 Experimental Study
4.1 Setup
Psychological stress detection is a highly personalized issue and there are no
available benchmark specially for the problem. In this work, we collect data
ourselves and conduct a user study on a real micro-blog data set. 36 high school
students (15 males and 21 females, aged between 15 and 17) in Shaanxi Province,
China, participated in the user study. 21,648 tweets from 2013/1/1 to 2015/5/1
were collected from their accounts in Tencent Weibo1 , averagely 636 tweets per
teenager. Recalling the real situations, they were asked to scan their own tweets
one by one and annotated the psychological stress on the four stress categories in
Category and corresponding stress levels in Level expressed in each single tweet.
We take the annotation as the ground truth. For each teenager, chronologically,
we use the early 66% of his/her tweets as the training data, and the rest 34% as
the testing data.
1
One of the biggest Chinese micro-blog platform, http://t.qq.com/
Teenagers’ Stress Detection Based on Time-Sensitive Micro-blog 33
5 Conclusion
In this paper, together with content of tweets, we involve time-sensitive com-
ment/response acts under a tweet to help better detect stress revealed from a
teenager’s tweet. Focusing on the four main categories of adolescent stress (aca-
demic, affection, interpersonal, and self-cognition), we specify content features
for each stress category, and involve several novel features extracted from time-
sensitive comment/response acts. 33 high school students aged 17 participated in
our user study to evaluate the framework. Experimental results show that stress
detection performance varies with different time sensitivity, and involving com-
Teenagers’ Stress Detection Based on Time-Sensitive Micro-blog 35
References
1. The week news. http://theweek.com/article/index/252199/the-rise-of-youth-suici-
de-in-china
2. Sohu news (2012). http://learning.sohu.com/s2012/shoot/
3. Sohu news (2013). http://learning.sohu.com/20130402/n371458123.shtml
4. USA today (2014). http://www.usatoday.com/story/news/nation/2014/02/11/
stress-teens-psychological/5266739
5. Social media and the cost of caring (2015). http://www.pewinternet.org/files/
2015/01/PI Social-media-and-stress 0115151.pdf
6. Che, W., Li, Z., Guo, Y., Qin, B., Liu, T.: Multilingual dependency-based syntactic
and semantic parsing. In: Proc. of CoNLL, pp. 49–54 (2009)
7. Che, W., Li, Z., Liu, T.: LTP: a chinese language technology platform. In: Proc.
of Coling, pp. 13–16 (2010)
8. Choudhury, M., Counts, S., Horvitz, E.: Social media as a measurement tool of
depression in populations. In: Proc. of ACM Web Science, pp. 47–56 (2013)
9. Choudhury, M., Gamon, M., Counts, S., Horvitz, E.: Prediction depression via
social media. In: Proc. of ICWSM (2013)
10. Li, Q., Xue, Y., Jia, J., Feng, L.: Helping teenagers relieve psychological pressures:
a micro-blog based system. In: Proc. of EDBT, pp. 660–663 (2014)
11. Lin, H., Jia, J., Guo, Q., Xue, Y., Huang, J., Cai, L., Feng, L.: Psychological stress
detection from cross-media microblog data using deep sparse neural nework. In:
Proc. of ICME, pp. 1–6 (2014)
12. Lin, H., Jia, J., Guo, Q., Xue, Y., Li, Q., Huang, J., Cai, L., Feng, L.: User-level
psychological stress detection from social media using deep neural network. In:
Proc. of MM, pp. 507–516 (2014)
13. Park, M., McDonald, D., Cha, M.: Perception differences between the depressed
and non-depressed users in twitter. In: Proc. of ICWSM (2013)
14. Tan, C., Lee, L., Tang, J., Jiang, L., Zhou, M., Li, P.: User-level sentiment analysis
incorporating social networks. In: Proc. of SIGKDD, pp. 1397–1405 (2011)
15. Wang, X., Zhang, C., Ji, Y., Sun, L., Wu, L.: A depression detection model based
on sentiment analysis in micro-blog social network. In: Proc. of PAKDD (2013)
16. Xue, Y., Li, Q., Jin, L., Feng, L., Clifton, D.A., Clifford, G.D.: Detecting adolescent
psychological pressures from micro-blog. In: Zhang, Y., Yao, G., He, J., Wang, L.,
Smalheiser, N.R., Yin, X. (eds.) HIS 2014. LNCS, vol. 8423, pp. 83–94. Springer,
Heidelberg (2014)
17. Yang, Y., Jia, J., Zhang, S., Wu, B., Chen, Q., Li, J., Xing, C., Tang, J.: How do
your friends on social media disclose your emotions. In: Proc. of AAAI
36 L. Zhao et al.
18. Shen, Y., Kuo, T., Yeh, I., Chen, T., Lin, S.: Exploiting temporal information
in a two-stage classification framework for content-based depression detection. In:
Proc. of PAKDD, pp. 276–288 (2013)
19. Zhang, Y., Tang, J., Sun, J., Chen, Y., Rao, J.: Moodcast: emotion prediction via
dynamic continuous factor graph model. In: Proc. of ICDM
20. Zhao, J., Dong, L., Wu, J., Xu, K.: Moodlens: an emoticon-based sentiment analysis
system for chinese tweets. In: Proc. of SIGKDD, pp. 1528–1531 (2012)