Sensors 18 02310 PDF
Sensors 18 02310 PDF
Article
A Smart Sensing Architecture for Domestic
Monitoring: Methodological Approach and
Experimental Validation
Andrea Monteriù 1, * ID , Mario Rosario Prist 1 , Emanuele Frontoni 1 ID , Sauro Longhi 1 ,
Filippo Pietroni 2 ID , Sara Casaccia 2 , Lorenzo Scalise 2 , Annalisa Cenci 1 , Luca Romeo 1 ,
Riccardo Berta 3 , Loreto Pescosolido 4 ID , Gianni Orlandi 5 and Gian Marco Revel 2 ID
1 Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy;
[email protected] (M.R.P.); [email protected] (E.F.); [email protected] (S.L.); [email protected] (A.C.);
[email protected] (L.R.)
2 Department of Industrial Engineering and Mathematical Sciences, Università Politecnica delle Marche,
60131 Ancona, Italy; [email protected] (F.P.); [email protected] (S.C.); [email protected] (L.S.);
[email protected] (G.M.R.)
3 Electrical, Electronics and Telecommunication Engineering and Naval Architecture Department,
Università degli Studi di Genova, 16145 Genoa, Italy; [email protected]
4 Italian National Research Council, Institute for Informatics and Telematics (CNR-IIT), 56124 Pisa, Italy;
[email protected]
5 Department of Information Engineering, Electronics e Telecommunications, University of Rome La Sapienza,
00184 Rome, Italy; [email protected]
* Correspondence: [email protected]; Tel.: +39-071-220-4314
Received: 5 June 2018; Accepted: 14 July 2018; Published: 17 July 2018
Abstract: Smart homes play a strategic role for improving life quality of people, enabling to
monitor people at home with numerous intelligent devices. Sensors can be installed to provide
a continuous assistance without limiting the resident’s daily routine, giving her/him greater comfort,
well-being and safety. This paper is based on the development of domestic technological solutions
to improve the life quality of citizens and monitor the users and the domestic environment, based
on features extracted from the collected data. The proposed smart sensing architecture is based
on an integrated sensor network to monitor the user and the environment to derive information
about the user’s behavior and her/his health status. The proposed platform includes biomedical,
wearable, and unobtrusive sensors for monitoring user’s physiological parameters and home
automation sensors to obtain information about her/his environment. The sensor network stores the
heterogeneous data both locally and remotely in Cloud, where machine learning algorithms and data
mining strategies are used for user behavior identification, classification of user health conditions,
classification of the smart home profile, and data analytics to implement services for the community.
The proposed solution has been experimentally tested in a pilot study based on the development of
both sensors and services for elderly users at home.
Keywords: smart homes; smart home technologies; aging; activity of daily living
1. Introduction
Life expectancy has increased significantly in the last years thanks to the rapid growth in medical
science. The number of people aged 65 and older is increasing [1]. Consequently, the percentage of
elderly people that prefer to stay in their homes and communities is growing: this phenomenon is
called “Aging in Place” [2]. In this context, smart home technologies could significantly support people
to have a better life quality, to live independently and to stay in contact with family and caregivers [3].
Thanks to their software and hardware components, smart homes allow collectin data and, thus, to
monitor the health status, the behavior and the life quality of elderly users, avoiding risky situations
and putting the users in contact with their family, caregivers and medical staff [4]. Thus, modern
sensor-embedded houses, or smart houses, can not only assist elderly people but also help to resolve
the social isolation they could face [5,6]. In this scenario, smart home technologies hold a great promise
for the future of healthcare and well-being of older adults, people with disabilities, and the general
population overall [7].
Smart homes have been extensively researched in the last years. The “Smart Rooms” implemented by
the MIT Media Lab [8] could be defined as the first approach to this topic. Thereafter, several papers
have been published on this topic with a wide range of prospective applications. A review of the state
of the art of smart homes is presented in [9–11], while an international selection of leading smart home
projects, as well as the associated technologies of wearable/implantable monitoring systems and assistive
robotics are presented in [5]. A review of sensor technology used in smart homes with a focus on direct
environment sensing and infrastructure mediated sensing is provided in [12]. A review of the potential
of smart homes to support independent living is provided in [13], identifying some of the health needs
of elderly people who could live at home if provided with adequate support, the range and type of
technologies that could be employed to this objective, and suitable metrics to be used to measure the
effectiveness of these technologies. Many research projects have been delivered on smart homes with the
objective to provide an ecosystem of medical and home automation sensors, computers or smartphone,
wireless networks [14] and software services for healthcare monitoring and control [5]. Many of them can
be grouped into distinct categories, such as projects for facilitating the connection between the elderly and
their informal caregiver, projects for monitoring health parameters and generate alerts messages in relation
to a specific programmable situation, or projects that realize the smart home monitoring with the focus to
learn and to predict the habits of its inhabitants in order to manage elderly safety and improve life quality.
The use of a new architecture and technologies for intelligent environments, which includes smart user
interface, dynamic configuration of the smart sensors, wireless control, tracking of the elderly people
and flexible user services interaction, was proposed by Brumitt et al. in the EasyLiving project [15] at
Microsoft Research. A multi-disciplinary research project, namely the CASAS Smart Home project, has
been presented by the Washington State University. The objective of the project was to improve the
safety, the life quality, the comfort and the state of the smart home residents using intelligent software
agents and sensors and environment controllers [16,17]. In [18], Cook et al. proposed an intelligent
and versatile home environment, namely MavHome project, which acquires data, and learns and
predicts the residents habits to maximize their comfort and wellness, while reducing operating cost.
The DOREMI project [19] is oriented to reduce the cognitive decline, malnutrition, and sedentariness of
elderly people, and to increase the social interaction with the use of cognitive virtual games and virtual
companion. The use of software platform and smart object permits to stimulate and to unobtrusively
monitor the elderly daily life activities. In addition, different AAL platforms and solutions exist and
have been studied in different European projects, see for instance [20–24]. Although the described
smart home projects apply very interesting concepts in real scenarios, they often do not integrate all
technological aspects such as biomedical sensors, wireless sensor network, home automation devices,
behavioral analysis, Cloud infrastructure, custom Cloud services and flexibility, interoperability and
extensibility of the acquisition software platform.
This paper is focused on the development of domestic technological solutions to improve the life
quality of citizens and monitor the users and the environment where they spend most of their time,
i.e., their house, based on features extracted from the collected data. The innovative system described
in this paper is based on an integrated sensor network to monitor the user and the environment to
derive information about the user’s behavior, her/his health status, her/his social condition, etc.
The proposed platform includes biomedical, wearable, and unobtrusive sensors for monitoring
user’s physiological parameters and home automation sensors to obtain information about her/his
Sensors 2018, 18, 2310 3 of 22
environment, e.g., energy consumptions, light status, user movement, etc. The sensor network stores
the heterogeneous data both locally and remotely in Cloud, where machine learning algorithms and
data mining strategies are used for user-health behavior identification, classification of user health
conditions, classification of the smart home profile, and data analytics to implement services for
the community. One of the aspects of our proposed architecture with respect to the existing ones is
the user interaction with the architecture, namely the way the user can interact with the system by
using, as a user interface, an Android app that can be run on most commercial smartphones/tablets
to perform biomedical measurements from any of the devices. More specifically, the app layout
depends on the specific logged-in user in a dynamic fashion. Each user is presented with the subset
of devices, among those present in the house, which she/he has the permission to use. The app
serves to initiate the measurement process from any of such devices. The proposed solution has
been experimentally tested in a pilot study carried out in a small city of Veneto Region, Italy, within
the context of the Health@Home project [25]. The pilot involved the development of both sensors
and services for elderly users at home. Thus, the ICT technologies, characteristics of a smart home,
are used to collect data and information, with the aim to provide ad-hoc services (e.g., care and
social services) for elderly users and to improve their quality of life. It is worth pointing out that
the idea of bringing integrated monitoring services to citizens’ homes, is not confined to the vertical
e-Health domain. In fact, the concept of “Smart Home” is well integrated in horizontal domains
such as “Smart Buildings” and “Smart Cities” [7,26,27]. The Health@Home project platform aims at the
overall development of an e-market place where services are offered, which make use of citizen’s data
collected in their home environments. The ultimate goal of the project is to generate service models
that are economically sustainable by coupling social/sanitary support (e.g., catering, social assistance,
etc.) with house-related interventions (e.g., maintenance of appliances) exploiting a unique ICT
platform. This is the reason for the sensor network architecture proposed in this paper, here specifically
exploited for advanced domestic monitoring as a part of the whole system.
The paper is organized as follows. The hardware and software of the proposed smart sensing
architecture are described in Section 2. The pilot case is detailed in Section 3, while an extensive
analysis of the results of the pilot study is presented in Section 4. Some remarks and future works
conclude this paper in Section 5.
The developed Physio Kit is characterized by devices satisfying several requirements. First,
the sensors are easy to use for elderly people. The choice has fallen on devices that are familiar to
the user (e.g., devices that are typically used with medical staff at hospitals, care centers, pharmacies,
etc.). Moreover, all the devices are characterized by an adequate measurement accuracy, a wireless
communication protocol (i.e., bluetooth) to avoid the need for the user to handle cables and plugs, and
a low cost. Table 1 reports the description of the selected biomedical devices.
• Thermostat (LN4691) is a device for the temperature monitoring and control inside the apartment,
equipped with a temperature probe.
• Green switch—IR and ultrasound (L4658N)—is a presence control system (Passive InfraRed-PIR).
All smart homes are equipped with at least two PIR for each apartment. The authors are
developing a tool to define the activities (behavior) of the older person inside the apartment
using the ON/OFF signals coming from the PIR. The PIR are usually installed near the door of
the bedroom and the bathroom and in some apartments in the kitchen, for others near the main
door or in the living room based on the apartment plan.
• Electrical consumption meters (F520) are installed in the TV, the washing machine and the oven.
• Light status (F411/4) are used to control the ON/OFF of the lights to define, together with the
PIR analysis, the behavior of the older user.
Sensors 2018, 18, 2310 6 of 22
Figure 3. Concept of the Smart Home architecture developed and tested in the pilot case.
The non-profit OSGi was born in 1999 by union of IBM, Oracle, Philips, Sun, etc., with the
aim to standardize the approach of modular applications development in the field of home and
industrial automation [28]. The OSGi framework has the goal to implement a clear specification for
building modular applications based on components and introduce a programming Service Oriented
Architecture (SOA), allowing a separation much more rigorous than the other native paradigms,
between the interface and its implementation. From the programming point of view, OSGi is a modular
system for Java language, which defines the modality to create modules and how to interact with
each other, at runtime. The OSGi architecture is composed by OSGi Framework and a set of bundles.
OSGi implements a centralized service-oriented architecture with loosely coupled services
(see Figure 4). The basic functionality is provided by the OSGi Framework to execute OSGi functions
and the environment to download and run bundles. In addition, OSGi is a dynamic modular
system where the modules can be installed, updated and uninstalled without affecting the entire
application. OSGi is focused on providing developers with software tools aimed at endowing strong
interoperability and modularity capabilities into the devised software. This was a major requirement for
Sensors 2018, 18, 2310 7 of 22
the selection of the framework to use in the development of different modules of the proposed software
architecture, given also to the heterogeneity of the devices’ manufacturers. In addition, the Service
Bridge itself exposes a server (exclusively accessible on the private Wi-Fi network of the apartment),
which communicates with an Android App installed on a dedicated smart device, namely a tablet,
and allows the end-user to perform the biomedical measurements, while interacting with the developed
Graphical User Interface (GUI). The same Android App comprises an ad-hoc module, which allows
the acquisition of all quantities and data from the sensor equipment, described before, sending them
to the Service Bridge. Finally, data storage is performed both locally (i.e., with a local database in the
Service Bridge) and on Cloud, using a dedicated data upload module. All these aspects are described
in detail in the following subsections. This architecture has been continuously developed within the
project and improved with respect to what described by authors in previous works [29,30].
all raw data are available for the Cloud repository, statistical information is firstly elaborated by a local
machine and, then, sent to Cloud Computing for further elaborations and analysis. Static tables also
include information about the processing time for the statistical analysis. An asynchronous scheduler,
integrated in a dedicated bundle, has been used to implement this functionality. This scheduler can
additionally schedule commands to run after a given delay and to periodically execute biometric data
processing, which increases computational efficiency. The number of tasks is directly related to the
number of different devices installed into the Service Bridge, and to the number of indicators to be
monitored. The proposed bundles architecture for the asynchronous scheduler (see Figure 5) consists
of three levels: Scheduler, Dispatcher, and Threshold. The Scheduler module runs a thread when each
event is verified. The Dispatcher module controls if the current event should be associated to a specific
indicator and it notifies to all subscribed services to run the related data processing. The Threshold
module executes the elaboration process. The implementation of each software-module has been
compliant with the OSGi open standard [31,32].
the measurement. In our pilot experiment, users were trained to use this application, by means of
documentation material provided by the experimenter and through in site demonstrations and tutorials.
In summary, the Health App communicates with the Service Bridge, which is then demanded to all the
following tasks, as described before (data acquisition, data storage to both local DB and Cloud, etc.).
The user interface of the Health App has been kept as simple as possible, also on the basis of the feedback
received by the volunteers that have been involved by us prior to the release of the App. Particularly,
it is not possible, from the App, to see the measurements, as it is intended to just provide a means
for users to let the measured values be stored in the local DB. The measurements can only be seen
through a dedicated web service, which acts at the Cloud level (see Section 2.3). If, on the home page
of the Health App, the user selects the environmental control, another App is started, hereafter called
Home Automation App. The Home Automation App is able to automatically collect data (e.g., PIR triggers,
lights on/off, and room temperature), without any additional required interaction. However, if wanted,
the user may access to the information about the Home Automation Kit with the Home Automation App
and, eventually, control the environment itself (e.g., turning on a light, as shown in Figure 6).
Figure 6. Snapshots of the Home Automation App for monitoring and control the environment.
Note that the main reason for the development of the Health App has been the necessity to trigger the
acquisition of the sensors. This is because of the non-feasibility, for the Service Bridge (i.e., for OSGI and
the adopted architecture), to deal with the identification of collected devices (only one communication is
allowed at each time). However, from the first conducted demos, some users found difficult to interact
with a technology that they are not aware of. For example, the authentication part, developed to be
in agreement with security standards, is not easily completed by all users. A second development
stage has been necessary to provide a suitable solution for these persons. Thus, an Android box has
been installed in some apartments. This device hosts both the home automation service (part of the
previously described Home Automation App), to collect the environmental measurements, together with
a dedicated scanning service. This service directly communicates with the Service Bridge (i.e., the server),
scans both Bluetooth and BLE devices connected at the moment, and sends a command to start the
acquisition (refer to Section 2.4 for the different user interaction flows). In this way, the acquisition can
be conducted by the user, without the need to interact with the Health App.
• User: An end-user of the health monitoring services offered through the platform.
• Device: A device (environmental sensors, physiological parameters monitoring gadget, home
automation appliances, etc.) which provides measurements about a user and stores the values on
the Cloud.
• Feature: A physical dimension that can be measured by a device (e.g., the heart rate, the environment
temperature, etc.).
• Raw measurement: The specific instance of a feature measurement, acquired by a device for a specific
user, stored in the local database and on the Cloud, and accessible by any service (to which the user
has subscribed) to implement its functions.
• Indicators: The definition of a particular function of a set of raw measurements (min, max, average,
etc.) computed for one user over a predefined time window, with the goal to extract particular
trends in the evolution of a physiological quantity value.
• Indicator values: The actual results of computations performed on a group of raw measurements,
according to the definition of an “indicator”.
Two different levels of storage are present to save data coming from the different devices:
the Smart Home and the Cloud level. The database implementation at both levels (SQL-based in the
first case and MongoDB-based in the second one) has been designed according to the above listed
abstract concepts. The first level, residing in the Smart Home architecture (Figure 3), consists of a local
DB, organized in different static and dynamic tables [29]. The static ones contain the lists, for the
apartment of interest, of different users, devices, features and indicators to be computed. The dynamic
tables are designed to collect all the raw quantities from sensors and the associated indicator values:
each raw datum is univocally identified by the combination of three ID numbers (user, device, and
feature). In addition, a computing bundle has been implemented to process the raw data for fixed time
span (i.e., daily, weekly or monthly) and store the result of such process (e.g., average, trend, etc.) in
a different dynamic table (the “Indicator values” table).
The second level consists of a Cloud DB. The Cloud exposes a web service and several REST APIs,
(called H@H APIs after the name of the Health@Home project (Figure 3)) for letting, on the one hand,
the data upload module periodically performs its upload tasks, and, on the other hand, authorized
users access the data from remote. Authorized users include the monitored users themselves,
and the authorized personnel conducting the Pilot study. Both the local and Cloud components are
equipped with several layers of protection, including HTTPS connections, credential and token-based
authentication, database encryption (at the Cloud level) or OS level encryption (at the local level),
selective IP authorization, etc. In any case, data stored on both DBs are anonymous, since different
users are just represented by alphanumeric users IDs. For the pilot case considered in this work,
the local DB was used to temporarily store data extracted by the physiological devices. Conversely,
data coming from the Home Automation Kit (i.e., collected through the Home Automation App, or service)
was directly sent to the Cloud. The data acquired in the pilot case are also kept available, for a limited
amount of time, on the Cloud database to allow their future processing and the development of
dedicated services from the involved research teams.
End User Android Device Biomedical device Service Bridge Cloud and local DB
Authentication
Credentials verification
Data matches
Device selected
Ask to perform measurement
Send data
OK (or error)
Figure 7. Overview of how the user interacts with the Health App and performs a measurement.
First, the user has to interact with the Android device (i.e., Health App) and with each individual
biomedical device. Once the App starts, the user proceeds with the authentication step, by means of
the username/password credentials. The App interacts with the local web server in the Service Bridge
and, if authenticated, the list of installed devices will be shown in the GUI of the App. Then, if the user
chooses a sensor, a new window will popup, which asks the user to start the physical measurement
procedure (e.g., the body weight). Notably, each user is presented with a personalized layout, including
only those devices (sensors), among those installed in the house, which she/he is entitled to use.
This is possible since the set of allowed devices is downloaded (from the Service Bridge) at each login.
The information on which user can use which device is contained in a table of the local database of
the Service Bridge. This approach has two advantages. First, it makes the interface more simple
for elderly users: if one user is interested in blood pressure monitoring only, and another one in
glycemia monitoring, each of them will see only the dedicated devices, making the interface simpler
to use. Second, as a user decides to start a new kind of monitoring, e.g., acquiring a new device,
or getting the permission to use a device already present in the house, but formerly used by another
user only, there is no need to update the app. In fact, only the user permission table on the Service
Bridge needs to be updated and, if the device is an entirely new one, the corresponding bundle
has to be installed in the Service Bridge, but this is completely transparent to the client app running
on the Android device, which will just get the updated information, from the Service Bridge, upon
login. Each BLE device adopted, once the measure has been conducted, will open the Bluetooth
communication channel, meaning that data are available to be collected. While the user selects the
“get data” button from the Health App, the same App communicates the bundle to be executed to
the Service Bridge, which starts collecting data from the sensors. If something goes wrong, an error
message will be communicated to the bundle. Otherwise, data collected will be sent to the storage
repositories (Cloud and local DB). The same procedure could be performed for each other biomedical
device. Finally, the user can exit the App through a dedicated button. In summary, the user interaction
with the Health App is reduced to these three steps: authentication, device acquisition trigger and
exit from application. Even if these tasks seem simple to be conducted, the steps described must be
performed sequentially, otherwise the acquisition procedure could generate errors, with potential
data loss. In fact, some users felt comfortable in using the App and the procedure explained, while
others found difficulties in interacting with the Android device. However, the totality of users was
Sensors 2018, 18, 2310 12 of 22
conscious of how to perform the biomedical measurements requested (i.e., body weight, pressure,
temperature and blood saturation/HR). This suggested the authors to provide a simplification of
the previous procedure, with the integration of an Android Box, as replacement of the smart device
(i.e., without an App and a GUI). The adoption of the new device provided a modification in the
user-machine interaction, which can be summarized in Figure 8.
End User Android BOX Biomedical device Service Bridge Cloud and local DB
Initial authentication
Device identified
Start selected bundle
Get data
Send data
OK (or error)
Repeat for other sensors
3. Pilot Case
The H@H pilot case, presented in this paper, is Oderzo, a small town in Veneto Region, where the
H@H consortium has identified, together with local entities, 13 older persons living in 8 apartments
that have been steadily monitored. The identification of the pilot case has followed these 4 phases:
• Phase #1: definition of the cohort, started on July 2017 and finished after two months;
• Phase #2: installations, from December 2017 to January 2018;
• Phase #3: user instructions, from the end of January 2018 to February 2018; and
• Phase #4: tests, running phase.
The decision to choose this cohort, Phase #1, is based on both user and apartment requirements.
The requirements for the users are: age (65–85 years old), gender (both males and females),
pathologies (not particular pathologies ), family group (user alone or couples), social status (normal)
and psychological and physiological conditions (not psychological disease and ability to perform
daily living activities). The apartment requirements are based on devices to be installed, electrical
system to be replaced or installed as new and web connectivity for all apartments. The matching
between the user and apartment requirements, defined the selected cohort for the considered
pilot case in Veneto Region. Phase #2 has been characterized from the collaborative work of the
installers together with the project researchers to define the installation strategies for each apartment.
Each apartment has a similar plan, so, the devices and sensors have been placed, taking into account
the structural and implant characteristics of the apartments. Note that the installation of smart home
equipment is comparable in each apartment (e.g., one PIR in the main bathroom, bedroom and living
room, and thermostat in the living room). Two of the considered plans are shown in Figure 9.
Phase #3 consisted on providing the instructions to the users for correctly making the measurements
(i.e., biomedical equipment). Although the authors made a user manual with the line guide to acquire
data and signals, a period of 2–3 days with the users was necessary to start with the measurement
setup. The test phase, namely Phase #4, is a complex part of the considered pilot case, where the authors
identified some problems in the user interaction with the technology. For this reason, the architecture of
the smart home sensor network required some changes, described in previously Section 2.2.
Sensors 2018, 18, 2310 13 of 22
• Indoor air temperature (average, standard deviation, range, maximum and minimum values);
Sensors 2018, 18, 2310 14 of 22
• Light status, as the total count of activation (i.e., living room, extractor hood, hallway,
main bedroom, main bathroom, bathroom mirror); and
• PIR, as the total activation event occurred in a fixed time (i.e., living room, main bedroom,
main bathroom).
Once the raw data of the home automation equipment were collected, they were manipulated to
derive the features described above.
The same methodology was applied to the following acquired common biomedical quantities:
• Heart rate (average, standard deviation, range, minimum and maximum values);
• Systolic pressure;
• Diastolic pressure;
• Mean Arterial Pressure;
• Oxygen saturation (average, standard deviation, range, minimum and maximum values);
• Body weight; and
• Body temperature.
For these features, given the fact that the self-monitoring was generally performed 2–3 times
a week (thus, fewer and asynchronous data with respect to the home automation ones), the missing
values were filled, with a zero-hold approach. This approach allowed producing a synchronized
matrix of features for the application of different classification techniques. However, since the filling of
data may be excessive, in the case of hourly analysis, the daily processing approach has been preferred.
The user’s behavior classification analysis, namely Case I, was conducted for five different homes,
where sufficient home automation and biomedical data were collected.
3.1.2. Case II: Classification of Health Condition from Home Automation Feature
The second analysis focused on the possibility to discriminate possible alert events for the user,
from a smart processing of the home automation quantities. Thus, differently from the previous case,
this analysis was intra-subject. The aim of such analysis was to evaluate if the user health status,
according to preliminary information given by her/his self-monitoring of several biomedical features,
can be deduced or predicted, with enough accuracy, by her/his behavior within the home. In this case,
the target response is the normal condition versus possible alert situation, identified through data
clustering of two biomedical features (i.e., unsupervised learning technique from daily median HR
and average systolic pressure quantities). In particular, the k-means approach was used to clusterize
the biomedical data [36], providing the corresponding annotation (i.e., normal versus alert condition).
This analysis was conducted for three different cases:
• An apartment (namely, Home 1), where a couple lives (namely, User 1 and User 2) and biomedical
data were collected for both. In this scenario, the focus is on assessing how the prediction analysis
may react (i.e., it is not possible to discriminate the home automation features for the different
users, while this can be performed for the biomedical quantities).
• An apartment (namely, Home 2), where a person lives alone and, thus both home automation and
biomedical data were related only to her/him.
• An apartment (namely, Home 3), where a couple lives (namely, User 1 and User 2) and biomedical
data were monitored only for one person. This case is interesting to see the accuracy of the
prediction, in the case the home automation features may present a higher dispersion, given by
the second person.
For this analysis, biomedical data (used for the identification of possible alerts) were not filled
(i.e., raw quantities with no zero-hold or any additional processing). In addition to the approach
discussed for the previous test, the data related to both light and PIR activations were also analyzed
hourly (i.e., for each day the total count of events for each hour). This allowed obtaining more
discriminating power for the classification of user’s health status.
Sensors 2018, 18, 2310 15 of 22
4. Results
Figure 10. Confusion matrices for the different tested approaches. The classification has been obtained
from the combination of health and home automation features, collected daily within the experimental
trials in Oderzo.
Figure 10 highlights that the combination of several heterogeneous features allows discriminating
the different user-house scenarios with high accuracy (i.e., >95% for all the cases). Going in details,
it is possible to conduct the same test using only the home automation features, or only the biomedical
ones. Table 2 summarizes the accuracies obtained when this analysis is applied.
Table 2. Results of the users’ discrimination according to the quantities adopted in the classification.
Looking at the data, it can be noticed that classifying the users through biomedical features produces
a higher accuracy with respect to their behavior (i.e., the home automation collected quantities). This is
because the higher inter-subject discriminant power of the physiological features, with respect to the other
Sensors 2018, 18, 2310 16 of 22
case, while a higher variability occurs due to the impossibility to associate a behavior (e.g., bathroom
light on) to a user respect to another in the same home. Another consideration is that there are some
physiological quantities, e.g., the body weight, that alone may be able to discriminate the single users,
if their values differs greatly. In this case, it is preferable to have a classification that considers more
features than the mere body weight. Thus, a deeper investigation has been performed for the DT
and NCFS applied techniques, to identify the most important predictors from the ones involved
in the classification. Figure 11 shows the percentage of the importance index, calculated from the
considered predictors.
DT NCFS
Figure 11. Percentage of importance of the health-related predictors for the classification of the users’
behavior and smart home profile.
As it can be noticed for the decision tree technique, it mostly considers the Weight feature for
the classification, while, on the contrary, the NCFS method makes use of all the predictors. Thus,
the second method should be preferred to the first one. Moreover, it is characterized by a higher
accuracy with respect to the other tested methods. The same analysis has been conducted for the
home automation features (see Figure 12), where it can be noticed that features related to the different
scenarios (e.g., features related to the bathroom, as PIR triggers and lights on/off) are all important for
a robust discrimination.
DT NCFS
Figure 12. Percentage of importance of the home automation-related predictors for the classification of
the users’ behavior and smart home profile.
Sensors 2018, 18, 2310 17 of 22
A statistical comparison with respect to chance level was performed for the macro-F1 score
computed for each fold of the cross-validation procedure. The macro-F1 is the F1 score averaged over
each class. Classifier performance exceeds chance level (i.e., macro-F1 = 0.5) in Home 1, User 2
(mean = 0.73, 95% CI = (0.573, 0.897), t9 = 3.29, p < 0.01) and in Home 2 (mean = 0.64,
95% CI = (0.548, 0.732), t9 = 3.44, p < 0.01), while it does not overcome chance level in Home 1
User 1 (mean = 0.58, 95% CI = (0.492, 0.678), t9 = 2.06, p = 0.0694), and in Home 3 (mean = 0.48,
95% CI = (0.393, 0.571), t9 = −0.45, p = 0.66). The obtained results suggest how the subject’s health
condition is often encoded in the human behavior. For the single-resident analysis (i.e., Home 2),
the results about the machine learning approach demonstrated how the situation of health alert is
quite correlated to a change of human behavior captured by the domotic sensors. When there are multi
inhabitants within the same apartment (i.e., Home 1 and Home 3), the human behavior is not always
a good predictor of situation of health alert. This can be related to: (i) the difficulty to discern every
single human behavior according to the domotic features; and (ii) the fact that the human behavior
of one user may not be correlated to the situation of health alert of the other user. This is confirmed
by the results represented in Figure 13 and Table 3. Although the best macro-F1 score is achieved
(on average) by “Home 1, User 2”, which presents a higher variability especially with respect to the
case of a single inhabitant (i.e., Home 2) (see Figure 13).
In fact, this is confirmed in the case of a single inhabitant (i.e., Home 2), where all the home
automation features are strictly related to the same user. On the contrary, the machine learning model
is not able to provide a clear distinction in the case of more persons living in the same apartment
(i.e., in Home 1 and Home 3). This assumption is confirmed by the results of the performed analysis.
However, the approach identified by the authors and discussed with these preliminary results is
Sensors 2018, 18, 2310 18 of 22
promising and will be better investigated and improved in future works. For example, the integration
of an electronic logbook, where the users can provide information about their daily health status may
be combined with the physiological features, in a semi-supervised manner, for improving the health
condition’s prediction will be considered.
0.9
0.8
0.7
0.6
Macro-F1
0.5
0.4
0.3
0.2
0.1
0
Daily Hourly Daily Hourly Daily Hourly Daily Hourly
Home 1 user1 Home 1 user2 Home 2 Home 3 user 1
5. Conclusions
In this paper, the authors present the design and implementation of a smart communication
architecture for user monitoring inside a domestic environment developed with an extensive
partnership. The authors propose an innovative idea of an interoperable embedded intelligent system,
where several simple and low-cost smart devices, both health sensors (Physio Kit) and home automation
sensors (Home Kit), are used to monitor the general health status and the behaviors of elderly people.
The chosen sensors are easy to use and non-invasive so that they can be easily accepted by an elderly
person. One of the main innovative aspects of our proposed architecture with respect to the existing
ones is the user interaction with the architecture in order to perform biomedical measurements. As for
the hardware, in addition to the sensors, the project includes the use of a gateway as well as a smart
device (i.e., a tablet) to display the App that interacts with the sensors. In addition, the App has been
designed to be user-friendly, easy to use and acceptable to elderly users. In fact, one of the major
problems encountered in AAL monitoring systems is precisely the non-acceptance or the inability to
use the system itself by the user, especially when dealing with the elderly. The main goal that AAL
systems must accomplish is to ensure the persons’ welfare, without, however, compromising the
dignity of the person. Hence, extreme attention has been taken into account by the authors to this
aspect of the system and, in this work, the authors propose an active approach to maintain the
Service Bridge as transparent as possible, which means that user interactions are kept to the minimum
required. An Android box has been installed in some apartments, which hosts the home automation
service that communicates directly with the Service Bridge without the need of sending a command to
start the biomedical parameters acquisition. In this way, the acquisition can be conducted by the
user, without the need to interact with the Health App or, in any case, only for data visualization.
Sensors 2018, 18, 2310 19 of 22
In any case, a period of user training was necessary, which lasted approximately one month, since
the combination of innovative technologies and elderly people requires time and efforts. The main
target of the project was the development and the implementation of the software architecture taking
into account in particular its modularity, scalability and extendibility, so the authors have decided
to use an OSGi framework. The performance analysis of a system connected to many smart homes
is another common problem of AAL monitoring systems, thus the use of a scalable architecture for
storage, analysis, and sharing of many data is necessary. Moreover, the OSGi framework enables the
integration of new sensors in a plug and play mode, only developing a new set of bundles without
modifying the software architecture.
The feasibility and appropriateness of the proposed architecture and technologies in the creation of
a low cost and flexible system has been successfully evaluated through an extensive experimentation.
The entire hardware and software architecture was installed in eight apartments. Data from biomedical
and home automation sensors were collected in the App and then sent to the Cloud where machine
learning algorithms were used for the user behaviors identification and data analytics to finalize
services for the elderly community. Experimentation has highlighted the stability of the novel adopted
architecture and allowed obtaining some very promising preliminary results about two aspects:
inter-subject classification, and intra-subject classification. In the first case, the classification of different
house profiles using the combination of all features (both home automation and health) allows the
discrimination of different house scenarios with high accuracy (mean ± std = 0.99 ± 0.01) and macro-F1
score (mean ± std = 0.99 ± 0.01). Moreover, an unsupervised approach was made to annotate data
on which to carry out more in-depth studies in the future (e.g., PIR sensors will be used with the
information of the timestamp to study user’s paths inside the house). In particular, in the second
study case, the authors used home automation data to predict and distinguish normal and abnormal
behavior. The machine learning algorithm learns the alert/normal condition from the clustering of
health data and the results are very promising, especially when the person lives alone (i.e., macro-F1:
mean = 0.64, 95% CI = (0.548, 0.732), t9 = 3.44, p < 0.01). In the future, these machine learning
algorithms could be used on the collected data to generate alarms when the activities carried out by the
user and monitored by home automation sensors deviate from the typical normal behavior of the user.
This could be a good solution for those elderly people who live alone and are not continuously assisted,
as these alarms could be sent to a family member or a caregiver to alert her/him of a possible problem.
In this way, the system could ensure an automatic management of alarms and allow detecting relevant
information that cannot be inferred from data visualization.
Author Contributions: Conceptualization, S.L., A.M., G.M.R., L.S. and G.O.; Data Curation, A.C., S.C., E.F., A.M.,
F.P., M.R.P., G.M.R. and L.R.; Formal Analysis, A.C., S.C., E.F., A.M., F.P., M.R.P. and L.R.; Funding Acquisition,
R.B., S.L., G.O., G.M.R. and L.S.; Investigation, S.C., A.M., F.P., L.P., G.M.R. and L.S.; Methodology, S.C., E.F.,
A.M., F.P., L.P., G.M.R. and L.S.; Project Administration, E.F., S.L., G.O. and G.M.R.; Resources, S.C., A.M., F.P.,
G.M.R. and L.S.; Software, R.B., A.C., S.C., E.F., F.P., L.P., M.R.P. and L.R.; Supervision, S.L., G.O., G.M.R. and L.S.;
Validation, E.F., A.M., G.M.R. and L.S.; Visualization, A.C., S.C., A.M., F.P., M.R.P. and L.R.; Writing—Original
Draft Preparation, R.B., A.C., S.C., F.P., L.P. and L.R.; and Review and Editing, S.C., A.M., F.P., M.R.P., G.M.R., L.R.
and L.S.
Funding: This research is part of the project “HEALTH@HOME” which was funded by Italian Ministry of
Education, Universities and Research under grant number SCN_0558.
Acknowledgments: The authors thank the “A.T.E.R. Treviso (territorial company for residential construction in
the province of Treviso)” for the support in the selection of the pilot units, and the MR&D technicians for their
technical support during the installations.
Conflicts of Interest: The authors declare no conflict of interest.
Sensors 2018, 18, 2310 20 of 22
Abbreviations
The following abbreviations are used in this manuscript:
References
1. Thapliyal, H.; Nath, R.K.; Mohanty, S.P. Smart Home Environment for Mild Cognitive Impairment
Population: Solutions to Improve Care and Quality of Life. IEEE Consum. Electron. Mag. 2018, 7, 68–76.
[CrossRef]
2. Peek, S.T.; Wouters, E.J.; van Hoof, J.; Luijkx, K.G.; Boeije, H.R.; Vrijhoef, H.J. Factors influencing acceptance
of technology for aging in place: A systematic review. Int. J. Med. Inform. 2014, 83, 235–248. [CrossRef]
[PubMed]
3. Wilson, C.; Hargreaves, T.; Hauxwell-Baldwin, R. Smart homes and their users: A systematic analysis and
key challenges. Pers. Ubiquitous Comput. 2015, 19, 463–476. [CrossRef]
4. Amiribesheli, M.; Bouchachia, H. A tailored smart home for dementia care. J. Ambient Intell. Humaniz. Comput.
2018, 1–28. [CrossRef]
5. Chan, M.; Estève, D.; Escriba, C.; Campo, E. A review of smart homes: Present state and future challenges.
Comput. Methods Programs Biomed. 2008, 91, 55–81. [CrossRef] [PubMed]
6. Cook, D.J. How smart is your home? Science 2012, 335, 1579–1581. [CrossRef] [PubMed]
7. Van Hoof, J.; Demiris, G.; Wouters, E.J. Handbook of Smart Homes, Health Care and Well-Being; Springer:
New York, NY, USA, 2017.
8. Pentland, A.P. Smart rooms. Sci. Am. 1996, 274, 68–76. [CrossRef]
9. Harper, R. Inside the Smart Home; Springer: New York, NY, USA, 2006.
10. Chan, M.; Campo, E.; Estève, D.; Fourniols, J.Y. Smart homes current features and future perspectives.
Maturitas 2009, 64, 90–97. [CrossRef] [PubMed]
11. De Silva, L.C.; Morikawa, C.; Petra, I.M. State of the art of smart homes. Eng. Appl. Artif. Intell. 2012,
25, 1313–1321. [CrossRef]
12. Ding, D.; Cooper, R.A.; Pasquina, P.F.; Fici-Pasquina, L. Sensor technology for smart homes. Maturitas 2011,
69, 131–136. [CrossRef] [PubMed]
13. Fox, C.; Rodrigues, L.T.; Altomonte, S.; Gillott, M.C. A review of the potential of smart homes to support
independent living. In Proceedings of the 16th International Conference on Sustainable Energy Technologies,
Bologna, Italy, 17–20 July 2017.
Sensors 2018, 18, 2310 21 of 22
14. Ciabattoni, L.; Freddi, A.; Longhi, S.; Monteriù, A.; Pepa, L.; Prist, M. An open and modular hardware
node for wireless sensor and body area networks. J. Sens. 2016. [CrossRef]
15. Brumitt, B.; Meyers, B.; Krumm, J.; Kern, A.; Shafer, S. Easyliving: Technologies for intelligent environments.
In Proceedings of the International Symposium on Handheld and Ubiquitous Computing, Bristol, UK,
25–27 September 2000; pp. 12–29.
16. Cook, D.; Schmitter-Edgecombe, M.; Crandall, A.; Sanders, C.; Thomas, B. Collecting and disseminating
smart home sensor data in the CASAS project. In Proceedings of the CHI Workshop on Developing
Shared Home Behavior Datasets to Advance HCI and Ubiquitous Computing Research, Boston, MA, USA,
4–9 April 2009; pp. 1–7.
17. Cook, D.J.; Crandall, A.S.; Thomas, B.L.; Krishnan, N.C. CASAS: A smart home in a box. Computer 2013,
46, 62–69. [CrossRef] [PubMed]
18. Cook, D.J.; Youngblood, M.; Heierman, E.O.; Gopalratnam, K.; Rao, S.; Litvin, A.; Khawaja, F. MavHome:
An agent-based smart home. In Proceedings of the First IEEE International Conference on Pervasive
Computing and Communications, Fort Worth, TX, USA, 23–26 March 2003; pp. 521–524.
19. Palumbo, F.; La Rosa, D.; Ferro, E.; Bacciu, D.; Gallicchio, C.; Micheli, A.; Chessa, S.; Vozzi, F.; Parodi, O.
Reliability and human factors in Ambient Assisted Living environments. J. Reliab. Intell. Environ. 2017,
3, 139–157. [CrossRef]
20. CAALYX : Complete Ambient Assisting Living Experiment. FP6-IST Project ID: 045215. 2008. Available
online: https://cordis.europa.eu/project/rcn/80528_en.html (accessed on 16 July 2018).
21. AALIANCE: European Ambient Assisted Living Innovation Alliance. FP7-ICT Project ID: 217050. 2010.
Available online: https://cordis.europa.eu/project/rcn/85562_it.html (accessed on 16 July 2018).
22. PERSONA: Perceptive Spaces Promoting Independent Aging. FP6-IST Project ID: 045459. 2010. Available
online: https://cordis.europa.eu/project/rcn/80532_it.html (accessed on 16 July 2018).
23. ReAAL: Make It ReAAL. CIP Project ID: 325189. 2016. Available online: https://cordis.europa.eu/project/
rcn/191949_it.html (accessed on 16 July 2018).
24. IN LIFE: INdependent LIving Support Functions for the Elderly. H2020 Project ID: 643442. 2018. Available
online: https://cordis.europa.eu/project/rcn/194067_it.html (accessed on 16 July 2018).
25. Pescosolido, L.; Berta, R.; Scalise, L.; Revel, G.M.; De Gloria, A.; Orlandi, G. An IoT-inspired cloud-based
web service architecture for e-health applications. In Proceedings of the IEEE International Smart Cities
Conference, Trento, Italy, 12–15 September 2016; pp. 1–4.
26. Klein, C.; Kaefer, G. From smart homes to smart cities: Opportunities and challenges from an industrial
perspective. In Proceedings of the International Conference on Next Generation Wired/Wireless Networking,
St. Petersburg, Russia, 3–5 September 2008; p. 260.
27. Granzer, W.; Praus, F.; Kastner, W. Security in building automation systems. IEEE Trans. Ind. Electron. 2010,
57, 3622–3630. [CrossRef]
28. Alliance, O. OSGi Service Platform, Core Specification, Release 4, Version 4.1; OSGi: San Ramon, CA, USA, 2007.
29. Scalise, L.; Pietroni, F.; Casaccia, S.; Revel, G.M.; Monteriù, A.; Prist, M.; Longhi, S.; Pescosolido, L.
Implementation of an “at-home” e-health system using heterogeneous devices. In Proceedings of the IEEE
International Smart Cities Conference, Trento, Italy, 12–15 September 2016; pp. 1–4.
30. Casaccia, S.; Pietroni, F.; Calvaresi, A.; Revel, G.M.; Scalise, L. Smart Monitoring of User’s Health at Home:
Performance Evaluation and Signal Processing of a Wearable Sensor for the Measurement of Heart Rate and
Breathing Rate. In Proceedings of the International Joint Conference on Biomedical Engineering Systems
and Technologies, Rome, Italy, 21–23 February 2016; pp. 175–182.
31. Cheng, S.T.; Wang, C.H.; Horng, G.J. OSGi-based smart home architecture for heterogeneous network.
Expert Syst. Appl. 2012, 39, 12418–12429. [CrossRef]
32. Blasco, R.; Marco, Á.; Casas, R.; Cirujano, D.; Picking, R. A smart kitchen for ambient assisted living. Sensors
2014, 14, 1629–1653. [CrossRef] [PubMed]
33. Breiman, L. Classification and Regression Trees; Routledge: London, UK, 2017.
34. Yang, W.; Wang, K.; Zuo, W. Neighborhood Component Feature Selection for High-Dimensional Data.
J. Comput. 2012, 7, 161–168. [CrossRef]
Sensors 2018, 18, 2310 22 of 22
35. Vapnik, V. The Nature of Statistical Learning Theory; Springer: New York, NY, USA, 2013.
36. Lloyd, S. Least squares quantization in PCM. IEEE Trans. Inf. Theory 1982, 28, 129–137. [CrossRef]
c 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).