sustainability

Article
A Systemic Design Method to Approach Future
Complex Scenarios and Research Towards
Sustainability: A Holistic Diagnosis Tool
Chiara Battistoni * , Carolina Giraldo Nohra and Silvia Barbero
Politecnico di Torino, Department of Architecture and Design, Viale Pier Andrea Mattioli, 39, 10125 Torino, Italy
* Correspondence: [email protected]




Received: 25 June 2019; Accepted: 9 August 2019; Published: 17 August 2019


Abstract: This article aims to frame the role of Systemic Design (SD) as an alternative design
model for the future of design for sustainability, by defining and assessing a structured process to
execute Holistic Diagnosis (HD), an innovative context framework. Taking as its background a deep
understanding of the design for sustainability and systems thinking concepts that frame SD as a field
where HD is rooted, multiple case-study analyses were performed. HD demonstrates its ability to
overcome the design boundaries in different fields such as industrial production, local communities,
and policy-making, thereby providing a more in-depth understanding of complex environments with
an iterative process: assess, research, collect, visualize, and interpret. This framework is a relevant tool
for designers to address problem framing in complex scenarios to obtain future sustainable solutions
with an innovative and transdisciplinary approach, thereby promoting a horizontal dialogue among
all involved components.

Keywords: design for sustainability; systemic design; systems thinking; Holistic Diagnosis

1. Introduction
More than ever before, nations today are experiencing erratic disruptions, which are correlated
to climate change, economic inequalities, and war, exacerbating more and more what are known as
irresolvable “wicked problems” [1]. The wide complexity of these problems is defined by multiple
interconnections and interdependences, involving different factors [2]. How can we navigate such
complexity to attain a sustainable and resilient future? What strategies must communities, governments,
and industries address towards enabling resilient territories and ensuring the future of natural and
social resources?
The first step towards such sustainable livelihoods comes from paradigm shifts: discoveries in
physics—quantum theories—have permitted the transition from Cartesian and Newtonian mechanisms
(a linear model) to a holistic and ecological view of life [3]. Kate Raworth has interpreted this
phenomenon in economic terms as a change in the mentality of 21st-century economists. In this
framework, a different economy must be embedded and based on a dynamic complexity, which is
distributive and regenerative by design, created by adaptable social humans who have grown agnostic
and stay inside the safe zone for humanity, which they consider the planetary boundaries that Raworth
called the “doughnut” [4].
These approaches towards complexity and its wickedness are based on the statement that “Systemic
and inter-connected problems need systemic and inter-connected solutions” [5]. Consequently,
these problems require the participation of experts from diverse background disciplines to achieve
innovative solutions. Facilitating possible dialogues among technicians, economists, humanists,
and many more, the designer acquires a key role, which is underlined by his/her competences and

Sustainability 2019, 11, 4458; doi:10.3390/su11164458 www.mdpi.com/journal/sustainability

Sustainability 2019, 11, 4458 2 of 30

high skills as a “mediator” [6,7]. For his/her capability as an expert in designing future scenarios [8],
a transition in design discipline also takes place—from the limited perspective of product designer for
the industry to a designer of complex systems collaborating with many other experts.
To be able to determine sustainable solutions for complex scenarios, Systemic Design (SD)
expertise provides a method to tap into the holistic analysis of these contexts, allowing the design
discipline an opportunity to create autopoietic open systems based on contextual assets. This article
aims to frame the role of SD as an alternative design model and strategy for the future of design
for sustainability, which is based on Holistic Diagnosis (HD). Due to the importance of this tool as
an innovative context framework to obtain a holistic picture of the state-of-the-art and to determine
advantages for change, this article defines and assesses a structured process to execute HD, taking as
its background a deep understanding of the Design Thinking and Systems Thinking (ST) concepts,
which frame the process to define it. This disruptive approach improves Design methodologies in the
first phase of problem definition and research, making the HD a relevant tool for designers to address
problems and framing complex scenarios within an innovative and transdisciplinary approach, thereby
promoting a horizontal dialogue among all involved components. Ultimately, fostering synergies
between disciplines like design, technology, economics, and sociology, which are fundamental for
finding innovative and anticipatory solutions for holistic and complex changes.
SD has emerged as an approach to provide systemic and interconnected solutions to the
complexity of the current situation, encompassing economic, environmental and social contexts.
P.H. Jones, a relevant thinker about the SD discipline, understands SD as a merge between
human-centred design and multi-stakeholder service system design, as its application has moved
from artefacts and communication, products, and services, to organizational transformation and
social transformation—four domains that have increased their complexity [9]. SD represents “an
integrative interdiscipline with the potential to implement systems theory with creative methods and
mindsets, by bringing deep technical knowledge, aesthetic skill, and creative implementation to the
most abstract programmes of collective action” [10]. A systemic designer embodies traditional design
competencies—form and process reasoning, social and generative research methods, and sketching
and visualization practices—being, moreover, able to “describe, map, propose and reconfigure complex
services and systems . . . (they view design as) . . . an advanced practice of rigorous research and
form-giving methods, practices of critical reasoning and creative making, and of sub-disciplines and
deep skillsets” [9].
Today, SD has a worldwide relevance. International research networks, such as the Systemic
Design Research Network (SDRN) [11], have approached the topic since 2012, and the Systemic
Design Association (SDA) [12] was created in 2018 and features the involvement of the Oslo School of
Architecture and Design, Ontario College of Art and Design University in Toronto and Politecnico di
Torino in Italy.
In the early 20000 s, a research group at the Department of Architecture and Design in Politecnico
di Torino (Italy) (with the ZERI foundation [13]) developed a particular SD approach as a step forward
for eco-design to reach a blue economy and Circular Economy. This group wanted to model production
and energy systems after nature’s principles, primarily connecting their outputs and inputs to reach
zero emissions in the air, water, and soil (Figure 1). SD’s main goal is to promote a paradigm shift,
thereby providing a new way to act with:

1. A change in the management of resources, improving production processes through a continuous

transformation of matter, and
2. To activate new relationships between subjects, producing a general wellness improvement in
people [14].
• Autopoiesis: Self-producing systems sustain themselves by reproducing automatically, defining
their own paths of action and coevolving together;
• Acting locally: The local context becomes fundamental because it values local resources
(humans, cultures, and materials);
• Human at the centre of the project: A human being is considered connected to its environmental,
Sustainability 2019, 11, 4458 3 of 30
social, cultural, and ethical context, and its needs become central in design requirements.

Figure 1. A graphic visualisation of the material flows in the Systemic Design approach at Politecnico
Figure 1. A
di Torino graphic visualisation of the material flows in the Systemic Design approach at Politecnico
(Italy).
di Torino (Italy).
This SD approach is developed around five guidelines [14]:
The use of this approach to design production processes has several positive outcomes [15]:
• Output–input: The output (waste) of a system becomes the input (resource) for another one;
•• Environmental:These
Relationships: A lower consumption
relationships of the
generate local resources and the use of more sustainable
system;
• production processes;
Autopoiesis: Self-producing systems sustain themselves by reproducing automatically, defining
• Social:
their Thepaths
own creation of new
of action jobs
and linked to together;
coevolving the cultural and spatial places of belonging;
•• Economic:
Acting The The
locally: optimization of resources
local context minimizes costs
becomes fundamental and itincreases
because the competitiveness
values local of
resources (humans,
companies, as well as
cultures, and materials);new business areas.
• Human at the centre of
The SD methodology the project:
passes from theA human being
definition is considered
of the connected
context to the toaits
design of environmental,
complex system.
social, cultural,
Its principal steps canand
be ethical
divided context, and ([16,17]
as follows its needs become
(Figure 2)):central in design requirements.
1. The use of
Holistic this approach
diagnosis to design
(HD) with fieldproduction processesAn
and desk research: hasanalysis
several and
positive outcomesof
visualization [15]:
all the
• components that define
Environmental: A lowertheconsumption
current scenario, considering
of local both
resources thethe
and surrounding
use of morecontext and the
sustainable
flow of energy and
production processes; matter;
2.
• Definition
Social: Theof problems
creation andjobs
of new leverages
linked for change:
to the With
cultural andthe complex
spatial data
places collected in HD, it is
of belonging;
possible to underline the criticalities and potentialities, and gather eco-guidelines, for the
• Economic: The optimization of resources minimizes costs and increases the competitiveness of
definition of new complex systems;
companies, as well as new business areas.
3. Design of a system; the new production model: The goal is to obtain zero emissions. S system is
The SD methodology
created passes from between
based on relationships the definition of the and
processes context to theoptimizing
actors, design of a the
complex
energysystem.
and
Its principal
materialsteps
flowscan bevalorising
and divided asthefollows
waste([16,17] (Figure 2)):
as resources;
4.
1. Study
Holisticofdiagnosis
the outcomes: Preliminary
(HD) with evaluation
field and desk of An
research: the analysis
benefitsand
given by the system
visualization at
of all the
environmental, economic, and social level;
components that define the current scenario, considering both the surrounding context and the
5. Implementation:
flow of energy and Realization
matter; of the system in the specific context and the evaluation of the
2. feasibility
Definitionofofthe new business
problems plan; for change: With the complex data collected in HD, it is
and leverages
possible to underline the criticalities and potentialities, and gather eco-guidelines, for the definition
of new complex systems;
3. Design of a system; the new production model: The goal is to obtain zero emissions. S system is
created based on relationships between processes and actors, optimizing the energy and material
flows and valorising the waste as resources;
Sustainability 2019, 11, 4458 4 of 30

4. Study of the outcomes: Preliminary evaluation of the benefits given by the system at environmental,
economic, and social level;
Sustainability 2019, 11, x FOR PEER REVIEW 4 of 35
5. Implementation: Realization of the system in the specific context and the evaluation of the
feasibilityofofthe
6. Analysis theresults
new business plan; The inputs coming from the implementation improve the
and feedback:
6. project
Analysis and
of enable the discovery
the results of new
and feedback: Theopportunities,
inputs coming making it autopoietic.
from the implementation improve the
project and enable the discovery of new opportunities, making it autopoietic.

Figure 2. Graphic visualization of the Systemic Design (SD) methodology. Retrieved from a RETRACE
Figure presentation.
project 2. Graphic visualization
Courtesy of theofauthor.
the Systemic Design (SD) methodology. Retrieved from a
RETRACE project presentation. Courtesy of the author.
This methodology has gained relevance in multiple environments, especially in academia. It has
been This
used methodology
in the Mastershas gained program
of science relevanceinin‘Systemic
multipledesign
environments,
‘Aurelio especially in academia.
Peccei” since It has
2003–04 (before
itbeen
wasused in the
named Masters of science
‘Ecodesign’) program
at the Design in ‘Systemic
School design ‘Aurelio
of the Politecnico Peccei’’
di Torino sinceIt 2003–04
[17]. (before
is also uses in
it was named
European ‘Ecodesign’)
projects at the Interreg
(e.g., RETRACE Design School
Europe of the
[18] Politecnico
and PROGIREG di [19])
Torino
and[17]. It is also studies
collaborative uses in
European
with projects
industries (e.g.,
(e.g., RETRACE Tecco
Agrindustria Interreg Europe
s.r.l., Luigi[18] and PROGIREG
Lavazza S.p.A., and[19]) and Poult).
Groupe collaborative studies
with industries (e.g., Agrindustria Tecco s.r.l., Luigi Lavazza S.p.A., and Groupe Poult).
2. Materials and Methods
2. Materials andseeks
This article Methods
to define and assess HD as a tool for systemic approaches in the design discipline
and discusses
This articlea defined
seeks toprocess
define andfor assess
its execution
HD as abased on systemic
tool for HD’s previous definitions
approaches in the and
designapplications
discipline
in
anddifferent
discusses contexts.
a definedTo process
achievefor these goals, the based
its execution research on method employed
HD’s previous a three-stage
definitions approach:
and applications
ainliterature
different review,
contexts.anTo analysis
achieveofthesecasegoals,
studies thewith the inductive
research method, and
method employed a framework
a three-stage design.
approach: a
This process enables this study to move from a broader perspective to a
literature review, an analysis of case studies with the inductive method, and a framework design.narrower, more efficient result.
This
Theenables
process literaturethisreview
study started
to movewith fromthe scientificperspective
a broader contributions to ato the design
narrower, for efficient
more sustainability
result.that
have Theframed
literature review started with the scientific contributions to the design for sustainability and
the concept, in order to understand how the design process approaches complexity that
how
havethe ST has
framed theinfluenced
concept, inthem,
order thereby providing
to understand how athe taxonomy of the approaches
design process SD discipline. Afterwards,
complexity and
the research addressed, in detail, the potentialities of the HD tool questioned
how the ST has influenced them, thereby providing a taxonomy of the SD discipline. Afterwards, the in this article. A literature
review
research was conducted
addressed, inon the primary
detail, database to
the potentialities ofdetermine
the HD tool scientific contributions
questioned (Scopus),
in this article. in order
A literature
to find uses
review was of the term “holistic
conducted diagnosis”
on the primary and itstoapplication
database determine in the design
scientific discipline (this
contributions review
(Scopus), in
was conducted in September 2018 and updated in August 2019). Moreover,
order to find uses of the term “holistic diagnosis” and its application in the design discipline (this the HD place was framed
in the SD
review wasmethodology
conducted in developed
September in 2018
Politecnico di Torino
and updated to assess2019).
in August its importance
Moreover,and the discuss
HD place a new
was
framework
framed in the to define a process todeveloped
SD methodology implementinHD. To achieve
Politecnico di this,
Torinoprevious attempts
to assess to define and
its importance the
typologies, processes, and tools among the research group in SD at Politecnico
discuss a new framework to define a process to implement HD. To achieve this, previous attempts to di Torino are reported
to understand
define the evolution
the typologies, of theand
processes, framework
tools amongover thetime.research group in SD at Politecnico di Torino
The second stage of the examination
are reported to understand the evolution of the frameworkused a multiple case-study analysis [20]. To determine a basis
over time.
to compare
The second stage of the examination used a multiple case-studycase
and relate SD practices across domains, three representative studies
analysis extracted
[20]. from SDa
To determine
projects
basis to were
compare selected in theSD
and relate areas of study
practices where
across the HDthree
domains, tool was applied: a case
representative project for industrial
studies extracted
production, one involving local communities, and one addressing change
from SD projects were selected in the areas of study where the HD tool was applied: a project in policy-making. The goalfor
of both selected projects was to attain local circular and sustainable
industrial production, one involving local communities, and one addressing change in policy- development. The purpose of
the analysis
making. Thewas goaltoofdetermine
both selectedhowprojects
the HD was process has been
to attain localconducted
circular and in different
sustainable groups of works
development.
The purpose of the analysis was to determine how the HD process has been conducted in different
groups of works approaching different topics underlying the barriers faced in process
implementation. Moreover, radar graphs were used to evaluate, for each case study, the importance
of every different stage involved in the HD process (desk research, field research, and research
Sustainability 2019, 11, 4458 5 of 30

approaching different topics underlying the barriers faced in process implementation. Moreover,
radar graphs were used to evaluate, for each case study, the importance of every different stage
involved in the HD process (desk research, field research, and research synthesis). This can also
clarify how the HD tool changes depending on the topic to address and show how different contexts
influenced challenges in implementing the SD approach.

3. Results

3.1. Taxonomy
Currently, sustainability is understood as a system of resilient relationships rather than a
characteristic of individual components of systems [21]. As the world has become more interconnected,
a desirable sustainable future has increased in complexity. This complexity is only visible through
‘wicked problems’. These challenges are portrayed as trivial or lasting situations that cannot be
overcome immediately due to their inner complexity or exogenous/endogenous relations [10].
This prevailing complex scenario can only be approached through a process-based, multi-scale,
and systemic approach [22]. Such a shift involves a radical transformation in how a human society
operates and requires deep leverage for change from social, cultural institutional, and organizational
perspectives [23,24].
Over the last few decades, design has continuously been related to different aspects of
the sustainability dialogue and practice as a primary engine for innovation in our society on
industry, local communities, and government [25–28]. The recent review presented by Ceschin
and Gaziulusoy [21] describes the evolution of the design for sustainability: from product innovation to
product–service system innovation to spatial–social innovation and socio–technical system innovation.
This timeframe illustrates how design has evolved towards dematerialization and is approaching more
closely to solutions for complex social, environmental, and even political problems, as suggested by
Papanek [29]. During this transition, designers have expanded their field of action from a single user
to communities as users, thereby becoming a more participatory discipline and delivering sustainable
services and systems. This last part is synthesized by Buchanan [30], who has addressed the role of
design practices to approach current wicked problems with the purpose of transitioning towards a
more resilient, fair, and sustainable society.
Hence, more and more developments around design for sustainability have gained momentum,
providing a different vision for the role of design. A visible manifestation of this vision is the manifesto
of Danish designers, ‘Design for People, Profit, and Planet’, which proclaims the designer’s future
role by balancing three interests for innovation and sustainable development and moving forward a
concept considered contradictory in the past [31]. Consequently, the designer has changed its role,
providing skills and capabilities for sustainability development [32].
Designers have been hailed by the current complexities as the ones with creative abilities and
other skills to approach future scenarios and face current wicked problems. The designer’s approach
to problem-solving refers to the designer’s ability to create frames. This is the result of dealing
continuously with complex problems that have to encourage designers to create these frames [33].
The method for creating new frames allows a more comprehensible interpretation of complex situations
in terms of themes, which are based on a process of analysis related to phenomenological methods [34].
A main outcome of this process will be solutions focusing on strategies. Tools like graphic visualization
design expose all the components of complex scenarios, displaying different levels of interconnection
that increase the number of interpretations for a context. Designers in this process seek to deliver a
wider range of possibilities to generate other types of conversations on innovative approaches and
problem solving. Involving the audience on a deeper level and changing their traditional roles as
passive recipients into active participants that reach design conclusions allows the comprehension of
innovative approaches by a wider audience where arguments can be seen from a bigger spectrum of
perspectives [30].
Sustainability 2019, 11, 4458 6 of 30

Systems Thinking and Design

In the last half-century, the System Theory and the ST approaches have been integrated into
design discipline. The major thinkers on ST, collected by Ramage and Shipp in 2009, agreed that
“To make sense of the complexity of the world, we need to look at it regarding wholes and relationships
rather than splitting it down into its parts and looking at each in isolation” [35] (p. 1). According to
Capra [2], one of the most relevant authors on the topic, ST emerged between the 1920s and the 1930s
because of the contributions of researchers in diverse disciplines, such as psychologists, biologists,
and ecologists. However, researchers have agreed that the starting point of the ST movement was
in the 1940s, with the appearance of the two schools of thoughts, the General Systems Theory [36]
and Cybernetics [37]. Thanks to discoveries in physics—quantum theory—there was a shift in the
cultural paradigm of western culture from Cartesian and Newtonian mechanisms to a more holistic
and ecological view of life [3].
The holism theory, which suggests that the whole is more than the sum of its single parts, has
determined the properties of systems that have completely changed the way we see complexity.
Thinking in systems means looking at the whole, analysing single components and focusing attention
on relationships and connections. The discovery of the interdependence between each part of a
system and between the system and its environment also allowed us to define the system’s boundaries,
thus creating an identity and no isolation. ST, in practical terms, means zooming out from a single
part and considering that part’s relationship to its surroundings and other ecosystems (applying a
qualitative approach more than quantitative approach) and mapping the situation more than measuring
it, by using a multidisciplinary approach [2].
Application of knowledge on living systems to other systems created by human beings enables us
to learn from nature and subsequently create something that will be sustainable itself. As suggested by
P.H. Jones, “Systems theory and its guidelines in practice—Systems Thinking—have been promoted as
the best techniques for raising social awareness about interconnected complex systems, which might
determine human destiny” [9] (p. 92). In fact, researchers have agreed that the concept of
interconnections represents a primary ability to tackle current complex scenarios and the immediacy of
a sustainable future, which involves a complete social, economic, and environmental perspective.
The result of the application of ST to the design discipline is the birth of a new discipline called
SD: a holistic approach applied to projects for artefacts and services, which allows one to have a
wider view of the context/scenario in which this discipline will be introduced. As Jones [10] declared,
the origin of this application passed from a soft part represented by the Social System Theory to the
hard part, represented by Systems Dynamics: “Christopher Alexander, Victor Papanek (with critical
social design), and John Chris Jones (design methods originator), influenced a new generation of
designers” [10] (p. viii). One of the many reasons for this application is the need to develop more
innovative solutions as a response to the complexity of design problems, as Charnley [38] has stated.
Bhamra, Hernandez, and Mawle [39] also recognized this relationship: a higher level of design for
sustainability is reached through innovation at a systems level—a more radical and strategic approach
that involves many stakeholders, such as communities, governments, companies, and customers.

3.2. Holistic Diagnosis: a Tool for Systemic Approaches

From the perspective of the SD discipline in Politecnico di Torino, HD exists in the first stage of
the design path. It is a method for comprehending the problem definition, which, in the design process,
is a common step. As Buchanan quoting Rittel, a teacher at Ulm school, stated: “design process is
divided in two distinct phases: problem definition and problem solution. Problem definition is an
analytic sequence in which the designer determines all of the elements of the problem and specifies all
of the requirements that a successful design solution must have” [30] (p. 15).
The term HD comes from the union between diagnosis—the central concept—and holism—its
characterization. ‘Diagnosis’, according to the Cambridge dictionary, refers to the doctor’s opinion and,
therefore, belongs to the healthcare field. In Italian, diagnosis is translated as ‘rilievo’, which refers more
Sustainability 2019, 11, 4458 7 of 30

to a survey in architecture (site survey, architectural survey, survey maps, map making, field survey,
and metric survey). Holism refers to the ST previously defined in the previous paragraph.
To understand how HD is currently used, and the previous attempts that defined its process,
a literature review on the databases Scopus in August 2019 was performed using the keyword “holis*
diagnos*” only in article title, abstract, and keywords to look for results.
The results in Table A1 reveal that the term HD is used by 40 documents. Their analysis permits
us to understand the different subjects that refer to the term: 21 records are related to medicine (5 in
alternative or integrative medicine), 9 to engineering (2 medicine-engineering), 2 to management, 2 to
human science, 1 to human-computer interaction/design and 1 to participatory design, 1 to cognitive
science, 1 to philosophy, 1 to communication/climate science, and 1 to safety. The number of records in
the subject area ‘alternative and integrative medicine’ highlight the relationship between ‘holism’ and
oriental culture, as also stated by Capra (1982). Parallel to this, the records demonstrate that holistic
approaches have started to be used in other different contexts, from engineering to management and
governance. Interestingly, the second record uses the term in the field of participatory design applied
to agroecology, which could reflect the development of holistic approaches in the design field related
to sustainability. However, no results seem to refer to this concept as a tool with a precise methodology
and implementation process, except for the conference paper by Montagner [40], which applied the
concept to data design and referred to SD by Bistagnino [14] as part of the research group in Politecnico
di Torino.
Due to the lack of information about the HD process in scientific contributions found during the
review, in order to define a structured framework to approach complexity in any contextual system,
the research was extended to articles, books, PhD theses, and conference proceedings produced without
indexes on SD, especially by the SD research group in Politecnico di Torino.
According to [14,41], one of the main contributors to the definition of the methodological frame of
SD, HD is defined as a mapping of the state-of-the-art useful for giving indications about the quality
and the quantity of what an anthropic process involves. Moreover, to highlight the relationships
that are activated, both inside the system and between the system and its environment (as the local
context), one can analyse afterwards the implications at each territorial dimension, from regional to
worldwide ones.
In that regard, HD represents a useful tool to guide the first complete overview analysis of
contexts/products/processes/services and define the current state-of-the-art. From this point of view,
HD is related to ST, which defines a detailed study on behavioural patterns and interactions. An analysis
of this nature is understood as a holistic overview of the components of the system and how their
interconnections/relations result in the sum of all parts/subjects that interact between the environment
and other systems.
To reach an effective understanding of the HD results, we require visualization tools whose main
aim is to break down the information of the system. The synthesis of this analysis is represented as a
graphical outcome, which is a giga-map [42,43] that displays all the components of the system and the
relationships between them.
In the SD methodology, HD refers to two different levels of analysis: HD1 for energy and matter
analysis and HD2 for context/framework analysis. Starting from a deeper overview on a single
production process with an analysis of the output (what goes out) and input (what comes in), the view
is enlarged to its context of reference to help understand its influences.

3.2.1. Holistic Diagnosis Phase 1: Energy and Matter Analysis

This first phase of the HD entails the analysis of everything used by the production, exchange,
and consumption of goods and services (Figure 3), including:
• Input: resources as raw materials, semi-finished and energy, which enters in the process;
• Output: waste and surplus, both matter and energy or data, that produce or don’t use the process;
• Final product or service;
 The HD1 is divided into three steps:
• A general overview of the entire anthropic activity (seen as a production process), considering
the flows of energy and matter that enter and go out (input and output);
• An analysis of the relationships with other anthropic/natural activities that the input and
Sustainability 2019, 11, 4458 8 of 30
output generate;
• A detailed analysis of the input and output of every single sub-process involved into the
• entire process.
Goods and people management, as well as logistics.

Figure 3. Example of a giga-map about holistic diagnosis (HD) phase 1 on a pastry shop placed in
Figure 3.Valley.
Anzasca Example of a giga-map
Retrieved about holistic diagnosis (HD) phase 1 on a pastry shop placed in
from [16].
Anzasca Valley. Retrieved from [16].
The purpose of HD1 is to analyse in detail all the resources used by anthropic activity. This activity
is seen as an
HD1 open system,
is unrooted where
in other the boundaries
methods, presenting are the limits
many of thewith
similarities production process
them: niche itself used
analysis (when in
the production[44],
permaculture starts and when itanalysis
material-flow stops), and
and itsubstance-flow
contains all the sub-processes
analysis inside.
from urban metabolism [45]; an
The HD1 is material
economic-wide divided into
flowthree steps:
account [46]; input–output analyses [47]; stock and flow analyses in
system dynamics [48]; the urban harvest approach [49]; life cycle analyses [50], and many more.
• A general overview of the entire anthropic activity (seen as a production process), considering the
3.2.2.flows of energy
Holistic and Phase
Diagnosis matter2:that enter Analysis
Context and go out (input and output);
• An analysis of the relationships with other anthropic/natural activities that the input and
The second
output phase of HD is an analysis of every relationship generated in a direct or indirect
generate;
way, including the environment where the system is placed, to discover the relationships in between
• A detailed analysis of the input and output of every single sub-process involved into the
the activities and the contexts around them. This analysis goes in depth for both territorial
entire process.
considerations and stakeholder involvement. The context is determined from its morphological
HD1and
features is unrooted in other
also through its methods,
economic,presenting
social, andmany similarities
cultural aspects.with them: niche
Attention shiftsanalysis used
from natural
in permaculture
resources [44], material-flow
to relevant analysis
industrial activities, and substance-flow
typical analysis
products, folklore, from urban metabolism
and demographic [45];
aspects (Figure
an
4). economic-wide
Furthermore, tomaterial
produce flow
an account [46]; input–output
overall analysis, analyses
the HD should [47]; stock
involve and flow
mapping analyses
of the in
different
system dynamics
actors and [48]; theinvolved
stakeholders urban harvest
in theapproach
topic of [49]; life cycle
analysis. analyses [50],
For example, and
in the many
case more.
of production
activities, the analysis should be addressed not only to producers and end users but also to the
3.2.2. Holisticproviders,
technicians, Diagnosisintermediaries,
Phase 2: Context and Analysis
other pertinent public and private bodies.
The second phase of HD is an analysis of every relationship generated in a direct or indirect way,
including the environment where the system is placed, to discover the relationships in between the
activities and the contexts around them. This analysis goes in depth for both territorial considerations
and stakeholder involvement. The context is determined from its morphological features and also
through its economic, social, and cultural aspects. Attention shifts from natural resources to relevant
industrial activities, typical products, folklore, and demographic aspects (Figure 4). Furthermore,
to produce an overall analysis, the HD should involve mapping of the different actors and stakeholders
involved in the topic of analysis. For example, in the case of production activities, the analysis should
be addressed not only to producers and end users but also to the technicians, providers, intermediaries,
and other pertinent public and private bodies.
Sustainability 2019, 11, 4458 9 of 30
Sustainability 2019, 11, x FOR PEER REVIEW 9 of 35

Figure 4. Example
Example of
ofaagiga-map
giga-mapon
onHD
HDphase
phase2 2by
bythe
thestudents
studentsofof
Systemic Design
Systemic in in
Design Politecnico di
Politecnico
Torino.
di Torino.

The HD2 is a framework that has been infrequently analysed by scholars scholars over
over the
the years.
years.
Nevertheless, wewe can
cantrace
traceitsitsroots
rootsusing
using
thethe tools
tools related
related to giga-map
to giga-map [42,43],
[42,43], think-map
think-map [51], [51],
rich
rich pictures
pictures [52],[52],
and and mind
mind maps maps
[53].[53].

3.2.3. Holistic Diagnosis

3.2.3. Holistic Diagnosis Process
Process Definition
Definition
Starting
Starting from
from the
thedefinition
definitionofofBistagnino
Bistagnino[14,41],
[14,41],HD
HDhas
hasevolved
evolved through
throughdifferent studies
different to be
studies to
defined as an established framework [54,55].
be defined as an established framework [54,55].
Gaiardo,
Gaiardo, inin2016,
2016,identified three
identified principal
three ways
principal to realize
ways an effective
to realize HD. These
an effective HD. methods should
These methods
be actuated
should not consequentially
be actuated but withbut
not consequentially reiteratively [56] (p. 113)
with reiteratively (Figure
[56] (p. 5):
113) (Figure 5):
1.
1. Existing information
Existing informationresearch—desk
research—desk research:
research: The collection
The collection of information
of information about
about the the
state-of-
state-of-the-art is done through formal sources, such as existing scientific
the-art is done through formal sources, such as existing scientific literature and literature and official
databases, as
databases, as well
well as
as informal ones, such as social media;
2. Integration information research—fieldresearch:
Integration information research—field research:Complementary
Complementary to the
to the previous
previous phase,phase,
this
this analysis
analysis is done
is done through
through direct
direct experience
experience in in
thethe fieldofofreference,
field reference,ranging
rangingfrom
from direct
direct data
recording to collection of perceptions (pictures, direct interviews, etc.);
recording
3. Information
Information design visualization—research synthesis: This is used to ease the understanding of
the
the collected
collected data,
data, thereby
thereby exposing
exposing controversial
controversial aspects,
aspects, potentialities,
potentialities, and
and data
data correlation.
correlation.
Thus, it is possible
Thus, it possible to start a project development and at the same time to communicate the
communicate
research
research results to other parties.

Both desk than field studies look for both quantitative and qualitative data through different
tools and different sources. For each of these methods, there is visual framing and gap analysis,
which should not be sequential but iterative. The third—research synthesis—produces three outputs:
data correlation, a list of criticalities, and a list of potentialities [54].
This framework details a way to build a toolkit to conduct the research phase and, consequently,
visualise complexities. It specifies the instruments needed to perform desk and a field research and
also delivers the way to analyse external contexts and the potential lists of outcomes that should be
reached within the research synthesis.
Nevertheless, the field of data to be analysed is still wide. To be able to process results with a
standardized procedure is necessary to frame the type of information that will be extracted from a
given system. For that purpose, the following methodology proposes a research study to establishing
Sustainability 2019, 11, 4458 10 of 30

categories where
Sustainability a delimited
2019, 11, x FOR PEERamount
REVIEW of information can be extracted to approach an HD in a more
10 of 35
effective way.

Figure 5. General schema of holistic diagnosis. Retrieved by [54]. Courtesy of the author.

As result Figure 5. General

of this, a detailedschema of holistic
description of diagnosis.
the entireRetrieved
method and by [54]. Courtesy
useful ofneeded,
tools is the author.
in order to
render the importance of an HD inside SD. That been said, the purpose of this article is to define and
assess aBoth desk than
structured field to
method studies look
achieve for both
a more quantitative
effective andofqualitative
execution datanew
the HD. This through different
approach tools
allows
theand
HDdifferent sources.
to be utilized evenForfor
each
theof these methods,
analysis of multiple there is visual
contexts framing and gap
simultaneously analysis,
within which should
multidisciplinary
not be sequential but iterative. The third—research synthesis—produces
groups and usess standard organized information to achieve synthesis results. three outputs: data correlation,
a list of criticalities, and a list of potentialities [54].
This framework
3.3. Comparative details
Case Studies a way tothe
Applying build
HD aTool
toolkit to conduct the research phase and, consequently,
visualise complexities. It specifies the instruments needed to perform desk and a field research and
The HD framework over the years has been applied in the design process for several SD projects,
also delivers the way to analyse external contexts and the potential lists of outcomes that should be
as guided by the research group at Politecnico di Torino. The following applications illustrate how the
reached within the research synthesis.
HD method has been improved in different fields:
Nevertheless, the field of data to be analysed is still wide. To be able to process results with a
• standardized
Industrial production—from
procedure is necessary a certain production
to frame the type chain to the analysis
of information of be
that will local contextfrom
extracted for a
product
given system.innovation;
For that purpose, the following methodology proposes a research study to establishing
• categories where a delimited amount
Local Communities—from a certainof information
productive sectorcan beand
extracted to approach
context an HD in
to the definition of anew
more
effective way. for social innovation;
opportunities
• As result
Policy of this, a detailed
making—from a certain description of the entire
regional context to themethod andofuseful
definition tools
strategic is needed,chains
production in order
to render the importance
and policy planning tools. of an HD inside SD. That been said, the purpose of this article is to define
and assess a structured method to achieve a more effective execution of the HD. This new approach
3.3.1. Industrial
allows the HD Production
to be utilized even for the analysis of multiple contexts simultaneously within
multidisciplinary
The HD withingroups and usess
an industrial standard organized
production context isinformation
common intoSD achieve synthesis
projects results.in
experienced
Politecnico di Torino and requires an acknowledgement of the outcomes generated by the linear
3.3. Comparative Case Studies Applying the HD Tool
production models at environmental level, thereby increasing the awareness of the relationships
between one
The HD company andover
framework the local context
the years haswhere it operates.
been applied in the design process for several SD projects,
as A case study
guided by theonresearch
industrial production
group is the EN.FA.SI.
at Politecnico di Torino.project (l’ENergiaapplications
The following e il FAgioloillustrate
in SIstema),
how
implemented
the HD method withhas
thebeen
support of the in
improved Piedmont
differentRegion
fields: (Italy) with POR-FESR 2007–2013 funds for
productive transition and innovation. This project was developed in collaboration with local industries
• Industrial production—from a certain production chain to the analysis of local context for
and aimed to develop a specific area in the North West of Italy (Cuneo province) where the Cuneo
product innovation;
Bean (Fagiolo Cuneo) is cultivated, a product registered as a TFP—Traditional Food Product—and a
• Local Communities—from a certain productive sector and context to the definition of new
PGI—Protection of Geographical Indication [57–59].
opportunities for social innovation;
• Policy making—from a certain regional context to the definition of strategic production chains
and policy planning tools.
between one company and the local context where it operates.
A case study on industrial production is the EN.FA.SI. project (l’ENergia e il FAgiolo in SIstema),
implemented with the support of the Piedmont Region (Italy) with POR-FESR 2007–2013 funds for
productive transition and innovation. This project was developed in collaboration with local
industries
Sustainability and
2019, aimed
11, 4458 to develop a specific area in the North West of Italy (Cuneo province) where 11 of 30
the Cuneo Bean (Fagiolo Cuneo) is cultivated, a product registered as a TFP—Traditional Food
Product—and a PGI—Protection of Geographical Indication [57–59].
With the goal of reducing the environmental impact of industrial cultivation and food
With the goal of reducing the environmental impact of industrial cultivation and food
transformation, thus creating relationships with other productions to enhance production outputs,
transformation, thus creating relationships with other productions to enhance production outputs,
the HD1 and HD2 in this case were developed simultaneously. Starting with the HD1, the SD research
the HD1 and HD2 in this case were developed simultaneously. Starting with the HD1, the SD research
group in Politecnico di Torino (composed of systemic designers and researchers based in the same
group in Politecnico di Torino (composed of systemic designers and researchers based in the same
region), using desk research, analysed the cultural aspects of the Cuneo area and productive sectors.
region), using desk research, analysed the cultural aspects of the Cuneo area and productive sectors.
In the meantime, mixing desk and field research framed the supply chain of the Cuneo bean (HD2)
In the meantime, mixing desk and field research framed the supply chain of the Cuneo bean (HD2)
through field
through field visits
visits and
and interviews
interviews involving
involving local
local actors
actors from
from the
the agricultural
agricultural consortium
consortium of of the
the local
local
producers of
producers of the
the Cuneo
Cuneo Bean.
Bean. Manufacturing
Manufacturing activities,
activities, such
such as
as Agrindustria
Agrindustria Tecco
Tecco s.r.l.
s.r.l. and
and Arese
Arese
Franco s.n.c., focused on the transformation of the beans; other research centres, such
Franco s.n.c., focused on the transformation of the beans; other research centres, such as Agroinnova as Agroinnova
and CReSO,
and CReSO, focused
focused on on the
the agro-food
agro-food sector.
sector. The
The HDHD waswas led
led by
by the
the SD
SD group
group in in Politecnico
Politecnico di di
Torino, which
Torino, which developed
developeditituntil
untilresearch
researchsynthesis,
synthesis,thereby
therebycreating
creating giga-maps,
giga-maps, such
such as as
thethe ones
ones in
in Figures 6 and 7, which included the feedback received from the other actors.
Figures 6 and 7, which included the feedback received from the other actors. This process lasted for This process lasted
for several
several monthsmonths andand required
required multiple
multiple cycles
cycles of of iterationsthrough
iterations throughdesk
deskandandfield
field research
research and and
research synthesis,
research synthesis,especially
especiallyforfor
thethe
identification of the
identification of quantity and quality
the quantity of the inputs
and quality of the and
inputsoutputs
and
involved in the production processes.
outputs involved in the production processes.

Figure 6.
Figure Giga-mapof
6. Giga-map ofthe
theHD1
HD1in
inthe
theEN.FA.SI
EN.FA.SI project.
project. Retrieved
Retrieved from
from [59].
[59]. Translated.
Translated.
Sustainability 2019, 11, x FOR PEER REVIEW 12 of 35

Sustainability 2019, 11, 4458 12 of 30

Sustainability 2019, 11, x FOR PEER REVIEW 12 of 35

Figure 7. Giga-map of the HD2 in the EN.FA.SI project. Courtesy of the author.

The HD, in this case, taking into consideration the level of detail and importance of each phase
(desk and field research and research synthesis), can be evaluated as represented in Figure 8. This
figure represents Figure 7. Giga-map
a solid startingofpoint
the HD2 in the of
of dense EN.FA.SI project.used
information Courtesy of the author.
to develop the projects, which
Figure 7. Giga-map of the HD2 in the EN.FA.SI project. Courtesy of the author.
include the design and implementation of systemic and integrated production. A network of
The HD, in this case, taking into consideration the level of detail and importance of each phase
companies and zero-emission productions were created, working from the reduction of the water
(deskThe
andHD,
fieldinresearch
this case,
andtaking intosynthesis),
research consideration
can be the level of as
evaluated detail and importance
represented in Figureof8.each
This phase
figure
consumption in the cultivation process to the design of a new product, bean flakes, and their
(desk and field
represents research
a solid startingand research
point of densesynthesis), can beused
of information evaluated as represented
to develop the projects,in which
Figure include
8. This
packaging, which gave new life to beans discarded in the selection process.
figure represents
the design a solid startingofpoint
and implementation of dense
systemic of information
and integrated used toAdevelop
production. networkthe of projects,
companies which
and
The role of the HD in industrial production can also be found in other projects, such as the project
include the design
zero-emission and implementation
productions of systemic
were created, working from the and integrated
reduction production.
of the A network
water consumption of
in the
developed within the large food industry based on the large-scale production of biscuits [60], which
companies and zero-emission
cultivation process to the designproductions were created,
of a new product, working
bean flakes, from packaging,
and their the reduction of the
which gave water
new
required an active role for the employees and a deep analysis of the local territory.
consumption in the cultivation
life to beans discarded process
in the selection to the design of a new product, bean flakes, and their
process.
packaging, which gave new life to beans discarded in the selection process.
The role of the HD in industrial production can also be found in other projects, such as the project
developed within the large food industry based on the large-scale production of biscuits [60], which
required an active role for the employees and a deep analysis of the local territory.

Figure 8. Evaluation of the HD process implemented in the EN.FA.SI project.

Figure 8. Evaluation of the HD process implemented in the EN.FA.SI project.
The role of the HD in industrial production can also be found in other projects, such as the
project
3.3.2. developed
Local within the large food industry based on the large-scale production of biscuits [60],
Communities
which required an active role for the employees and a deep analysis of the local territory.
In the case of a scenario with local communities, the HD tool underlines the recognition of the
relationships between
Figure 8.resources
3.3.2. Local Communities Evaluationinofa the
local
HDcontext
process(and its actors)
implemented in and know-how,
the EN.FA.SI which are usually
project.

In the case of a scenario with local communities, the HD tool underlines the recognition of the
3.3.2. Local Communities
relationships between resources in a local context (and its actors) and know-how, which are usually
In the case of a scenario with local communities, the HD tool underlines the recognition of the
relationships between resources in a local context (and its actors) and know-how, which are usually
Sustainability 2019, 11, x FOR PEER REVIEW 13 of 35
Sustainability 2019, 11, 4458 13 of 30

reduced due to the lack of awareness regarding the impact of waste generation in a natural
environment
reduced due toand thethe
lackvalorisation
of awareness ofregarding
human capital.
the impact of waste generation in a natural environment
In this
and the case study,
valorisation we consider
of human capital.an applied study developed in Ahuacuotzingo (Mexico) within
the context
In this of
casea PhD
study,thesis on SD [61],
we consider anwith the goal
applied studyofdeveloped
implementing sustainable good-practices
in Ahuacuotzingo that
(Mexico) within
could foster the economic and social relations of the farmers. The HD started,
the context of a PhD thesis on SD [61], with the goal of implementing sustainable good-practices that through desk studies
in Italy,
could with
foster theaeconomic
recognition and of the relations
social Mexicanofterritory
the farmers.(HD2)ThebyHD the foreign
started, PhD student
through to the
desk studies in
community. Due to the lack of data around the different production processes
Italy, with a recognition of the Mexican territory (HD2) by the foreign PhD student to the community. present there, different
periods
Due to the of field
lack of research in the the
data around areadifferent
were done with direct
production field visits
processes andthere,
present interviews thanks
different to the
periods of
presence of a local connection actor who gained the trust of the community
field research in the area were done with direct field visits and interviews thanks to the presence of a and facilitated
interactions,
local connection welcoming
actor who the designer
gained inside
the trust the community
of the community.and Thefacilitated
direct collaboration
interactions,of the local
welcoming
community
the designer was insidea the
keycommunity.
element in The analysing the different of
direct collaboration processes
the local performed
community by wasdifferent small
a key element
farmers (HD1).
in analysing the different processes performed by different small farmers (HD1).
The strong sense
The strong sense ofof belonging
belonging to to the
the territory
territory and
and traditions
traditions among
among thethe community
community of of farmers
farmers
played aa central
played central role
role in
in the
the analysis
analysis and and offered
offered aa significant
significant advantage
advantage to to the
the data
data collection
collection process,
process,
both in HD1 and HD2, where the community was very active and proud
both in HD1 and HD2, where the community was very active and proud to cooperate. The research to cooperate. The research
synthesis (Figures99and
synthesis (Figures and10),
10),
in inthisthis case,
case, waswas developed
developed during
during the collection
the data data collection
processprocess and
and greatly
greatly
helped thehelped
studenttheorganize
studentaorganize a large
large quantity quantity
of data of datathe
and manage and manage of
complexity thethe
complexity of the
research, thereby
research, thereby obtaining a big picture
obtaining a big picture to help start the gap analysis.to help start the gap analysis.

Figure 9.
Figure An example
9. An example of
of aa giga-map
giga-map on
on the
the HD1
HD1 of
of the
the Mexican
Mexican project.
project. Retrieved
Retrieved from
from [61].
[61]. Courtesy
Courtesy
of the author. Translated by the authors.
of the author. Translated by the authors.
Sustainability 2019, 11, 4458 14 of 30
Sustainability
Sustainability2019,
2019,11,
11,xxFOR
FORPEER
PEERREVIEW
REVIEW 14
14of
of35
35

Figure 10. An example of a giga-map on the HD1 of the Mexican project. Retrieved from [61]. Courtesy
Figure
Figure 10.
10. An
An example
example ofof aa giga-map
giga-map on on the
the HD1
HD1 of
of the
the Mexican
Mexican project.
project. Retrieved
Retrieved from
from [61].
[61].
of the author. Translated by the authors.
Courtesy
Courtesy of
of the
the author.
author. Translated
Translated byby the
theauthors.
authors.
The overall HD process can be evaluated as represented in Figure 11, taking into consideration the
The overall HD process
process can be
be evaluated as
as represented in
in Figure 11, taking
taking into consideration
level The overall
of detail andHDimportance can
of each evaluated
phase (desk represented
and field researchFigure
and11,research into consideration
synthesis). In this
the level of detail and importance of each phase (desk and field research and research synthesis). In
particular case, the HD approach was, afterwards, turned into a key tool for developing synthesis).
the level of detail and importance of each phase (desk and field research and research In
strategies for
this
this particular
particular case,
case, the
the HD
HD approach
approach was,
was, afterwards,
afterwards, turned
turned into
into aakey
key tool
tool for
fordeveloping
developing strategies
strategies
social innovation in the territory and fostering rural livelihoods.
for
for social
social innovation
innovation in in the
the territory
territory and
and fostering
fostering rural
rural livelihoods.
livelihoods.

Figure 11. Evaluation of the HD process for the Mexican project in Ahuacuotzingo.
Figure
Figure 11.
11. Evaluation
Evaluation of
of the
theHD
HD process
process for
forthe
the Mexican
Mexican project
projectin
in Ahuacuotzingo.
Ahuacuotzingo.
Another project with the goal of bonding the link between the territory and the community is the
Another
Another project
one performed in thewith
project area the
with goal
goal of
of bonding
theLea-Artibai
of in the the
bonding the link
link between
Spanish the
the territory
betweencountry
Basque [62]. and
territory and the
the community
community is is
the one performed in the area of Lea-Artibai in the Spanish Basque
the one performed in the area of Lea-Artibai in the Spanish Basque country [62]. country [62].
3.3.3. Policy Making
3.3.3.
3.3.3. Policy
Policy Making
Making
HD, as a tool for policymakers, still has limited research in the context of policy-making.
HD,
HD, as
Nevertheless,as aa the
tool for
for policymakers,
toolimplementation
policymakers, still
of the SD
still has limited
limited research
methodology
has in
in the
the context
in policy-making
research of
of policy-making.
processes
context has proven
policy-making.
Nevertheless,
Nevertheless, the implementation of the SD methodology in policy-making processes has proven
the key role the
of implementation
these approaches of
inthe SD methodology
participatory in policy-making
processes. At first processes
sight, it can has
be proven the
challenging
the
key
for role of these
keypolicymakers approaches
role of these toapproaches in
understandinthe participatory processes.
importanceprocesses.
participatory At
of HD because first sight, it
of traditional
At first can
sight, it can be challenging
governments for
models.
be challenging for
policymakers
policymakers to to understand
understand the the importance
importance of of HDHD because
because ofof traditional
traditional governments
governments models.
models.
However,
However, HD HD is is regarded
regarded as as aa supporting
supporting tool
tool toto increase
increase the
the effectiveness
effectiveness and and innovation
innovation ofof the
the
 Sustainability 2019, 11, 4458 15 of 30
Sustainability 2019, 11, x FOR PEER REVIEW 15 of 35

public-sector.
However, HDThis instrument
is regarded as aims to improve
a supporting toolour
to ability
increaseto help authorities and
the effectiveness andpolicymakers
innovation ofdeal the
with public issues
public-sector. Thisthrough
instrumenta qualitatively innovative
aims to improve our approach
ability to in theauthorities
help process of policy-making.
and policymakers A
current example of HD in policy-making is the RETRACE Interreg Europe
deal with public issues through a qualitatively innovative approach in the process of policy-making. project (a systemic
approach
A currentfor transition
example of HDtowards a Circular Economy)
in policy-making [18]. TheInterreg
is the RETRACE aim of this project
Europe is to(adrive
project EU
systemic
policies
approach towards a Circular
for transition Economy
towards by applying
a Circular Economy) the[18].
SD Approach
The aim of [63]. The project
this project coordinated
is to drive EU policiesby
the SD research group in the Department of Architecture and Design
towards a Circular Economy by applying the SD Approach [63]. The project coordinated by the SD(DAD) at the Politecnico di
Torino,
researchinvolves
group in eight
theprivate
Departmentand public partners and
of Architecture more
and than (DAD)
Design 70 stakeholders from Italy,diFrance,
at the Politecnico Torino,
Spain, Slovenia, and Romania to foster the cooperation between EU regions. The
involves eight private and public partners and more than 70 stakeholders from Italy, France, Spain, HD tool, in this case,
started from the HD2 of each different region involved to understand each
Slovenia, and Romania to foster the cooperation between EU regions. The HD tool, in this case, started region’s principal
characteristics,
from the HD2 of and thedifferent
each productive sectors
region subsequently
involved directed
to understand policies
each region’sonprincipal
the Circular Economy.
characteristics,
The data required for the collection of information on the regions were decided
and the productive sectors subsequently directed policies on the Circular Economy. The data requiredby the lead partner (SD
Research group), and
for the collection the HD2 was
of information onimplemented
the regions were in every region
decided by thanks
the leadtopartner
coordinated work between
(SD Research group),
universities,
and the HD2local was authorities,
implemented government
in every regionoffices, associations,
thanks public work
to coordinated administration, and local
between universities,
stakeholders requiring
local authorities, several months.
government After the research
offices, associations, public process, the information
administration, and localfrom all five
stakeholders
involved
requiringregions
several(through
months.desk After research) was assembled
the research process, the byinformation
the lead partner
from(the SD involved
all five Research group)
regions
in charge of the HD research synthesis (Figure 12) [56]. In the case of the
(through desk research) was assembled by the lead partner (the SD Research group) in charge of Piedmont Region, the lead
the
partner was in charge of both the data collection and the research synthesis.
HD research synthesis (Figure 12) [56]. In the case of the Piedmont Region, the lead partner was In this case, the
in
visualisation
charge of both phase for the
the data HD2 delivered
collection all the synthesis.
and the research information In collected
this case, to
theall the different
visualisation actors
phase for
involved in the data
the HD2 delivered all collection,
the informationproviding a starting
collected to all thepoint to open
different actorsdiscussions
involved inand receive
the data more
collection,
feedback.
providing a starting point to open discussions and receive more feedback.

(a) (b)

Figure
Figure12.
12.An
Anexample
exampleofofaagiga-map
giga-mapon onthe
theHD2
HD2for forthe
thePiedmont
PiedmontRegion
Regionininthe
theproject
projectRETRACE.
RETRACE.
Retrieved
Retrievedfrom
from[56].
[56].(a)
(a)The
Theresearch
researchsynthesis
synthesisofofthe
thedemography
demographypart;
part;(b)
(b)the
theresearch
researchsynthesis
synthesisofof
the
theeconomy
economypart.
part.

Subsequently,each
Subsequently, eachregion
regionperformed
performed an an
HD1HD1 of main
of the the main productive
productive chainschains (Figure
(Figure 13).
13). This
This analysis
analysis aided aided in a comprehension
in a better better comprehension of thecomplex
of the main main complex
industrialindustrial
systems systems (productive
(productive chains)
chains)
of of each region,
each region, therebythereby obtaining
obtaining a holistic
a holistic panorama
panorama that facilitates
that facilitates policy-making
policy-making processes
processes to
to identify opportunities that can foster a transition into the Circular Economy, where
identify opportunities that can foster a transition into the Circular Economy, where waste (outputs) waste (outputs)
fromone
from oneproductive
productivechain
chainpart
partbecomes
becomesthe theinput
inputforforanother.
another.InInthethecase
caseofofthe
thePiedmont
PiedmontRegion,
Region,
this analysis
this analysis was
wasimplemented
implementedespecially
especiallythrough
throughdesk research
desk on official
research regional
on official documents
regional dealing
documents
with special
dealing waste management,
with special such as such
waste management, [64]. as [64].
Sustainability 2019, 11, x FOR PEER REVIEW 16 of 35
Sustainability 2019, 11, 4458 16 of 30
Sustainability 2019, 11, x FOR PEER REVIEW 16 of 35

Figure 13. An example of a giga-map on HD1 in the project RETRACE on the ‘management of End of
Figure 13. An example of a giga-map on HD1 in the project RETRACE on the ‘management of End of
life vehicles’.
Figure 13. AnRetrieved
examplefrom [65].
of a giga-map on HD1 in the project RETRACE on the ‘management of End of
life vehicles’. Retrieved from [65].
life vehicles’. Retrieved from [65].
In this project, the designers from Politecnico performed both roles, project managers and
In this project, the designers from Politecnico performed both roles, project managers and
methodology leaders, so
In this project, theinstructions
designers fromfor thePolitecnico
content and executionboth
performed guidelines
roles, were synchronized
project to
managers and
methodology leaders, so instructions for the content and execution guidelines were synchronized to
execute and effectively
methodology leaders, perform this HD
so instructions formethodology.
the content and execution guidelines were synchronized to
execute and effectively perform this HD methodology.
For the
execute andpurpose of the
effectively project,this
perform another step was added. This step focused on a deeper description
HD methodology.
For the purpose of the project, another step was added. This step focused on a deeper description
of theForpolicy instrument
the purpose of theaddressed by each
project, another stepcountry, in This
was added. order to focused
step highlight
on athe strengths
deeper and
description
of the policy instrument addressed by each country, in order to highlight the strengths and weaknesses
weaknesses
of the policyrelated to its inclusion
instrument addressedof theby
Circular Economyinand
each country, SD. to highlight the strengths and
order
related to its inclusion of the Circular Economy and SD.
The overall
weaknesses HD process
related can be evaluated
to its inclusion as in Economy
of the Circular Figure 14.and SD.
The overall HD process can be evaluated as in Figure 14.
The overall HD process can be evaluated as in Figure 14.

Figure 14. Evaluation of the HD process implemented in the EN.FA.SI project.

Figure 14. Evaluation of the HD process implemented in the EN.FA.SI project.
4. Discussion: AFigure
New14. HD Framework
Evaluation of the HD process implemented in the EN.FA.SI project.
4. Discussion: A New HD Framework
Given the past experiences of former examples where HD was settled, implemented, and assessed
4. Discussion: A New HD Framework
Given
with partners the and
paststakeholders
experiences (universities,
of former examples where HDgovernment
local authorities, was settled,offices,
implemented, and
associations,
assessed with
Given the partners
past and
experiences stakeholders
of former (universities,
examples local
where HDauthorities,
was government
settled,
and public administration), these stakeholders can allow one to refine and perfect the framework. implemented, offices,
and
associations,
assessed they
Moreover, and
with public
partners
can administration),
help make andthestakeholders
framework these stakeholders
(universities,
more accessible and can allow
local one to refine
authorities,
comprehensible and perfect
government
for the
offices,
transdisciplinary
framework.
associations,Moreover,
and publicthey can help
administration),make the
these framework
stakeholders more
can accessible
allow one and
to
research toward sustainable development. After such processes, the result is the definition of a more comprehensible
refine and perfect for
the
transdisciplinary
framework.
structural research
andMoreover,
organized toward
they
process sustainable
cantohelp development.
make create,
elaborate, the framework
generate,moreAfteraccessible
suchdraft,
configure, processes,
and the result
and comprehensible
perform is the
the HD for
to
definition
frame andof a more
transdisciplinary
reveal structural
research
problems and organized
toward
efficientlysustainableprocess
in any complex to
development.elaborate,
context, Aftercreate,
thereby such generate,
processes,
giving configure,
the to
directions result draft,
is the
design a
and perform
definition the
of a HD
more to frame
structural andandreveal problems
organized efficiently
process to in any
elaborate, complex
create, context,
generate,
sustainable future—from the research and visualize [54] stages to Assess, Research, Collect, Visualize, thereby
configure, giving
draft,
directions
and perform
Interpret to design
the HD
(ARCVI) atosustainable
(Figure frame
15).and future—from
Thisreveal problems
classification the inresearch
isefficiently and
in
line with thevisualize
any complex [54] stages
context,
SD methodology to Assess,
thereby
identifiedgiving
by
Research,
directionsCollect, Visualize,
to design Interpretfuture—from
a sustainable (ARCVI) (Figure 15). This and
the research classification
visualize is[54]
in line
stageswithto the SD
Assess,
Research, Collect, Visualize, Interpret (ARCVI) (Figure 15). This classification is in line with the SD
Sustainability 2019,
Sustainability 2019,11,
11,4458
x FOR PEER REVIEW 17 of
17 of 30
35

methodology identified by Ryan 2014 [66] and composed of the following steps: inquiring, framing,
Ryan 2014 [66]
formulating, and composed
generating, of theand
facilitation, following steps: inquiring, framing, formulating, generating,
reflecting.
facilitation, and reflecting.

Figure 15. Graphic scheme about the HD process Assess, Research, Collect, Visualize, Interpret
(ARCVI).
Figure 15. Graphic scheme about the HD process Assess, Research, Collect, Visualize, Interpret
(ARCVI). of the Data Framework
4.1. Assessment
In order toofproperly
4.1. Assessment assess a data framework is vital to understand the scope of the projects
the Data Framework
which allows moreover to define the boundaries of the system, from the social, regional, urban or
In order to properly assess a data framework is vital to understand the scope of the projects
industrial system. However, “systems rarely have real boundaries” [48] (p. 95), but mankind has used
which allows moreover to define the boundaries of the system, from the social, regional, urban or
them to define otherwise endless concepts according to their intended purposes [48]. Each project
industrial system. However, “systems rarely have real boundaries” [48] (p. 95), but mankind has used
has a key topic from where to start the analysis: a particular industry, sector, value chain, or context.
them to define otherwise endless concepts according to their intended purposes [48]. Each project
The preliminary conditions for each project frame this starting point. When dealing with territories
has a key topic from where to start the analysis: a particular industry, sector, value chain, or context.
(such as cities, regions or countries), these conditions can be defined by political, geographical or
The preliminary conditions for each project frame this starting point. When dealing with territories
cultural borders, depending on the case.
(such as cities, regions or countries), these conditions can be defined by political, geographical or
Afterwards, the definition passes to the categories in which the principal topic will be analysed.
cultural borders, depending on the case.
These categories are distributed into subjects depending on the scope of the research. For example,
Afterwards, the definition passes to the categories in which the principal topic will be analysed.
in the case of the case study on the RETRACE project, the main categories of data were geography,
These categories are distributed into subjects depending on the scope of the research. For example,
demography, culture (material culture—craft, art and architecture—, gastronomy, history), economy,
in the case of the case study on the RETRACE project, the main categories of data were geography,
and urban centres (Figure 16).
demography, culture (material culture—craft, art and architecture—, gastronomy, history), economy,
The geography part focused both on an understanding of the principal morphological features
and urban centres (Figure 16).
and on the use of the soil by anthropomorphic activities, such as the residential area and productive
activities. Such categories deliver a frame for a wide analysis perspective of the area. Nevertheless,
to avoid an overly broad perspective, it is essential to establish the level of detail (subcategories)
according to the scope given and from the timeframe. The division into categories supports organized
data collection that will be key in further stages of the method. It is essential to canalize the bundle of
data to establish the scope of the investigation, which will delimit an early selection of the data that are
considered inside the process. At the end of this stage, the main outcome should be the generation of a
personalized format.
Sustainability 2019, 11, 4458 18 of 30
Sustainability 2019, 11, x FOR PEER REVIEW 18 of 35

Figure
Figure 16. Graphic scheme
16. Graphic scheme with
with an
an example
example of
of the
the categories
categories analysed
analysed for
for the
the HD
HD context
context analysis
analysis in
in
the RETRACE project.
the RETRACE project.
4.2. Research
The geography part focused both on an understanding of the principal morphological features
and on thestep
This use was previously
of the divided into desk
soil by anthropomorphic and field
activities, research
such [54,55], using
as the residential areathe
andterminology
productive
from [67]: Such categories deliver a frame for a wide analysis perspective of the area. Nevertheless,
activities.
to avoid
1. Deskanresearch:
overly broad
In thisperspective, it is of
case, the review essential to establish
information about thethestate-of-the-art
level of detailis(subcategories)
done through
according to the scope given and from the timeframe. The division
different sources, both conventional and unconventional. Conventional into categories supports
sources organized
are understood
data collection that will be key in further stages of the method. It is essential to
as existing scientific literature, official reports, and databases. Unconventional sources canalize the bundle
are
of data to establish
understood the scope
as official dataoffound
the investigation, which(Facebook,
on social networks will delimit an early
Twitter, selection
Youtube, of the data
LinkedIn) and
that are considered
audiovisual inside
media theNews,
(T.V., process. At Internet)
Radio, the end of this
that canstage, the mainon
be supported outcome
verifiedshould
portalsbe the
(Over
generation of a personalized format.
the years this trend has increased its popularity).
2. Field research: This typology defines research taken to the place where the collection of data
4.2. Research
will be developed. This involves tools and informal activities, such as interviews, observations,
This stepdescriptions
and live was previously divided into
of qualitative desk and field
and quantitative research [54,55], using the terminology
information.
from[67]:
These two types of research methods are well known to the research community and have been
1. Desk research:
developed by many In this case,
scholars. theshould
They reviewhappen
of information about theasstate-of-the-art
simultaneously, they complementis done
one through
another.
different sources, both conventional and unconventional. Conventional sources
Furthermore, in some cases, it is necessary to verify, in the field, the information found with deskare understood
as existing
research. scientific literature,
This verification official reports,
is done to increase the leveland databases.
of accuracy Unconventional
of the sourcesif the
research and verify are
understood as official data found on social networks (Facebook, Twitter, Youtube,
given data are current. However, both quantitative and qualitative data are needed to frame a topic. LinkedIn)
and research
The audiovisual
phasemedia (T.V.,
mainly News, on
depends Radio, Internet)
the level that can
of detail be data
of the supported on verified
targeted. Sometimes portals
the
(Over
defined the
goal inyears this trend phase
the assessment has increased
cannot beits reached
popularity).
due to many factors, as demonstrated in the
2. Fieldcase-study
multiple research: This typology
analysis defines
in Section research
3.3. For HD taken to the place
in industrial where the the
production, collection of data
collection will
of data
be developed.
for HD1 Thisitsinvolves
usually finds largest tools and informal
shortcoming in theactivities, such as interviews,
lack of openness and trust byobservations,
the industryandto
live descriptions
the researchers, throughof qualitative
the signingandof aquantitative
non-disclosure information.
agreement. It also requires many field visits
inside a production
These two typesplant to understand
of research methodsits arequalitative
well known aspects,
to the which
researchusually are notand
community given
havebybeen
the
industry, commonly because of the lack of analysis of particular aspects (e.g.,
developed by many scholars. They should happen simultaneously, as they complement one another. the calculation of heat
dispersion
Furthermore,during the cases,
in some process).
it isIndeed,
necessary from the evaluation
to verify, graph
in the field, the(see Figure 8),found
information it is possible
with deskto
notice how the field research in this case is very relevant to the HD1 stage, and it has
research. This verification is done to increase the level of accuracy of the research and verify if the been evaluated
with
givenfive,
datathe
are maximum score. Moreover,
current. However, in many
both quantitative and contexts, thedata
qualitative HD2are phase
needed at the beginning
to frame is
a topic.
seen The
as a research
completely useless
phase tooldepends
mainly that needs onto belevel
the developed
of detailbyof
researchers without Sometimes
the data targeted. initial support.
the
The RETRACE project, for example, finally demonstrated its potentialities
defined goal in the assessment phase cannot be reached due to many factors, as demonstrated after research synthesis,
in the
when each
multiple contributor
case-study to theinanalysis
analysis raised
Section 3.3. Forhis
HDorinher level ofproduction,
industrial awareness the
of the currentofsituation
collection data for
and
HD1 usually finds its largest shortcoming in the lack of openness and trust by the industry to the
wanted to continue to add information. For this reason, research synthesis is evaluated with the
researchers, through the signing of a non-disclosure agreement. It also requires many field visits
with five, the maximum score. Moreover, in many contexts, the HD2 phase at the beginning is seen
as a completely useless tool that needs to be developed by researchers without initial support. The
RETRACE project, for example, finally demonstrated its potentialities after research synthesis, when
each contributor to the analysis raised his or her level of awareness of the current situation and
wanted to continue to add information. For this reason, research synthesis is evaluated with the
Sustainability 2019, 11, 4458 19 of 30
maximum score (5) in both stages of the HD process (see Figure 14). Another critical point, for
example, in this European project where the HD2 was performed at the same time in different
contexts,
maximumwas the(5)
score accessibility of certain
in both stages of the HDdatabases.
process The
(see level
Figureof14).
detail was not
Another equalpoint,
critical in allfor
theexample,
regions
involved due to the
in this European differences
project where thein the
HD2national census on
was performed at agriculture,
the same time economy, andcontexts,
in different populationwas(see
the
Figure 17). Due
accessibility to this problem,
of certain databases.the feedback
The level ofreceived
detail wasat this moment
not equal was
in all able
the to confirm
regions or modify
involved due to
the
the categories
differencesof inthe
thedata assessed
national censuspreviously.
on agriculture, economy, and population (see Figure 17). Due to
Fundamental
this problem, to this step
the feedback is keeping
received at thistrack of thewas
moment reference
able toused to identify
confirm or modifythethe
data, the day when
categories of the
the
dataresearch
assessedwas performed, and the person in charge of the research, in the case of a large team.
previously.

(a) (b)

(c) (d)

Figure
Figure 17. Comparison
Comparison between
between the the giga-maps
giga-maps realized
realized for
for the
the HD
HD context
context analysis
analysis inin the
the RETRACE
RETRACE
project.
project. Retrieved
Retrievedfrom
from[56].
[56].(a)(a)
Demography
Demography part of the
part Piedmont
of the Region,
Piedmont Italy;Italy;
Region, (b) demography part
(b) demography
of north-east,
part Romania;
of north-east, (c) demography
Romania; (c) demographypartpart
of Nord
of Nord Aquitaine, France;
Aquitaine, France;(d)
(d)the
theBiscay
BiscayRegion
Region in
in
Basque
Basque Country, Spain.

Fundamental to this step is keeping track of the reference used to identify the data, the day when
4.3. Collect
the research was performed, and the person in charge of the research, in the case of a large team.
The aim of this phase is to assemble the data gathered in the research phase. Such data are
organized
4.3. Collect inside the format established in the ASSESSMENT step. Alongside this process, it is
important to include the references for each data in order to guarantee accuracy inside the analysis
The aim of this phase is to assemble the data gathered in the research phase. Such data are
and enable tracing of the information at all times. This organization will support the researcher in
organized inside the format established in the ASSESSMENT step. Alongside this process, it is
further steps. Once the format is completed, the main outcome should be a unified database.
important to include the references for each data in order to guarantee accuracy inside the analysis and
enable tracing of the information at all times. This organization will support the researcher in further
steps. Once the format is completed, the main outcome should be a unified database.
One of the key aspects of this phase is the confrontation of ideas between all the actors of the
multidisciplinary research team because it allows a collection of data under diverse disciplines, thereby
giving the analysis a wider approach. One suggestion is to use a database that is common and
well-known between all the actors to facilitate the integration of feedback. Here, the HD format
becomes an important tool to reach a synchronized dialogue between the actors of the research,
allowing them to add information into the format simultaneously. This advantage facilitates research
collaboration between people in different places and countries (Table 1).
Sustainability 2019, 11, 4458 20 of 30

Table 1. Example of a database used in RETRACE project.

Person in Charge Date of Specific Year Related to

Main Topic Category Sub-Category Data Unit Reference More Info
of the Research Research Data the Data
Regione Piemonte.
Monitoraggio del consumo di
suolo in Piemonte, 2015, p. 51.
20 January Piedmont USE OF Retrieved from https://www.
Chiara GEOGRAPHY Urban area 147,316 ha 2013 latest data
2019 Region THE SOIL regione.piemonte.it/web/sites/
default/files/media/documenti/
2019-02/monitoraggio_
consumosuolo_2015.pdf
Sustainability 2019, 11, 4458 21 of 30

In the RETRACE project, for the collection of data related to the HD2, an excel file was used.
This file was organized as represented in Table 1 and was able to keep track of each data collected.
It was also able to simplify future checks by a third party and provide a reliable document for the party
in charge of the research synthesis.

4.4. Visualize
The interpretation of the database on a first approach can be difficult, given the complexity of the
context. At this stage, the information and the potential connections between the categories are only
comprehensible by the research team. Therefore, this visualization phase is key to place the information
on a common ground where all actors can access it and have a productive and collaborative horizontal
dialogue. For an example created for the RETRACE project, please see Figures 12, 13 and 17.
To display the information smoothly and comprehensibly, it is necessary to use different graphics
tools to elaborate visualizations and infographics [68]; these tools may range from payment/free
software to freehand drawings. The display of this information allows one to glimpse potential
connections between the different categories relating quantitative and qualitative information:

Using drawings or pictures as a way of representing problems or issues is widely used

for collaborative problem-solving, and the power of diagrammatic representations to
evoke and record human perspectives is widely acknowledged across a range of domains
including sustainable development, social entrepreneurship, information visualisation and
knowledge representation. [69] (p. 5)

Visualization should be in line with the goal of communication. Visualization changes every time,
depending on the goal and its public. As Tufte wrote, context is essential to understand visualization,
and “graphics must not quote data out of context and context is essential for graphical integrity” [68]
(p. S1678). In this phase the role of the designer is highlighted as a mediator between complex data and
all actors of a project, translating the given information into efficient and simple visual language. This is
possible thanks to their skills in communication and user analysis. Each single category collected
in a single paper permits the creation of infographic maps that should be made “through stages of
refinements shifting between manual and digital media...helped the designer to internalize very large
amounts of information...printing it out in hard copy and hanging it on the office or studio wall would
make these large amounts of information immediately accessible at any time”, as Sevaldson suggested
for the giga-maps [42] (p. 12).
As seen in the case studies, research synthesis acquires a central role in the management of
complexity, proving to be a useful method for researchers to control a significant quantity of data
(see the Mexican case and the EN.FA.SI project), where the research synthesis gains two points for its
importance in the entire process–to be used as a platform where, on the printed giga-maps, all the
stakeholders can comment, give their feedback, and have a big picture of the system during analysis,
thereby scoring five points.
Sustainability 2019, 11, 4458 22 of 30

4.5. Interpretation of Complexity

The visualization of the data helps to ease one’s reading and interpretation of the complexity,
which is considered a qualitative inductive method. This method allows one to reframe the so called
wicked problems [30] of a territorial system, highlighting the driving factors and the sleeping assets.
This means it aims to reach, adopt, and mirror the complexity and wickedness of real-life networks
of interconnected problems [43]. This process allows an effective and holistic reading of the territory,
enabling a deep and effective analysis of the context by locating connections among the data presented
on each map. Moreover, visualization enables the interpretation of the data’s flows, as well as relational
factors, encouraging an overview of the existing relationships between the components and processes.
Such interpretation oversees the system’s criticalities beyond the immediate cause but from a wider
perspective of how it can be addressed from a systemic point of view [70]. Therefore, these elements
are not solved in a logical way, and the process is not taken over by the designer. On the contrary,
visualization allows all members of the multidisciplinary research team to have access to the same kind
of information to elaborate further analysis of a complex scenario, integrating all feedback. Ultimately
this stage shows that this kind of method leaves the HD open and comprehensible to everyone,
from experts in the field to common citizens.
In the case of the RETRACE project, an example of the ‘interpretation of the complexity’ delivered
by the information collected in the HD process (see the case study on policy-making) was the recognition
of a gap in the current policies activated at a regional level. In fact, at the regional level, there is
a high presence of companies related to the food sector (based on more than 3000 data from the
focus on economy) and a high amount of agricultural vocations (more than 1,000,000 ha of useful
agricultural area, based on data from the focus on geography), as well as many well-known products at
the international level (data from the focus on gastronomy culture). However, the companies working
in the primary sector are not considered by the policies that currently focus on industrial sectors in
decline, although these activities are great producers of organic waste, which can be improved and
reduced using practises on Circular Economy.

4.6. Research Challenges

This research started in 2016 thanks to the reflections carried out for the European project. It is
possible to individuate some challenges related both to the framework proposed and the research itself.
Although the HD method has proven its effectiveness and accuracy, there are certain limitations to be
considered, which were also pointed out in the description of the framework steps.
In all case studies, a large challenge is data accessibility. The most common issue is related to
database consultation in different contexts. This is due to the lack of updates, language barriers, and the
level of detail of the information delivered on such platforms. Parallel to this, the main issue relies on
where date are incomplete or cannot be found. Moreover, the collection of quantitative and qualitative
data requires a close partnership with local stakeholders, not only for access to tangible databases
but also for the collection of intangible data as behavioural or cultural. In many cases, the HD has
demonstrated itself to be an effective process for all actors in the territory and is able to increase
awareness of the local resources. This happens because these actors were stimulated to think in a
holistic way, thereby enlarging the borders of their scenario understanding outside the classic narrow
approach and overpassing the ‘localism’ effect sometimes present inside a few kilometres. Another
challenge is the cultural barrier rooted in the current cultural paradigm, linear thinking, and language.
The method requires an interdisciplinary team, in some cases managing authorities or corporate
teams (traditional structures), which will have a top-down approach. This will entail some troubles in
assembling a team within the workgroup. For example, the HD within the RETRACE Interreg Europe
project was a key element in the decision-making processes, helping to visualize, from a wider lens,
multidisciplinary teamwork at a policy level, through the collection of different feedback from all
stakeholders across the spectrum. At the same time, HD also provided the opportunity to visualize the
main difficulties faced by actors who are not familiarized with the SD Approach, which disrupts the
Sustainability 2019, 11, 4458 23 of 30

traditional linear top-down approach of governance and instead deals with multiple components and
bottom-up approaches. HD promotes a multi-stakeholder approach, which passes from the general to
the particular, and vice versa.
A crucial phase is the identification of system boundaries and the level of detail of the analysis
in the assessment step, which can influence the system analysis and the final results because of its
high level of dependence from the system observer. Certainly, this framework must be adapted to the
preliminary conditions of each project, as demonstrated by the different case studies. Each project
proposed for an HD has a specific topic for analysis: a particular industry, sector, value chain, or territory.
The analysis of these topics within the HD method can define and highlight various potentialities and
criticalities, helping to define new scenarios.
A challenge related to multidisciplinarity is the requirement of involving multiple experts in the
working team alongside the designers. This can also represent a preliminary obstacle for funding
reasons. However, HD offers a playground of collaborations, which take the interpretation phase to a
higher level.
Moreover, the challenges can be related to the research itself. Effort was employed in framing the
proposed design method to provide a framework adaptable to all the design requirements. For this
goal, case-studies were selected among the previous studies in different sectors carried out by the
department. Until now, HD was always guided by the SD research group in Politecnico di Torino
and executed by a mixed group of stakeholders in the different territories where the projects were
proposed. HD has not yet been proved to be effective without the leading role of systemic designers,
which could represent a limit. However, this study opens the use of the HD method to the research
community for a testing phase in multi-layered projects.

5. Conclusions
Today’s societal challenges require holistic approaches that are able to interpret and provide
innovative and sustainable solutions. Within such scenarios are necessary creative and structured
design methodologies, which represent the key to intervening in contemporary issues and shaping
future designs for sustainability. New approaches like SD provide specific tools to help design new
relations among the entities of a system, displaying their hidden relationships and potentialities and
facilitating a proactive collaboration among the actors. This process of integrating ST in design allows
contexts to be understood more deeply with a wider perspective. A key component of this disruptive
approach is the HD tool, which can be applied to diverse contexts (from industrial production to
local communities and policy-making), delivering effective strategies to frame and reveal problems
efficiently in any complex context that, consequently, can facilitate decision-making processes.
HD, as a method, has been previously described and defined in different papers and
books [14,41,54,55]. From that starting point, this article aimed to define and assess it as a detailed
process step by step, to be applied in different fields to organize information about complex scenarios
in a holistic and effective way. This method is poised to transcend beyond the design scene to be
implemented by other scholars and workers in different sectors, thereby facilitating interdisciplinary
discussions on SD. For more than over 10 years, this process has been proven in diverse case studies,
from industry to communities to policy-making, allowing us to recognize and understand the benefits
and limits of this method at different levels.
Sustainability 2019, 11, 4458 24 of 30

The HD overview of complex scenarios provides tools to encourage the generation of

new cooperation channels among different local actors, generating more sustainable solutions.
The information breakdown of complex phenomena into a holistic perspective for all stakeholders
promotes horizontal dialogue between stakeholders. This aspect is delivered effectively through data
infographics that improve decision-making processes and allows an overview of all potentialities
and the so-called ‘sleeping assets’, which can activate new relations among the context components,
thus generating new autopoietic systems. This method, through the generation of resilient systems,
allows flexibility on multi-levels, passing from regional to national. At the same time, it delivers a
structured methodology that facilitates effective implementation of the HD, producing more accurate
results. Fostering a multidisciplinary approach that invites participants from different sectors to
co-create within an interdisciplinary scenario will connect governments and citizens, to obtain more
sustainable development.
After showing the wide range of applications of this method, one of the figures that stands
out in the process as the main mediator between actors or stakeholders is the designer. This role,
acquired by the designer during his/her experience in design practise, is required by disciplines that
are multidisciplinary themselves. Certainly, the designer is a fundamental actor for the HD process
because of his/her problem-solving and communication skills. These assets are key for the processing
of information, thus transforming it into comprehensible and tangible reading for all stakeholders
involved. To achieve this in an accurate way during the process, the designer has encounters with
specialists in the areas involved in order to ensure a correct interpretation of the facts. This means
the designer is in the spotlight of the HD method as a connector/mediator among all competencies
and acts as a transdisciplinary team leader, who involves all actors inside the analytical framework.
This proves that the design discipline has the necessary elements to use creative and structured
innovation approaches to face the complexity in HD analysis.

Author Contributions: Conceptualization, C.B., C.G.N., and S.B.; Investigation, C.B. and C.G.N.; Methodology,
C.B., C.G.N., and S.B.; Supervision, S.B.; Validation, S.B.; Visualization, C.B. and C.G.N.; Writing—original draft,
C.B. and C.G.N.; Writing—review & editing, C.B., C.G.N., and S.B.
Funding: This research received no external funding.
Conflicts of Interest: The authors declare no conflict of interest.
Sustainability 2019, 11, 4458 25 of 30

Appendix A

Table A1. Results of the literature review.

Subject Area Citation in Abstract Year Authors

“This article explores how quantitative risk and qualitative threat approaches led to incomplete
SOCIAL SCIENCE—conflicts 2019 Boeke, S., de Valk, G.
analyses, and how bureaucratic processes stifled a holistic diagnosis of the situation in Mali.”
“It was structured around three main stakeholders’ workshops to support the holistic diagnosis,
DESIGN and AGROECOLOGY 2019 Audouin, E., Bergez, J.-E., Therond, O.
the design of a normative vision, and the backcasting approach of the transition pathway.”
“A holistic diagnostic approach is crucial to diagnose this condition and initiate therapy before
MEDICINE—clinical 2018 Anand, P., Aggarwal, S., Garg, S.
complications set in.”
“We report results of systematic, holistic, diagnostic, and cell studies to elucidate the mechanistic Steinbach, A.J., Allen, J.S., Borup, R.L., (...),
ENGINEERING—materials 2018
role of the experimentally determined influence of the anode gas-diffusion layer (GDL . . . ).” Zenyuk, I.V., Weber, A.Z.
“We have tried to answer this question by a holistic diagnosis of water management and its
ENGINEERING—water 2018 Merabet-Baghli, N., Bouanani, A., Billaud, J.P.
projection in the future.”
“Holistic diagnostic sugarcane supply chain studies are critical and have in the past identified
ENGINEERING—griculture Shongwe, M.I., Bezuidenhout, C.N.
several system-scale opportunities.”
“Integrated Assessment of Left Ventricular Electrical Activation and Myocardial Strain Mapping
in Heart Failure Patients: A Holistic Diagnostic Approach for Endocardial Cardiac Maffessanti, F., Prinzen, F.W., Conte, G., (...),
MEDICINE—ENGINEERING 2018
Resynchronization Therapy, Ablation of Ventricular Tachycardia, and Biological Therapy.” Krause, R., Auricchio, A.
(in TITLE)
“We report results of systematic, holistic, diagnostic, and cell studies to elucidate the mechanistic
role of the experimentally determined influence of the anode gas-diffusion layer (GDL) on the Steinbach, A.J., Allen, J.S., Borup, R.L., (...),
MEDICINE—ENGINEERING 2018
performance of ultra-thin electrode polymer-electrolyte fuel cells, which can further enable Zenyuk, I.V., Weber, A.Z.
fuel-cell market penetration.”
“The wave-based NDT methods are found to be a value-added complement to routine
ENGINEERING/ARCHITECTURE 2017 Riggio, M., Macchioni, N., Riminesi, C.
methodologies for a holistic diagnosis of timber members.”
Ito, K., Takamatsu, K., Nohno, K., Sugano, A.,
“The result implies the need for holistic diagnosis and counseling for patients with
MEDICINE—gynaecology 2017 Funayama, S., Katsura, K., Kaneko, N., Ogawa, M.,
dryness complaints.”
Meurman, J.H., Inoue, M.
HUMAN-COMPUTER INTERACTIONS— “Starting from an holistic diagnosis and the analysis of trends, the team define six personas, Montagner, F., Stabellini, B., di Salvo, A.,
2017
data design useful to write down essential guideline.” Tamborrini, P.M., Marcengo, A., Geymonat, M.
Maffessanti, F., Prinzen, F.W., Conte, G., Regoli, F.,
“A Holistic Diagnostic Approach for Endocardial Cardiac Resynchronization Therapy, Ablation
MEDICINE—cardiology 2017 Caputo, M.L., Suerder, D., Moccetti, T., Faletra, F.,
of Ventricular Tachycardia, and Biological Therapy.”
Krause, R., Auricchio, A.
“To this end, complex questions surrounding access to and control of information as well as
pedagogical theory and practice need to be radically re-examined to ensure not only holistic
SOCIAL SCIENCE—governance 2017 Camilleri, J.
diagnosis but also institutional arrangements that can connect remedial responses into some
relatively coherent whole.”
Sustainability 2019, 11, 4458 26 of 30

Table A1. Cont.

Subject Area Citation in Abstract Year Authors

“Introduction Clinical holistic diagnosis (CHD) in Chinese medicine (CM) has tried to evaluate
MEDICINE—integrative 2016 Luo, C.-H., Chung, C.-Y.
most of the whole body functions non-invasively but subjectively via pulse diagnosis (PD).”
“Introduction Pulse diagnosis (PD) in Chinese medicine (CM) is a well-established clinical tool
MEDICINE—integrative 2016 Luo, C.-H., Su, C.-J., Huang, T.-Y., Chung, C.-Y.
used to aid holistic diagnosis.”
“In the process of critiquing this underside of MHE, psychopathologists are treated to a novel
categorizing of themselves from a sociology of knowledge framework and psychopathology is
MEDICINE—psychopathology 2016 Ajani ya Azibo, D.
offered a reframing of how to formulate holistic diagnostic impressions of ADP encompassing
authentic culture.”
“The first approach is called symptom diagnostics, whereas the second is called holistic diagnosis
ENGINEERING—mechanical 2015 Żółtowski, B., Kostek, R.
. . . . Whereas in holistic diagnostics two kinds of models are used: linear and non-linear.”
“This mixed methods research examined how holistic diagnostic feedback (HDF) is processed by Jang, E.E., Dunlop, M., Park, G.,
COGNITIVE SCIENCE 2015
young learners with different profiles of reading skills, goal orientations, and perceived ability.” van der Boom, E.H.
“Magic is neither modern nor traditional nor irrational per se, but has to be contextualized and
PHILOSOPHY described in terms of characteristics like holistic diagnosis, interpersonal congruence, the 2015 Koch, A.
imaginations of agency, and efficacy.”
“While still at early stages in the clinical phenome domain, there remains great promise that CZP
Yu, Y.-N., Liu, J., Zhang, L., Wang, Z., Duan, D.D.,
MEDICINE—pharmacology can help us realize the application of personalized medicine and contribute to rational holistic 2015
Wang, Y.-Y.
diagnosis and treatment.”
“Due to continuous development in advanced analytical techniques and in bioinformatics,
Bujak, R., Struck-Lewicka, W., Markuszewski, M.J.,
MEDICINE—biomedical metabolomics has been extensively applied as a novel, holistic diagnostic tool in clinical and 2014
Kaliszan, R.
biomedical studies.”
ENGINEERING—environmental engineering “Holistic diagnosis of pipeline system with impedance method.” 2014 Kim, S.
Sobieraj, A., Bracik, J., Paluch, K., Krysta, K.,
MEDICINE—Psychiatry and Psychotherapy “Liaison psychiatry in Poland—Can we achieve a successful holistic diagnosis?” 2013
Krupka-Matuszczyk, I.
“Mature field subsurface integrity: Formulation of new paradigm through holistic diagnostic
SAFETY 2013 Ismail, W.R., Pradana, A.F.
approach for D-field, Malaysia.”
“Inspired by SCM practitioners’ holistic diagnostic processes, an integrated diagnostic model Do, J.-H., Jang, E., Ku, B., Jang, J.-S., Kim, H.,
MEDICINE—complementary and alternative 2012
was then proposed by combining the four individual models.” Kim, J.Y.
“To do this, we construct a holistic diagnostic rubric that allows us to examine atmospheric
Shukla, S.P., Chandler, M.A., Rind, D., Sohl, L.E.,
COMMUNICATION—CLIMATE SCIENCE teleconnections, both energetically and dynamically, as produced by a general 2011
Jonas, J., Lerner, J.
circulation model.”
“Another SHM solution has also been created that gathers raw vibration data and converts them
TRANSPORTATION—SUSTAINABILITY 2011 Matros, J.
into valuable information enabling analysts to provide a holistic diagnosis of a structure.”
“Antioxidants work against degenerative processes in the central nervous system: Holistic
MEDICINE—complementary and integrative 2009 Kersteen, W.
diagnosis and therapy of Parkinson’s syndrome.”
“An holistic diagnostic approach is therefore necessary to interpret the test results optimally. Ellis, M., Al-Ramadi, B., Finkelman, M.,
MEDICINE—microbiology Future studies should address this in further detail as well as the impact of empirical antifungal 2008 Hedstrom, U., Kristensen, J., Ali-Zadeh, H.,
drug use and patient outcome.” Klingspor, L.
MEDICINE—psychiatry “Therefore, psychiatric evaluation should be integrated into a holistic diagnostic formulation.” 2007 Eytan, A.
Sustainability 2019, 11, 4458 27 of 30

Table A1. Cont.

Subject Area Citation in Abstract Year Authors

“If we regard functional dysphonia in a child as a symptom of a disturbed relationship between
MEDICINE—paediatrics the child and his environment and as an indicator of a psychosocial conflict, e.g., within the 2007 Blaser, L., Seifert, E.
family, we have to deal with this through holistic diagnosis and therapy.”
MEDICINE—complementary and integrative “Coherence in medicine and holistic diagnosis.” 2007 Popp, F.-A.
“DSM-IV and the taxonomy of roles: How can the taxonomy of roles complement the DSM-IV to
MEDICINE—psychotherapy 2007 Roten, R.G.
create a more holistic diagnostic tool?”
“The successful dermatologic therapy requires the holistic diagnosis of the women with skin
MEDICINE—gynaecology disorders described above and use the antiandrogenic treatment with conventional methods and 2006 Szpringer, E.A., Lutnicki, K.R., Zych, I.S.
laser depilation in hirsutismus.”
“Nature observation and mythology as basis for holistic diagnostics and therapy in
MEDICINE 2004 Meier, P.
Theophrastus von Hohenheim (Paracelsus).”
“This is connected with general and multidimensional approach to the patient’s situation and Zegarlicka, M., Jarosz-Chobot, P., Kokoszka, A.,
MEDICINE—paediatrics 2004
therapy process and holistic diagnostical-therapeutical procedure.” Małecka-Tendera, E.
“We document the recent emergence of health and safety concerns, assess the responses of
MANAGEMENT/HEALTH employers and the Health and Safety Executive (HSE), critique the existing regulatory 2003 Taylor, P., Baldry, C., Bain, P., Ellis, V.
framework and present a holistic diagnostic model of occupationally induced ill-health.”
MEDICINE—anaesthesiology “By this way each component is mapped and a final (holistic) diagnosis can be made.” 2003 Poppe, C., Devulder, J., Mariman, A., Mortier, E.
MEDICINE—neurology “Holistic diagnosis and therapy: My ‘heart’ from the psychosomatic point of view.” 1995 Peseschkian, N.
“Hence the need to look at a broader institutional and policy context in an holistic diagnosis of
MANAGEMENT—PUBLIC
the training process before actually addressing the detailed profiles of training needs. 1992 Collins, P.D., Mullen, J.
ADMINISTRATION
Three levels.”
Sustainability 2019, 11, 4458 28 of 30

References
1. Rittel, H.W.J.; Webber, M.M. Dilemmas in a general theory of planning. Policy Sci. 1973, 4, 155–169. [CrossRef]
2. Capra, F.; Luisi, P.L. Vita e Natura: Una Visione Sistemica; Aboca: Südharz, Hirsch-Apotheke, Germany, 2014;
ISBN 978-88-95642-98-7.
3. Capra, F. The Turning Point: Science, Society, and the Rising Culture; Bantam Books: Toronto, ON, Canada;
New York, NY, USA, 1988; ISBN 978-0-553-34572-8.
4. Raworth, K. Doughnut Economics: Seven Ways to Think Like a 21st-Century Economist; Random House Business
Books: London, UK, 2017; ISBN 978-1-84794-139-8.
5. Brown, T.; Wyatt, J. Design Thinking for Social Innovation. Dev. Outreach 2010, 12, 29–43. [CrossRef]
6. Celaschi, F. Design as a mediation between areas of knowledge. In Man at the Center of the Project; Germak, C.,
Ed.; Allemandi and C.: Torino, Italy, 2008.
7. Celaschi, F.; Formia, E.; Lupo, E. Do transdisciplinar ao indisciplinado modo de aprender design: Educar
através de/para a Disruption. Strateg. Des. Res. J. 2013, 6, 1–10. [CrossRef]
8. Weigand, K.; Flanagan, T.; Dye, K.; Jones, P. Collaborative foresight: Complementing long-horizon strategic
planning. Technol. Forecast. Soc. Chang. 2014, 85, 134–152. [CrossRef]
9. Jones, P.H. Systemic Design Principles for Complex Social Systems. In Social Systems and Design; Metcalf, G.S.,
Ed.; Springer: Tokyo, Japan, 2014; Volume 1, pp. 91–128. ISBN 978-4-431-54477-7.
10. Jones, P.; Kijima, K. (Eds.) Systemic Design: Theory, Methods, and Practice. In Translational Systems Sciences;
Springer: Tokyo, Japan, 2018; Volume 8, ISBN 978-4-431-55638-1.
11. Systemic Design Research Network (SDRN). Available online: https://systemic-design.net/sdrn/ (accessed on
25 June 2019).
12. Systemic Design Association. Available online: https://systemic-design.net/sdrn/ (accessed on 25 June 2019).
13. ZERI Foundation. Available online: http://www.zeri.org/ (accessed on 10 June 2019).
14. Bistagnino, L. Systemic Design. In Design the Production and Environmental Sustainability, 2nd ed.; Slow Food:
Bra, Italy, 2011.
15. Barbero, S. L’approccio metodologico del Design Sistemico. In Il Fare Ecologico; Lanzavecchia, C., Ed.;
Edizioni Ambiente: Milano MI, Italia, 2012; ISBN 978-88-6627-062-1.
16. Barbero, S.; Pallaro, A. Systemic design and policy making: The case of Retrace project. In Proceedings of the
Relating Systems Thinking and Design (RSD5) Symposium, Toronto, ON, Canada, 13–15 October 2016.
17. Battistoni, C.; Barbero, S. Systemic Design, from the content to the structure of education: New educational
model. Des. J. 2017, 20, S1336–S1354. [CrossRef]
18. RETRACE Project. Available online: https://www.interregeurope.eu/retrace/ (accessed on 5 June 2019).
19. PROGIREG Project. Available online: http://www.progireg.eu/ (accessed on 20 June 2019).
20. Yin, R.K. Case Study Research and Applications: Design and Methods; Sage Publications: Shawzend Oaks, CA,
USA, 2017.
21. Ceschin, F.; Gaziulusoy, I. Evolution of design for sustainability: From product design to design for system
innovations and transitions. Des. Stud. 2016, 47, 118–163. [CrossRef]
22. Bagheri, A.; Hjorth, P. Planning for sustainable development: A paradigm shift towards a process-based
approach. Sustain. Dev. 2007, 15, 83–96. [CrossRef]
23. Geels, F.W.; McMeekin, A.; Mylan, J.; Southerton, D. A critical appraisal of Sustainable Consumption and
Production research: The reformist, revolutionary and reconfiguration positions. Glob. Environ. Chang. 2015,
34, 1–12. [CrossRef]
24. Loorbach, D. Transition Management for Sustainable Development: A Prescriptive, Complexity-Based
Governance Framework. Governance 2010, 23, 161–183. [CrossRef]
25. Design Council. Eleven Lessons: Managing Design in Eleven Global Companies-Desk Research Report 2008; Design
Council: London, UK, 2018.
26. Gruber, M.; de Leon, N.; George, G.; Thompson, P. Managing by Design. Acad. Manag. J. 2015, 58, 1–7.
[CrossRef]
27. Meroni, A. Creative Communities. People Inventing Sustainable Ways of Living; Edizioni Polidesign: Milano MI,
Italia, 2007.
28. Ryan, C. Eco-Innovative Cities Australia. In System Innovation for Sustainability 1: Perspectives on Radical
Changes to Sust; Greenleaf Publishing Limited: Sheffield, UK, 2008; pp. 197–213. ISBN 978-1-907643-36-1.
Sustainability 2019, 11, 4458 29 of 30

29. Papanek, V.; Fuller, R.B. Design for the Real World; Thames and Hudson: London, UK, 1972.
30. Buchanan, R. Wicked problems in design thinking. Des. Issues 1992, 8, 5–21. [CrossRef]
31. Valade-Amland, S. Design for People, Profit, and Planet. Des. Manag. Rev. 2011, 22, 16–23. [CrossRef]
32. De los Rios, I.C.; Charnley, F.J.S. Skills and capabilities for a sustainable and circular economy: The changing
role of design. J. Clean. Prod. 2017, 160, 109–122. [CrossRef]
33. Dorst, K. The core of ‘design thinking’ and its application. Des. Stud. 2011, 32, 521–532. [CrossRef]
34. Van Manen, M. Beyond assumptions: Shifting the limits of action research. Theory Pract. 1990, 29, 152–157.
[CrossRef]
35. Ramage, M.; Shipp, K. Systems Thinkers; Springer: London, UK, 2009; ISBN 978-1-84882-524-6.
36. Von Bertalanffy, L. General System Theory: Foundations, Development, Applications; George Braziller: New York,
NY, USA, 1969.
37. Wiener, N. Cybernetics or Control and Communication in the Animal and the Machine; The MIT Press: Cambridge,
MA, USA, 1948.
38. Charnley, F.; Lemon, M.; Evans, S. Exploring the process of whole system design. Des. Stud. 2011, 32, 156–179.
[CrossRef]
39. Bhamra, T.; Hernandez, R.; Mawle, R. Sustainability: Methods and Practices. In Handbook of Design for
Sustainability; Bloomsbury: London, UK, 2013; pp. 106–120.
40. Montagner, F.; Stabellini, B.; Di Salvo, A.; Tamborrini, P.M.; Marcengo, A.; Geymonat, M. Data Design for
Wellness and Sustainability. In Universal Access in Human–Computer Interaction. Human and Technological
Environments; Antona, M., Stephanidis, C., Eds.; Springer International Publishing: Cham, Switzerland, 2017;
Volume 10279, pp. 562–578. ISBN 978-3-319-58699-1.
41. Bistagnino, L. microMACRO. Micro Relations as a Vital Network of Economic and Productive System, 2nd ed.;
Edizione Ambiente: Milano, Italy, 2017; ISBN 978-88-6627-211-3.
42. Sevaldson, B. Systems Oriented Design: The emergence and development of a designerly approach to
address complexity. In Proceedings of the 2nd International Conference for Design Education Researchers,
Oslo, Norway, 14–17 May 2013; pp. 1–22.
43. Sevaldson, B. Visualizing Complex Design: The Evolution of Gigamaps. In Systemic Design; Springer:
Berlin/Heidelberg, Germany, 2018; pp. 243–269.
44. Mollison, B. Permaculture: A Designer’s Manual; Tagari Publications: Tyalgum, New South Wales, Australia,
1988.
45. Zhang, Y.; Yang, Z.; Yu, X. Urban metabolism: A review of current knowledge and directions for future study.
Environ. Sci. Technol. 2015, 49, 11247–11263. [CrossRef]
46. Eurostat. Economy-wide material flow accounts (EW-MFA). In Compilation Guide; Eurostat: Brussels,
Belgium, 2013.
47. Midmore, P.; Munday, M.; Roberts, A. Assessing industry linkages using regional input-output tables.
Reg. Stud. 2006, 40, 329–343. [CrossRef]
48. Meadows, D.H. Thinking in Systems: A Primer; Wright, D., Ed.; Chelsea Green Publishing: White River
Junction, VT, USA, 2011; ISBN 978-1-60358-055-7.
49. Agudelo-Vera, C.M.; Mels, A.; Keesman, K.; Rijnaarts, H. The urban harvest approach as an aid for sustainable
urban resource planning. J. Ind. Ecol. 2012, 16, 839–850. [CrossRef]
50. Wolf, M.-A.; Chomkhamsri, K.; Brandao, M.; Pant, R.; Ardente, F.; Pennington, D.W.; Manfredi, S.;
De Camillis, C.; Goralczyk, M. ILCD handbook-general guide for life cycle assessment-detailed guidance.
2010. Available online: https://eplca.jrc.ec.europa.eu/uploads/ILCD-Handbook-General-guide-for-LCA-
DETAILED-GUIDANCE-12March2010-ISBN-fin-v1.0-EN.pdf (accessed on 25 June 2019).
51. Oxman, R. Think-maps: Teaching design thinking in design education. Des. Stud. 2004, 25, 63–91. [CrossRef]
52. Berg, T.; Pooley, R. Rich Pictures: Collaborative Communication Through Icons. Syst. Pract. Action Res. 2013,
26, 361–376. [CrossRef]
53. Buzan, T.; Buzan, B. How to Use Radiant Thinking to Maximize Your Brain’s Untapped Potential; Dutton: New York,
NY, USA, 1996.
54. Gaiardo, A. Innovation, Entrepreneurship and Sustainable Design. A Methodology Proposal for Sustainable
Innovation Initiatives. Ph.D. Thesis, Politecnico di Torino, Turin, Italy, 2016.
55. Barbero, S. Opportunities and challenges in teaching Systemic Design. In Proceedings of the Systems and
Design: Beyond Processes and Thinking, Valencia, Spain, 22–24 June 2016.
Sustainability 2019, 11, 4458 30 of 30

56. Battistoni, C.; Nohra, C.G. The Retrace Holistic Diagnosis. In Systemic Design Method Guide for Policymaking:
A Circular Europe on the Way; Barbero, S., Ed.; Allemandi: Torino, Italy, 2017; Volume 1, ISBN 978-88-422-2444-0.
57. Tamborrini, P.M. Food, Culture and Territory: EN.FA.SI for Cuneo bean. In Micro Relations as a Vital Network
of Economic and Productive System; MicroMacro: Milano, Italy, 2017; ISBN 978-88-6627-211-3.
58. Barbero, S.; Tamborrini, P. Systemic Design in AgroFood Sector: EN. FA. SI Project. In Proceedings of
the International Conference on Designing Food and Designing For Food, London, UK, 28–29 June 2012;
pp. 28–29.
59. Dalle Nogare, G. Sistema di Comunicazione Nuovo Fagiolo Cuneo. Bachelor’s Thesis, Politecnico di Torino,
Turin, Italy, 2014.
60. Barbero, S.; Battistoni, C. From the Sustainable Biscuit Production to Territorial Development through Systemic
Incubator; Croatian Association for PLM.: Zagreb, Croatian, 2016.
61. Bicocca, M. Sviluppo Rurale e Innovazione Sostenibile. Come L’Approccio del Design Sistemico Può Favorire
la Crescita Delle Aree Marginali. Ph.D. Thesis, Politecnico di Torino, Turin, Italy, 2016.
62. Battistoni, C.; Pallaro, A.; Arrizabalaga Arambarri, L. Systemic Design for a sustainable local economic
development: Lea-Artibai case study. In Proceedings of the Libro de Actas—Systems and Design: Beyond
Processes and Thinking (IFDP-SD2016), Universitat Politècnica València, Valencia, Spain, 22–24 June 2016.
63. Barbero, S. Systemic Design Method Guide for Policymaking: A Circular Europe on the Way; Allemandi: Torino,
Italy, 2017; Volume 1, ISBN 978-88-422-2444-0.
64. Regione Piemonte. Regione Piemonte Piano Regionale di Gestione dei Rifiuti Speciali (Allegato A); Regione
Piemonte: Torino, Italy, 2015.
65. Battistoni, C.; Barbero, S. The Holistic Diagnosis as a Method to Support urban Mining Actions: The Case Study of
the European Project Retrace for Piedmont Region (Italy); CISA Publisher: Padova, PD, Italy, 2018.
66. Ryan, A. A Framework for Systemic Design. FORMakademisk 2014, 7, 1–14. [CrossRef]
67. Celaschi, F.; Deserti, A. Design e Innovazione: Strumenti e Pratiche per la Ricerca Applicata; Carocci: Roma,
Italy, 2007.
68. Stabellini, B.; Remondino, C.L.; Tamborrini, P. Data Visualization Collection. How graphical representation
can inspect and communicate sustainability through Systemic Design. Des. J. 2017, 20, S1673–S1681.
[CrossRef]
69. Berg, T.; Bowen, T.; Smith, C.; Smith, S. Visualising the future: Surfacing student perspectives on
post-graduation prospects using rich pictures. High. Educ. Res. Dev. 2017, 36, 1339–1354. [CrossRef]
70. Ruttonsha, P. Towards a (Socio-ecological) Science of Settlement: Relational Dynamics as a Basis for Place.
In Systemic Design; Springer: Berlin/Heidelberg, Germany, 2018; pp. 173–240.

© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).