Applied Soft Computing 57 (2017) 265292

Contents lists available at ScienceDirect

Applied Soft Computing

journal homepage: www.elsevier.com/locate/asoc

Review Article

A systematic review and meta-Analysis of SWARA and WASPAS

methods: Theory and applications with recent fuzzy developments
Abbas Mardani a, , Mehrbakhsh Nilashi b,d, , Norhayati Zakuan a ,
Nanthakumar Loganathan a , Somayeh Soheilirad a , Muhamad Zameri Mat Saman c ,
Othman Ibrahim b
a
Faculty of Management, Universiti Teknologi Malaysia (UTM), Skudai Johor, Malaysia
b
Faculty of Computing, Universiti Teknologi Malaysia (UTM), Skudai Johor, 81310, Malaysia
c
Department of Manufacturing and Industrial Engineering, Faculty of Mechanical Engineering, Universiti Teknologi Malaysia, Skudai, Malaysia
d
Department of Computer Engineering, Lahijan Branch, Islamic Azad University, Lahijan, Iran

a r t i c l e i n f o a b s t r a c t

Article history: The Multiple Criteria Decision Making (MCDM) utility determining approaches and fuzzy sets are con-
Received 17 August 2016 sidered to be new development approaches, which have been recently presented, extended, and used by
Received in revised form 28 March 2017 some scholars in area of decision making. There is a lack of research regarding to systematic literature
Accepted 29 March 2017
review and classication of study about these approaches. Therefore; in the present study, the attempt is
Available online 5 April 2017
made to present a systematic review of methodologies and applications with recent fuzzy developments
of two new MCDM utility determining approaches including Step-wise Weight Assessment Ratio Analysis
Keywords:
(SWARA) and the Weighted Aggregated Sum Product Assessment (WASPAS) and fuzzy extensions which
Decision making
Fuzzy sets
discussed in recent years. Regarding this, some major databases including Web of Science, Scopus and
Multiple criteria decision making (MCDM) Google Scholar have been nominated and systematic and meta-analysis method which called PRISMA
PRISMA has been proposed. In addition, the selected articles were classied based on authors, the year of pub-
SWARA lication, journals and conferences names, the technique and method used, research objectives, research
WASPAS gap and problem, solution and modeling, and nally results and ndings. The results of this study can
assist decision-makers in handling information such as stakeholders preferences, interconnected or con-
tradictory criteria and uncertain environments. In addition, ndings of this study help to practitioners
and academic for adopting the new MCDM utility techniques such as WASPAS and SWARA in different
application areas and presenting insight into literature.
2017 Elsevier B.V. All rights reserved.

Contents

1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
2. Literature review . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267
2.1. Classication of MCDM methods with fuzzy theory sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267
2.2. MCDM utility determining methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
2.3. Distribution based on the MCDM utility determining techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
2.3.1. Weighted aggregated sum product assessment (WASPAS) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
2.3.2. WASPAS method with fuzzy theory sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269
2.3.3. WASPAS method and interval type-2 fuzzy sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269
2.3.4. WASPAS method based on interval-valued intuitionistic fuzzy numbers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270
2.3.5. WASPAS method with single-valued neutrosophic set . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
2.3.6. WASPAS method with grey number . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272

Corresponding author.
E-mail addresses: [email protected] (A. Mardani),
[email protected], [email protected] (M. Nilashi).

http://dx.doi.org/10.1016/j.asoc.2017.03.045
1568-4946/ 2017 Elsevier B.V. All rights reserved.
266 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

2.3.7. Stepwise weight assessment ratio analysis (SWARA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 273

3. Research methodology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274
3.1. Literature search . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274
3.2. Articles eligibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
3.3. Summarizing and data extraction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
4. Distribution of the MCDM utility determining techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
4.1. Application areas classication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
4.2. Distribution of papers based on WASPAS approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
4.3. Distribution of papers based on SWARA approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
4.4. Distribution of paper based on integration of SWARA and WASPAS approaches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277
4.5. Relationship and comparison analysis on the results of SWARA and WASPAS methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277
4.6. Distribution of papers by approaches and application elds . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
4.7. Distribution of papers by publication year and approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
4.8. Distribution of papers by journal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
5. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
Appendix A . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ??
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 288

1. Introduction cult and complex and achieving the optimal decision is impossible
though the single criterion [1].
In the operations research, mathematical modeling and sophis- Due to the nature of problems related to MCDM approaches,
ticated statistical analysis have been used for solving a number of there are various approaches are available for solution thereof.
business and organizational problems and improving a decision- Simple Additive Weighing (SAW) method as the rst multi-
making process [1]. Due to the increasing complexity of business criteria evaluation method was introduced by MacCrimmon [30].
environment, companies rely on analysis to make decisions, In addition, MacCrimmon [30] explained the two step of weighing
which were formerly based on managers intuition [2]. Operations including; criteria normalizing values and voting in an manage-
research provides the required tools for government agencies and ment team for importance coefcients of a criterion. Some other
large companies to make better decisions to reduce risks and to partial aggregation approaches such as ELimination and Choice
enhance the quality of their performance [3,4]. Challenges asso- Expressing REality (ELECTRE) and Preference Ranking Organisation
ciated with the development of technology and global economy Method for Enrichment Evaluations (PROMETHEE) have respec-
complicated the business environment even more. The operations tively suggested by Roy [31] and Brans and Mareschal [32]. Keeney
research based on the advanced software tools and sophisticated and Raiffa [33], improved and extended the MCDM approaches
mathematical models can help to evaluate all the options available by using multiple attribute utility function. Zavadskas, Kaklauskas
to a rm with respect to possible project outcomes and perform and Sarka [23], suggested the approach of Complex Proportional
the analysis of risks associated with making particular decisions. Assessment (COPRAS). Some other approaches based on pair-wise
The results obtained in these analyses present the complete infor- comparisons are Analytic Network Process (ANP) and Analytic Hier-
mation, based on which managers, decision makers and policy archy Process (AHP) [35,36]. Zavadskas, Turskis, Antucheviciene
makers can make the required decisions and work out an appro- and Zakarevicius [37], suggested the new MCDM utility determin-
priate policy. As an effective approach, Multiple Criteria Decision ing approach which called the Weighted Aggregated SumProduct
Making (MCDM) was widely used to evaluate a nite number of Assessment (WASPAS). Hwang and Yoon [38], was proposed the
decision alternatives with multiple criteria [5,6]. It was used in Technique for the Order Preference by Similarity to Ideal Solution
various scientic elds, such as business and management [79], (TOPSIS). Opricovic and Tzeng [39], is introduced the VlseKriteri-
risk management [10,11], computer science [7,12,13], health and jumska Optimizacija I Kompromisno Resenje, means multi-criteria
medical [1416], engineering [1719]. In solving many real-world optimization and compromise solution (VIKOR) approach based
problems, it is difcult for decision makers to precisely assess the on linear normalization. In addition; Brauers and Zavadskas [40]
performance ratings and criteria weights [20]. The MCDM meth- was suggested the Multi-objective Optimization by Ratio Anal-
ods can be applied effectively to determining the value and utility ysis (MOORA) approach. Moreover; later, this approach was
degree of various areas and establishing the priority order for their extended by Brauers and Zavadskas [41] as called MULTIMOORA
implementation [21]. Using these methods, the problem of eval- (MOORA plus the full multiplicative form). These two approaches
uating a discrete set of alternatives can be examined based on including the pair-wise alternatives comparisons. Furthermore;
a set of decision criteria [22]. Different criteria represent various multi-objective optimization on the basis of simple ratio analy-
dimensions of the alternatives; as a result, they might be conict- sis approach suggested by Das, Sarkar and Ray [42]. Additive Ratio
ing with each other. For example, in the construction processes, Assessment (ARAS) method is proposed by Zavadskas and Turskis
complex decisions, involving a number of conicting and inter- [43]. Zavadskas, Turskis and Bagocius [44], used fuzzy ARAS method
active criteria are analyzed. As a result, the MCDM theory was to measure of deep-water port alternatives. In recent years, several
provided with the elements of mathematical statistics and MCDM of previous studies reviewed and classify the application of these
methodology, considering statistical relations between the devel- approaches in various areas such as; MCDM and E-learning [45],
oped criteria. In this regard, some scholars in recent years have MCDM and service quality [46], MULTIMOORA [47], MCDM and
attempted to develop, extend and present the new MCDM meth- transportation and tourism industries [48,49], MCDM, sustainable
ods and techniques, as well as utility determining approaches and renewable energy [5053], ELECTRE [54], MCDM and supply
[1,2329]. To reach the efcient decisions in various areas such chain [55], VIKOR [56], [57], MCDM techniques [58], Fuzzy Multi-
as economic, management, computer science, mathematical mod- ple Criteria Decision Making (FMCDM) [59]; TOPSIS [60] and [61],
elling, and mathematical conventional (hard) or soft computing can soft computing technology and MCDM [62], [63] and [64], MCDA
be used successfully. Generally in the real world problems are dif- analysis [65].
 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292 267

Various approaches have been suggested regarding the multi (DEA) [91,92], Roy [93], summarized the information on the ELEC-
attribute utility theory for MCDM. In this regard; two new MCDM TRE group methods. Seminal studies were prepared by Belton and
approaches which called Step-wise Weight Assessment Ratio Anal- Stewart [94] and Gal, Stewart and Hanne [95], Miettinen [96].
ysis (SWARA) and WASPAS were introduced in 2010 and 2012 by The related literature covers a number of classications of
[37] and [66]. However, the conducted surveys did not keep up MCDM tools with fuzzy theory sets. For example, Peneva and
with the changing situation in this eld. Therefore, the researchers Popchev [97] stated that if the weights were given as real numbers,
believe that there is a need for a systematic review of the most the operators, such as Ordered Weighted Maximum (OWMAX) and
important recent studies conducted in the considered area. In addi- Minimum (OWMIN) [98], weighted arithmetic means [99], and
tion, the researchers think that there is a need for a comprehensive the ordered weighted geometric operator Chiclana, Herrera and
paper, combining the available studies and methods. The presented Herrera-Viedma [100] could be applied to the aggregation of fuzzy
review attempts to systematically describe some previous studies relations. In the mathematical models, there are operators, whose
that employed the considered methods and techniques. This paper weights do not adequately represent them: Min, Max, MaxMin,
makes some contributions to this area of research. The current Gamma, and Generalized Mean [101]. The idea of using the given
study considered some new perspectives in reviewing the arti- weights in this case is offered in [102]. Inuiguchi, Ichihashi and
cles, such as classify of the papers based on authors, publication Tanaka [103], performed a study of recent developments in fuzzy
date, journal name, the technique and method, research objectives, programming. In their work, they employed such applications as
research gap and problem solution and modeling and, nally, the exible programming, possibilistic programming, possibilistic lin-
results and ndings. The structure of this review study is orga- ear programming with fuzzy goals, possibilistic programming with
nized as follows. Section 2 reviews the literature regarding the two fuzzy preference relations, possibilistic linear programming using
MCDM utility determining approaches. Section 3 presents research fuzzy max, and robust programming. The two other categories pro-
methodology including the systematic review, meta-analysis and posed by Hwang, Chen and Hwang [104] included the ways to
the procedure of this study. Section 4 presents the results based nd a ranking based on the degree of optimality, linguistic ranking
on MCDM utility determining techniques and application areas. methods and the comparison function, as well as Hamming dis-
Finally, Section 5 presents conclusion, limitations, and recommen- tance, proportion to the ideal, fuzzy mean and spread, centroid
dations for future studies. index, left and right scores, and area measurement. The second
category contains the methods, employing different ways of evalu-
ating the relative signicance of multi-attributes, including analytic
2. Literature review hierarchy process, fuzzy simple additive weighting methods, fuzzy
outranking methods, fuzzy conjunctive/disjunctive methods, and
2.1. Classication of MCDM methods with fuzzy theory sets maximin methods.
Based on the relationship among the aggregated arguments,
The MCDM methods cover a wide range of distinct approaches. the aggregation operators can be roughly divided into two classes:
The MCDM methods can be classied into two categories: the dis- the operators that consider the dependence of aggregated argu-
crete MCDM or discrete Multi-attribute Decision Making (MADM) ments and those that consider these arguments independently.
and continuous Multi-Objective Decision Making (MODM) meth- In the case of the rst class, Yager [105] introduced the Ordered
ods [6769]. Recently, hundreds of papers have been published Weighted Averaging (OWA) operator for reordering the arguments
to provide the information about MCDM methods, their develop- prior to their aggregation. This operator motivated Chiclana, Her-
ment and application in different elds. This article provides an rera and Herrera-Viedma [100] and Xu and Da [106] to propose
overview of the publications describing MCDM methods. The study the ordered weighted geometric (OWG) operator. Yager [107], used
was performed on the Web of Science, Scopus and Google Scholar the continuous interval-valued arguments to develop the Contin-
databases. The 1970s present an important period for many seminal uous Ordered Weighted Averaging (COWA) operator. Torra [108]
works. The fundamentals of modern MCDM methods were devel- and Torra and Narukawa [109] developed the Hesitant Fuzzy Sets
oped in 1950s and 1960s. The research and development of MCDM (HFSs) concept to present the hesitant fuzzy information, which
methods increased during the 80 s and early 90s, but it seems that covers the arguments with a set of possible values. It is consid-
the exponential growth of this process continued [70]. The book by ered to be a new efcient tool for collecting and representing the
Kksalan, Wallenius and Zionts [70] provides a brief history of the arguments under uncertainty, particularly, in the decision making
development of MCDM methods. It briey describes the develop- process. Zhu, Xu and Xia [110], investigated the geometric BMs
ment of this area from the ancient to modern times. Hwang, Masud, combined with hesitant fuzzy information and introduced the hesi-
Paidy and Yoon [71], provided a review of the development and tant fuzzy geometric Bonferroni means (HFGBM). Yu, Wu and Zhou
applications of MODM methods in a relatively short period of time. [111], developed the generalized hesitant fuzzy Bonferroni means
Keeney, Raiffa and Rajala [72], formulated the basics of decision (GHFBM), with its application in the multi-criteria group decision
with multiple objectives. Later, Tzeng and Huang [73] reviewed making (MCGDM).
the MADM methods SAW, TOPSIS, ELECTRE, and The Linear Pro- The aggregation techniques have a great inuence on the MCDM
gramming Technique for Multidimensional Analysis of Preference problems, and the aggregation operators were widely applied to
(LINMAP). Mardani, Jusoh, Md Nor, Khalifah, Zakwan and Valipour MCDM. In a fuzzy environment, Chen and Tan [112] developed
[74] and Mardani et al. [75,76] grouped MCDM and FMCDM tools several functions for measuring the extent, to which each alter-
in a different way. native is suitable with respect to a set of the criteria used in MCDM.
The related studies are performed on the previously developed Hong and Choi [113], used the maximum and minimum opera-
well-known methods, such as SAW [30], AHP [77,78], ANP [79], tions for developing some approximate techniques to address the
Decision-Making Trial and Evaluation Laboratory (DEMATEL) [80], MCDM problems. Moreover, the aggregation operators extended
PROMETHEE [81], ELECTRE [8285], TOPSIS [86], VIKOR [87,88], to the intuitionistic fuzzy environment (IFSs) [114] which play a
and their modications by applying fuzzy and grey number the- signicant role for basic elements that reect preference values
ory. Saaty [89], published a detailed study of the AHP. Later, Saaty or judgements of decision makers. Li [115], designed several lin-
[79] published a study of the further development of the ANP ear programming models and introduced the respective decision
method. Zeleny and Cochrane [90], published a book, dealing with making methods by means of IFSs. Liu and Wang [116], proposed a
the problem of the compromise theory. Data Envelopment Analysis series of score functions to be applied to solving MCDM problems
268 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

in accordance with the evaluation functions and the intuitionis- Table 1

Frequently of two new MCDM utility approaches.
tic fuzzy point operators. Based on the interval-valued IFSs, Chen,
Wang and Lu [117] offered a method of MCGDM. Furthermore, in Approach Number Percentage
the decision making process, hesitancy and uncertainty are gener- WASPAS 26 47%
ally considered as unavoidable problems. To express the evaluation SWARA 23 42%
information of decision makers more objectively, several improved Integrating of SWARA and WASPAS 6 11%
tools, including a fuzzy set [118], type-2 fuzzy set [119], an intu- Total 55 100%

itionistic fuzzy set [114] and a fuzzy multi-set [120,121], as well as

a linguistic fuzzy set [122,123], were offered in the literature.
uating of sustainability performance by applied ANP and COPRAS
approaches. Adhikary, Bose, Bose and Mitra [153] and Pancholi
2.2. MCDM utility determining methods
and Bhatt [154] used COPRAS-G for Failure Mode Effect and Crit-
icality Analysis (FMECA). In case of supplier selection, Keshavarz
MCDM theory was provided with the elements of mathematical
Ghorabaee, Amiri, Salehi Sadaghiani and Hassani Goodarzi [155]
statistics and MCDM methodology, considering statistical relations
integrated COPRAS approach with interval type-2 fuzzy sets. In
between the developed criteria. In this regard, some scholars in
eld of sustainability, Nuuter, Lill and Tupenaite [156] used COPRAS
recent years have attempted to develop, extend and present new
approach to compare the housing market sustainability in different
utility determining approaches, for example; Brauers [124] pub-
European countries. Nguyen, Dawal, Nukman, Aoyama and Case
lished a research based on the MOORA and MULTIMOORA methods.
[157], used the fuzzy linguistic preference based AHP and fuzzy
MOORA method was introduced by Brauers and Zavadskas [125] on
COPRAS for evaluating of machine tool. Varmazyar, Dehghanbaghi
the basis of earlier investigations. Kaklauskas, Zavadskas, Raslanas,
and Afkhami [158], integrated four different MCDM approaches
Ginevicius, Komka and Malinauskas [126], used COPRAS approach
including COPRAS, ARAS, DEMATEL and TOPSIS for assessing the
for low-e windows selection in retrot of public buildings. Kak-
research centers of Research and Technology Organization (RTO).
lauskas, Zavadskas, Banaitis and Satkauskas [127], used COPRAS
Liou, Tamosaitiene, Zavadskas and Tzeng [159], integrated the ANP
for utility and market value of a real estate. The relatively recently
and COPRAS-G for enhancing and choosing the green supplier in
developed MCDM methods, such as COPRAS [23,34,129], ARAS
supply chain management system. As a result; in recent years,
[129131], MOORA [132], MULTIMOORA [41], SWARA [66] and
the development of hybrid and modular methods has been grow-
WASPAS [133] are being rapidly developed and applied to solve real
ing dramatically. Fig. 1 shows the new MCDM utility determining
life problems [128]. Zavadskas and Turskis [28], proposed the ARAS
approaches. The present review paper attempts to systematically
method which can be described as a recently-formed, but easy-to-
describe the two MCDM utility techniques including WASPAS and
use and effective MCDM method. This method was applied to solve
SWARA in following sections.
different decision-making problems. The fuzzy and grey extension
of this method referred to as ARAS-Fuzzy (ARAS-F) (Turskis and
Zavadskas [134]) and ARAS-Gray (ARAS-G) (Turskis and Zavad- 2.3. Distribution based on the MCDM utility determining
skas [130]), were developed. Some other studies in these areas techniques
are including [135,136], and [137]. Brauers and Zavadskas [41]
extended the MOORA method and made it more robust under the In recent years, research on the MCDM utility determining
name of MULTIMOORA. Yazdani, Alidoosti and Zavadskas [138], approaches has been continued, and many applications of these
adopted the fuzzy COPRAS for risk analysis and management for approaches have been found in several elds. MCDM provides
critical asset protection. Podvezko [139], compared the features of effective decision making approaches for the domains, where the
SAW and COPRAS approaches based on different characteristics, selection of the best alternative is highly complicated. The current
denition, and properties demonstrating. In addition Chatterjee, study provides a details review of the main trends of considering
Athawale and Chakraborty [140] used COPRAS approach and val- the MCDM theory and practice. The main purpose of the review is
uation of mixed data (EVAMIX) for material selection. Das, Sarkar to introduce two new MCDM utility determining approaches used
and Ray [141], combined the FAHP and COPRAS approach for evalu- in previous studies and to suggest approaches, which could be most
ating of performance in Indian technical institutions. In the area of effectively applied to identifying the best alternative. MCDM util-
construction management, Bitarafan, Hashemkhani Zolfani, Are ity determining approaches were used in many areas (see Table 2).
and Zavadskas [142] integrated AHP and COPRAS-G for assessing MCDM methods help to choose the best alternatives based on mul-
of cold-formed steel structures. Maity, Chatterjee and Chakraborty tiple criteria. The best alternative can be determined by analyzing
[143], used the COPRAS-G for selection of cutting tool material. the scopes and weights of the criteria and selecting the optimum
Chatterjee and Chakraborty [144], combined the COPRAS approach ones by using any MCDM technique. The current review closely
and PROMETHEE II for material selection. Fouladgar, Yazdani- shows the process of enhancing WASPAS and SWARA and their
Chamzini, Lashgari, Zavadskas and Turskis [145], integrated the applications in various elds from different perspectives. In total,
FAHP and fuzzy COPRAS for selection of maintenance strategy. 55 papers were classied according to two MCDM utility deter-
Barysiene [146], applied COPRAS-G approach for evaluating of the mining approaches including; SWARA, WASPAS and integrating of
container terminal technologies. In the eld of quality control, two approaches (see Table 1). Following sections discusses about
Hashemkhani Zolfani et al. [147] used AHP and COPRAS-G for selec- literature and developments of these two techniques.
tion of quality control. Balezentis and Zeng [148], extended the
MULTIMOORA approach with type-2 fuzzy sets for personnel selec- 2.3.1. Weighted aggregated sum product assessment (WASPAS)
tion. Tavana, Momeni, Rezaeiniya, Mirhedayatian and Rezaeiniya WASPAS the rst time was suggested in 2012 and it is one
[149], integrated the FANP approach with COPRAS-G for selection of of the robust new MCDM utility determining approaches. This
social media platform. Bairagi, Dey, Sarkar and Sanyal [150], applied approach is an integration of Weighted Product Model (WPM)
the FAHP, fuzzy COPRAS-G, fuzzy VIKOR and fuzzy TOPSIS for robot and Weighted Sum Model (WSM). Zavadskas, Turskis, Antuchevi-
selection in the automated foundry. Nguyen, Dawal, Nukman and ciene and Zakarevicius [37], proposed WASPAS approach and
Aoyama [151], integrated the FANP and COPRAS-G approaches for argued that; the accuracy of this approach is strength than WPM
selection of machine tool. Rabbani, Zamani, Yazdani-Chamzini and and WSM. Zavadskas, Turskis, Antucheviciene and Zakarevicius
Zavadskas [152], used balanced scorecard (BSC) approach for eval- [37], proposed this new method and proved that this aggregated
 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292 269

Fig. 1. New MCDM utility determining approaches.

method performs more accurately than other approaches. Recently, numbers and compared the result of it with some existing meth-
a number of studies conducted by using WASPAS method which ods. Chakraborty and Zavadskas [170] applied the WASPAS method
is presented in the following scholars: Bagocius, Zavadskas and for solving some multi-criteria manufacturing problems such as
Turskis [160] used WASPAS to select a deep-water port; Staniunas, selection of cutting uid, electroplating system, forging condition,
Medineckiene, Zavadskas and Kalibatas [161] employed WASPAS arc welding process, etc. Lashgari, Antucheviciene, Delavari and
for ecological-economic assessment of multi-dwelling house mod- Kheirkhah [171] developed an MCDM approach based on the Quan-
ernization; Zavadskas, Antucheviciene, Saparauskas and Turskis titative Strategic Planning Matrix (QSPM) and WASPAS method to
[162] used WASPAS to evaluate the facade alternatives; Zavadskas, determine outsourcing strategies. Vafaeipour, Hashemkhani Zol-
Antucheviciene, Saparauskas and Turskis [163] applied WASPAS fani, Varzandeh, Derakhti and Eshkalag [172], applied the SWARA
for verication of robustness of methods to assess the alternative and WASPAS methods to evaluate the solar projects based on
solutions; Bitarafan, Hashemkhani Zolfani, Are, Zavadskas and regions priority. Dziugaite-Tumeniene and Lapinskiene [173], uti-
Mahmoudzadeh [164] used WASPAS to evaluate of real-time intel- lized the WASPAS method for multi-criteria assessment of an
ligent sensors for structural health monitoring of bridges; Dejus and energy supply system of a low energy house. Bozorg-Haddad,
Antucheviciene [165] used it to assess health and safety solutions Azarnivand, Hosseini-Moghari and Loiciga [174], developed and
on the construction site; and Hashemkhani Zolfani, Aghdaie, Der- compare multiple criteria techniques to rank Pareto solutions
akhti, Zavadskas and Morshed Varzandeh [166] applied WASPAS regarding the problems of multiobjective reservoir operation intro-
to decision making with respect to business issues in the foresight duced the WASPAS and COPRAS.
perspective. The methodology of WASPAS technique is presented
in Fig. 2. 2.3.2. WASPAS method with fuzzy theory sets
This method has been applied in many decision-making prob- This subsection introduced the WASPAS method with fuzzy
lems and environments. Siozinyte and Antucheviciene [167], theory set which called WASPAS-F (Turskis et al. [194]). In this
developed an MCDM approach to handle the problem of day- method used the fuzzy approach to allocate the relative impor-
lighting and tradition continuity in a reconstructed vernacular tant of attributes by employing fuzzy numbers instead of precise
building using the AHP, COPRAS, TOPSIS and WASPAS methods. numbers. In recent years this method integrated with other MCDM
Hashemkhani Zolfani, Aghdaie, Derakhti, Zavadskas and Varzan- approaches such as fuzzy AHP for solving MCDM problems in the
deh [168], developed a multi-criteria decision making approach to fuzzy environment in order to deal with uncertain information. The
solve a shopping mall locating problem using the SWARA and WAS- methodology of WASPAS-F provided in Fig. 3.
PAS methods Bagocius, Zavadskas and Turskis [169], proposed an
MCDM approach based on the WASPAS method for selection and
2.3.3. WASPAS method and interval type-2 fuzzy sets
ranking of the feasible location areas of wind farms and assessing
Keshavarz Ghorabaee, Zavadskas, Amiri and Esmaeili [175], sug-
the types of wind turbines in the Baltic sea offshore area. Bitarafan,
gested the new integrated approach based on interval type-2 fuzzy
Hashemkhani Zolfani, Are, Zavadskas and Mahmoudzadeh [164],
sets and WASPAS method which can be applicable in solving prob-
developed a multi-criteria decision-making approach to evaluate
lems related to MCDM techniques. In addition, using the proposed
real-time intelligent sensors for structural health monitoring of
method can help decision makers for evaluation of alternatives
bridges based on the SWARA and WASPAS methods. Zavadskas,
in the high accuracy way. For developed WASPAS method based
Antucheviciene, Razavi Hajiagha and Hashemi [1], proposed an
on interval type-2 fuzzy sets, some modications were performed
extended WASPAS method with interval-valued intuitionistic fuzzy
for the weighted product model and normalization. In addition, in
270 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

Fig. 2. Methodology of WASPAS technique.

this integration, the new analysis developed to achieve the weights 2.3.4. WASPAS method based on interval-valued intuitionistic
of criteria by integrating subjective weights from decision makers fuzzy numbers
with objective weights resulted from entropy approach in the pro- Zavadskas, Antucheviciene, Razavi Hajiagha and Hashemi [1],
cedure of the new developed method. Moreover, this combination proposed the new approach based on extended WASPAS method
can leads to realistic weights of criteria for decision making and with integrating of interval-valued intuitionistic fuzzy sets. The
increases stability in various criteria weights. Fig. 4 represented the objective of this integrated approach is to increase the strengths
methodology of WASPAS method based on interval type-2 fuzzy of interval-valued intuitionistic fuzzy sets for handing the uncer-
sets. tainty with the improved of accuracy regarding MCDM methods.
WASPAS method extended by Zavadskas, Turskis, Antucheviciene
and Zakarevicius [37] and can help to attain the high accuracy
 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292 271

Fig. 3. The methodology of WASPAS with fuzzy theory set method (Turskis et al. [194]).

Fig. 4. Methodology of WASPAS method based on interval type-2 fuzzy sets (Keshavarz Ghorabaee, Zavadskas, Amiri and Esmaeili [175]).

of estimation using proposed methodology for optimization of 2.3.5. WASPAS method with single-valued neutrosophic set
weighted aggregation set. In this proposed method which called Zavadskas, Bausys, Stanujkic and Magdalinovic-Kalinovic [176]
WASPAS-IVIF, the interval-valued intuitionistic fuzzy numbers and Zavadskas, Bausys and Lazauskas [177] proposed the new
were generalized based on fuzzy sets theory by focus on non- method based on WASPAS and single-valued neutrosophic set for
membership degree and to ordinal membership degree of fuzzy assessment of the construction of a waste incineration plant and
sets numbers and providing these both degrees in the interval num- selection of lead-zinc otation circuit design. This method is devel-
bers. Integrating the WASPAS method based on interval-valued oped by using the framework of single-valued neutrosophic set
intuitionistic fuzzy numbers makes the suggested approach as for present the means to show and approach the vagueness of
the effective tool for MCDM methods. The algorithm of extended the initial information explicitly. This method integrated WASPAS
approach presented in Fig. 5. with single-valued neutrosophic set for solving problems related
272 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

Fig. 5. Algorithm of proposed WASPAS method with interval-valued intuitionistic fuzzy sets (Zavadskas, Antucheviciene, Razavi Hajiagha and Hashemi [1]).

to MCDM approaches. Methodology of the proposed method by limits, black and white numbers. Previous papers proposed a grey
(Zavadskas, Bausys, Stanujkic and Magdalinovic-Kalinovic [176] system theory to study uncertain systems, and also introduced the
and Kazimieras Zavadskas, Bausys and Lazauskas [177]) is pre- concept of interval grey numbers. This theory provides an ef-
sented in Fig. 6 . cient approach for solving problems with signicant uncertainty,
and therefore has been successfully applied in many elds for the
purpose of analysis, modeling and forecasting. On the basis of the
2.3.6. WASPAS method with grey number grey system theory, many classical MCDM methods are adapted for
Grey theory can be successfully integrated with many of the the use of interval grey numbers, and extended for solving a num-
decision-making processes to improve the quality of judgments. ber of problems. Some previous papers extended the grey theory
It is suitable for expressing quantitative but imprecise data. Also with different MCDM approaches such as grey TOPSIS, COPRAS-G,
ambiguity in dealing with imprecise data can be reduced through ARAS-G, SAW-G, the grey extension of the LINMAP method, the
linguistic assessment of attributes. The linguistic assessments can grey extension of the MOORA method, Grey AHP and grey com-
also be converted into associated grey values. The grey system the- promise programming. Zavadskas, Turskis and Antucheviciene [29]
ory is identied as an effective methodology that can be used to proposed the new version of WASPAS with the grey attributes
solve uncertain problems with partially known information. In the scores. The advantages of the proposed technique are based on its
grey system theory, all information can be classied into three cat- capabilities of handling imprecise information due to applied grey
egories that are labelled with corresponding colours white, grey relations and capabilities of providing decisions of enhanced accu-
and black. There are several types of grey numbers such as: grey
numbers with only upper limits, grey numbers with only lower
 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292 273

Fig. 6. Methodology of the proposed method by integrating WASPAS and single-valued neutrosophic set.

Fig. 7. Methodology of WASPAS method with Grey theory [29].

racy when optimizing weighted aggregated assessment. The steps their average value [181]. All previous and recent studies, SWARA
of WASPAS-G methodology are presented in Fig. 7. methodology was used for a particular purpose, are as follows:
Kersuliene and Turskis [181] used SWARA for architect selection;
Kersuliene, Zavadskas and Turskis [66] employed SWARA in ratio-
2.3.7. Stepwise weight assessment ratio analysis (SWARA)
nal dispute resolution method selection; Hashemkhani Zolfani et al.
There are several kinds of MADM methods for criteria weight
[182] applied SWARA to select the optimal alternative of mechan-
calculation in the literature. In addition, in some methods, the cal-
ical longitudinal ventilation of tunnel pollutants; Hashemkhani
culations is very complicated, and the accuracy of the methods is
Zolfani et al. [183] used SWARA in the investigation of success
not very high [178]. SWARA is a method where experts apply their
factors of online games based on explorer; Hashemkhani Zolfani,
own implicit knowledge, experiences, and information. In addition,
Zavadskas and Turskis [184] used SWARA in sustainable develop-
it is not considered to be complicated and time consuming [179].
ment of building structures in rural areas based on the local climate;
The main feature of the SWARA method is associated with its possi-
Hashemkhani Zolfani, Aghdaie, Derakhti, Zavadskas and Morshed
bility of estimating the experts or interest groups opinions about
Varzandeh [166] employed SWARA in decision making on business
the signicance of the attributes in the process of weight deter-
issues with foresight perspective; Zolfani, Zavadskas and Turskis
mination [66]. The rst criterion in ranking is considered to be
[184] used SWARA in design of products; Hashemkhani Zolfani
most signicant, while the last criterion is least signicant [180].
and Saparauskas [179] used SWARA for prioritizing sustainability
The nal ranks are determined by a group of experts based on
274 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

Fig. 8. SWARA methodology [37].

assessment indicators of energy system; Aghdaie, Hashemkhani highlight different facts which individual primary studies fail to
Zolfani and Zavadskas [185] utilized SWARA in market segmen- do, e.g. it may prove that results are statistically considerable and
tation and selection; Hasan Aghdaie, Hashemkhani Zolfani and important when small primary studies provide questionable and
Zavadskas [186] applied SWARA in the machine tool selection; Ali- uncertain results with large condence interval [190]. The main
mardani, Hashemkhani Zolfani, Aghdaie and Tamosaitiene [180] goal of PRISMA statement is to help researchers and practitioners
used SWARA in agile supplier selection, and Hashemkhani Zolfani for completing the report of clear literature review [191]. Several of
and Bahrami [187] employed SWARA in the investment prioritiz- previous studies have been conducted PRISMA statement in various
ing in high tech industries. The methodology of SWARA technique elds to collecting a comprehensive literature review [191193].
is presented in Fig. 8. In our review study, for conducting of PRISMA method, we accom-
plished three main steps including; search in literature, choosing
3. Research methodology the eligible published papers, extraction of data and summarizing
[45].
For our research methodology, this review paper proposed
the Preferred Reporting Items for Systematic Reviews and Meta- 3.1. Literature search
Analyses (PRISMA) provided by Moher, Liberati, Tetzlaff and
Altman [188]. PRISMA statement has two main parts including In this step, we have been nominated some popular databases
meta-analysis and systematic reviews. Systematic reviews provide including of Web of Science, Scopus Google Scholar to present a sys-
objective summaries of what has been written and found out about tematic review of methodologies and applications of WASPAS and
research topics. This is especially valuable in wide research areas, SWARA. The literature search was accomplished based on various
where many publications exist, each focusing on a narrow aspect keywords such as: WASPAS; SWARA; WASPAS and SWARA; WAS-
of the eld [189]. Systematic reviews aim to provide a full overview PAS and ARAS; WASPAS and MULTIMOORA; WASPAS and COPRAS;
of research conducted on a specic eld until the present date. SWARA and ARAS; SWARA and MULTIMOORA; SWARA and COPRAS
All research procedures have to be made explicit before the actual and different MCDM utility determining approaches. We selected
conduct of the review to make the process objective and replica- those papers which were published from 2010 to 2016. In total; 83
ble. Meta-analysis presents a means of mathematically integrating scholarly papers were extracted according to our strategy search.
ndings employing diverse statistical approach from diverse of pre- In the next step we checked the duplicated papers with redun-
vious articles. In this kind of synthesis, primary studies that are dant information and after this step 75 paper were remained. Then;
compatible in their quality level are selected. This may help and we removed eight records due to duplicates; after this step; we
 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292 275

Fig. 9. Study owchart for the identication, screening, eligibility and included of articles.

screened papers based on abstracts; topic and unrelated studies are Table 2
Distribution of papers based on application areas.
removed and in total 64 of potentially related paper were remained
(see Fig. 9). Application elds Number of paper Percentage (%)

Construction management 22 40.00%

3.2. Articles eligibility Manufacturing and operation management 14 25.45%
Computing and operation research 7 12.73%
Sustainable and renewable energy 5 9.09%
In this step of review, for the purpose of eligibility, we reviewed
Human resource management 4 7.27%
the full text of each manuscript independently which extracted Other areas 3 5.45%
from last step. In the last step, carefully we identied the related Total 55 100.00%
articles to attain a consensus. Articles which had used WASPAS and
SWARA were chosen. Book chapters, unpublished working papers,
editorial notes, master dissertations and doctoral theses, textbooks construction management, manufacturing and operation man-
and non-English papers were excluded. Several of previous studies agement, computing and operation research, sustainable and
have used other methods such as MCDM, fuzzy set etc.; therefore, renewable energy, human resource management, and other areas
in this step also we excluded those studies, because in this review (see Table 2). In addition, articles were summarized and reviewed
paper we focused on two MCDM utility determining techniques based on various criteria such as authors, the year of publication,
rather than the MCDM techniques. In the end, we selected 55 arti- journals and conferences names, the technique and method used,
cles related to DEA models in green and sustainable SCM, from 33 research objectives, research gap and problem, solution and mod-
scholarly international journals and conferences between 2010 and eling, and results and ndings. We believe that, the reviewing,
2016 which met our inclusion criteria. summarizing, and classifying of articles can help us to achieve vari-
ous critical and importance hints. Consequently, some suggestions
3.3. Summarizing and data extraction and recommendations for future studies were proposed. Further-
more; we believe that; this review paper was accomplished very
In the nal step of our methodology, after negotiation with carefully and it presented a comprehensive source regarding the
experts, some required information was collected and nally 55 application of two new MCDM approaches in various elds. We
articles were reviewed and summarized. In owing, all selected should mentioned that, the key difcult point during using PRISMA
articles were classied into different classications including; method was about implicit expressing of methodologies in abstract
276 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

and research method section of the selected articles. Thus, we need tion alternatives and attributes. Some studies integrating WASPAS
to search on full manuscript and see the details to assess the exact approach with other new utility approaches such as COPRAS,
applied approaches for evaluating of various elds. Although, in MOORA, MULTIMOORA and other old MCDM approaches such
selection of paper we spent considerable time, but it helped us to as AHP, entropy and TOPSIS (Staniunas, Medineckiene, Zavadskas
select the most appropriate published studies for conducting this and Kalibatas [161]; Siozinyte and Antucheviciene [167]; Zavad-
review paper. skas, Antucheviciene, Saparauskas and Turskis [163]; Zavadskas,
Antucheviciene, Saparauskas and Turskis [162]; Karande, Zavad-
skas and Chakraborty [197]). In previous studies, there is a lack of
4. Distribution of the MCDM utility determining techniques
attention to ecological factors in multi-dwelling house moderniza-
tion. In this study three approaches, including WASPAS, COPRAS
4.1. Application areas classication
and TOPSIS were used for making an ecological-economic assess-
ment of multi-dwelling house modernization. Results of this paper
Although classifying and combining of selected articles in var-
indicated that modernization can help to decrease missions around
ious elds are difcult, but, for these classifying and grouping, we
30%. Siozinyte and Antucheviciene [167], used WASPAS, COPRAS,
used the opinions of experts in eld of MCDM utility determin-
AHP and TOPSIS to solve the problem related to tradition conti-
ing techniques. Consequently, based on opinions of experts, we
nuity and daylighting in the reconstructed buildings. This study
categorized articles into six different applications areas including;
mentioned that; there are problems of tradition continuity and
construction management, manufacturing and operation man-
daylighting in a reconstructed vernacular building. In order to
agement, computing and operation research, sustainable and
improve daylighting in the reconstructed building and preserve
renewable energy, human resource management and other areas
the features of its vernacular architecture, the AHP was used for
(see Table 2). In the following sections, all articles were summa-
weighting the evaluation criteria, and COPRAS, TOPSIS and WAS-
rized and reviewed based on various criteria including; authors, the
PAS were applied to ranking the available alternative solutions. The
year of publication, journals and conferences names, the technique
results show that a rational solution to the problems of daylighting
and method used, research objectives, research gap and problem,
in a reconstructed building and preserving its traditional features
solution and modeling, results and ndings.
of vernacular architecture could be implemented in new glass
structures. Zavadskas, Antucheviciene, Saparauskas and Turskis
4.2. Distribution of papers based on WASPAS approach [162], employed the WASPAS, WPM, WSM and MOORA for eval-
uating facades, this study argued that; for commercial or buildings
Table A1 in Appendix A presents the studies, where the WAS- facades, need to select the best design solution, outcomes of this
PAS technique was used. Based on the results presented in this paper indicated that, four building facades alternatives for pub-
table, a total of 27 studies used WASPAS technique combined lic or commercial buildings were evaluated considering a set of
with other techniques in various application areas such as indus- twelve criteria in the presented case study. Karande, Zavadskas
trial robot selection, construction sites selection, manufacturing and Chakraborty [197], used six different MCDM approaches for
process, material selection, construction contractor, software selec- selection of real time industrial robot, ndings of this paper found
tion, real time manufacturing, indoor environment and other that the MOORA was most robust approach with compare to other
areas. Some of these studies integrated WASPAS approach with six approaches. Other information about this section presented in
fuzzy set theory (Turskis, Zavadskas, Antucheviciene and Kosareva Table A1.
[194], Keshavarz Ghorabaee, Zavadskas, Amiri and Esmaeili) [175]
. Turskis, Zavadskas, Antucheviciene and Kosareva [194], proposed 4.3. Distribution of papers based on SWARA approach
the new fuzzy Multi-Attribute Performance Measurement (MAPM)
for selection of construction sites. This paper integrated fuzzy Table A2 in Appendix A presents the studies, where the SWARA
WASPAS and fuzzy AHP for selection of the best shopping cen- approach was used. Based on the results presented in this table, a
tre construction site, results of this study demonstrated that; the total of 22 studies used SWARA in various application areas such
increasing competition cause a lot of construction site selection as ERP, buildings retrot, building structures, machine tools selec-
problems and making decisions is a complex process that involves tion, energy system sustainability, selecting the architect, supplier
multiple, usually conicting, objectives or attributes. Keshavarz selection, high tech industries selection, dispute resolution, per-
Ghorabaee, Zavadskas, Amiri and Esmaeili [175], suggested a novel sonal selection, mining industry selection, manufacturing systems
approach by combining WASPAS approach and Interval type-2 and corporate social responsibility. Some of these studies integrat-
fuzzy sets (IT2FSs) for green supplier selection. For solving green ing SWARA and COPRAS as another new MCDM utility approach
supplier selection, this paper extended the WASPAS approach with (Volvaciovas, Turskis, Aviza and Mikstiene [206]; Hashemkhani
interval type-2 fuzzy environment. The ndings of this study found Zolfani and Zavadskas [22]; Hasan Aghdaie, Hashemkhani Zolfani
that; the proposed approach is able to solve problems regard- and Zavadskas [186]; Hashemkhani Zolfani and Bahrami [187]),
ing green supplier selection. Some studies combined the WASPAS Volvaciovas, Turskis, Aviza and Mikstiene [206] applied SWARA
approach with grey number (Zavadskas, Turskis and Antuchevi- for selecting the strategy of public buildings retrot, this paper
ciene [29]; Turskis, Daniunas, Zavadskas and Medzvieckas [196]), applied MADM techniques for solving this problem, the results
Zavadskas, Turskis and Antucheviciene [29] proposed the WASPAS obtained in this paper shown that, the best retrotting strategy
grey for choose and assess the right construction contractor. This is to perform the construction work at the same stage, using the
study integrated the WASPAS with grey attributes for selecting the greatest possible number of workers. Hashemkhani Zolfani and
right contractor. The ndings of this paper demonstrated that; the Zavadskas [22], used the SWARA and COPRAS for developing of
proposed method able to development strategy ranking, manage- the building structures. Results of this study revealed that the area
ment decisions and effective investment in the area of construction with local climate is optimal for Iranian traditional systems. Hasan
contractor. Turskis, Daniunas, Zavadskas and Medzvieckas [196], Aghdaie, Hashemkhani Zolfani and Zavadskas [186], employed
used WASPAS grey for choosing foundation of dwelling house with SWARA for selecting machine tools, this paper argued that; SWARA
a single-story. The ndings of this paper concluded that; the pro- and COPRAS-G are more useful for evaluating the alternatives
posed approach has the high prediction accuracy with clear and with compare to other techniques, the results of this paper with
simple process for evaluating and ranking of building founda- respect to conicting criteria, show that the presented approach
 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292 277

is most practical for machine tool ranking. Hashemkhani Zolfani and SWARA techniques in various application areas such as high
and Bahrami [187], ranked the high tech industries by employing technology (Ghorshi Nezhad, Hashemkhani Zolfani, Moztarzadeh,
SWARA, in this paper SWARA was used for evaluating and weight- Zavadskas and Bahrami [220]), personnel selection (Karabasevic,
ing the criteria, although; the results yielded by COPRAS method Stanujkic, Urosevic and Maksimovic [221]), renewable ener-
show that Nano Technology and Biotechnology were the rst and gies (Heidarzade, Varzandeh, Rahbari, Zavadskas and Vafaeipour
second high tech in Iran. Some studies integrated SWARA and [222]; Vafaeipour, Hashemkhani Zolfani and Morshed Varzan-
ARAS for solving MCDM problems (Kersuliene and Turskis [181]; deh, Derakhti and Keshavarz Eshkalag [223]). Ghorshi Nezhad,
Karabasevic, Zavadskas, Turskis and Stanujkic [207]; Karabasevic, Hashemkhani Zolfani, Moztarzadeh, Zavadskas and Bahrami [220]
Paunkovic and Stanujkic [208]). Kersuliene and Turskis [181], inte- used SWARA for evaluating and ranking the high technology selec-
grated SWARA with ARAS-F for selecting the architect. Karabasevic, tion, this study indicated that; planning for future in every level
Zavadskas, Turskis and Stanujkic [207], used SWARA and ARAS of organization is important task because of exists of various cri-
approaches for personal selection, ndings of this paper found that; teria, in this regard; this paper used SWARA to nd the weights
the proposed model for selection of personal is easy to use and of criteria and applied WASPAS for ranking the alternatives, the
able to solving problems in this eld. Karabasevic, Paunkovic and ndings of this paper found that; the attractiveness was the rst
Stanujkic [208], assessed and rank the indicators of corporate social ranked and research and technology potential had the rst rank in
responsibility by using two MCDM approaches including SWARA sub-criteria in ranking of high tech industry. Karabasevic, Stanujkic,
and ARAS, results of this paper found that, contribution to economic Urosevic and Maksimovic [221], integrated SWARA and WASPAS
development had the highest weight among other CSR sub-criteria. approaches for personnel selection, this study found personnel
In addition; some studies integrated SWARA and MULTIMOORA selection and recruitment process is important role in the human
(Karabasevic, Stanujkic, Urosevic and Maksimovic [209]), Karaba- resource management in every organization, they used SWARA
sevic, Stanujkic, Urosevic and Maksimovic [209] used SWARA for for evaluate weights of criteria and WASPAS for assessing of the
determine weights of criteria and MULTIMOORA for ranking the alternatives, the ndings of this paper found that interview pre-
alternatives, results of this paper found the proposed model can be paredness had the rst rank among other criteria. Heidarzade,
used for solving problems related to personal selection and recruit- Varzandeh, Rahbari, Zavadskas and Vafaeipour [222], used SWARA
ment. Moreover; SWARA approach integrated with old MCDM and WASPAS approaches for selection of best site regarding wind
techniques such as VIKOR, TOPSIS and PROMOTHEE. (Hashemkhani energy, this paper mentioned that, nding the best location site
Zolfani, Esfahani, Bitarafan, Zavadskas and Are [182]; Alimardani, for wind energy is the critical issue in Iran, therefore; this paper
Hashemkhani Zolfani, Aghdaie and Tamosaitiene [180]; Stanujkic, applied SWARA approach to evaluate weight of criteria and used
Karabasevic and Zavadskas [210]; Shukla, Mishra, Jain and Yadav WASPAS for assessing the alternatives, the nding of this study
[211];). Hashemkhani Zolfani, Esfahani, Bitarafan, Zavadskas and is useful for decision maker related to wind energy. Vafaeipour,
Are [182], employed SWARA for selecting mechanical longitudi- Hashemkhani Zolfani, Morshed Varzandeh, Derakhti and Keshavarz
nal ventilation, in this paper to identify and evaluate more effective Eshkalag [223], integrated SWARA and WASPAS approaches to
criteria, the authors used the SWARA method, meanwhile, VIKOR implement solar projects, this study mentioned there is lack of
was applied to evaluate and rank the alternatives. Results showed attention to solar power plants in Middle East countries, such as
that jet fans with spot extraction by axial fans make the best choice. Iran, based on experts opinions and literature, this paper found,
Alimardani, Hashemkhani Zolfani, Aghdaie and Tamosaitiene [180], there are 29 quantitative and qualitative criteria are important for
indicated that; due to a large number of factors, supplier selec- implementation of solar power pants, this paper ranked the solar
tion process is a difcult task for every company, therefore, two projects in 25 cities of Iran and found Yazd was ranked as the rst
MADM methods, including SWARA and VIKOR were applied to city and economical perspective was ranked as the rst criteria.
decision-making process, results of this article show that the pre- Table A3 provides the information of all papers which integrated
sented method is most practical for supplier alternatives ranking the both SWARA and WASPAS approaches.
with respect to the multi-conicting criteria in agile environment.
Stanujkic, Karabasevic and Zavadskas [210], used SWARA approach 4.5. Relationship and comparison analysis on the results of
and group decision making to select the best packaging design to SWARA and WASPAS methods
meet customers requirements, ndings of this paper found that
the proposed model, decrease the number of pairwise comparisons There have been several MADM methods, such as the AHP,
in previous MCDM methods such as AHP. Shukla, Mishra, Jain and ANP, and entropy in dealing with the multiple criteria problems.
Yadav [211], argued that ERP system selection is the important task In all of the above-mentioned methods, SWARA method has pri-
in the enterprises due to changing the current environments, in orities in comparing to the classical AHP and other methods as
this regard, this study used SWARA and PROMETHEE approaches to follows, SWARA was developed for group decision-making estab-
select the best ERP system and competent in company, the results of lishment of criteria weights. Despite this, it can be successfully used
this paper found that good technical capability, system vendors and by a single decision-maker; in addition; the number of compar-
service support were the signicant factor in selection of ERP sys- isons is equal to n 1, when criteria are ranked according to the
tem. Aghdaie, Hashemkhani Zolfani and Zavadskas [212], used two importance in descending order, while in AHP method it equals to
MADM approaches including SWARA and VIKOR to nding syn- n (n 1) ; the calculation algorithm of this method is very simple
ergies of MADM and data mining, this study demonstrated that; and very close to common humans thinking, and thus it is under-
need to identify the interaction of MADM and data mining for sup- standable as for novice users and as well for experienced users;
plier ranking and clustering. The details of selected papers based furthermore; in SWARA method no needs to check consistency
on SWARA approach presented in Table A2. of judgments, because it is ensured when criteria are ranked in
descending order; moreover; SWARA method is exible and not
4.4. Distribution of paper based on integration of SWARA and needs any comparative scale (for example 9 points Saatys scale,
WASPAS approaches which express relative importance of pair of criteria in numbers).
In case of WASPAS method, there are a number of multi-attribute
Table A3 in Appendix A presents some studies which inte- utility function forms. Most of them are additive form which are
grated the WASPAS and SWARA techniques. Based on the results used in SAW, SMART, and similar MADM methods. Another popu-
presented in this table, a total six studies integrated WASPAS lar utility form is multiplicative form. In most cases of assessment,
278 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

decision-makers should select between these two forms. WASPAS and Journal Engineering Economics had the rst rank among the
method integrates both forms of utility function to one and allows journals presented in this table, while Procedia Engineering journal
to decision-maker to take decision in more comfortable way. WAS- was ranked second, and Technological and Economic Development
PAS improves the chance of more consistent and best values and of Economy and Journal of Business Economics and Management
SWARA is an appropriate technique for the issues with priorities were ranked third among 33 journals considered in the work. The
which identied earlier, based on conditions. SWARA is able to information about other journals is presented in Table 3.
predict opinions of experts based on the importance ratio of each
criterion. SWARA is helpful for experts in the evaluating of weights
and criteria. Some previous scholars integrated SWARA and WAS- 5. Conclusion
PAS as a new hybrid MADM approach to evaluate the criteria and
rank the alternatives. This review paper presents a comprehensive overview of the
theory and applications with recent fuzzy developments of WAS-
4.6. Distribution of papers by approaches and application elds PAS and SWARA as two new MCDM utility determining approaches.
Because of the ability of WASPAS and SWARA approaches to eval-
In recent decades, research on MCDM has continued and many uate the criteria, rank the alternatives and comparative analysis,
areas for its application have been found. MCDM provides effective recently, WASPAS and SWARA related papers have increased in
decision making methods in the domains, where the selection of several MCDM problems. These selected papers were categorized
the best alternative is very complicated. The current study reviews into six application areas. In addition, all papers were classied by
the main streams of considering the MCDM theory and practice in authors, the year of publication, journals and conferences names,
detail. The main purpose is to identify two MCDM utility deter- the technique and method used, research objectives, research gap
mining approaches in various application areas, and to suggest and problem, solution and modeling, and nally results and nd-
approaches which could be used most robustly and effectively ings. Moreover; this study reviews the published papers in period
to identify the best alternatives. The MCDM approach has been of 20102016 in popular international journals and conferences
applied to many domains of science. The MCDM approach helps accessible in three important databases such as Web of Science,
to select the best alternatives in the presence of multiple criteria, Scopus and Google Scholar. To this end, we carefully selected 55
while the best one can be obtained by analyzing different scopes studies about WASPAS and SWARA based on the title, abstract,
and weights of the criteria and the selection of the optimum ones introduction, research method, and conclusion.
is performed by using any MCDM utility determining approach. A number of important points with respect to WASPAS and
This survey shows the development of two MCDM utility deter- SWARA applications extracted from this literature review arti-
mining approaches and their applications in various areas. In total, cle. The extensive of the selected studies were published in
55 papers were classied into six areas: construction management, 2013 and 2015. In total, papers were classied into six areas
manufacturing and operation management, computing and opera- including construction management, manufacturing and operation
tion research, sustainable and renewable energy, human resource management, computing and operation research, sustainable and
management and other areas. Regarding the MCDM utility deter- renewable energy, human resource management and other areas.
mining approaches, the results given in Fig. 10 show that previous In this regard, construction management was the most important
scholars published more papers in the elds related to construction application area with 20 papers used WASPAS and SWARA. Addi-
management than in other application areas. In addition; Fig. 10 tionally, 33 international journals and conferences were considered
shows the frequently of SWARA, WASPAS and integrating of these in the current review paper. Journal of Civil Engineering and Man-
two approaches in six application areas. The information of other agement was ranked rst among the considered journals in terms
application areas and approaches is provided in Fig. 10. of using WASPAS and SWARA approaches.
WASPAS method integrated with fuzzy set theory, interval type-
4.7. Distribution of papers by publication year and approach 2 fuzzy environment. The researchers have shown that there are a
great number of MCDM utility determining approaches with fuzzy
Distribution of papers based on publication year and MCDM util- sets theory, and that several of these approaches had been used to
ity approaches is shown in Fig. 11. In general, regarding SWARA solve problems related to various application areas. Moreover, this
approach, the rst paper was published in 2010 and in eld of ratio- study conrms that the MCDM utility determining approaches can
nal dispute resolution and has an upward trend between 2010 and help decision makers and stakeholders to overcome some inherent
2016, where it reached to the peak of seven papers in 2013 and 2015 uncertainties of various application areas decision making. The pro-
in various application areas. Regarding the WASPAS approach, the cesses of evaluation and calculation in different elds of decision
rst paper was published in 2012 in eld of operation research and making are usually based on using the MCDM utility determining
computing and has upward trend between 2012 and 2016, which approaches. It is necessary to apply different approaches to obtain
it reached to the peak of six papers in 2013, 2014, 2015 and 2016 in the rankings of the alternatives referring to different areas and to
various application areas. In case of integrated SWARA and WASPAS ensure the validity of MCDM utility determination. It is believed
approaches, they have been used since 2013 in area of shopping that the results obtained by various mathematical methods are
mall location and area has an upward trend between 2013 and more rational, and more mathematical methods can contribute to
2016, where it reached to the peak of two papers in 2014 and 2016 solving the various areas problems in the future. As long as the
in various application areas. The information of other publication criteria and weights are used, MCDM approaches are appropriate
years and approaches is provided in Fig. 11. to solving specic decision making problems in other application
areas, and the MCDM utility determining approaches can be viewed
4.8. Distribution of papers by journal as a powerful tool for solving the problems in different elds of
science.
Scholarly papers have been chosen from a total of 33 interna- This review paper has some limitations, which can be consid-
tional journals and conferences. The results presented in Table 3 ered as an object of future studies. First, this review is focused
give more than 33 scientic journals and conference publications on the use of the MCDM utility determining approaches rather
using the considered two MCDM utility determining approaches. than the old MCDM techniques. WASPAS and SWARA methods
Based on the results, Journal of Civil Engineering and Management [225] can be adapted to the development of hybrid MCDM meth-
 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292 279

25

20

15

10

0
Manufacturing and
Construction Computing and Sustainable and Human resource
operation Other areas
management operation research renewable energy management
management
Integrating of SWARA and WASPAS 2 6 2 2 4 0
WASPAS 10 9 3 1 1 2
SWARA 8 0 0 2 1 1

Fig. 10. The distribution of papers based on application areas and approaches.

0
2010 2011 2012 2013 2014 2015 2016
SWARA 1 1 0 7 3 7 4
WASPAS 1 6 7 6 6
Intrgrated WASPAS and SWARA 1 2 2 1

Fig. 11. The distribution of papers by publication year and approach.

ods such as ARAS, EDAS [226229], Investment Value Assessments WASPAS method with interval type-2 fuzzy sets, combined WAS-
along with Recommendations (INVAR) [230], CODAS [231,232], PAS method based on interval-valued intuitionistic fuzzy numbers,
Fuzzy Ranking and Aggregated Weights (AFRAW) [233], MULTI- combined WASPAS method with single-valued neutrosophic set
MOORA and MOORA [234238]. The concept of the neutrosophic and WASPAS method with Grey number. In this regard, future
set developed by Smarandache is a set model which generalizes papers can focus on the integrating WASPAS and SWARA methods
the classic set, fuzzy set, interval fuzzy set, intuitionistic fuzzy set with other types of fuzzy theory sets, fuzzy integrals and aggrega-
and interval valued intuitionistic fuzzy set. In contrast to intu- tion operators such as; hesitant fuzzy Choquet integral, in addition,
itionistic fuzzy sets and also interval valued intuitionistic fuzzy generalized hesitant fuzzy Choquet ordered averaging (GHFCOA),
sets, indeterminacy degree of an element in a universe of dis- hesitant fuzzy Choquet geometric Bonferroni mean (HFCGBM), the
course is expressed explicitly in the neutrosophic set. There are hesitant fuzzy weighted averaging (HFWA), hesitant fuzzy ordered
three membership functions such that truth membership, indeter- weighted distance (GHFOWD) and the generalized hesitant fuzzy
minacy membership and falsity membership in a neutrosophic set, hybrid weighted distance (GHFHWD) and some types of distance
and they are independent. In this require, due to nature of SWARA measures related to dual hesitant fuzzy sets based on Archimedean
method, we can suggest that, it is appropriate in the future to t-conorm and t-norm for dual hesitant fuzzy information. More-
apply intuitionistic or neutrosophic sets with method. This paper over; future studies can combine these two techniques with
reviewed and classies two MCDM utility determining methods qualitative information and quantitative data based on hesitant
including SWARA and WASPAS with fuzzy theory sets. There are fuzzy linguistic term sets, discrete tting aggregation and simpli-
other MCDM utility determining methods such as COPRAS, ARAS ed optimal discrete tting aggregation, fuzzy Choquet integral
[207], and MULTIMOORA [239] with their fuzzy extensions and operator 2-tuple linguistic, ordered weighted averaging opera-
Grey number, for example fuzzy ARAS, Grey ARAS, MULTIMOORA tor, 2-tuple linguistic weighted averaging operator, interval-valued
with integrating with interval-valued triangular fuzzy numbers, 2-tuple linguistic, 2-tuple averaging operator, 2-tuple linguistic
MULTIMOORA with fuzzy set theory, fuzzy MULTIMOORA with power average operator, 2-tuple OWA operator, 2-tuple weighted
interval-valued intuitionistic, COPRAS method with Grey [240] average (2TWA) operator. In case of interval-valued intuition-
and fuzzy set theory, COPRAS with interval-valued intuitionistic. istic fuzzy, future scholars can use MCDM utility determining
Therefore future studies can review and classication of these tech- methods for integrating with Interval-valued intuitionistic fuzzy
niques with their fuzzy extensions and Grey number. In addition; weighted arithmetic aggregation, the interval-valued intuitionistic
this study addressed to the signicant role of fuzzy set theory fuzzy ordered weighted aggregation, interval-valued intuitionistic
and Grey number with WASPAS method for example; combined fuzzy hybrid aggregation operators. Furthermore, future studies
280 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

Table 3
Distribution of papers based on the journals of their publication.

Number Name of journal N %

1 Journal of Civil Engineering and Management 5 9.09%

2 Inzinerine Ekonomika-Engineering Economics 5 9.09%
3 Procedia Engineering 4 7.27%
4 Technological and Economic Development of Economy 3 5.45%
5 Journal of Business Economics and Management 3 5.45%
6 Archives of Civil and Mechanical Engineering 3 5.45%
7 Informatica 2 3.64%
8 Economic Computation and Economic Cybernetics Studies and Research 2 3.64%
9 Economic Research-Ekonomska Istrazivanja 2 3.64%
10 Acta Montanistica Slovaca 2 3.64%
11 International Journal of Strategic Property Management 2 3.64%
12 CATENA 1 1.82%
13 Expert Systems with Applications 1 1.82%
14 World Sustainability Forum 1 1.82%
15 Buletin Teknologi Tanaman 1 1.82%
16 Serbian Journal of Management 1 1.82%
17 Journal of Economics, Management and Informatics 1 1.82%
18 International Journal of Industrial Engineering Computations 1 1.82%
19 Sustainability 1 1.82%
20 Journal of Cleaner Production 1 1.82%
21 Journal of Production Engineering 1 1.82%
22 Proceedings of the 6th International ICT Conference 1 1.82%
23 Procedia Social and Behavioral Sciences 1 1.82%
24 International Journal of Intelligent Enterprise 1 1.82%
25 Computer-Aided Civil and Infrastructure Engineering 1 1.82%
26 International Journal of Computers Communications & Control 1 1.82%
27 Energy Conversion and Management 1 1.82%
28 International Journal of Business and Systems Research 1 1.82%
29 Elektronika ir Elektrotechnika 1 1.82%
30 Applied Soft Computing 1 1.82%
31 Information Technology and Control 1 1.82%
32 Studies in Informatics and Control 1 1.82%
33 Transport 1 1.82%

can combine the MCDM utility determining methods with fuzzy in the review. However, the researchers believe that this paper
ordered weighted operators like induced interval-valued intuition- comprehensively reviewed most of the papers published by inter-
istic fuzzy ordered weighted geometric, fuzzy ordered weighted national journals and conferences. Moreover, the current review
averaging (FOWA) operator, the fuzzy hybrid harmonic mean paper can provide future academic scholars with a better under-
(FHHM) operator, the intuitionistic fuzzy hybrid geometric (IFHG) standing of the MCDM utility determining approaches. This study
operator, the intuitionistic fuzzy hybrid averaging (IFHA) operator can be used by academics and managers as a basis for further
and the dynamic intuitionistic fuzzy weighted geometric (DIFWG) research. It can also help the practitioners make more appropri-
operator. ate decisions using these approaches and be a guide to scholars,
Articles published at the end of 2016 and rst of 2017 (if any) improving the discussed methodologies. The authors of this paper
have not been included in the present paper because of the lim- carefully selected and summarized the available papers of several
ited reporting time. The present review can be expanded for the publishers in Web of Science, Scopus, and Google Scholar. However,
future studies. Another limitation is that the data were collected a number of relevant outlets remained beyond the scope of the cur-
from journals and conferences, while the examined documents rent study. Therefore, the future researchers will be able to review
did not include papers, textbooks, doctoral and masters theses the papers, which are not considered in the current review. Another
and unpublished papers on the MCDM problems. Therefore, in the limitation is associated with the fact that the paper presents a
future study, the data can be collected from these sources, and review of numerous works on the problem of using the recently
the obtained results can be compared with the data obtained and developed MCDM approaches published in various journals and
reported in this study. One more limitation is that all the papers conferences. However, this review does not cover recent methods
were extracted from the journals written in English, which implies discussed in the books.
that the scientic journals in other languages were not involved
Appendix A.
Table A1
Distribution of papers based on WASPAS technique.

Author Technique and Research Objective Research gap and problem Solution and modeling Results and ndings
method

Karande, Zavadskas WASPAS, WSM, Used six different MCDM Due to inherent ability to judge Compared six MCDM Findings of this paper found
and Chakraborty WPM MOORA, approaches for selection of real diverse in selection of real time approaches for choose the that the MOORA was most
[197] reference point time industrial robot. industrial robot, MCDM is the industrial robot. robust approach compare to
approach and useful tool for solving other six approaches.
MULTIMOORA problems in this regards.
Turskis, Zavadskas, Fuzzy WASPAS Proposed the new fuzzy There are various quantitative Integrated fuzzy WASPAS and The increasing competition
Antucheviciene multi-attribute performance and qualitative attributes fuzzy AHP for selection of the cause a lot of construction site
and Kosareva [194] measurement (MAPM) for conicting in assessment of best shopping centre selection problems. Making
selection of construction sites. construction site alternatives. construction site decisions is a complex process
that involves multiple, usually
conicting, objectives or
attributes. They are
ill-structured.
Madic, WASPAS, AHP and Application the WASPAS Need to determine the most Integrated three MCDM The ndings of this paper
Antucheviciene, OCRA approach to determine of appropriate manufacturing approaches including WASPAS, found that; change in assist gas
Radovanovic and manufacturing process process criteria and need to AHP and OCRA for determine pressure, cutting speed and
Petkovic [198] conditions in laser cutting. consider a number of diverse best condition of laser power was the most
and conicting processes manufacturing process important factors.

A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

performance. regarding laser cutting.
Yazdani [199] WASPAS Used factor relationship (FARE) Need to present the material Used WASPAS for evaluating The results of this study found
and WASPAS approaches for selection model in order to and ranking of alternative and that; the proposed
material selection. reach the desired outputs with FARE for elaborate the weights FARE-WASPAS model is useful
the minimum cost and specic of criteria. methodology for material
applicability. selection eld.
Zavadskas, Turskis WASPAS-G Proposed the WASPAS grey for Due to increase the Integrated the WASPAS with The ndings of this paper
and choose and assess the right competition in world market grey attributes for selecting the demonstrated that; the
Antucheviciene construction contractor. chooses the contractor for right contractor. proposed method able to
[29] better performance is the development strategy ranking,
signicant issue for management decisions and
organizations. effective investment.
Chakraborty and WASPAS Used WASPAS approach for Due to the number of Proposed WASPAS method to Findings of this paper found
Zavadskas [170] solving decision making conicting selection criteria, nding the appropriate that; the proposed method had
problem related to there is need to the logical, assessment criteria of selecting accurately ranking capability
manufacturing. simple and systematic the manufacturing problems. for solving decision making
approaches or mathematics problems related
tools for solving problems manufacturing.
related to manufacturing.
Zavadskas, WASPAS Proposed WASPAS approach to Need to improve machining Used WASPAS approach for the The outcomes of this paper
Chakraborty, explore the optimization performance of non-traditional parametric optimization of ve found that; WASPAS approach
Bhattacharyya and parameters in non-traditional machining processes because famous non-traditional can be used as efcient for
Antucheviciene machining processes. of several control parameters. machining processes. multi and single responds
[200] optimization of the
non-traditional machining
processes.
Madic, Gecevska, WASPAS Used the WASPAS approach There is need to consider the This study involved ve The outcomes of this paper
Radovanovic and based on economic analysis of economic and technological economic criteria and eight found that; abrasive jet
Petkovic [201] machining process. criteria for selection of different machining processes machining was the best
machining process. by using the WASPAS machining processes.
. approach.
Zavadskas, Turskis, WASPAS Proposed new approach to Due to the important of Integrated WSM and WPM for The results of this paper
Antucheviciene measure the latter approaches computer-aided multiple create new approach as called demonstrated that; the
and Zakarevicius accuracy and increasing of criteria decision support WASPAS. proposed WASPAS approach
[37] alternatives ranking accuracy. system this paper proposed enable enables to attain the
new decision making approach measurement high accuracy.
as WASPAS.
Madic, Vitkovic and WASPAS Applied WASPAS approach for Assessment and selection of For solving this problem, The ndings of this paper
Trifunovic [202] selection the software. software based on organization authors of this paper employed indicated that; there was good
needs is difcult problem. WASPAS approach. correlation between results of

281
this study with other previous
studies for solving problem
regarding software selection.
 282
Table A1 (Continued)

Author Technique and Research Objective Research gap and problem Solution and modeling Results and ndings
method

Zavadskas, WASPAS-IVIF Extended WASPAS approach There is need to improve the Integrated WASPAS approach The results of this paper found
Antucheviciene, for solving problems in area of accuracy of WSM and WPM with interval-valued that; the integrated proposed
Razavi Hajiagha decision making in uncertain based on aggregation methods intuitionistic fuzzy sets. approach is the perfect method
and Hashemi [1] environments. such as interval-valued for solving strategy selection
intuitionistic fuzzy sets. and management decision
problems.
Chakraborty, WASPAS Used WASPAS to valeted ve There is need to use the Integrated weighted product The ndings of this paper
Zavadskas and problems related to real time WASPAS method to validate model (WPM) and weighted found that; WASPAS method is
Antucheviciene manufacturing. problems related to real time sum model (WSM) as WASPAS the validated method for
[203] manufacturing because of for solving problems in solving real time
inuenced by control manufacturing elds. manufacturing problems with

A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

parameter. compare with previous studies.
Zavadskas, WASPAS Used WASPAS approach to There is need to evaluate the Evaluated the indoor The outcomes of this paper
Kalibatas and select the optimal indoor current dwelling houses and environment of six different found that MADM-opt able to
Kalibatiene [204] environment. refurbish them to satisfy the apartments in the same brick evaluate the options and their
humans needs and energy house by utilizing of WASPAS assessment based on best
efcient requirement. approach. options.
Staniunas, WASPAS, COPRAS Ecologicaleconomic In previous studies, there is a Three techniques, including Results of this paper indicated
Medineckiene, and TOPSIS evaluation of dwelling house lack of attention to ecological WASPAS, COPRAS and TOPSIS, that modernization can help
Zavadskas and modernization by applying factors in multi-dwelling house were used for making an decrease missions around 30%.
Kalibatas [161] WASPAS, COPRAS and TOPSIS. modernization. ecological-economic
assessment of multi-dwelling
house modernization.
Zavadskas, WASPAS The analysis of performance by A need for evaluating the Suggested WASPAS for Results of this paper indicated
Skibniewski and applying WASPAS to journals progress of scientic journals, evaluating a journals progress. that the ranking order of
Antucheviciene of civil engineering. such as civil engineering journals was different when
[205] journals. applying both approaches.
Zavadskas, WASPAS, WPM, Employed WASPAS, WPM, A need for choosing the best WASPAS, WPM, WSM and Four building facades
Antucheviciene, WSM and MOORA WSM and MOORA for design solution for a MOORA techniques were alternatives for public or
Saparauskas and evaluating facades. commercial or public applied to selecting the best commercial buildings were
Turskis [162] buildings facades. facades. evaluated considering a set of
twelve criteria in the presented
case study.
Zavadskas, Bausys WASPAS-SVNS Proposed a new approach Due to important inuence of For selection of lead-zinc Findings of this paper found
and Stanujkic [25] based on WASPAS and single processing costs and useful otation circuit design this that; the proposed approach is
valued neutrosophic sets for minerals, need to consider paper integrated the WASPAS suitable approach for selection
selection of lead-zinc otation adequate circuit design of lead- method and single valued of lead-zinc otation circuit
circuit design. zinc utilization. neutrosophic sets. design.
Bagocius, WASPAS and Used a mixed WASPAS and There is a need for developing This paper proposes an According to the proposed
Zavadskas and entropy entropy approach for a deep-water sea port in the integrated multi-criteria model for resolving the
Turskis [160] deep-water port selection. Klaipeda region to satisfy the decision-making model to problem the best alternative is
economic needs. solve the problem. the fourth alternative. The
proposed model shows the
performance ratio of each
alternative to the optimal
alternative.
Table A1 (Continued)

Author Technique and Research Objective Research gap and problem Solution and modeling Results and ndings
method

Dejus and WASPAS Employed WASPAS for It is emphasised that more The use of the WASPAS The investigation has revealed
Antucheviciene evaluating health and safety on investigations should be made technique for assessment and that typical solutions for
[165] the construction site to identify the options for selection of appropriate occupational safety are used in
improving education and solutions for occupational the eld of road construction;
training effectiveness of safety is suggested. however, they are intended for
construction workers in the protecting third persons from
area of health and safety. accessing dangerous zones
next to a construction site
rather than for ensuring health
and safety of workers.
Siozinyte and WASPAS, COPRAS; Used WASPAS, COPRAS, AHP There are problems of tradition In order to improve daylighting The results show that a rational
Antucheviciene AHP and TOPSIS and TOPSIS for solving the continuity and daylighting in a in the reconstructed building solution to the problems of
[167] problem of tradition continuity reconstructed vernacular and preserve the features of its daylighting in a reconstructed
and daylighting in the building. vernacular architecture, the building and preserving its
reconstructed buildings AHP was used for weighting traditional features of
the evaluation criteria, and vernacular architecture could
COPRAS, TOPSIS and WASPAS be implemented in new glass
were applied to ranking the structures.
available alternative solutions.

A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

Bagocius, WASPAS Wind turbine selection by The construction of wind farms MCDM methods represent a Calculations were made
Zavadskas and using WASPAS is a challenge of crucial robust and exible tool applying WASPAS method,
Turskis [169] importance to Lithuania. investigating and assessing which showed that the best
possible discrete alternatives type of the wind power plant
evaluated applying the suitable for any conditions is
aggregated WSM and WPM REpower M5 5.0 MW Wind
method, WASPAS. Turbine.
Turskis, Daniunas, WASPAS grey Used WASPAS grey for or Building construction selection Integrated WASPAS approach The ndings of this paper
Zavadskas and choosing the kind of is the important issue for with grey number for dwelling concluded that; the proposed
Medzvieckas [196] foundation for dwelling house stakeholders, contractors and house. approach has the high
with a single-story. owners. prediction accuracy with clear
process and simple for
evaluating and ranking of
building foundation
alternatives and attributes.
Lashgari, QSPM and WASPAS Used WASPAS for selection of There is need to analysis the Employed WASPAS and The ndings of this study
Antucheviciene, the best outsourcing various internal and external Quantitative Strategic indicated that; the rst ve
Delavari and development strategies. factors which inuencing on Planning Matrix (QSPM) for best ranked strategic options
Kheirkhah [171] the outsourcing of healthcare evaluating and selecting of the coincide WASPAS and QSPM.
services in Tehran. best outsourcing strategy.
Kazimieras WASPAS-SVNS Used WASPAS approach for There is need to consider all Integrated WASPAS with Results of this paper concluded
Zavadskas, Bausys plant construction site for factors regarding sustainability single-valued neutrosophic set that; this territory is
and Lazauskas incineration of non-hazardous for the waste incineration for evaluating of sites for the appropriate for the project
[177] wastes. plant. construction of a Waste implementation in the
Incineration Plant. construction of a waste
incineration plant.
Zavadskas, WASPAS, MOORA Applied WASPAS, MOORA and There is a need for verifying The paper employs the Based on the results of the
Antucheviciene, and MULTIMOORA MULTIMOORA for evaluating the robustness of methods in innovative, newly developed research, the conclusion that
Saparauskas and the robustness of methods. assessing the alternative WASPAS method and the newly developed WASPAS
Turskis [163] solutions. reputed MOORA method, method seems to be robust can
consisting of the Ratio System be conrmed. The validation of
and the Reference Point the method for real life
approach as well as the Full applications can also be made.
Multiplicative Form and
MULTIMOORA.
Keshavarz WASPAS and Proposed a novel approach by There is need to nd the best For solving green supplier The ndings of this study
Ghorabaee, IT2FSs combining WASPAS approach solution by integration of selection this paper extended found that; the proposed
Zavadskas, Amiri and Interval type-2 fuzzy sets objective and subjective the WASPAS approach with approach is able to solve
and Esmaeili [175] (IT2FSs) for green supplier weights for solving problems interval type-2 fuzzy problems regarding green

283
selection. related to green supplier environment. supplier selection.
selection by using MCDM
techniques.
 284
Table A2
Distribution of papers based on SWARA approach.

Author Technique and method Research Objective Research gap and Solution and Results and
problem modeling ndings

Hashemkhani SWARA-COPRAS Ranked high tech A need for focusing SWARA was used The results yielded
Zolfani and industries by on the priority of for evaluating and by COPRAS method
Bahrami [187] employing SWARA. investment in high weighting the show that Nano
tech industries in criteria, while Technology is the
Iran. COPRAS was best high tech
employed for industry to develop
evaluating and in Iran, while
ranking the Biotechnology is at
alternatives. the second place of
importance. Then
follows BioMEMS,
and Biomedical
engineering is the
last according to

A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

the priority order.
Kersuliene, SWARA Applied SWARA to In order to assess SWARA method It has been proved
Zavadskas and evaluating and dispute resolution could be applied to that successful
Turskis [66] selecting a rational methods from practical selection of a
method of dispute economic, social implementation of rational method for
resolution and other specialised dispute resolution
perspectives, it is decision support is based on the
necessary to apply systems and attribute weight
methods to alternative dispute determination by
assessing solutions resolution in a using SWARA
based on multiple virtual method and the
attributes. environment. initial
decision-making
matrix normalised
by applying linear
normalisation
method.
Karabasevic, SWARA and ARAS Used SWARA for Using decision Integrated SWARA Findings of this
Zavadskas, Turskis selection of making tools in and ARAS paper found that;
and Stanujkic [207] personal. hiring approaches for the proposed
organizations are personal selection. model for selection
not common, of personal is easy
therefore; need to to use and able to
suggest the new solving problems
framework for in this eld.
choose the
candidates in
process of
recruitment.
Nakhaei, Lale Are, SWARA and SMART Used SWARA to Need to Integrated SWARA The results of this
Bitarafan and ranked and assessment of and SMART for paper found that;
Kaplinski [214] weighted of index building regarding evaluating and capability to
and sub-index. of vulnerability to calculating weights decrease blast
explosion. of index and effect,
sub-index. remembering that
location
underground was
the criterial factor
of blast.
Table A2 (Continued)

Author Technique and method Research Objective Research gap and Solution and Results and
problem modeling ndings

Karabasevic, SWARA and Used SWARA The recruitment Used SWARA for Results of this
Stanujkic, Urosevic MULTIMOORA approach for and personal determined paper found the
and Maksimovic personal selection selection is the weights of criteria proposed model
[209] in mining industry. important part of and MULTIMOORA can be used for
human resource for ranking the solving problems
management and alternatives. related to personal
need to consider selection and
decision making recruitment.
approach in this
eld.
Jamali, SWARA and Assess and analysis Due to important Integrated SWARA The ndings of this
Farrokhnejad and COPRAS G of advance and complexity of and COPRAS grey study found that;
Mohammadi [215] manufacturing manufacturing to evaluate and operating cost was
systems by systems decision analysis ve kinds the important
integration of process a new of manufacturing criterion in group
SWARA and decision making is systems. of stability criteria.
COPRAS grey required.

A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

approaches.
Dehnavi, Aghdam, SWARA Proposed new Due to important For solving The results of this
Pradhan and hybrid approach by of landslides which problems in area of study found that
Morshed integrated SWARA the important landslides, this proposed approach
Varzandeh [216] technique and concern for rural paper integrated better can predict
ANFIS to assess and urban areas three techniques to assess of
landslide and also including SWARA, landslides hazard
susceptible areas infrastructures in ANFIS and GIS. in Iran.
by applied Iran, there is need
geographical to evaluated
information landslides.
system.
Karabasevic, SWARA and ARAS Assessed and rank Need to nd the Integrated SWARA Results of this
Paunkovic and the indicators of corporate social and ARAS paper found that;
Stanujkic [208] corporate social responsibility approaches for contribution to
responsibility by indicators due to evaluation of CSR economic
using two MCDM increasing of indicators and development had
approaches company image ranking companies. the highest weight
including SWARA and responsibility among other CSR
and ARAS. toward society. sub-criteria.
Stanujkic, SWARA and group Used SWARA Identify the best Integrated the The ndings of this
Karabasevic and decision making approach and and ideal solution SWARA approach paper found that
Zavadskas [210] group decision for packaging and group decision the proposed
making to select design is the making method for model decrease is
the best packaging complex process choose the best number of pairwise
design to meet and needs to use packaging design. comparisons in
customers decision making previous MCDM
requirements. approaches. methods such as
AHP.
Hashemkhani SWARA Proposed SWARA Due to signicant Used SWARA The outcomes of
Zolfani, Salimi, for evaluation the the role of approach as the this study found
Maknoon and new framework for technology efcient MADM that, the
Kildiene [217] R&D projects based foresight in approach for technological merit
on technology developing the evaluation of factor was the
foresight. country economy, technology important factors.
need to consider it foresight criteria in
as the most high level of
important decision making.
government

285
sections.
 286
Table A2 (Continued)

Author Technique and method Research Objective Research gap and Solution and Results and
problem modeling ndings

Shukla, Mishra, Jain SWARA and Used SWARA and ERP system For chose the The results of this
and Yadav [211] PROMETHEE PROMETHEE selection is the suitable paper found that
approaches to important task in component and good technical
select the best ERP the enterprises due ERP system this capability, system
system and to changing the study integrated vendors and
competent in current the SWARA and service support
company. environments. PROMETHEE were the
approaches. signicant factors
in selection of ERP
system.
Hashemkhani SWARA and YYB Used SWARA producing and Integrated SWARA The outcomes of
Zolfani, Zavadskas theory approach for designing products method and this study

A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

and Turskis [184] ranking the is the very criterial Yin-Yang balance indicated that; the
important criteria issue (YYB) theory for important criterion
in producing and product producing in producing and
designing products. and designing. designing products
was considering
important general
features of each
product and
applications.
Nakhaei, Lale Are, SWARA and Integrated SWARA Need to consider Used SWARA for Findings of this
Bitarafan and COPRAS and COPRAS to the resources determine the best paper found that;
Kildiene [218] assess the light management light index among lamp with battery
supply in the public supply possess is various indexes source was the
underground safe very important and COPRAS light supply for the
spaces. issue underground approach for select city shelters.
safe spaces. the best strategy.
Kouchaksaraei, SWARA and Integrated SWARA Need to consider Applied SWARA to The ndings of this
Hashemkhani COPRAS and COPRAS for the glasshouse as evaluating the propose approach
Zolfani and glasshouse the important criteria of able to solving
Golabchi [219] locating. factors in the glasshouse locating problems related to
prevalent and used COPRAS locating and other
greenhouses. for assessing the issues.
alternatives.
Aghdaie, SWARA and VIKOR Used two MADM Need to identify Suggested the new The results of this
Hashemkhani approaches the interaction of hybrid approach paper found that;
Zolfani and including SWARA MADM and data based on the hybrid model
Zavadskas and VIKOR to mining for supplier DM-MADM for presents the
[212,213] nding synergies of ranking and clustering and systematically
MADM and data clustering. ranking of supplier. analytic approach
mining. for raking and
clustering in the
real problems with
a integrating of
decision making
and MCDM
methods.
Table A3
Distribution of papers based on integration of SWARA and WASPAS approaches.

Author Technique and Research Objective Research gap and Solution and Results and
method problem modeling ndings

Hashemkhani SWARA and Evaluated Nash When there are at Strategy evaluation The study shows
Zolfani, Maknoon WASPAS equilibrium least two Nash based on MCDM how this new
and Zavadskas strategies by equilibriums, what methodology is framework can be
[224] applying SWARA do researchers do? considered for effective in
and WASPAS Why did they not decision making, policy-makers
evaluate Nash when there are future decisions
equilibriums? more than two with respect to
Nash equilibriums. critical issues,
when at least two
different Nash
equilibriums exist.
Ghorshi Nezhad, SWARA-WASPAS Used SWARA for Planning for future Integrated SWARA The ndings of this
Hashemkhani evaluating and in every level of for nding the paper found that;
Zolfani, ranking high organization is weights of criteria the attractiveness
Moztarzadeh, technology important duty and applied as aspect was the

A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

Zavadskas and selection. because of exist of WASPAS for rst ranked and
Bahrami [220] various criteria. ranking the research and
alternatives. technology
potential had the
rst rank in
sub-criteria in
ranking of high
tech industry.
Karabasevic, SWARA and Integrated SWARA Personnel selection Used SWARA for Findings of this
Stanujkic, Urosevic WASPAS and WASPAS for and recruitment evaluate weights of paper found that
and Maksimovic personnel process is criteria and interview
[221] selection. important role in WASPAS for preparedness had
the human assessing of the the rst rank
resource alternatives. among other
management in criteria.
every organization.
Heidarzade, SWARA and Used SWARA and Finding the best Applied SWARA for The nding of this
Varzandeh, WASPAS WASPAS for location site for evaluate weight of study is useful for
Rahbari, Zavadskas selection of best wind energy is the criteria and used decision maker
and Vafaeipour site regarding wind critical issue in WASPAS for related to wind
[222] energy. Iran. assessing the energy.
alternatives.
Vafaeipour, SWARA and To implement solar Lack of attention to Finding 29 Ranking of solar
Hashemkhani WASPAS projects by solar power plants quantitative and projects in 25 cities
Zolfani, Morshed applying SWARA in Middle East qualitative criteria of Iran, in which
Varzandeh, and WASPAS countries, such as based on experts Yazd was ranked
Derakhti and techniques. Iran. opinions and rst and
Keshavarz Eshkalag literature. economical
[223] perspective, was
ranked rst in
criteria.
Hashemkhani SWARA and The authors There is a lack of The authors of this The results of this
Zolfani, Aghdaie, WASPAS applied SWARA to previous studies paper believe that study
Derakhti, selecting the considering all SWARA and demonstrated that
Zavadskas and shopping mall criteria for WASPAS are decision criteria
Morshed location. selecting the mall powerful can be signicant
Varzandeh [166] location. techniques for for selecting the
solving these kinds shopping mall
of problems. location.

287
288 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

References Continuous Optimization and Knowledge-Based Technologies (EurOPT

2008) (2008) 241247.
[1] E.K. Zavadskas, J. Antucheviciene, S.H. Razavi Hajiagha, S.S. Hashemi, [28] E.K. Zavadskas, Z. Turskis, A new additive ratio assessment (ARAS) method in
Extension of weighted aggregated sum product assessment with multicriteria decision-making, Technol. Econ. Dev. Econ. 16 (2010) 159172.
interval-valued intuitionistic fuzzy numbers (WASPAS-IVIF), Appl. Soft [29] E.K. Zavadskas, Z. Turskis, J. Antucheviciene, Selecting a contractor by using
Comput. 24 (2014) 10131021. a novel method for multiple attribute analysis: weighted aggregated sum
[2] J. Qin, X. Liu, W. Pedrycz, Frank aggregation operators and their application product assessment with grey values (WASPAS-G), Stud. Inf. Control 24
to hesitant fuzzy multiple attribute decision making, Appl. Soft Comput. 41 (2015) 141150.
(2016) 428452. [30] K.R. MacCrimmon, Decisionmaking Among Multiple-attribute Alternatives:
[3] A. Bilbao-Terol, M. Arenas-Parra, V. Canal-Fernndez, J. Antomil-Ibias, Using a Survey and Consolidated Approach, In, DTIC Document, 1968.
TOPSIS for assessing the sustainability of government bond funds, Omega 49 [31] B. Roy, Classement et choix en prsence de points de vue multiples Revue
(2014) 117. francaise dautomatique, dinformatique et de recherche oprationnelle,
[4] A. zgen, M. Tanyas, Joint selection of customs broker agencies and Recherche Oprationnelle 2 (1968) 5775.
international road transportation rms by a fuzzy analytic network process [32] J.P. Brans, B. Mareschal, PROMETHEE V. MCDM problems with segmentation
approach, Expert Syst. Appl. 38 (2011) 82518258. constraints, INFOR: Inf. Syst. Oper. Res. 30 (1992) 8596.
[5] G. Isklar, G. Bykzkan, Using a multi-criteria decision making approach [33] R.L. Keeney, H. Raiffa, Decisions with multiple objectives: preferences and
to evaluate mobile phone alternatives, Comput. Stand. Interfaces 29 (2007) value trade-offs, Cambridge University Press, 1993.
265274. [34] A. Cereska, E.K. Zavadskas, F. Cavallaro, V. Podvezko, I. Tetsman, I.
[6] T.-C. Wang, H.-D. Lee, Developing a fuzzy TOPSIS approach based on Grinbergiene, Sustainable Assessment of Aerosol Pollution Decrease
subjective weights and objective weights, Expert Syst. Appl. 36 (2009) Applying Multiple Attribute Decision-Making Methods, Sustainability
89808985. (2016).
[7] M. Li, L. Jin, J. Wang, A new MCDM method combining QFD with TOPSIS for [35] R.W. Saaty, Decision Making in Complex Environment: The Analytic
knowledge management system selection from the users perspective in Hierarchy Process (AHP) for Decision Making and the Analytic Network
intuitionistic fuzzy environment, Appl. Soft Comput. 21 (2014) 2837. Process (ANP) for Decision Making with Dependence and Feedback, Super
[8] S.K. Patil, R. Kant, A hybrid approach based on fuzzy DEMATEL and FMCDM Decisions, Pittsburgh, 2003.
to predict success of knowledge management adoption in supply chain, [36] T.L. Saaty, L.G. Vargas, Decision Making with the Analytic Network Process:
Appl. Soft Comput. 18 (2014) 126135. Economic, Political, Social and Technological Applications with Benets,
[9] A. Mardani, A. Jusoh, E.K. Zavadskas, N. Zakuan, A. Valipour, M. Kazemilari, Opportunities, Costs and Risks, Springer Science & Business Media, 2013.
Proposing a new hierarchical framework for the evaluation of quality [37] E.K. Zavadskas, Z. Turskis, J. Antucheviciene, A. Zakarevicius, Optimization of
management practices: a new combined fuzzy hybrid MCDM approach, J. weighted aggregated sum product assessment, Elektrotechnika 122 (2012)
Bus. Econ. Manage. 17 (2016) 116. 36.
[10] A. Valipour, N. Yahaya, N. Md Noor, A. Mardani, J. Antucheviciene, A new [38] C.-L. Hwang, K. Yoon, Multiple Attribute Decision Making: Methods and
hybrid fuzzy cybernetic analytic network process model to identify shared Applications a State-of-the-art Survey, Springer Science & Business Media,
risks in PPP projects, Int. J. Strat. Prop. Manage. 20 (2016) 409426. 2012.
[11] N.Y. Alireza Valipour, Norhazilan Md Noor, Simona Kildiene, Hadi Sarvari, A. [39] S. Opricovic, G.-H. Tzeng, Compromise solution by MCDM methods: a
Mardani, A fuzzy analytic network process method for risk prioritization in comparative analysis of VIKOR and TOPSIS, Eur. J. Oper. Res. 156 (2004)
freeway PPP projects: an Iranian case study, J. Civil Eng. Manage. 21 (2015) 445455.
933947. [40] W.K.M. Brauers, E.K. Zavadskas, The MOORA method and its application to
[12] H. Ahmadi, M.S. Rad, M. Nilashi, O. Ibrahim, A. Almaee, Ranking the Micro privatization in a transition economy, Control Cybern. 35 (2006) 445.
level critical factors of electronic medical records adoption using TOPSIS [41] W.K.M. Brauers, E.K. Zavadskas, Project management by MULTIMOORA as an
method, Health Inf. 4 (2013). instrument for transition economies, Technol. Econ. Dev. Econ. (2010) 524.
[13] Y. Peng, G. Kou, G. Wang, Y. Shi, FAMCDM. A fusion approach of MCDM [42] M.C. Das, B. Sarkar, S. Ray, Decision making under conicting environment:
methods to rank multiclass classication algorithms, Omega 39 (2011) a new MCDM method, Int. J. Appl. Dec. Sci. 5 (2012) 142162.
677689. [43] E.K. Zavadskas, Z. Turskis, A new additive ratio assessment (ARAS) method in
[14] H. Ahmadi, M. Nilashi, O. Ibrahim, Organizational decision to adopt hospital multicriteria decision-making, Technol. Econ. Dev. Econ. 16 (2010) 159172.
information system: an empirical investigation in the case of Malaysian [44] E.K. Zavadskas, Z. Turskis, V. Bagocius, Multi-criteria selection of a
public hospitals, Int. J. Med. Inform. 84 (2015) 166188. deep-water port in the Eastern Baltic Sea, Appl. Soft Comput. 26 (2015)
[15] A. Jamshidi, S.A. Rahimi, D. Ait-kadi, A. Ruiz, A comprehensive fuzzy 180192.
risk-based maintenance framework for prioritization of medical devices, [45] M. Zare, C. Pahl, H. Rahnama, M. Nilashi, A. Mardani, O. Ibrahim, H. Ahmadi,
Appl. Soft Comput. 32 (2015) 322334. Multi-criteria decision making approach in E-learning: a systematic review
[16] O. Kulak, H.G. Goren, A.A. Supciller, A new multi criteria decision making and classication, Appl. Soft Comput. 45 (2016) 108128.
approach for medical imaging systems considering risk factors, Appl. Soft [46] A. Mardani, A. Jusoh, E.K. Zavadskas, Z. Khalifah, K.M. Nor, Application of
Comput. 35 (2015) 931941. multiple-criteria decision-making techniques and approaches to evaluating
[17] Y. Peng, G. Wang, H. Wang, User preferences based software defect of service quality: a systematic review of the literature, J. Bus. Econ. Manage.
detection algorithms selection using MCDM, Inf. Sci. 191 (2012) 313. 16 (2015) 10341068.
[18] Y.-H. Hung, T.-L. Huang, J.-C. Hsieh, H.-J. Tsuei, C.-C. Cheng, G.-H. Tzeng, [47] T. Balezentis, A. Balezentis, A survey on development and applications of the
Online reputation management for improving marketing by using a hybrid multi-criteria decision making method MULTIMOORA, J. Multi-Criteria Dec.
MCDM model, Knowl. Based Syst. 35 (2012) 8793. Anal. 21 (2014) 209222.
[19] N.H. Quang, V.F. Yu, A.C. Lin, L.Q. Dat, S.-Y. Chou, Parting curve selection and [48] A. Mardani, A. Jusoh, E.K. Zavadskas, M. Kazemilari, U.N.U. Ahmad, Z.
evaluation using an extension of fuzzy MCDM approach, Appl. Soft Comput. Khalifah, Application of multiple criteria decision making techniques in
13 (2013) 19521959. tourism and hospitality industry: a systematic review, Trans. Bus. Econ. 15
[20] A. Hatami-Marbini, M. Tavana, M. Moradi, F. Kangi, A fuzzy group Electre (2016) 192213.
method for safety and health assessment in hazardous waste recycling [49] A. Mardani, E.K. Zavadskas, Z. Khalifah, A. Jusoh, K.M. Nor, Multiple criteria
facilities, Saf. Sci. 51 (2013) 414426. decision-making techniques in transportation systems: a systematic review
[21] Z. Turskis, Multi-attribute contractors ranking method by applying ordering of the state of the art literature, Transport (2015) 127.
of feasible alternatives of solutions in terms of preferability technique, [50] A. Mardani, A. Jusoh, E.K. Zavadskas, F. Cavallaro, Z. Khalifah, Sustainable
Technol. Econ. Dev. Econ. 14 (2008) 224239. and renewable energy: an overview of the application of multiple criteria
[22] E.K. Zavadskas, Sustainable development of rural areas building structures decision making techniques and approaches, Sustainability 7 (2015)
based on local climate, Procedia Eng. 57 (2013) 12951301. 1394713984.
[23] E. Zavadskas, A. Kaklauskas, V. Sarka, The new method of multicriteria [51] A. Mardani, E.K. Zavadskas, Z. Khalifah, N. Zakuan, A. Jusoh, K.M. Nor, M.
complex proportional assessment of projects, Technol. Econ. Dev. Econ. 1 Khoshnoudi, A review of multi-criteria decision-making applications to
(1994) 131139. solve energy management problems: two decades from 1995 to 2015,
[24] E.K. Zavadskas, J. Antucheviciene, S.H.R. Hajiagha, S.S. Hashemi, Extension of Renew. Sustain. Energy Rev. 71 (2017) 216256.
weighted aggregated sum product assessment with interval-valued [52] A. Mardani, E.K. Zavadskas, D. Streimikiene, A. Jusoh, M. Khoshnoudi, A
intuitionistic fuzzy numbers (WASPAS-IVIF), Appl. Soft Comput. 24 (2014) comprehensive review of data envelopment analysis (DEA) approach in
10131021. energy efciency, Renew. Sustain. Energy Rev. 70 (2017) 12981322.
[25] E.K. Zavadskas, R. Bausys, D. Stanujkic, Selection of lead-zinc otation circuit [53] A. Mardani, E.K. Zavadskas, D. Streimikiene, A. Jusoh, K.M. Nor, M.
design by applying WASPAS method with single-valued neutrosophic set, Khoshnoudi, Using fuzzy multiple criteria decision making approaches for
Acta Montanist. Slovaca 21 (2016) 8592. evaluating energy saving technologies and solutions in ve star hotels: a
[26] E.K. Zavadskas, A. Kaklauskas, Z. Turskis, D. Kalibatas, An approach to new hierarchical framework, Energy 117 (2016) 131148.
multi-attribute assessment of indoor environment before and after [54] K. Govindan, M.B. Jepsen, ELECTRE. A comprehensive literature review on
refurbishment of dwellings, J. Environ. Eng. Landsc. Manage. 17 (2009) 511. methodologies and applications, Eur. J. Oper. Res. 250 (2016) 129.
[27] E.K. Zavadskas, A. Kaklauskas, Z. Turskis, J. Tamosaitiene, Contractor [55] K. Govindan, S. Rajendran, J. Sarkis, P. Murugesan, Multi criteria decision
selection multi-attribute model applynig COPRAS method with grey interval making approaches for green supplier evaluation and selection: a literature
numbers, 20th International Conference/Euro Mini Conference on review, J. Clean. Prod. 9 (8) (2015) 6683.
 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292 289

[56] M. Gul , E. Celik , N. Aydin , A. Taskin Gumus , A.F. Guneri , A state of the art [90] M. Zeleny, J.L. Cochrane, Multiple Criteria Decision Making, McGraw-Hill,
literature review of VIKOR and its fuzzy extensions on applications, Appl. New York, 1982.
Soft Comput. 46 (2016) 6089. [91] A. Charnes, W.W. Cooper, E. Rhodes, Measuring the efciency of decision
[57] A. Mardani, E.K. Zavadskas, K. Govindan, A. Amat Senin, A. Jusoh, VIKOR making units, Eur. J. Oper. Res. 2 (1978) 429444.
technique: a systematic review of the state of the art literature on [92] A. Charnes, Data Envelopment Analysis: Theory, Methodology and
methodologies and applications, Sustainability 8 (2016), UNSP 37. Applications, Springer, 1994.
[58] A. Mardani, A. Jusoh, K. MD Nor, Z. Khalifah, N. Zakwan, A. Valipour, Multiple [93] B. Roy, Multicriteria Methodology for Decision Aiding, Springer, 1996.
criteria decision-making techniques and their applicationsa review of the [94] V. Belton, T. Stewart, Multiple Criteria Decision Analysis: an Integrated
literature from 2000 to 2014, Econ. Res. Ekonomska Istrazivanja 28 (2015) Approach, Springer, 2002.
516571. [95] T. Gal, T. Stewart, T. Hanne, Multicriteria Decision Making: Advances in
[59] A. Mardani, A. Jusoh, E.K. Zavadskas, Fuzzy multiple criteria MCDM Models, Algorithms, Theory, and Applications, Da Capo Press, 1999.
decision-making techniques and applications Two decades reviewfrom [96] K. Miettinen, Nonlinear Multiobjective Optimization, Springer, 1999.
1994 to 2014, Expert Syst. Appl. 42 (2015) 41264148. [97] V. Peneva, I. Popchev, Multicriteria decision making based on fuzzy
[60] M. Behzadian, S. Khanmohammadi Otaghsara, M. Yazdani, J. Ignatius, A relations, Cybern. Inf. Technol. 8 (2008).
state-of the-art survey of TOPSIS applications, Expert Syst. Appl. 39 (2012) [98] J.C. Fodor, M. Roubens, Characterization of weighted maximum and some
1305113069. related operations, Inf. Sci. 84 (1995) 173180.
[61] E.K. Zavadskas, A. Mardani, Z. Turskis, A. Jusoh, K.M. Nor, Development of [99] F. Chiclana, F. Herrera, E. Herrera-Viedma, Integrating three representation
TOPSIS method to solve complicated decision-making problems: an models in fuzzy multipurpose decision making based on fuzzy preference
overview on developmentsfrom 2000 to 2015, Int. J. Inf. Technol. Dec. relations, Fuzzy Sets Syst. 97 (1998) 3348.
Making (2016) 645682. [100] F. Chiclana, F. Herrera, E. Herrera-Viedma, The ordered weighted geometric
[62] B. Vahdani, R. Tavakkoli-Moghaddam, S.M. Mousavi, A. Ghodratnama, Soft operator: properties and application in MCDM Problems, Proc. 8th Conf.
computing based on new interval-valued fuzzy modied multi-criteria Inform. Processing and Management of Uncertainty in Knowledgebased
decision-making method, Appl. Soft Comput. 13 (2013) 165172. Systems (IPMU, Citeseer) (2000).
[63] C. Kahraman, Fuzzy Multi-criteria Decision Making: Theory and [101] J.M. da Costa Sousa, U. Kaymak, Model predictive control using fuzzy
Applications with Recent Developments, Springer, 2008. decision functions, IEEE Trans. Syst. Man Cybern. Part B: Cybern. 31 (2001)
[64] E.K. Zavadskas, Z. Turskis, Multiple criteria decision making (MCDM) 5465.
methods in economics: an overview, Technol. Econ. Dev. Econ. 17 (2011) [102] R.R. Yager, On weighted median aggregation, Int. J. Uncertain. Fuzziness
397427. Knowl. Based Syst. 2 (1994) 101113.
[65] A. Guitouni, J.-M. Martel, Tentative guidelines to help choosing an [103] M. Inuiguchi, H. Ichihashi, H. Tanaka, Fuzzy Programming: a Survey of
appropriate MCDA method, Eur. J. Oper. Res. 109 (1998) 501521. Recent Developments, In: Stochastic Versus Fuzzy Approaches to
[66] V. Kersuliene, E.K. Zavadskas, Z. Turskis, Selection of rational dispute Multiobjective Mathematical Programming Under Uncertainty, Springer,
resolution method by applying new step-wise weight assessment ratio 1990, pp. 4568.
analysis (SWARA), J. Bus. Econ. Manage. 11 (2010) 243258. [104] F.P. Hwang, S.J. Chen, C.L. Hwang, Fuzzy Multiple Attribute Decision Making:
[67] E.K. Zavadskas, Z. Turskis, S. Kildiene, State of art surveys of overviews on Methods and Applications, Springer, Berlin Heidelberg, 1992.
MCDM/MADM methods, Technol. Econ. Dev. Econ. 20 (2014) 165179. [105] R.R. Yager, On ordered weighted averaging aggregation operators in
[68] C. Kahraman, S. Ceb, A new multi-attribute decision making method: multicriteria decisionmaking, IEEE Trans. Syst. Man Cybern. 18 (1988)
hierarchical fuzzy axiomatic design, Expert Syst. Appl. 36 (2009) 48484861. 183190.
[69] A. Chauhan, R. Vaish, Magnetic material selection using multiple attribute [106] Z. Xu, Q. Da, The ordered weighted geometric averaging operators, Int. J.
decision making approach, Mater. Des. 36 (2012) 15. Intell. Syst. 17 (2002) 709716.
[70] M.M. Kksalan, J. Wallenius, S. Zionts, Multiple Criteria Decision Making: [107] R.R. Yager, OWA aggregation over a continuous interval argument with
from Early History to the 21 st Century, World Scientic, 2011. applications to decision making, IEEE Trans. Syst. Man Cybern. Part B:
[71] C.-L. Hwang, A.S.M. Masud, S.R. Paidy, K.P. Yoon, Multiple Objective Decision Cybern. 34 (2004) 19521963.
Making, Methods and Applications a State-of-the-art Survey, Springer [108] V. Torra, Hesitant fuzzy sets, Int. J. Intell. Syst. 25 (2010) 529539.
Berlin, 1979. [109] V. Torra, Y. Narukawa, On hesitant fuzzy sets and decision, in: IEEE
[72] R.L. Keeney, H. Raiffa, D.W. Rajala, Decisions with multiple objectives: International Conference on Fuzzy Systems, 2009 FUZZ-IEEE 2009, IEEE,
Preferences and value trade-offs, IEEE Trans. Syst. Man Cybern. 9 (1979) 403. 2009, pp. 13781382.
[73] G.-H. Tzeng, J.-J. Huang, Multiple Attribute Decision Making: Methods and [110] B. Zhu, Z. Xu, M. Xia, Hesitant fuzzy geometric Bonferroni means, Inf. Sci.
Applications, CRC Press, 2011. 205 (2012) 7285.
[74] A. Mardani, A. Jusoh, K. Md Nor, Z. Khalifah, N. Zakwan, A. Valipour, Multiple [111] D. Yu, Y. Wu, W. Zhou, Generalized hesitant fuzzy Bonferroni mean and its
criteria decision-making techniques and their applications a review of the application in multi-criteria group decision making, J. Inf. Comput. Sci. 9
literature from 2000 to 2014, Econ. Res. Ekonomska Istrazivanja 28 (2015) (2012) 267274.
516571. [112] S.-M. Chen, J.-M. Tan, Handling multicriteria fuzzy decision-making
[75] Y. Wang, H. Lee, K. Lin, Fuzzy TOPSIS for multi-criteria decision-making, Int. problems based on vague set theory, Fuzzy Sets Syst. 67 (1994) 163172.
Math. J. 3 (2003) 367379. [113] D.H. Hong, C.-H. Choi, Multicriteria fuzzy decision-making problems based
[76] A. Mardani, E.K. Jusoh, Z. Khalifah, K.M. Nor, Application of multiple-criteria on vague set theory, Fuzzy Sets Syst. 114 (2000) 103113.
decision-making techniques and approaches to evaluating of service [114] K.T. Atanassov, Intuitionistic fuzzy sets, Fuzzy Sets Syst. 20 (1986) 8796.
quality: a systematic review of the literature, J. Business Econ. Manage. 16 [115] D.-F. Li, Multiattribute decision making models and methods using
(2015) 10341068. intuitionistic fuzzy sets, J. Comput. Syst. Sci. 70 (2005) 7385.
[77] T.L. Saaty, On polynomials and crossing numbers of complete graphs, J. [116] H.-W. Liu, G.-J. Wang, Multi-criteria decision-making methods based on
Combin. Theory Series A 10 (1971) 183184. intuitionistic fuzzy sets, Eur. J. Oper. Res. 179 (2007) 220233.
[78] T.L. Saaty, What Is the Analytic Hierarchy Process? Springer, 1988. [117] T.-Y. Chen, H.-P. Wang, Y.-Y. Lu, A multicriteria group decision-making
[79] T.L. Saaty, Decision Making with Dependence and Feedback: The Analytic approach based on interval-valued intuitionistic fuzzy sets: a comparative
Network Process, 1996. perspective, Expert Syst. Appl. 38 (2011) 76477658.
[80] E. Fontela A. Gabus, The DEMATEL observer in, DEMATEL 1976. [118] L.A. Zadeh, Fuzzy sets, Inf. Control 8 (1965) 338353.
[81] B. Mareschal, J.P., Brans, P. Vincke, PROMETHEE: A new family of outranking [119] D. Dubois, H. Prade, Systems of linear fuzzy constraints, Fuzzy Sets Syst. 3
methods in multicriteria analysis, in, ULBUniversite Libre de Bruxelles, (1980) 3748.
1984. [120] R.R. Yager, A characterization of the extension principle, Fuzzy Sets Syst. 18
[82] B. Roy, Classement et choix en prsence de points de vue multiples (1986) 205217.
RAIRO-Oper. Res. Recherche Oprationnelle 2 (1968) 5775. [121] S. Miyamoto, Z.-Q. Liu, T. Kunii, Soft Computing and Human-centered
[83] B. Roy, Problems and methods with multiple objective functions, Math. Machines, Springer-Verlag, New York, 2000.
Programm. 1 (1971) 239266. [122] Z. Xu, EOWA and EOWG operators for aggregating linguistic labels based on
[84] B. Roy, P. Bertier, La Mthode ELECTRE II(Une Application Au linguistic preference relations, International Journal of Uncertainty,
mdia-planning. . .), 1973. Fuzziness Knowl. Based Syst. 12 (2004) 791810.
[85] B. Roy, ELECTRE III: Un algorithme de classements fond sur une [123] Z. Xu, A method based on linguistic aggregation operators for group decision
reprsentation oue des prfrences en prsence de criteres multiples, making with linguistic preference relations, Inf. Sci. 166 (2004) 1930.
Cahiers du CERO 20 (1978) 324. [124] W.K. Brauers, Optimization Methods for a Stakeholder Society, a Revolution
[86] C. Hwang, K. Yoon, Multiple Attribute Decision Making: Methods and in Economic Thinking by Multi-objective Optimization, Series: Nonconvex
Applications, A State of the Art Survey, Sprinnger-Verlag, New York, NY, Optimization and Its Applications, Kluwer Academic Publishers,
1981. Boston/Dordrecht/London, 2004.
[87] S. Opricovic, Multicriteria optimization of civil engineering systems Faculty [125] W. Brauers, E.K. Zavadskas, The MOORA method and its application to
of Civil Engineering, Belgrade 2 (1998) 521. privatization in a transition economy, Control Cybern. 35 (2006) 445469.
[88] S. Opricovic, G.H. Tzeng, Multicriteria planning of post-earthquake [126] A. Kaklauskas, E.K. Zavadskas, S. Raslanas, R. Ginevicius, A. Komka, P.
sustainable reconstruction, Comput.-Aided Civ. Infrastruct. Eng. 17 (2002) Malinauskas, Selection of low-e windows in retrot of public buildings by
211220. applying multiple criteria method COPRAS: A Lithuanian case, Energy Build.
[89] T.L. Saaty, The Analytic Hierarchy Process: Planning, Priority Setting, 38 (2006) 454462.
Resources Allocation, McGraw, New York, 1980.
290 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

[127] A. Kaklauskas, E.K. Zavadskas, A. Banaitis, G. Satkauskas, Dening the utility [156] T. Nuuter, I. Lill, L. Tupenaite, Comparison of housing market sustainability
and market value of a real estate: a multiple criteria approach, Int. J. Strat. in European countries based on multiple criteria assessment, Land Use
Prop. Manage. 11 (2007) 107120. Policy 42 (2015) 642651.
[128] E.K. Zavadskas, J. Antucheviciene, Multiple criteria evaluation of rural [157] H.-T. Nguyen, S.Z.M. Dawal, Y. Nukman, H. Aoyama, K. Case, An integrated
buildings regeneration alternatives, Build. Environ. 42 (2007) 436451. approach of fuzzy linguistic preference based AHP and fuzzy COPRAS for
[129] E.K. Zavadskas, A. Kaklauskas, Z. Turskis, J. Tamosaitiene, Selection of the machine tool evaluation, PLoS One 10 (2015) e0133599.
effective dwelling house walls by applying attributes values determined at [158] M. Varmazyar, M. Dehghanbaghi, M. Afkhami, A novel hybrid MCDM model
intervals, J. Civil Eng. Manage. 14 (2008) 8593. for performance evaluation of research and technology organizations based
[130] Z. Turskis, E.K. Zavadskas, A novel method for multiple criteria analysis: grey on BSC approach, Eval. Program Plann. 58 (2016) 125140.
additive ratio assessment (ARAS-G) method, Informatica 21 (2010) 597610. [159] J.J. Liou, J. Tamosaitiene, E.K. Zavadskas, G.-H. Tzeng, New hybrid COPRAS-G
[131] Z. Turskis, E.K. Zavadskas, A new additive ratio assessment (ARAS) method MADM Model for improving and selecting suppliers in green supply chain
in multicriteria decision-making, Technol. Econ. Dev. Econ. (2010) 159172. management, Int. J. Prod. Res. 54 (2016) 114134.
[132] M. Bitarafan, S.H. Zolfani, S.L. Are, E.K. Zavadskas, A. Mahmoudzadeh, [160] V. Bagocius, K.E. Zavadskas, Z. Turskis, Multi-Criteria selection of a
Evaluation of real-Time intelligent sensors for structural health monitoring deep-Water port in klaipeda, Procedia Eng. 57 (2013) 144148.
of bridges based on SWARA-WASPAS; a case in Iran, Baltic J. Road Bridge [161] M. Staniunas, M. Medineckiene, E.K. Zavadskas, D. Kalibatas, To modernize
Eng. 9 (2014). or not: ecological-economical assessment of multi-dwelling houses
[133] A. Cereska, V. Podvezko, E.K. Zavadskas, Operating characteristics analysis of modernization, Arch. Civil Mech. Eng. 13 (2013) 8898.
rotor systems using MCDM Methods, Stud. Info. Control 25 (2016) 5968. [162] E.K. Zavadskas, J. Antucheviciene, J. Saparauskas, Z. Turskis, Multi-criteria
[134] Z. Turskis, E.K. Zavadskas, A new fuzzy additive ratio assessment method assessment of facades alternatives: peculiarities of ranking methodology,
(ARAS-F). Case study: the analysis of fuzzy multiple criteria in order to Procedia Eng. 57 (2013) 107112.
select the logistic centers location, Transport 25 (2010) 423432. [163] E.K. Zavadskas, J. Antucheviciene, J. Saparauskas, Z. Turskis, MCDM methods
[135] E.K. Zavadskas, S. Susinskas, A. Daniunas, Z. Turskis, H. Sivilevicius, Multiple WASPAS and MULTIMOORA: verication of robustness of methods when
criteria selection of pile-column construction technology, J. Civil Eng. assessing alternative solutions, Econ. Comput. Econ. Cybern. Stud. Res. 47
Manage. 18 (2012) 834842. (2013) 520.
[136] E.K. Zavadskas, Z. Turskis, J. Tamosaitiene, Risk assessment of construction [164] M. Bitarafan, S. Hashemkhani Zolfani, S.L. Are, E.K. Zavadskas, A.
projects, J. Civil Eng. Manage. 16 (2010) 3346. Mahmoudzadeh, Evaluation of real-time intelligent sensors for structural
[137] T. Bakshi, B. Sarkar, MCA based performance evaluation of project selection, health monitoring of bridges based on swara-waspas; a case in iran, Baltic J.
arXiv preprint arXiv:1105.0390, (2011). Road Bridge Eng. 9 (2014).
[138] M. Yazdani, A. Alidoosti, E.K. Zavadskas, Risk analysis of critical [165] T. Dejus, J. Antucheviciene, Assessment of health and safety solutions at a
infrastructures using fuzzy copras, Econ. Res. Ekonomska Istrazivanja 24 construction site, J. Civil Eng. Manage. 19 (2013) 728737.
(2011) 2740. [166] S. Hashemkhani Zolfani, M.H. Aghdaie, A. Derakhti, E.K. Zavadskas, M.H.
[139] V. Podvezko, The comparative analysis of MCDA methods SAW and COPRAS, Morshed Varzandeh, Decision making on business issues with foresight
Inzinerine Ekonomika-Eng. Econ 22 (2011) 134146. perspective; an application of new hybrid MCDM model in shopping mall
[140] P. Chatterjee, V.M. Athawale, S. Chakraborty, Materials selection using locating, Expert Syst. Appl. 40 (2013) 71117121.
complex proportional assessment and evaluation of mixed data methods, [167] E. Siozinyte, J. Antucheviciene, Solving the problems of daylighting and
Mater. Des. 32 (2011) 851860. tradition continuity in a reconstructed vernacular building, J. Civil Eng.
[141] M.C. Das, B. Sarkar, S. Ray, A framework to measure relative performance of Manage. 19 (2013) 873882.
Indian technical institutions using integrated fuzzy AHP and COPRAS [168] S. Hashemkhani Zolfani, M.H. Aghdaie, A. Derakhti, E.K. Zavadskas, M.H.M.
methodology, Socioecon. Plann. Sci. 46 (2012) 230241. Varzandeh, Decision making on business issues with foresight perspective;
[142] M. Bitarafan, S. Hashemkhani Zolfani, S.L. Are, E.K. Zavadskas, Evaluating an application of new hybrid MCDM model in shopping mall locating,
the construction methods of cold-formed steel structures in reconstructing Expert Syst. Appl. 40 (2013) 71117121.
the areas damaged in natural crises, using the methods AHP and COPRAS-G, [169] V. Bagocius, E.K. Zavadskas, Z. Turskis, Multi-person selection of the best
Arch. Civil Mech. Eng. 12 (2012) 360367. wind turbine based on the multi-criteria integrated additive-multiplicative
[143] S.R. Maity, P. Chatterjee, S. Chakraborty, Cutting tool material selection utility function, J. Civil Eng. Manage. 20 (2014) 590599.
using grey complex proportional assessment method, Mater. Des. [170] S. Chakraborty, E.K. Zavadskas, Applications of WASPAS method in
(19802015) 36 (2012) 372378. manufacturing decision making, Informatica 25 (2014) 120.
[144] P. Chatterjee, S. Chakraborty, Material selection using preferential ranking [171] S. Lashgari, J. Antucheviciene, A. Delavari, O. Kheirkhah, Using QSPM and
methods, Mater. Des. 35 (2012) 384393. WASPAS methods for determining outsourcing strategies, J. Bus. Econ.
[145] M.M. Fouladgar, A. Yazdani-Chamzini, A. Lashgari, E.K. Zavadskas, Z. Turskis, Manage. 15 (2014) 729743.
Maintenance strategy selection using AHP and COPRAS under fuzzy [172] M. Vafaeipour, S. Hashemkhani Zolfani, M.H.M. Varzandeh, A. Derakhti, M.K.
environment, Int. J. Strat. Prop. Manage. 16 (2012) 85104. Eshkalag, Assessment of regions priority for implementation of solar
[146] J. Barysiene, A multi-criteria evaluation of container terminal technologies projects in Iran: new application of a hybrid multi-criteria decision making
applying the COPRAS-G method, Transport 27 (2012) 364372. approach, Energy Convers. Manage. 86 (2014) 653663.
[147] S. Hashemkhani Zolfani, N. Rezaeiniya, M.H. Aghdaie, E.K. Zavadskas, Quality [173] R. Dziugaite-Tumeniene, V. Lapinskiene, The multicriteria assessment
control manager selection based on AHP-COPRAS-G methods: a case in Iran, model for an energy supply system of a low energy house, Eng. Struct.
Econ. Res. Ekonomska Istrazivanja 25 (2012) 7286. Technol. 6 (2014) 3341.
[148] T. Balezentis, S. Zeng, Group multi-criteria decision making based upon [174] O. Bozorg-Haddad, A. Azarnivand, S.-M. Hosseini-Moghari, H.A. Loiciga,
interval-valued fuzzy numbers: an extension of the MULTIMOORA method, Development of a comparative multiple criteria framework for ranking
Expert Syst. Appl. 40 (2013) 543550. pareto optimal solutions of a multiobjective reservoir operation problem, J.
[149] M. Tavana, E. Momeni, N. Rezaeiniya, S.M. Mirhedayatian, H. Rezaeiniya, A Irrig. Drain. Eng. (2016) 04016019.
novel hybrid social media platform selection model using fuzzy ANP and [175] M. Keshavarz Ghorabaee, E.K. Zavadskas, M. Amiri, A. Esmaeili,
COPRAS-G, Expert Syst. Appl. 40 (2013) 56945702. Multi-criteria evaluation of green suppliers using an extended WASPAS
[150] B. Bairagi, B. Dey, B. Sarkar, S. Sanyal, Selection of robot for automated method with interval type-2 fuzzy sets, J. Clean. Prod. 137 (2016) 213229.
foundry operations using fuzzy multi-criteria decision making approaches, [176] E.K. Zavadskas, R. Bausys, D. Stanujkic, N. Magdalinovic-Kalinovic, Selection
Int. J. Manage. Sci. Eng. Manage. 9 (2014) 221232. of lead-zinc otation circuit design by applying WASPAS method with
[151] H.-T. Nguyen, S.Z.M. Dawal, Y. Nukman, H. Aoyama, A hybrid approach for single-valued neutrosophic set, Acta Montanist. Slovaca 21 (2016) 8592.
fuzzy multi-attribute decision making in machine tool selection with [177] E.K. Zavadskas, R. Bausys, M. Lazauskas, Sustainable assessment of
consideration of the interactions of attributes, Expert Syst. Appl. 41 (2014) alternative sites for the construction of a waste incineration plant by
30783090. applying WASPAS method with single-Valued neutrosophic set,
[152] A. Rabbani, M. Zamani, A. Yazdani-Chamzini, E.K. Zavadskas, Proposing a Sustainability 7 (2015) 1592315936.
new integrated model based on sustainability balanced scorecard (SBSC) [178] M.H. Aghdaie, S. Hashemkhani Zolfani, E.K. Zavadskas, Sales branches
and MCDM approaches by using linguistic variables for the performance performance evaluation: a multiple attribute decision making approach, 8th
evaluation of oil producing companies, Expert Syst. Appl. 41 (2014) International Scientic Conference on Business and Management, Vilnius
73167327. (2014), Article number: bm.2014.001.
[153] D.D. Adhikary, G.K. Bose, D. Bose, S. Mitra, Multi criteria FMECA for [179] S.H. Zolfani, J. Saparauskas, New application of SWARA method in
coal-red thermal power plants using COPRAS-G, Int. J. Qual. Reliab. prioritizing sustainability assessment indicators of energy system, Eng.
Manage. 31 (2014) 601614. Econ. 24 (2013) 408414.
[154] N. Pancholi, M. Bhatt, Multicriteria FMECA based decision-Making for [180] M. Alimardani, S. Hashemkhani Zolfani, M.H. Aghdaie, J. Tamosaitiene, A
aluminium wire process rolling mill through COPRAS-G, J. Qual. Reliab. Eng. novel hybrid SWARA and VIKOR methodology for supplier selection in an
2016 (2016). agile environment, Technol. Econ. Dev. Econ. 19 (2013) 533548.
[155] M. Keshavarz Ghorabaee, M. Amiri, J. Salehi Sadaghiani, G. Hassani Goodarzi, [181] V. Kersuliene, Z. Turskis, Integrated fuzzy multiple criteria decision making
Multiple criteria group decision-making for supplier selection based on model for architect selection, Technol. Econ. Dev. Econ. 17 (2011) 645666.
COPRAS method with interval type-2 fuzzy sets, Int. J. Adv. Manuf. Technol. [182] S. Hashemkhani Zolfani, M.H. Esfahani, M. Bitarafan, E.K. Zavadskas, S.L.
75 (2014) 11151130. Are, Developing a new hybrid MCDM method for selection of the optimal
alternative of mechanical longitudinal ventilation of tunnel pollutants
during automobile accidents, Transport 28 (2013) 8996.
 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292 291

[183] S. Hashemkhani Zolfani, M. Farrokhzad, Z. Turskis, Investigating on [211] S. Shukla, P. Mishra, R. Jain, H. Yadav, An integrated decision making
successful factors of online games based on explorer, E & M EKONOMIE A approach for ERP system selection using SWARA and PROMETHEE method,
MANAGEMENT 16 (2013) 161169. Int. J. Intell. Enterprise 3 (2016) 120147.
[184] S. Hashemkhani Zolfani, E.K. Zavadskas, Z. Turskis, Design of products with [212] I. Meidute-Kavaliauskiene, J. Stankeviciene, M.H. Aghdaie, S. Hashemkhani
both International and Local perspectives based on Yin-Yang balance theory Zolfani, E.K. Zavadskas, The 2-dn international scientic conference
and SWARA method, Econ. Res. Ekonomska Istrazivanja 26 (2013) 153166. Contemporary issues in business, management and education
[185] M.H. Aghdaie, S. Hashemkhani Zolfani, E.K. Zavadskas, Market segment 2013Synergies of data mining and multiple attribute decision making,
evaluation and selection based on application of fuzzy AHP and COPRAS-G Procedia Soc. Behav. Sci. 110 (2014) 767776.
methods, J. Bus. Econ. Manage. 14 (2013) 213233. [213] A. Ruzgys, R. Volvaciovas, C. Ignatavicius, Z. Turskis, Integrated evaluation of
[186] M. Hasan Aghdaie, S. Hashemkhani Zolfani, E.K. Zavadskas, Decision making external wall insulation in residential buildings using SWARA-TODIM
in machine tool selection: an integrated approach with SWARA and MCDM method, J. Civil Eng. Manage. 20 (2014) 103110.
COPRAS-G methods, Inzinerine Ekonomika-Eng. Econ 24 (2013) 517. [214] J. Nakhaei, S. Lale Are, M. Bitarafan, O. Kaplinski, Model for rapid
[187] S. Hashemkhani Zolfani, M. Bahrami, Investment prioritizing in high tech assessment of vulnerability of ofce buildings to blast using SWARA and
industries based on SWARA-COPRAS approach, Technol. Econ. Dev. Econ. 20 SMART methods (a case study of swiss re tower), J. Civil Eng. Manage. 22
(2014) 534553. (2016) 831843.
[188] D. Moher, A. Liberati, J. Tetzlaff, D.G. Altman, Preferred reporting items for [215] G. Jamali, K. Farrokhnejad, M. Mohammadi, Decision making on analyzing
systematic reviews and meta-analyses: the PRISMA statement, Ann. Intern. advanced manufacturing systems dimensions: SWARA and COPRAS G
Med. 151 (2009) 264269. integration (Case study: automotive industry), Buletin Teknologi Tanaman
[189] D. Budgen, P. Brereton, Performing systematic literature reviews in software 12 (2015) 266274.
engineering, in: Proceedings of the 28th International Conference on [216] A. Dehnavi, I.N. Aghdam, B. Pradhan, M.H. Morshed Varzandeh, A new
Software Engineering, ACM, 2006, pp. 10511052. hybrid model using step-wise weight assessment ratio analysis (SWARA)
[190] P.J. Phillips, E.M. Newton, Meta-analysis of face recognition algorithms, in: technique and adaptive neuro-fuzzy inference system (ANFIS) for regional
Fifth IEEE International Conference on Automatic Face and Gesture landslide hazard assessment in Iran, Catena 135 (2015) 122148.
Recognition, 2002 Proceedings, IEEE, 2002, pp. 235241. [217] S. Hashemkhani Zolfani, J. Salimi, R. Maknoon, S. Kildiene, Technology
[191] A. Liberati, D.G. Altman, J. Tetzlaff, C. Mulrow, P.C. Gtzsche, J.P. Ioannidis, foresight about R&D projects selection; application of SWARA method at the
M. Clarke, P.J. Devereaux, J. Kleijnen, D. Moher, The PRISMA statement for policy making level, Inzinerine Ekonomika-Eng. Eco 23 (2015) 571580.
reporting systematic reviews and meta-analyses of studies that evaluate [218] J. Nakhaei, S. Lale Are, M. Bitarafan, S. Kildiene, Evaluation of light supply in
health care interventions: explanation and elaboration, Ann. Intern. Med. the public underground safe spaces by using of COPRAS-SWARA methods,
151 (2009) (W-65-W-94). Int. J. Strat. Prop. Manage. 20 (2016) 198206.
[192] A. Hughes-Morley, B. Young, W. Waheed, N. Small, P. Bower, Factors [219] R.H. Kouchaksaraei, S. Hashemkhani Zolfani, M. Golabchi, Glasshouse
affecting recruitment into depression trials: systematic review, locating based on SWARA-COPRAS approach, Int. J. Strat. Prop. Manage. 19
meta-synthesis and conceptual framework, J.Affect. Disord. 172 (2015) (2015) 111122.
274290. [220] M.R. Ghorshi Nezhad, S. Hashemkhani Zolfani, F. Moztarzadeh, E.K.
[193] N.S. Consedine, N.L. Tuck, C.R. Ragin, B.A. Spencer, Beyond the black box: a Zavadskas, M. Bahrami, Planning the priority of high tech industries based
systematic review of breast, prostate, colorectal, and cervical screening on SWARA-WASPAS methodology: the case of the nanotechnology industry
among native and immigrant African-Descent Caribbean populations, J. in Iran, Econ. Res. Ekonomska Istrazivanja 28 (2015) 11111137.
Immigr. Minor. Health 17 (2015) 905924. [221] D. Karabasevic, D. Stanujkic, S. Urosevic, M. Maksimovic, An Approach to
[194] Z. Turskis, E.K. Zavadskas, J. Antucheviciene, N. Kosareva, A hybrid model Personnel Selection Based on SWARA and WASPAS Methods
based on fuzzy AHP and fuzzy WASPAS for construction site selection, Int. J. ( ),
Comput. Commun. Control 10 (2015) 113128. BizInfo (Blace) Journal of Economics, Management and Informatics, 7 (2016).
[196] Z. Turskis, A. Daniunas, E.K. Zavadskas, J. Medzvieckas, Multicriteria [222] F. Heidarzade, M.H.M. Varzandeh, O. Rahbari, E.K. Zavadskas, M. Vafaeipour,
evaluation of building foundation alternatives, Comput.-Aided Civ. Placement of wind farms based on a hybrid multi criteria decision making
Infrastruct. Eng. 31 (2016) 717729. for Iran, In Proceedings of the 4th World Sustainability Forum 4 (2014) 120.
[197] P. Karande, E. Zavadskas, S. Chakraborty, A study on the ranking [223] M. Vafaeipour, S. Hashemkhani Zolfani, M.H. Morshed Varzandeh, A.
performance of some MCDM methods for industrial robot selection Derakhti, M. Keshavarz Eshkalag, Assessment of regions priority for
problems, Int. J. Ind. Eng. Comput. 7 (2016) 399422. implementation of solar projects in Iran: new application of a hybrid
[198] M. Madic, J. Antucheviciene, M. Radovanovic, D. Petkovic, Determination of multi-criteria decision making approach, Energy Convers. Manage. 86
manufacturing process conditions by using MCDM methods: application in (2014) 653663.
laser cutting, Inzinerine Ekonomika-Eng. Eco. 27 (2016) 144150. [224] S. Hashemkhani Zolfani, R. Maknoon, E.K. Zavadskas, Multiple nash
[199] M. Yazdani, New approach to select materials using MADM tools, Int. J. Bus. equilibriums and evaluation of strategies. New application of MCDM
Syst. Res. (2016) 118. methods, J. Bus. Econ. Manage. 16 (2015) 290306.
[200] E.K. Zavadskas, S. Chakraborty, O. Bhattacharyya, J. Antucheviciene, [225] M. Yazdani, S. Hashemkhani Zolfani, E.K. Zavadskas, New integration of
Application of WASPAS method as an optimization tool in non-traditional MCDM methods and QFD in the selection of green suppliers, J. Bus. Econ.
machining processes, Inf. Technol. Control 44 (2015) 7788. Manage. 17 (2016) 10971113.
[201] M. Madic, V. Gecevska, M. Radovanovic, D. Petkovic, multi-criteria economic [226] C. Kahraman, M. Keshavarz Ghorabaee, E.K. Zavadskas, S. Cevik Onar, M.
analysis of machining processes using the WASPAS method, J. Prod. Eng. 17 Yazdani, B. Oztaysi, Intuitionistic fuzzy EDAS method: an application to solid
(2014) 7982. waste disposal site selection, J. Environ. Eng. Landsc. Manage. 25 (2017)
[202] M. Madic, N. Vitkovic, M. Trifunovic, Application of the WASPAS method for 112.
software selection, in: Proceedings of the 6th International ICT Conference, [227] M. Keshavarz Ghorabaee, E.K. Zavadskas, M. Amiri, Z. Turskis, Extended
ISBN, 2014, pp. 978986. EDAS method for fuzzy multi-criteria decision-making: an application to
[203] S. Chakraborty, E.K. Zavadskas, J. Antucheviciene, Applications of WASPAS supplier selection, Int. J. Comput. Commun. Control 11 (2016) 358371.
method as a multi-criteria decisionmaking tool, Econ. Comput. Econ. [228] M. Keshavarz Ghorabaee, M. Amiri, E.K. Zavadskas, Z. Turskis, Multi-criteria
Cybern. Stud. Res. 49 (2015) 522. group decision-making using an extended edas method with interval type-2
[204] E.K. Zavadskas, D. Kalibatas, D. Kalibatiene, A multi-attribute assessment fuzzy sets, Econ. Manage. 2 (2017) 468.
using WASPAS for choosing an optimal indoor environment, Arch. Civil [229] Z. Turskis, B. Juodagalviene, A novel hybrid multi-criteria decision-making
Mech. Eng. 16 (2016) 7685. model to assess a stairs shape for dwelling houses, J. Civil Eng. Manage. 22
[205] E.K. Zavadskas, M.J. Skibniewski, J. Antucheviciene, Performance analysis of (2016) 10781087.

Civil Engineering Journals based on the Web of Science database, Arch. [230] A. Kaklauskas, Degree of project utility and investment value assessments,
Civil Mech. Eng. 14 (2014) 519527. Int. J. Comput. Commun. Control 11 (2016) 667684.
[206] R. Volvaciovas, Z. Turskis, D. Aviza, R. Mikstiene, Multi-attribute selection of [231] M. Keshavarz Ghorabaee, M. Amiri, E.K. Zavadskas, R. Hooshmand, J.
public buildings retrots strategy, Procedia Eng. 57 (2013) 12361241. Antucheviciene, Fuzzy extension of the CODAS method for multi-criteria
[207] D. Karabasevic, E.K. Zavadskas, Z. Turskis, D. Stanujkic, The framework for market segment evaluation, J. Bus. Econ. Manage. 18 (2017) 119.
the selection of personnel based on the SWARA and ARAS methods under [232] Z. Turskis, J. Antucheviciene, A New Combinative Distance-Based
uncertainties, Informatica 27 (2016) 4965. Assessment (Codas) Method For Multi-Criteria Decision-Making, Econ.
[208] D. Karabasevic, J. Paunkovic, D. Stanujkic, Ranking of companies according Comput. Econ. Cybernetics Stud. Res. 50 (2016) 2544.
to the indicators of corporate social responsibility based on SWARA and [233] M. Keshavarz Ghorabaee, E.K. Zavadskas, M. Amiri, J. Antucheviciene, A new
ARAS methods, Serbian J. Manage. 11 (2015) 4353. method of Assessment based on Fuzzy Ranking and Aggregated Weights
[209] D. Karabasevic, D. Stanujkic, S. Urosevic, M. Maksimovic, Selection of (AFRAW) for MCDM problems under type-2 fuzzy environment, Econ.
candidates in the mining industry based on the application of the SWARA Comput. Econ. Cybern. Stud. Res. 50 (2016) 3968.
and the MULTIMOORA methods, Acta Montanistica Slovaca 20 (2015) [234] T. Balezentis, A. Balezentis, Group decision making procedure based on
116124. trapezoidal intuitionistic fuzzy numbers: MULTIMOORA methodology, Econ.
[210] D. Stanujkic, D. Karabasevic, E.K. Zavadskas, A framework for the Selection Comput. Econ. Cybern. Stud. Res. 50 (2016) 103122.
of a packaging design based on the SWARA method, Eng. Econ. 26 (2015) [235] D. Stanujkic, E.K. Zavadskas, W.K. Brauers, D. Karabasevic, An extension of
181187. the MULTIMOORA method for solving complex decision-making problems
based on the use of interval-valued triangular fuzzy numbers, Trans. Bus.
Econ. 14 (2015) 355377.
292 A. Mardani et al. / Applied Soft Computing 57 (2017) 265292

[236] E.K. Zavadskas, J. Antucheviciene, S.H. Razavi Hajiagha, S.S. Hashemi, The [239] M. Yazdani, E.K. Zavadskas, J. Ignatius, M. Doval Abad, Sensitivity analysis in
interval-valued intuitionistic fuzzy MULTIMOORA method for group MADM methods: application of material selection, Inzinerine
decision making in engineering, Math. Prob. Eng. 2015 (2015) 113. Ekonomika-Eng. Eco. 27 (2016) 382391.
[237] M. Lazauskas, V. Kutut, E.K. Zavadskas, Multicriteria assessment of [240] M. Pavlovskis, J. Antucheviciene, D. Migilinskas, Application of MCDM and
unnished construction projects, Gradevinar 67 (2015) 319328. BIM for evaluation of asset redevelopment solutions, Stud. Inf. Control 25
[238] M. Lazauskas, E.K. Zavadskas, J. Saparauskas, Ranking of priorities among the (2016) 293302.
baltic capital cities for the development of sustainable construction, Econ.
Manage. 18 (2015) 1524.