ANN BASED Optimization
ANN BASED Optimization
KEYWORDS Abstract. A real manufacturing system faces lots of real-world situations, such as
Facility layout; stochastic behaviors; the lack of attention to this issue is noticeable in the previous research.
Articial neural The aim of this paper is to nd the optimum layout and the most appropriate handling
network; transporters for the problem by a novel solving algorithm. The new model contains two
Discrete-event objective functions including the Material Handling Costs (MHC) and the complication
simulation; time of jobs (makespan). Real-world situations such as stochastic processing times, random
Non-dominated breakdowns, and cross tracs among transporters are considered in this paper. Several
sorting genetic experiment designs have been produced using DOE technique in simulation software and an
algorithm. Articial Neural Network (ANN) as a meta-model is used to estimate the objective functions
in the metaheuristic algorithms. A hybrid non-dominated sorting genetic algorithm (H-
NSGA-II) is applied for the optimization task. The proposed methodology is evaluated
through a real case study. First, simulation model is validated by comparing it with a real
data set. Then, the prediction performance of ANN is investigated. Finally, the ability
of H-NSGA-II in searching the solution space is compared with the traditional NSGA-II.
The results show that the proposed approach, combing simulation, ANN, and H-NSGA-II,
provides promising solutions for practical applications.
© 2017 Sharif University of Technology. All rights reserved.
consumer market demands that manufacturers must be Simulation is known as a powerful tool to evaluate
competitive. This requires ecient operation of man- various alternatives of facility layout. Computer simu-
ufacturing plants and their ability to satisfy customer lation has been applied in dierent facility layout prob-
demand as quick as possible. On-time delivery and lems (for example, see [4,7-11]). Gupta [12] employed
short manufacturing cycle times, as practical issues, a simulation model to select the best layout from a set
should be considered during the layout design process. of candidate layouts. He rstly generated a number
This paper considers both MHC and completion of material
ows based on a predened probability
time of jobs (makespan) as optimality criteria of distribution and found the optimum layouts of each
the layout. To be more practical, this paper takes
ow. He dened the best solution as the layout with
the stochastic nature of transporters handling time each department pair being separated by the average
and transporters failure into account when calculating distance of the generated layouts. Then, the
exibility
the makespan. Also, this paper considers eect of of the layout was measured by evaluating its deviation
work
ow interference as a major concern, which has from the ideal distances.
previously been considered very poorly, in estimating According to Grajo [13], layout optimization and
the makespan. The cross trac of transporters can simulation are two tasks that are crucial to any facility
result in considerable delays [5]. These delays lead planning and layout study. This is because simulation
to an increase in cycle times of production system. models can re
ect all of the attributes of real systems
Consequently, by taking into account the above factors, that are dicult to consider using analytical models for
we estimate the makespan with the highest possible the layout optimization problems. Azadivar and Tomp-
precision. Because of the described complexity of the kins [14] suggested a simulation model with a GA-based
manufacturing system, a closed-form analytical expres- optimization algorithm. In their method, simulation
sion to calculate makespan does not exist. Therefore, models were used to evaluate the objective functions
we utilize an Articial Neural Network (ANN) to and GA-based algorithm was used to search the op-
estimate the makespan. More specically, we rst timum solution. Azadivar and Wang [4] presented a
build a series of random layout designs and then facility layout optimization technique that considered
discrete-event simulation model is used to evaluate the the dynamic features and operational constraints of the
makespan of these designs. The obtained makespan system as a whole. In their proposed approach, the
is applied to structure an ANN. The ANN works as performance measures of system, such as cycle time
makespan estimator during the search process. In and productivity, were evaluated by simulation. Pagell
order to search the solution space, a hybrid algorithm and Melnyk [9] investigated three layouts consisting
based on non-dominated sorting genetic algorithm of the existing worker-paced assembly line, a modied
(NSGA-II) and an adaptive local search are devel- assembly line, and service cells to improve the overall
oped. The remainder of this paper is organized as operation of a service process. They used computer
follows. simulation to stimulate a critical analysis of the pro-
Section 2 reviews the existing literature. Section 3 cess.
presents the mathematical formulation and properties Kulturel-Konak et al. [15] presented a case in
of the problem. Section 4 explains the proposed which the demand rate was considered as a stochastic
methodology. To show performance of the suggested parameter. They also allowed routing
exibility for the
method, computational experiments are done in Sec- products so that they were permitted to follow dierent
tion 5. Finally, the possible extensions of this research routes in the facility. They used a simulation approach
are listed along with the conclusions on the proposed to model the uncertainty. In their simulation, the
approach. mean, variance, and covariance of interdepartmental
ows were estimated; then, these estimations were
2. Literature review used in the design process. Tabu search metaheuristic
was employed to solve the problem. Jithavech and
There is no research similar to the work accomplished Krishnan [11] presented a simulation-based method to
in this paper as we review a series of approximately evaluate the uncertainty associated with the layout.
correlated studies. Rosenblatt [6] was the rst who They validated their simulation model against analyt-
introduced the concept of multi-objective approach to ical methods. Results from case studies showed that
facility layout problems. He considered both qualita- the simulation-based procedure resulted in reduction
tive and quantitative objectives together to come up of risk as high as 80%. Zhou et al. [10] introduced
with a multi-objective formulation. Rosenblatt also a method where simulation was combined with Ge-
proposed a graphical method to generate a series of netic Algorithm (GA) to optimize the layout. They
ecient solutions based on the con
icting objectives of tested the optimized site layout within a simulation
minimizing the
ow cost and maximizing the closeness environment. Altuntas and Selim [16] proposed four
rating. dierent weighted association rule-based data mining
366 P. Azimi and P. Soo/Scientia Iranica, Transactions E: Industrial Engineering 24 (2017) 364{377
approaches to solve facility layout problem. They The distances between machines are determined a
constructed a simulation model and compared the priori;
layouts obtained by the proposed approaches in terms Flow between machines is deterministic;
of ve performance measures, namely machine utiliza-
tion, total amount of products produced, cycle time, Machines and locations are of equal size;
transfer time, and waiting time in queue. Dombrowskia The initial allocation cost of a machine in a location
and Ernst [17] presented a scenario-based simulation is ignored;
approach that used scenario technique, morphological The transporters' failure may occur, which leads to
analysis, and discrete event simulation to nd out increase in their processing time.
factory layout. Karpe et al. [18] presented a state
of the art review of simulation methods for facility 3.1. Model formulation
layout problems. Azadeh et al. [19] presented an In this section, the nonlinear integer programming
integrated computer simulation-stochastic data envel- formulations of the problem are presented. Before
opment analysis approach to deal with the facility proceeding to the mathematical model, we introduce
layout problem. In their research, computer simulation the indices, parameters, and decision variables:
network was used for performance modeling of each
layout design. The outputs of simulation were average Indices and parameters
time-in-system, average queue length, and average i; j Index of machines
machine utilization. By comparing their study with k; l Index of locations
some of the relevant studies and methodologies in the tr Index of transporter
literature, they revealed the high ability of the method M The number of machines or the
to handle complex layout problems in manufacturing locations
systems. Fi;j Amount of material
ow among
This is the rst study that introduces an inte- machines i and j
grated computer simulation, ANN, and H-NSGA-II as
an optimization approach for handling imprecision and Dk;l The distance between the locations k
non-linearity of layout problems in a special case of and l
manufacturing system. Ci;j Unit material handling cost between
machines i and j
3. Problem description
The manufacturing system addressed here consists of
m machines in which n types of parts, each requiring
a set of operations, are to be processed. During
the manufacturing process, the transporters move the
materials from one machine to another until all the
processes are completed. The transporters' handling
time is stochastic with known probability distribution.
A desired design for the system requires an ar-
rangement of m machines in m predened positions
and assignment of transporters to each pair of machines
such that both MHC and makespan are minimized.
Since minimization of MHC does not match minimiza-
tion of makespan, the problem falls into the class of
multi-objective optimization problems. To explain the
con
ict between two objective functions, adapted from
Chiang et al. [20], an eight-machine example with the
work
ow matrix has been shown in Figure 1. The
solution to this problem using MHC-based layout is
shown in Figure 1(a). While this layout planning will
minimize the MHC, it is clear that there are numerous
points at which transporters interference occurs. An
alternative layout, taking work
ow interference into
account, can be providing a work
ow in which there Figure 1. Solution to the eight-facility example: (a)
are any con
icting work
ows (Figure 1(b)). Minimizing MHC, and (b) minimizing work
ow
Other assumptions considered are as follows: interference [20].
P. Azimi and P. Soo/Scientia Iranica, Transactions E: Industrial Engineering 24 (2017) 364{377 367
F C tr Fixed cost of establishing the the variable MHC and the second term of it is related
transporter type tr to xed cost of the transporters. The rst objective
mtr Maximum available transporter type tr function of the problem is computed by analytical
relationships and it focuses on minimizing the handling
captr Capacity of the transporter type tr costs. Objective function (2), which is evaluated by
ANNs, focuses on minimizing the whole processing
Decision variables completion time. Constraint set (3) states that each
8
<1;
> if the machine i machine is assigned to a location and Constraint set
Xi;k is assigned to the location k (4) guarantees that each location is occupied by only
>
:
0; otherwise one machine. Constraint set (5) allocates a trans-
porter for movement between two special machines
8 only when material
ow exists. Constraint set (8)
<1;
> if the transporter tr is selected to transfer controls the maximum available number of each type
tr
Yi;j parts from the machine i to the machine j
> :
of transporters. The decision variables are kept either
0; otherwise at 1 or at 0 by Constraint set (9).
M M M M TR
XXXX X Fi;j 4. Proposed ANN-based optimization
MinZ1 =
cap tr Ci;j
i=1 j =1 k=1 l=1 tr=1 Because of complexity and uncertainty of many real-
life problems, it is very dicult to create a precise
Dk;l Xi;k Xj;l Yi;jtr analytical model. In such complicated situations,
simulation is proven as a powerful computer-based
M X
M X
TR tool that can be used instead of the analytical models
X to study the behavior of complex real systems [21].
+ tr F C tr ;
Yi;j (1)
i=1 j =1 tr=1
Even though simulation models are skillful in capturing
complex system behaviors, simulation is essentially a
MinZ2 = Makespan; (2) test approach and the way to get the optimum solutions
is not clear in it. Therefore, as Fu [21] pointed
M
X out, there is a need to develop algorithms that take
Xi;k = 1; 8i = 1; 2; :::; M; (3) advantage of the optimization technique, while being
k=1 as accurate as simulation. The principle of simulation
M optimization is that during the optimization process,
X objective function and constraints are evaluated by
Xi;k = 1; 8k = 1; 2; :::; M; (4)
simulation model.
i=1
Another weakness of simulation model comes
TR
X from its requirement of a number of replications, which
tr = sgn ;
Yi;j i;j 8i = 1; 2; :::; M 1; usually make simulation a very time consuming pro-
tr=1 cess. In order to take a step towards lling this gap, this
paper proposes a novel simulation-based optimization
8k = i + 1; 2; :::; M ; (5) framework, which integrates the simulation modeling,
8 articial neural network, and metaheuristic optimiza-
<1;
> if Fi;j > 0 tion algorithm. The framework is shown in Figure 2. A
sgni;j
>
8i; j = 1; 2; :::; M series of dierent scenarios are generated. Then, based
:
0; otherwise (6) on these scenarios, discrete event simulation model is
run. This input-output data is used to train an ANN
tr = Y tr ;
Yj;i i;j 8i; j = 1; 2; :::; M ; 8tr = 1; 2; :::; T R; to approximate the objective function. ANN acts just
(7) like a tremendous intelligent brain, which is trained
by simulation data and has the capability to estimate
X1 X
M M the makespan as fast as analytical relationships and as
tr mtr ;
Yi;j 8tr = 1; 2; :::; T R; (8) accurate as simulation models.
i=1 j =i+1 To search the solution space, a multi-objective
tr 2 f0; 1g; i; j; k = 1; 2; ::; M ;
Xi;k ; Yi;j optimization algorithm, called NSGA-II, has been com-
bined with an adaptive local search. The NSGA-II
8tr = 1; 2; :::; T R: (9) showed the capacity to robustly solve large complicated
multi-objective problems [22]. In our hybrid NSGA-
The rst term of objective function (1) is related to II (H-NSGA-II), ANN is considered as a chromosomes
368 P. Azimi and P. Soo/Scientia Iranica, Transactions E: Industrial Engineering 24 (2017) 364{377
5. Computational experiments
To demonstrate and validate the simulation-based op-
timization framework proposed in this paper, a real-
life production system is studied. This case study
Figure 7. An example of crossover type 2. involves 6 machines, named M 1, M 2, M 3, M 4, M 5,
and M 6, and 6 products. The demand of product
is known (Table 1) and so the material
ow between
machines is clear. The distance between locations and
capacity and speed of the available transporters are,
respectively, shown in Tables 2 and 3. The MHC is
Figure 8. An example of mutation operator. xed at 1 $/meter. The model is coded in Enterprise
P. Azimi and P. Soo/Scientia Iranica, Transactions E: Industrial Engineering 24 (2017) 364{377 371
Table 1. Demand rate of products (per day). Table 3. Travel path distance between locations (meter).
Demand Sequence From/to 1 2 3 4 5 6
Product 1 300 1 !3 !6 1 0 10 20 15 20 30
Product 2 200 1 !2 !1 !3 !5 !6 2 10 0 10 20 15 20
Product 3 150 1 !3 !5 !2 !6 3 20 10 0 25 20 15
Product 4 220 1 !2 !3 !6 4 15 20 25 0 10 20
Product 5 150 1 !2 !4 !6 5 20 15 20 10 0 10
Product 6 90 1 !2 !6 6 30 20 15 20 10 0
Table 4. Results of real system and simulation model. After determining the structure of ANN, back-
Obtained makespan propagation algorithm is carried out to train the
Days network. The back-propagation algorithm has power-
(minute) % Error
no. ful approximation capacity and is applicable to both
Real system Simulation binary and continuous inputs. The type of transfer
1 387 389 0.52 function employed in this work is a sigmoid function
2 340 347 2.06 (Eq. (15)) at hidden layer and a linear transfer function
3 390 401 2.82 at output layer. Neural Network Toolbox V4.0 of MAT-
LAB mathematical software was used for makespan
4 395 386 2.28 prediction:
5 384 394 2.60
6 364 383 5.22 1
f (x) = : (15)
1+e x
7 400 397 0.75
8 400 407 1.75 For inter-comparisons between the simulated and mea-
9 386 393 1.81 sured makespans using the ANN model, two perfor-
mance measures, i.e. the Root Mean Squared Error
10 342 348 1.75 (RMSE) and coecient of determination (R2 ), are used
11 399 390 2.26 as follows [31]:
12 358 355 0.84 v
u
M 2
13 352 348 1.14 1 uX Yi Yi
RMSE = t (16)
14 396 391 1.26 m i=1 Yi
15 388 394 1.55
16 382 378 1.05 where m is the number of samples, Yi is the actual
response of sample i, and Y^i is the predicted response
17 340 351 3.24 of sample i. According to RMSE = 0.01545 and R2 =
18 383 391 2.09 0:9771, the ANN model has been properly trained and
19 375 379 1.07 has good quality predictions.
20 342 347 1.46 Usually, it is necessary to check the tted model
21 391 380 2.81
to ensure that it provides an adequate approximation
to the new input data. To this aim, the ANN results
22 363 372 2.48 are compared with respect to their deviations from
23 388 393 1.29 the simulation results for 15 new trials, which do
24 356 370 3.93 not belong to the training data set. We propose the
25 367 371 1.09 condence intervals to evaluate the overall performance
of the neural network, because interval estimates are
26 399 411 3.01 much more useful than point estimates for decision-
27 368 361 1.90 making. Each trial is simulated for 10 replications
28 372 374 0.54 and E (Ysim ) and V AR(Ysim ) are combined to form
29 385 382 0.78 condence intervals for each trial (Eq. (17)):
30 378 387 2.38
Interval = E (Ysim ) t 2 ;r
p
V AR(Ysim ): (17)
r
Average 375 379 1.92
As show in Figure 11, in each experiment trail, the
Table 5. The optimal ANN parameters. predicted result by ANN (red points) falls within
the interval obtained by the simulation, and so the
Parameter value capabilities of structured ANN will be proven.
Hidden layers 1
Nodes in hidden layer 14
5.3. Evaluation of the proposed metaheuristic
algorithm
Learning rate 0.015 We tested the optimization framework on numerous
random data sets that dier with respect to input
of output nodes, N is the number experiments, and h is parameters such as products demand, transporters
the numberpof nodes in the hidden layer. Consequently, capacity, material handling costs, etc. The main
2 + 24 14. The optimal ANN conguration,
h = 16+1 challenge in comparing the two multi-objective algo-
which was found experimentally, is summarized in rithms is that they do not try to nd one optimal
Table 5. solution, but a set of Pareto solutions. A good
P. Azimi and P. Soo/Scientia Iranica, Transactions E: Industrial Engineering 24 (2017) 364{377 373
performed similar. But, in terms of OPS and spac- changes: a genetic algorithm approach", Eur. J. Oper.
ing metric criteria, the performance of the proposed Res., 113, pp. 169-182 (1999).
hybrid algorithm was statistically better. For future 15. Kulturel-Konak, S., Smith, A.E. and Norman, B.A.
research, one may extend unequal area constraint \Layout optimization considering production uncer-
of departments, which demonstrates a more realistic tainty and routing
exibility", Int. J. Prod. Res.,
representation of real-world manufacturing facilities. 42(21), pp. 4475-4493 (2004).
Also, other factors aecting the makespan, such as 16. Altuntas, S. and Selim, H. \Facility layout using
human factors, can be investigated. weighted association rule-based data mining algo-
rithms: Evaluation with simulation", Expert Syst.
References Appl., 39, pp. 3-13 (2012).
1. Singh, S.P. and Sharma, R.R.K. \A review of dierent 17. Dombrowski, U. and Ernst, S. \Scenario-based simula-
approaches to the facility layout problems", Int. J. tion approach for layout planning", 8th CIRP Conf. on
Adv. Manuf. Technol., 30, pp. 425-433 (2006). Intell. Comput in Manuf. Eng., 12, pp. 354-359 (2013).
2. Tompkins, J.A., White, J.A., Bozer, Y.A. and Tan- 18. Karpe, A.B., Kulkarni, C.N. and Jahagirdar, R.S.
choco, J.M.A., Facilities Planning, Wiley, New York \Simulation methodology for facility layout problems",
(2003). Int. J. Res. Eng. Sci. Technol., 1, pp. 1-10 (2011).
3. Meller, R.D. and Gau, K.Y. \The facility layout prob- 19. Azadeh, A., Nazari, T. and Charkhand, H. \Opti-
lem: Recent and emerging trends and perspectives", mization of facility layout design problem with safety
J. Manuf. Syst., 15(5), pp. 351-366 (1996). and environmental factors by stochastic DEA and
simulation approach", Int. J. Prod. Res., 1(1), pp. 12-
4. Azadivar, F. and Wang, J. \Facility layout optimiza- 17 (2014).
tion using simulation and genetic algorithms", Int. J.
Prod. Res., 38(17), pp. 4369-4383 (2000). 20. Chiang, W., Kouvelis, P. and Urban, T. \Single and
5. Egbelu, P.J. and Tanchoco, J.M.A. \Potentials for bi- multiobjective facility layout with work
ow interfer-
directional guide-path for automated guided vehicle ence considerations", Eur. J. Oper. Res., 174(3), pp.
based systems", Int. J. Prod. Res., 24(5), pp. 1075- 1414-1426 (2006).
1097 (1986). 21. Fu, M.C. \Optimization for simulation: Theory vs.
6. Rosenblatt, M.J. \The facilities layout problem: A practice", Inf J. Comput., 14, pp. 192-215 (2002).
multi-goal approach", Int. J. Prod. Res., 17(4), pp. 22. Wang, G., Yan, Y., Zhang, X., Shangguan, J. and
323-332 (1979). Xiao, Y. \A simulation optimization approach for
7. Savsar, M. \Flexible facility layout by simulation", facility layout problem", Proc. of the IEEE Int'l. Conf.
Comput. Ind. Eng., 20(1), pp. 155-165 (1991). on Ind. Eng. Eng. Manage., pp. 734-738 (2008).
8. Morris, J.S. and Tersine, R.J. \A simulation compari- 23. Swisher, J.R., Hyden, P.D., Jacobson, S.H. and
son of process and cellular lay-outs in a dual resource Schruben, L.W. \A survey of recent advances in
constrained environment", Comput. Ind. Eng., 26(4), discrete input parameter discrete-event simulation op-
pp. 733-41 (1994). timization", IIE Trans., 36, pp. 591-600 (2004).
9. Pagell, M. and Melnyk, S.A. \Assessing the impact of 24. Fu, M.C., Glover, F.W. and April, J. \Simulation
alternative manufacturing layouts in a service setting", optimization: a review, new developments, and appli-
J. Oper. Manage., 22(4), pp. 413-29 (2004). cations", In: Kuhl ME, Steiger NM, Joines JA, Eds.,
10. Zhou, F., AbouRizk, S.M. and AL-Battaineh, H. Proceedings of the 2005 Winter Simulation Conference
\Optimization of construction site layout using a hy- (2005).
brid simulation-based system", Simul. Modell. Pract. 25. Ashtiani, A., Mirzaei, P.A. and Haghighat, F. \Indoor
Theory, 17, pp. 348-363 (2009). thermal condition in urban heat island: Comparison
11. Jithavech, I. and Krishnan, K.K. \A simulation-based of the articial neural network and regression methods
approach for risk assessment of facility layout de- prediction", Energy Build., 76, pp. 597-604 (2014).
signs under stochastic product demands", Int. J. Adv. 26. Funahashi, K. \On the approximate realization of
Manuf. Technol., 49(1), pp. 27-40 (2009). continuous mappings by neural networks", Neural
12. Gupta, R.M. \Flexibility in layouts: A simulation Netw., 2(1), pp. 83-92 (1989).
approach", Material Flow., 3, pp. 243-250 (1986). 27. Hornik, K., Stinchcombe, M. and White, H. \Multi-
13. Grajo, E.S. \Strategic layout planning and simulation layer feed forward networks are universal approxima-
for lean manufacturing a layOpt tutorial", Proceedings tors", Neural Netw., 2, pp. 359-66 (1989).
of the 1996 Winter Simulation Conference, pp. 564-568 28. Deb, K., Pratap, A., Agarwal, S. and Meyarivan, T.
(1996). \A fast and elitist multiobjective genetic algorithm:
14. Azadivar, F. and Tompkins, G. \Simulation optimiza- NSGA-II", IEEE Trans. Evol. Comput., 6, pp. 182-
tion with quantitative variables and structural model 197 (2002).
376 P. Azimi and P. Soo/Scientia Iranica, Transactions E: Industrial Engineering 24 (2017) 364{377
H-NSGA-II
H-NSGA-II
H-NSGA-II
H-NSGA-II
No.
NSGA-II
NSGA-II
NSGA-II
NSGA-II
Problem