Metaheuristics: From Design To Implementation: Chap 2 Single-Solution Based Metaheuristics
Metaheuristics: From Design To Implementation: Chap 2 Single-Solution Based Metaheuristics
Implementation
Chap 2
Single-solution based
Metaheuristics
Selection Candidates
Local
optima
Metaheuristics E-G. Talbi
High-level template of S-metaheuristics
Metaheuristics
S-meta
Repeat replace σ
N (σ )
By a better solution in the neighborhood
N ( σ1 ) N (σ 2 ) N (σ 4 )
N (σ 0 )
σ1 σ2 σ4
σ0 σ3
Solutions
Metaheuristics E-G. Talbi
Selection of the neighbor
• Best improvement: Deterministic/full - choosing
the best neighbor (i.e. that improves the most the
objective function).
• Entropy (diversity) n ⎛n
−1 n n ij ⎞
EG ( P ) = ∑ ∑ ⎜
n log ( n ) i =1 j =1 ⎝ P
ij
log
P ⎠
⎟
∑ ( f ( s ) − f (Π )
*
• Gap
s∈ P
Gap ( P ) =
P . f (Π )
*
l−h 1 l
2
∑ ( f ( xt) − f )
l t =1
• Correlation length
Random conf.
Local optima
• Different neighborhoods:
– City-swap: Hard problem
– 2-opt: big (single) valley
=> design a hybrid meta-heuristic
– Initialize the population of a GA with randomized
local optima
– Use recombination to keep solutions in the valley
• Classification of benchmarks
• Using of 2 measures:
– Entropy and average distance
type I type II type III uniforme uni-massif
entropie : high low high
diamètre : high low high
multi-massif
• …
• Prevent cycling
– Stroring solutions is time and memory consuming Æ k
last solutions, hash codes, …
– Tabu List (short term memory): to record a limited
number of attributes of solutions (moves, selections,
assignments, etc)
– Multiple tabu lists: some ingredients of the visited
solutions and/or the moves are stored
– Tabu tenure (length of tabu list): number of iterations
a tabu move is considered to remain tabu:
• Static
• Dynamic
• Adaptive
N2
N1
...
we change k move
Nkmax
N2
N1
...
Nk
x’
Nk
Nk+1
Nk(x’’)
x’
Metaheuristics E-G. Talbi x’’
VNS: Variable Neighbourhood Search
• Iterations: α = 6, 3, 2, 1
• This transform clusters distances in the center
• The ranking of the distances is preserved
c(p)= ∑i=1 ∑
N N
j=1
ai,jbp(i),p(j)
10
l1 l2
cost of assignment: 10×1+ 30×10 + 40×5 = 510
1
30 f1 f2
40
10
5
l3 f3
30
40
10 5
1
f1 f2
f3
l3
10
5
f3
1
f1 f2
f2
l3
10
5
f3
hi ri = 0 hi
ri = 0
ri = 1 wi
ai
bi
hi
• Small w
waste
areas
• Smooth h
upper
contour
The best items are those that best fit to the upper contour