Unit 4

Soft computing
 Unit content
• Introduction of Neuro-Fuzzy Systems,
• Architecture of Neuro Fuzzy Networks.
• Application of Fuzzy Logic: Medicine,
Economics, Indusrtry etc.
 Neuro-fuzzy systems

• Definition:-
A fuzzy neural network or neuro-fuzzy
system is a learning machine that finds the
parameters of a fuzzy system (i.e., fuzzy
sets, fuzzy rules) by exploiting approximation
techniques from neural networks.
• Combines fuzzy systems with neural network
 Neuro-fuzzy systems

• Both neural networks and fuzzy systems have some

things in common.
• They can be used for solving a problem (e.g. pattern
recognition, regression or density estimation) if
there does not exist any mathematical model of the
given problem.
• They solely do have certain disadvantages and
advantages which almost completely disappear by
combining both concepts.
Advantages and disadvantages of Fuzzy
logic and neural fuzzy systems
 Fuzzy logic and neural networks are natural
complementary tools in building intelligent systems.
 While neural networks are low-level computational
structures that perform well when dealing with raw
data, fuzzy logic deals with reasoning on a higher level,
using linguistic information acquired from domain
experts.
 However, fuzzy systems lack the ability to learn and
cannot adjust themselves to a new environment. On
the other hand, although neural networks can learn,
they are opaque to the user.
 Features of neuro fuzzy
networks
 Integrated neuro-fuzzy systems can combine the
parallel computation and learning abilities of
neural networks with the human-like knowledge
representation and explanation abilities of fuzzy
systems.

 As a result, neural networks become more

transparent, while fuzzy systems become capable
of learning.
 A neuro-fuzzy system is a neural network which is
functionally equivalent to a fuzzy inference model.

 Neuro-Fuzzy System can be trained to develop IF-THEN

fuzzy rules and determine membership functions for
input and output variables of the system.

 Expert knowledge can be incorporated into the

structure of the neuro-fuzzy system.

 At the same time, the connectionist structure avoids

fuzzy inference, which entails a substantial
computational burden.
Architecture of neuro-fuzzy system
 The structure of a neuro-fuzzy system is similar to
a multi-layer neural network.

 In general, a neuro-fuzzy system has:

 input and output layers,
 and three hidden layers
 that represent membership functions and
fuzzy rules.
 Neuro-fuzzy system
Layer 1 Layer 2 Layer 3 Layer 4 Layer 5

A1 A1 R1
x1 R1

x1 x1
A2  R2
x1 A2 R2
wR3 C1
C1
A3 A3 R3 R3 wR6
y
wR1 
B1 B1 R4 R4 wR2
x2 C2
wR4
C2
R5 wR5
x2 x2 B2
B2 R5
x2
R6
B3
B3 R6
Layer 1 Layer 2 Layer 3 Layer 4 Layer 5

A1 A1 R1
x1 R1

x1 x1
A2  R2
x1 A2 R2
wR3 C1
C1
A3 A3 R3 R3 wR6
y
wR1 
B1 B1 R4 R4 wR2
x2 C2
wR4
C2
R5 wR5
x2 x2 B2
B2 R5
x2
R6
B3
B3 R6

Layer 1 is the input layer. Each neuron in this layer transmits

external crisp signals directly to the next layer. That is,

Layer 2 is the fuzzification layer.

• Neurons in this layer represent fuzzy sets used in the antecedents of
fuzzy rules.
• A fuzzification neuron receives a crisp input and determines the
degree to which this input belongs to the neuron’s fuzzy set.
1. The activation function of a membership neuron is
set to the function that specifies the neuron’s fuzzy
set.
2. We use triangular sets, and therefore, the activation
functions for the neurons in Layer 2 are set to the
triangular membership functions.
3. A triangular membership function can be specified by
two parameters {a, b} as follows:
 ( 2) b
0 , if xi  a 
2

 2 xi( 2)  a
 b b
yi( 2)  1  , if a   xi( 2)  a 
 b 2 2
 ( 2) b
0, if xi  a 
2


Layer 1 Layer 2 Layer 3 Layer 4 Layer 5

A1 A1 R1
x1 R1

x1 x1
A2  R2
x1 A2 R2
wR3 C1
C1
A3 A3 R3 R3 wR6
y
wR1 
B1 B1 R4 R4 wR2
x2 C2
wR4
C2
R5 wR5
x2 x2 B2
B2 R5
x2
R6
B3
B3 R6

Layer 3 is the fuzzy rule layer.

1. Each neuron in this layer corresponds to a single fuzzy rule.

2. A fuzzy rule neuron receives inputs from the fuzzification neurons that represent
fuzzy sets in the rule antecedents.

3. For instance, neuron R1, which corresponds to Rule 1, receives inputs from
neurons A1 and B1.
 In a neuro-fuzzy system, intersection can be
implemented by the product operator.

Thus, the output of neuron i in Layer 3 is obtained

as:

yi(3)  x1(i3)  x2(3i )    xki

(3) y R(31)   A1   B1   R1
Layer 1 Layer 2 Layer 3 Layer 4 Layer 5

A1 A1 R1
x1 R1

x1 x1
A2  R2
x1 A2 R2
wR3 C1
C1
A3 A3 R3 R3 wR6
y
wR1 
B1 B1 R4 R4 wR2
x2 C2
wR4
C2
R5 wR5
x2 x2 B2
B2 R5
x2
R6
B3
B3 R6

Layer 4 is the output membership layer. Neurons in this layer represent fuzzy
sets used in the consequent of fuzzy rules.
An output membership neuron combines all its inputs by using the fuzzy
operation union.
This operation can be implemented by the probabilistic OR. That is,
( 4)
yi( 4)  x1
( 4)
i
( 4)
 x2 i
( 4)
   xli yC 1   R 3   R 6   C1

The value of C1 represents the integrated firing strength of fuzzy rule
neurons R3 and R6.
Layer 1 Layer 2 Layer 3 Layer 4 Layer 5

A1 A1 R1
x1 R1

x1 x1
A2  R2
x1 A2 R2
wR3 C1
C1
A3 A3 R3 R3 wR6
y
wR1 
B1 B1 R4 R4 wR2
x2 C2
wR4
C2
R5 wR5
x2 x2 B2
B2 R5
x2
R6
B3
B3 R6

Layer 5 is the defuzzification layer. Each neuron in this layer represents a single
output of the neuro-fuzzy system. It takes the output fuzzy sets clipped by
the respective integrated firing strengths and combines them into a single
fuzzy set.

Neuro-fuzzy systems can apply standard defuzzification methods, including

the centroid technique.

We will use the sum-product composition method.

 The sum-product composition calculates the crisp
output as the weighted average of the centroids of
all output membership functions.

For example, the weighted average of the centroids of

the clipped fuzzy sets C1 and C2 is calculated as,

C1  aC1  bC1  C 2  aC 2  bC 2

y
C1  bC1  C 2  bC 2
 Types of NFS
• Co-operative- In this NFS neural algorithm adapt fuzzy systems
In the case of cooperative neural fuzzy systems, both artificial neural network and
fuzzy system work independently from each other. The ANN tries to learn the
parameters from the fuzzy system. This can be either performed offline or online
while the fuzzy system is applied.
– Off-line Co-operative NFS– adaptation
– On-line Co-operative NFS– algorithms are used to adapt as the
system operates
 Types of NFS
• Concurrent – In this NFS, the two techniques (neural network
and Fuzzy Systems)are applied after one another as pre- or post-
processing
• Hybrid – fuzzy system being represented as a network structure,
making it possible to take advantage of learning algorithm
inherited from ANNs . Hybrid neuro-fuzzy systems are
homogeneous and usually resemble neural networks. Here, the
fuzzy system is interpreted as special kind of neural network.
The advantage of such hybrid NFS is its architecture since both
fuzzy system and neural network do not have to communicate
any more with each other. They are one fully fused entity. These
systems can learn online and offline
How does a neuro-fuzzy system learn?
A neuro-fuzzy system is essentially a multi-layer
neural network,

and thus it can apply standard learning algorithms

developed for neural networks,

including the back-propagation algorithm.

 When a training input-output example is presented to the system, the
back-propagation algorithm computes the system output and compares
it with the desired output of the training example.

 The error is propagated backwards through the network from the

output layer to the input layer.

 The neuron activation functions are modified as the error is

propagated.

 To determine the necessary modifications, the back-propagation

algorithm differentiates the activation functions of the neurons.
Application of Fuzzy Logic
Application of Fuzzy Logic
Application of Fuzzy Logic
Application of Fuzzy Logic
Application of Fuzzy Logic
Application of Fuzzy Logic
Application of Fuzzy Logic