Unit – 5 Artificial Neural Network

An Artificial neural network is usually a

computational network based on biological
neural networks that construct the structure of
the human brain. Similar to a human brain has
neurons interconnected to each other, artificial
neural networks also have neurons that are
linked to each other in various layers of the
networks. These neurons are known as nodes.

The given figure illustrates the typical diagram of Biological

Neural Network.

The typical Artificial Neural Network looks something like the

given figure.

Dendrites from Biological Neural Network represent inputs in Artificial

Neural Networks, cell nucleus represents Nodes, synapse represents
Weights, and Axon represents Output.
Relationship between Biological neural network and artificial neural
network:

Biological Neural Network Artificial Neural Network

Dendrites Inputs

Cell nucleus Nodes

Synapse Weights

Axon Output

An Artificial Neural Network in the field of Artificial

intelligence where it attempts to mimic the network of neurons makes
up a human brain so that computers will have an option to understand
things and make decisions in a human-like manner. The artificial neural
network is designed by programming computers to behave simply like
interconnected brain cells.

There are around 1000 billion neurons in the human brain. Each neuron
has an association point somewhere in the range of 1,000 and 100,000. In
the human brain, data is stored in such a manner as to be distributed, and
we can extract more than one piece of this data when necessary, from our
memory parallelly. We can say that the human brain is made up of
incredibly amazing parallel processors.

We can understand the artificial neural network with an example, consider

an example of a digital logic gate that takes an input and gives an output.
"OR" gate, which takes two inputs. If one or both the inputs are "On," then
we get "On" in output. If both the inputs are "Off," then we get "Off" in
output. Here the output depends upon input. Our brain does not perform
the same task. The outputs to inputs relationship keep changing because
of the neurons in our brain, which are "learning."

The architecture of an artificial neural network:

To understand the concept of the architecture of an artificial neural
network, we have to understand what a neural network consists of. In
order to define a neural network that consists of a large number of
artificial neurons, which are termed units arranged in a sequence of
layers. Lets us look at various types of layers available in an artificial
neural network.

Artificial Neural Network primarily consists of three layers:

Input Layer:

As the name suggests, it accepts inputs in several different formats

provided by the programmer.

Hidden Layer:

The hidden layer presents in-between input and output layers. It performs
all the calculations to find hidden features and patterns.

Output Layer:

The input goes through a series of transformations using the hidden layer,
which finally results in output that is conveyed using this layer.

The artificial neural network takes input and computes the weighted sum
of the inputs and includes a bias. This computation is represented in the
form of a transfer function.

It determines weighted total is passed as an input to an activation

function to produce the output. Activation functions choose whether a
node should fire or not. Only those who are fired make it to the output
layer. There are distinctive activation functions available that can be
applied upon the sort of task we are performing.

Advantages of Artificial Neural Network (ANN)

Parallel processing capability: Artificial neural networks have a
numerical value that can perform more than one task simultaneously.
Storing data on the entire network: Data that is used in traditional
programming is stored on the whole network, not on a database. The
disappearance of a couple of pieces of data in one place doesn't prevent
the network from working.

Capability to work with incomplete knowledge:

After ANN training, the information may produce output even with
inadequate data. The loss of performance here relies upon the
significance of missing data.

Having a memory distribution:

For ANN is to be able to adapt, it is important to determine the examples

and to encourage the network according to the desired output by
demonstrating these examples to the network. The succession of the
network is directly proportional to the chosen instances, and if the event
can't appear to the network in all its aspects, it can produce false output.

Having fault tolerance:

Extortion of one or more cells of ANN does not prohibit it from generating
output, and this feature makes the network fault-tolerance.

Disadvantages of Artificial Neural Network:

Assurance of proper network structure:

There is no particular guideline for determining the structure of artificial

neural networks. The appropriate network structure is accomplished
through experience, trial, and error.

Unrecognized behavior of the network:

It is the most significant issue of ANN. When ANN produces a testing

solution, it does not provide insight concerning why and how. It decreases
trust in the network.

Hardware dependence:

Artificial neural networks need processors with parallel processing power,

as per their structure. Therefore, the realization of the equipment is
dependent.

Difficulty of showing the issue to the network:

ANNs can work with numerical data. Problems must be converted into
numerical values before being introduced to ANN. The presentation
mechanism to be resolved here will directly impact the performance of
the network. It relies on the user's abilities.

The duration of the network is unknown:

The network is reduced to a specific value of the error, and this value does
not give us optimum results.

How do artificial neural networks work?

Artificial Neural Network can be best represented as a weighted directed
graph, where the artificial neurons form the nodes. The association
between the neurons outputs and neuron inputs can be viewed as the
directed edges with weights. The Artificial Neural Network receives the
input signal from the external source in the form of a pattern and image in
the form of a vector. These inputs are then mathematically assigned by
the notations x(n) for every n number of inputs.

Afterward, each of the input is multiplied by its corresponding weights

(these weights are the details utilized by the artificial neural networks to
solve a specific problem). In general terms, these weights normally
represent the strength of the interconnection between neurons inside the
artificial neural network. All the weighted inputs are summarized inside
the computing unit.

If the weighted sum is equal to zero, then bias is added to make the
output non-zero or something else to scale up to the system's response.
Bias has the same input, and weight equals to 1. Here the total of
weighted inputs can be in the range of 0 to positive infinity. Here, to keep
the response in the limits of the desired value, a certain maximum value
is benchmarked, and the total of weighted inputs is passed through the
activation function.

The activation function refers to the set of transfer functions used to

achieve the desired output. There is a different kind of the activation
function, but primarily either linear or non-linear sets of functions. Some
of the commonly used sets of activation functions are the Binary, linear,
and Tan hyperbolic sigmoidal activation functions. Let us take a look at
each of them in details:

Binary:
In binary activation function, the output is either a one or a 0. Here, to
accomplish this, there is a threshold value set up. If the net weighted
input of neurons is more than 1, then the final output of the activation
function is returned as one or else the output is returned as 0.

Sigmoidal Hyperbolic:
The Sigmoidal Hyperbola function is generally seen as an "S" shaped
curve. Here the tan hyperbolic function is used to approximate output
from the actual net input. The function is defined as:

F(x) = (1/1 + exp(-????x))

Where ???? is considered the Steepness parameter.

Types of Artificial Neural Network:

There are various types of Artificial Neural Networks (ANN) depending
upon the human brain neuron and network functions, an artificial neural
network similarly performs tasks. The majority of the artificial neural
networks will have some similarities with a more complex biological
partner and are very effective at their expected tasks. For example,
segmentation or classification.

Feedback ANN:
In this type of ANN, the output returns into the network to accomplish the
best-evolved results internally. As per the University of Massachusetts,
Lowell Centre for Atmospheric Research. The feedback networks feed
information back into itself and are well suited to solve optimization
issues. The Internal system error corrections utilize feedback ANNs.

Feed-Forward ANN:
A feed-forward network is a basic neural network comprising of an input
layer, an output layer, and at least one layer of a neuron. Through
assessment of its output by reviewing its input, the intensity of the
network can be noticed based on group behavior of the associated
neurons, and the output is decided. The primary advantage of this
network is that it figures out how to evaluate and recognize input
patterns.

Convolutional Neural Network: A Convolutional neural network has

some similarities to the feed-forward neural network, where the
connections between units have weights that determine the influence of
one unit on another unit. But a CNN has one or more than one
convolutional layer that uses a convolution operation on the input and
then passes the result obtained in the form of output to the next layer.
CNN has applications in speech and image processing which is particularly
useful in computer vision.

Modular Neural Network: A Modular Neural Network contains a

collection of different neural networks that work independently towards
obtaining the output with no interaction between them. Each of the
different neural networks performs a different sub-task by obtaining
unique inputs compared to other networks. The advantage of this modular
neural network is that it breaks down a large and complex computational
process into smaller components, thus decreasing its complexity while still
obtaining the required output.

Recurrent Neural Network: The Recurrent Neural Network saves the

output of a layer and feeds this output back to the input to better predict
the outcome of the layer. The first layer in the RNN is quite similar to the
feed-forward neural network and the recurrent neural network starts once
the output of the first layer is computed. After this layer, each unit will
remember some information from the previous step so that it can act as a
memory cell in performing computations.

Applications of Artificial Neural Networks

Social Media: Artificial Neural Networks are used heavily in Social Media.
For example, let’s take the ‘People you may know’ feature on Facebook
that suggests people that you might know in real life so that you can send
them friend requests. Well, this magical effect is achieved by using
Artificial Neural Networks that analyze your profile, your interests, your
current friends, and also their friends and various other factors to
calculate the people you might potentially know. Another common
application of Machine Learning in social media is facial recognition. This
is done by finding around 100 reference points on the person’s face and
then matching them with those already available in the database using
convolutional neural networks.

Marketing and Sales: When you log onto E-commerce sites like
Amazon and Flipkart, they will recommend your products to buy based on
your previous browsing history. Similarly, suppose you love Pasta, then
Zomato, Swiggy, etc. will show you restaurant recommendations based on
your tastes and previous order history. This is true across all new-age
marketing segments like Book sites, Movie services, Hospitality sites, etc.
and it is done by implementing personalized marketing. This uses Artificial
Neural Networks to identify the customer likes, dislikes, previous shopping
history, etc., and then tailor the marketing campaigns accordingly.

Healthcare: Artificial Neural Networks are used in Oncology to train

algorithms that can identify cancerous tissue at the microscopic level at
the same accuracy as trained physicians. Various rare diseases may
manifest in physical characteristics and can be identified in their
premature stages by using Facial Analysis on the patient photos. So the
full-scale implementation of Artificial Neural Networks in the healthcare
environment can only enhance the diagnostic abilities of medical experts
and ultimately lead to the overall improvement in the quality of medical
care all over the world.

Personal Assistants: I am sure you all have heard of Siri, Alexa,

Cortana, etc., and also heard them based on the phones you have!!!
These are personal assistants and an example of speech recognition that
uses Natural Language Processing to interact with the users and formulate
a response accordingly. Natural Language Processing uses artificial neural
networks that are made to handle many tasks of these personal assistants
such as managing the language syntax, semantics, correct speech, the
conversation that is going on, etc.