Evolution of Neuromorphic Computing With Machine Learning and Artificial Intelligence
Evolution of Neuromorphic Computing With Machine Learning and Artificial Intelligence
Abstract - In the present century, where artificial conditions with its biological structure and constricted
intelligence and machine learning are regenerating the world, architecture of neurons, similarly, neuromorphic chips are
this paper takes inspiration from brain intelligence and designed having behavior to adapt to all changes in the
explores new advanced computing known as Neuromorphic system and give the output by changing accordingly. Thus,
Computing. The energy efficiency and accuracy of the brain every data is maintained in the proper way and memory and
are remarkable and its retaining ability and grasping tendency processing can be done simultaneously. Therefore,
are overwhelming. Motivated by this, our paper discusses this
2022 IEEE 3rd Global Conference for Advancement in Technology (GCAT) | 978-1-6654-6855-8/22/$31.00 ©2022 IEEE | DOI: 10.1109/GCAT55367.2022.9971889
2
Authorized licensed use limited to: The National Institute of Engineering. Downloaded on October 15,2024 at 11:03:23 UTC from IEEE Xplore. Restrictions apply.
thiocyanate (CuSCN) and the backtracking function is also TensorFlow materials. Some models are discovered using
explained in this which helps in finding the previous data. NengoDL liking Spiking MNIST having all features,
therefore NengoDL allows the use of all neural networks and
C. A Stochastic Approach To Machine Learning With Nengo methods.
Neuromorphic Computing
In paper [12], content-based image retrieval is discussed
Machine learning algorithms have turned to be the best which is finding the similarity between the query image and
techniques for providing the endless performance in the dataset of product images using the Loihi chip as discussed
ample of applications and scenarios. With the advent of in paper [5]. In content-based image retrieval, visual search is
neuromorphic systems, machine learning algorithms can be done using neuromorphic neural networks and SNNs are
implemented in an energy-efficient manner. The new trained on Fashion-MNIST (image classification dataset). By
framework is discovered by the scientists which will have doing this, the nearest visual neighbors of the query image
more SNN (Spiking Neural Networks) and charge pump are obtained using the neuromorphic chip Loihi considerably
discharge strategies that increase the workload and design the showing the power efficiency of neuromorphic systems. This
neuromorphic chips which will have more appropriate will also accelerate the process by providing 12.5 times more
reliability and give workload-specific performance [8]. energy than GPU and 2.5 more times than CPU. Thus, it
IBM’s TrueNorth Neuromorphic system was designed using shows that by using neuromorphic systems, machine learning
16 TrueNorth neuromorphic processors and this system applications can become more reliable.
called NS16e is an advanced structure invented to make ML
techniques more reliable and scalable. NS16e has just like One more application of machine learning i.e., short-term
brain computation having neurons and synapses and gives wind power forecasting can be enhanced using neuromorphic
output like the brain comparing to Von-Neumann computing. This paper builds up more ML algorithms using
architecture. In the field of radar, NS16e proves to be the best neuromorphic models for efficient forecasting of wind power
armature for finding the direction, distance and sending the and uses NengoDL software [11] for making deep spiking
pulses of radio waves [9]. neural networks by ANN(Artificial Neural Network) -SNN
conversion. SNNs are made more useful by overcoming all
Inspired from the brain and by using SNN’s, the Neu the challenges by using the error backpropagation algorithm
Cube framework is established through which new data and ANN-to-SNN algorithm and making them more capable
machines are invented known as STDM (Evolving Spatio- of forecasting wind [13].
Temporal Data Machines). eSTDM is the promising
approach used for predictions in all fields like stroke In paper [14], lower energy efficiency maintenance is
prediction, personalised event prediction, and ecological discussed that how we can use system software for lowering
predictions. These evolving connectionist systems can be the energy used in the neuromorphic system for solving the
used for new knowledge discovery and for the better machine learning problems and applied to fields like
acquiring of all the input and output information [10]. In Embedded systems and Internet-of-Things (IoT). Thus, it
these spatial data machines, it is very important to learn all provides the clear recognition that system software helps to
patterns correctly and data streams, for this data machine divide the SNN model into clusters, mapped clusters into
requires SSTD (Spatio or Spectro-temporal data). SSTD is neurosynaptic cores and arrangement of neurons and
synapses into the core. This will lower the energy level by
ࡱǣ ሺο࢚ሻ ՜ (2) 20% making the system more considerable for machine
In equation 2, A(t) = (ܽଵ (t), ܽଶ (t),……...ܽ (t)) and learning problems. The author also discusses the heuristic-
t=1,2,3,4…..,݉ where ܣis a set of independent variables, ܤ based mapping approach to arrange neurons and synapses in
is the set of dependent output variables, ݐis the time window such a manner that would take lower energy consumption.
and ܧis the linked function between whole input data. Thus, Authors in paper [15] mention about PyCarl which is
by using neuromorphic computing systems like Neu Cube PyNN interface that increases the neuromorphic development
system, more machine learning data machines are established cycle by allowing the combination of both machine learning
which can do predictions, retrieve data and information, and models and code sharing. In this PyCarl tool, CARL-sim
give output accordingly. SNN simulations are done using biological details of neurons
Evolution Of Machine Learning With Neuromorphic and synapses and hardware-oriented simulations. It allows all
Computing the users to apply machine learning models and
neuromorphic hardware early during implementation. This
In this section the recent research work for the evolution will take the field of neuromorphic computing at its peak.
of machine learning techniques or applications with
neuromorphic computing is elaborated. In the paper [16], the author mentions SpiNNaker which
is the programmable neuromorphic platform in which a
NengoDL is discussed in the paper [11], which is a machine learning algorithm like the k-NN algorithm can be
software tool designed for the implementation of SNN-based applied. This article tells that K- nearest neighbor search can
algorithms. The main aim of NengoDL is to allow all the be performed with more accuracy absorbing low power
users to use this framework to construct hybrid models and particularly for the classification tasks. This platform allows
form dynamic neural networks combining both deep learning the simulation of large-scale spiking neural networks.
as well as neuromorphic systems. NengoDL offers higher Classification task on the Irish dataset is also performed
speed and allows more models to run at the same time i.e., using SpiNNaker platform and the output obtained is correct
inducement of the model is done once keeping all different with higher accuracy it is also seen that on an increasing
models in parallel rather than running all different models in number of K values, k-NN algorithm gives more correct
a row taking a long time. NengoDL has some prominent output. Software simulation is done using NEST to run
features in comparison to other tools like forming of spiking SpiNNaker platform.
versions from deep learning networks, and the insertion of
3
Authorized licensed use limited to: The National Institute of Engineering. Downloaded on October 15,2024 at 11:03:23 UTC from IEEE Xplore. Restrictions apply.
Machine learning has its ample applications, and these arrays and PARC (Pattern Recognition Engine) are used for
are solved at fastest pace with neuromorphic computing one recognizing chemicals. Olfactory systems made from these
such is explained in paper [17] which is in cheminformatics are used for wide purposes like in chemical factories, and
for band gap prediction and classification of chemicals. In wine industries. The Authors also discuss the data-to-event
this, neuromorphic simulation software CrossSim and encoding using AERO, signal conditioning and pre-
NeuroSim are used for classifying materials and predicting processing.
the band gap of small-molecule organic semiconductors. The
state-of-the-art contemporary architecture uses Dynamic One more architecture of the multi-core neuromorphic
Random Access Memory (DRAM) to obtain the results, but processor chip is discussed in paper [20] which is particularly
crossbar neuromorphic circuitry allows to do parallel work used for the classification of visual signals in DVS (dynamic
and does not use DRAM. This energy-efficient neuromorphic vision sensor) to manage the large traffic in the system. This
system is suitable for performing such tasks in chemical architecture called Dynamic Neuromorphic Asynchronous
organics providing low power and consuming less energy. In Processors (DYNAP)s has different neurons and synapses
this work, the author also aims for more fabrication of routing methods like memory optimized routing method, and
neuromorphic circuits to be specially designed to meet the programmable Address Event Representation (AER) routing
industry requirements for chemical purposes. to minimize memory needs and maximize the
programmability which supports a wide range of real-life
In paper [18], deep medical image analysis is discussed applications. It particularly has 1k Very Large-Scale
which is used for doing detection of diseases to give Integration (VLSI) neurons distributed among neurons and
outcomes and for this, machine learning technique combines routers for meeting these demands. This paper particularly
with neuromorphic computing system like loihi chip to aims at building such neuromorphic systems which have on-
overcome challenges like having less-labelled images, lack chip heterogeneous memory structures and have the
of advanced technology like magnetic resonance imaging. capability to reduce the memory requirements and construct
Some learning methods are described in it like spatial different network methodologies.
representation learning, and transfer learning for providing
the correct output from the large-scale database. It also In paper [21], Design-Technology-Co-Framework
resolves the issue of time management of Magnetic (DTCO) is developed which is constructed for performing
Resonance Imaging (MRI) as it is a long-lasting test taking machine learning algorithms and this is an essential
ample time. Therefore, this benchmarking technology will framework for inference accuracy robustness. It represents
enable countless machine learning applications to apply by how the ML algorithm, emerging memory Verilog-A models
overcoming all challenges. and the circuit interacts to obtain the best output, this is done
using SPICE and PYTHON packages. Also, an example,
The authors in the paper [19], discuss the e-nose systems ReRAM neuromorphic circuit is also studied in which
which have been encouraged using machine learning robustness of Neural Network (NN) is implemented for digit
algorithms. Neuromorphic SNNs are used for doing recognition and in ReRAM neuromorphic circuit, it was
classification of malts and producing olfactory systems found by the author that by using DTCO framework deeper
consuming less energy offering real-time processing giving neural network has less robustness making the neuromorphic
97% more accuracy. In this, the neuromorphic approach of circuit more robust. In table 1, the comparative analysis of
Akida SNN and Address Event Representation Olfaction the studied Neuromorphic computing systems has been
(AERO) encoder is used for the classification of malts in presented.
olfactory systems. Using the neuromorphic approach, sensor
4
Authorized licensed use limited to: The National Institute of Engineering. Downloaded on October 15,2024 at 11:03:23 UTC from IEEE Xplore. Restrictions apply.
[16] SpiNNaker Embedded systems, Classification tasks NEST K-nearest neighbor algorithm
[12] Loihi Content based image retrieval NxSDK K-nearest neighbor algorithm
5
Authorized licensed use limited to: The National Institute of Engineering. Downloaded on October 15,2024 at 11:03:23 UTC from IEEE Xplore. Restrictions apply.
[11] D. Rasmussen, “NengoDL: Combining deep learning and Computing Simulation in Band Gap Prediction and Chemical
neuromorphic modelling methods,” Neuroinformatics, vol. 17, no. Reaction Classification,” ACS omega, vol. 7, no. 1, pp. 168–175,
4, pp. 611–628, 2019. 2021.
[12] T.-Y. Liu, A. Mahjoubfar, D. Prusinski, and L. Stevens, [18] N. Getty, T. Brettin, D. Jin, R. Stevens, and F. Xia, “Deep medical
“Neuromorphic computing for content-based image retrieval,” PLoS image analysis with representation learning and neuromorphic
One, vol. 17, no. 4, p. e0264364, 2022. computing,” Interface Focus, vol. 11, no. 1, p. 20190122, 2021.
[13] J. M. G. Sopeña, V. Pakrashi, and B. Ghosh, “Neuromorphic [19] A. Vanarse, A. Osseiran, A. Rassau, and P. van der Made,
computing for short-term wind power forecasting,” 2022. “Application of Neuromorphic Olfactory Approach for High-
[14] T. Titirsha, S. Song, A. Balaji, and A. Das, “On the role of system Accuracy Classification of Malts,” Sensors, vol. 22, no. 2, p. 440,
software in energy management of neuromorphic computing,” in 2022.
Proceedings of the 18th ACM International Conference on [20] S. Moradi, N. Qiao, F. Stefanini, and G. Indiveri, “A scalable
Computing Frontiers, 2021, pp. 124–132. multicore architecture with heterogeneous memory structures for
[15] A. Balaji et al., “PyCARL: A PyNN interface for hardware-software dynamic neuromorphic asynchronous processors (DYNAPs),” IEEE
co-simulation of spiking neural network,” arXiv Prepr. Trans. Biomed. Circuits Syst., vol. 12, no. 1, pp. 106–122, 2017.
arXiv2003.09696, 2020. [21] H. Cao, T. Lam, H. Nguyen, A. Venkattraman, D. Parent, and H. Y.
[16] I. Sugiarto, A. B. Gumelar, and A. Yogatama, “Embedded Machine Wong, “Study of ReRAM neuromorphic circuit inference accuracy
Learning on a Programmable Neuromorphic Platform,” in Recent robustness using DTCO simulation framework,” in 2021 IEEE
Advances in Electrical and Electronic Engineering and Computer Workshop on Microelectronics and Electron Devices (WMED),
Science, Springer, 2022, pp. 119–128. 2021, pp. 1–4.
[17] B. Li, H. Sun, H. Shu, and X. Wang, “Applying Neuromorphic
6
Authorized licensed use limited to: The National Institute of Engineering. Downloaded on October 15,2024 at 11:03:23 UTC from IEEE Xplore. Restrictions apply.