Concepts of Machine Learning

Table of Contents
Table of Figures.............................................................................................................................................2
Introduction:................................................................................................................................................3
Types of Machine Learning:...................................................................................................................3
Supervised Machine Learning................................................................................................................4
Unsupervised Machine Learning:..........................................................................................................4
Semi-supervised Machine Learning.......................................................................................................4
Reinforcement Learning.........................................................................................................................4
Machine Learning Algorithms:..................................................................................................................5
Artificial Neural Network.......................................................................................................................5
Random Forest.........................................................................................................................................6
Regression Trees:.....................................................................................................................................6
Applications of Machine Learning:............................................................................................................7
Predictive analytics and intelligent decision making:..........................................................................8
Cyber security and threat intelligence...................................................................................................8
Internet of Things (IoT) and smart cities..............................................................................................8
E-mail Spam and Malware Filtering:....................................................................................................8
E-Commerce and product recommendations:......................................................................................8
Natural language processing (NLP) and sentiment analysis...............................................................9
Product Recommendation:...................................................................................................................9

List of Figures
Figure 1: Machine Learning Process.......................................................................................................3
Figure 2 : Machine learning algorithm.................................................................................................7

Tables
Table 1 : Types of Machine Learning.......................................................................................................5
Table 2 : Comparison between Collaborative and Content –Based Filtering......................................9

1
 Introduction:
ML is a field that focuses on the learning aspect of AI by developing algorithms that best
represent a set of data. In contrast to classical programming, in which an algorithm can be
explicitly coded using known features, ML uses subsets of data to generate an algorithm that
may use novel or different combinations of features and weights than can be derived from
first principles. In ML, there are four commonly used learning methods, each useful for
solving different tasks: supervised, unsupervised, semi supervised, and reinforcement
learning. To better understand these methods, they will be defined via an example of a
hypothetical real estate company that specializes in predicting housing prices and features
associated with those houses [1]

Figure 1: Machine Learning Process.

Types of Machine Learning:

Machine Learning algorithms are mainly divided into four categories: Supervised
learning, unsupervised learning, Semi-supervised learning, and Reinforcement

2
learning. In the following, we briefly discuss each type of learning technique with the
scope of their applicability to solve real-world problems. [2]

 Supervised Machine Learning

 Unsupervised Machine Learning
 Semi-supervised Machine Learning
 Reinforcement Learning

Supervised Machine Learning:

Supervised learning is typically the task of machine learning to learn a function that maps
an input to an output based on sample input-output pairs. It uses labeled training data and
a collection of training examples to infer a function. Supervised learning is carried out
when certain goals are identified to be accomplished from a certain set of inputs, i.e.,
a task-driven approach. [2]

Unsupervised Machine Learning:

Unsupervised learning analyzes unlabeled datasets without the need for human
interference, i.e., a data-driven process. This is widely used for extracting generative
features, identifying meaningful trends and structures, groupings in results, and
exploratory purposes. The most common unsupervised learning tasks are clustering,
density estimation, feature learning, dimensionality reduction, finding association rules,
anomaly detection, etc. [2]

Semi-supervised Machine Learning:

Semi-supervised learning can be defined as a hybridization of the above-mentioned
supervised and unsupervised methods, as it operates on both labeled and unlabeled data.
Thus, it falls between learning “without supervision” and learning “with supervision”. In
the real world, labeled data could be rare in several contexts, and unlabeled data are
numerous, where semi-supervised learning is useful [2]

Reinforcement Learning:
Reinforcement learning is a type of machine learning algorithm that enables software
agents and machines to automatically evaluate the optimal behavior in a particular context
or environment to improve its efficiency. This type of learning is based on reward or

3
 penalty, and its ultimate goal is to use insights obtained from environmental activists to
take action to increase the reward or minimize the risk. It is a powerful tool for training
AI models that can help increase automation or optimize the operational efficiency of
sophisticated systems such as robotics, autonomous driving tasks, manufacturing and
supply chain logistics, however, not preferable to use it for solving the basic or
straightforward problems. [3]

Table 1 : Types of Machine Learning.

Types of Machine Function Examples

Learning
Supervised Learning The dataset has labels and Encompasses logistic
outcomes, infers from data regression and
for prediction. artificial network
Unsupervised learning The dataset contains no This contains hierarchical,
labels, detects and pivotal clustering, principal
relationships. component analysis.
Semi-supervised A combination of It is used in image and
supervised and speech recognition.
unsupervised learning
Reinforcement Utilizes reward function to It is used in medical
execute tasks
imaging and analytics.

Machine Learning Algorithms:

Various machine learning algorithms that are discussed here [4]

 Artificial Neural Networks.

 Random forest.
 Regression Trees.

Artificial Neural Network:

4
The most common approach to develop nonparametric and nonlinear
classification/regression is based on ANNs. There are many different types of ANNs.
However, it is not the scope of this paper to describe the different types of networks,
which can be found at the bibliography. This section provides a brief description of one
of the most used ANNs: the feed-forward propagation neural network [4]

Random Forest:
RF is a regression technique that combines the performance of numerous DT algorithms
to classify or predict the value of a variable avoid the correlation of the different trees, RF
increases the diversity of the trees by making them grow from different training data
subsets created through a procedure called bagging. Bagging is a technique used for
training data creation by resampling randomly the original dataset [4]

Regression Trees:

DTs, along with neural networks, are the most widely used machine learning algorithms
in geosciences. The main benefit of using a hierarchical tree structure to perform
classification decisions is that the tree structure is transparent, which in comparison with
artificial neural networks (ANNs), is easier to interpret. In order to induce the DT from a
dataset, an evaluation measure of each of the evidential features is used to maximize the
inter node heterogeneity. A DT represents a set of restrictions or conditions which are
hierarchically organized, and which are successively applied from a root to a terminal
node or leaf of the tree. The main benefit of using a hierarchical tree structure to perform
classification decisions is that the tree structure is transparent, which in comparison with
artificial neural networks (ANNs), is easier to interpret [4]

5
Figure 2 : Machine learning algorithm.

Applications of Machine Learning:

In the current age of the Fourth Industrial Revolution (4IR), machine learning becomes popular
in various application areas, because of its learning capabilities from the past and making
intelligent decisions. In the following, we summarize and discuss ten popular application areas of
machine learning technology. [2]

 Predictive analytics and intelligent decision making.

 Cyber security and threat intelligence.
 Internet of things (IoT) and smart cities.
 E-mail Spam and Malware Filtering.
 E-commerce and product recommendations.
 Natural language processing (NLP) and sentiment analysis.

Predictive analytics and intelligent decision making: A major application

field of machine learning is intelligent decision-making by data-driven predictive

6
analytics. The basis of predictive analytics is capturing and exploiting relationships
between explanatory variables and predicted variables from previous events to predict the
unknown outcome

Cyber security and threat intelligence: Cyber security is one of the most
essential areas of Industry which is typically the practice of protecting networks, systems,
hardware, and data from digital attacks. For instance, clustering techniques can be used to
identify cyber-anomalies, policy violations, etc.

Internet of Things (IoT) and smart cities: Internet of Things (IoT) is another
essential area of Industry which turns everyday objects into smart objects by allowing
them to transmit data and automate tasks without the need for human interaction. IoT is,
therefore, considered to be the big frontier that can enhance almost all activities in our
lives, such as smart governance, smart home and education.

E-mail Spam and Malware Filtering:

E-mail spam and malware filtering are important measures to protect users from unwanted
and malicious content in their e-mail inbox. Spam filtering involves identifying and
blocking unsolicited or unwanted e-mails, such as promotional messages or phishing
attempt.

E-Commerce and product recommendations:

Product recommendation is one of the most well-known and widely used applications of
machine learning, and it is one of the most prominent features of almost any e-commerce
website today. Machine learning technology can assist businesses in analyzing their
consumers’ purchasing histories and making customized product suggestions.

Natural language processing (NLP) and sentiment analysis:

Natural language processing (NLP) involves the reading and understanding of spoken or
written language through the medium of a computer. Thus, NLP helps computers, for

7
 instance, to read a text, hear speech, interpret it, analyze sentiment, and decide which
aspects are significant, where machine learning techniques can be used.

Product Recommendation: Then machine learning techniques such as

Collaborative Filtering and Content-Based Filtering are as follows:

Table 2 : Comparison between Collaborative and Content –Based Filtering.

Collaborative Filtering Content-Based Filtering

It recommends items based on preferences It recommends items by focusing their
and behaviors of similar users. characteristics themselves.
It looks for user’s choice and the It analyzes the attributes and features of the
characteristics of items to suggest them. item to recommend similar item based on
them.
For example: For example :
Recommendations, Personalization. Characteristics, attributes etc.

References

[1] R. Y.Choi, "TRANSLATIONAL VISION SCIENCE AND TECHNOLOGY," NATIONAL

INSTITUTE OF HEALTH, SATURDAY FEB 2020. [Online]. Available:
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7347027/. [Accessed FRI MARCH 2020].

[2] I. H.Sarker, "SPRINGER," SPRINGER , SUN MARCH 2021. [Online]. Available:

https://link.springer.com/article/10.1007/s42979-021-00592-x#citeas. [Accessed
WEDNESDAY MARCH 2021].

[3] M. S.-C. M. C.-O. M. C.-R. V. Rodriguez-Galiano, "science direct," 2015. [Online].

Available: https://www.sciencedirect.com/science/article/pii/S0169136815000037#bb0475.

[4] I. H.Sarker, "SPRINGER," FRI MARCH 2021. [Online]. Available: Sarker, I.H. Machine
Learning: Algorithms, Real-World Applications and Research Directions. SN COMPUT.
SCI. 2, 160 (2021). https://doi.org/10.1007/s42979-021-00592-x. [Accessed FRI MARCH

8
2021].