Scribd
Upload
12 views

Support Vector Machines

Support vector machines (SVMs) are a supervised machine learning algorithm used for classification and regression. SVMs work by mapping data points to high-dimensional space and finding the optimal separating hyperplane that maximizes the margin between two classes. The hyperplane is determined by support vectors, which are data points closest to the decision boundary. Non-linear classification is possible by using kernel tricks to map inputs to high-dimensional feature spaces.

Uploaded by

Amita Soni
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
12 views

Support Vector Machines

Support vector machines (SVMs) are a supervised machine learning algorithm used for classification and regression. SVMs work by mapping data points to high-dimensional space and finding the optimal separating hyperplane that maximizes the margin between two classes. The hyperplane is determined by support vectors, which are data points closest to the decision boundary. Non-linear classification is possible by using kernel tricks to map inputs to high-dimensional feature spaces.

Uploaded by

Amita Soni
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 30

Support Vector Machines

What is Support Vector Machine?

• “Support Vector Machine” (SVM) is a supervised


machine learning algorithm which can be used for
both classification or regression challenges.
• However, it is mostly used in classification
problems.
• In this algorithm, we plot each data item as a
point in n-dimensional space (where n is number
of features you have) with the value of each
feature being the value of a particular coordinate.
SVM
• Then, we perform classification by finding the
hyper-plane that differentiate the two classes
very well
Example

• Support Vectors are simply the co-ordinates of


individual observation. For instance, (45,150) is a
support vector which corresponds to a female.
Example
• There are many possible frontier which can
classify the problem in hand. Following are the
three possible frontiers.
Example
• The easiest way to interpret the objective function in a
SVM is to find the minimum distance of the frontier
from closest support vector (this can belong to any
class).
• For instance, orange frontier is closest to blue circles
and the closest blue circle is 2 units away from the
frontier.
• Once we have these distances for all the frontiers, we
simply choose the frontier with the maximum distance
(from the closest support vector).
• Out of the three shown frontiers, we see the black
frontier is farthest from nearest support vector (i.e. 15
units).
Different scenarios
Example
Possible hyperplanes
Find three vectors
• Select three support vectors s1,s2,s3
Example
Example
Example
Example
Example
Example
Example

2
Margin will be given by .
|𝑤|
Non Linear example

Input space
Non Linear example
Non Linear example
Non Linear example
Non Linear example

Feature Space
Non Linear example
Non Linear example
Non Linear example
Non Linear example
Non Linear example
Non Linear example
Non Linear example
For multiclass classification

You might also like