University Institute of Engineering

DEPARTMENT OF COMPUTER SCIENCE

& ENGINEERING
Bachelor of Engineering (Computer Science & Engineering)
Artificial Intelligence and Machine Learning(21CSH-316)
Prepared by:
Sitaram patel(E13285)
Topic: Linear_Regression

DISCOVER . LEARN . EMPOWER

Course Outcome

2
Course Objectives

3
 Errors in Machine Learning
Errors in Machine Learning
We can describe an error as an action which is inaccurate or wrong. In Machine Learning,
error is used to see how accurately our model can predict on data it uses to learn; as
well as new, unseen data. Based on our error, we choose the machine learning model
which performs best for a particular dataset.
. There are two main types of errors present in any machine learning model. They are
Reducible Errors and Irreducible Errors.
• Irreducible errors are errors which will always be present in a machine learning model,
because of unknown variables, and whose values cannot be reduced.
• Reducible errors are those errors whose values can be further reduced to improve a
model. They are caused because our model’s output function does not match the
desired output function and can be optimized.

4
We can further divide reducible errors into
two: Bias and Variance

5
 CONTI.
• What is Bias?
• To make predictions, our model will analyze our data and find patterns in it. Using these
patterns, we can make generalizations about certain instances in our data. Our model after
training learns these patterns and applies them to the test set to predict them.
• Bias is the difference between our actual and predicted values. Bias is the simple
assumptions that our model makes about our data to be able to predict new data.
• When the Bias is high, assumptions made by our model are too basic, the model can’t
capture the important features of our data. This means that our model hasn’t captured
patterns in the training data and hence cannot perform well on the testing data too. If this
is the case, our model cannot perform on new data and cannot be sent into production.
• This instance, where the model cannot find patterns in our training set and hence fails for
both seen and unseen data, is called Underfitting.
• The below figure shows an example of Underfitting. As we can see, the model has found
no patterns in our data and the line of best fit is a straight line that does not pass through
any of the data points. The model has failed to train properly on the data given and cannot
predict new data either.
• . 6
 What is Variance

• Variance is the very opposite of Bias. During training, it allows our model to ‘see’ the
data a certain number of times to find patterns in it. If it does not work on the data for
long enough, it will not find patterns and bias occurs. On the other hand, if our model is
allowed to view the data too many times, it will learn very well for only that data. It will
capture most patterns in the data, but it will also learn from the unnecessary data
present, or from the noise.
• We can define variance as the model’s sensitivity to fluctuations in the data. Our model
may learn from noise. This will cause our model to consider trivial features as
important.

7
 References
• Books and Journals
• Understanding Machine Learning: From Theory to Algorithms by Shai Shalev-Shwartz and Shai
Ben-David-Cambridge University Press 2014
• Introduction to machine Learning – the Wikipedia Guide by Osman Omer.

• Video Link-
• https://www.youtube.com/watch?v=9f-GarcDY58
• https://www.youtube.com/watch?v=GwIo3gDZCVQ

• Web Link-
• https://towardsdatascience.com/data-science-simplified-simple-linear-regression-models-3a97811a6a3d
• https://www.nku.edu/~statistics/Simple_Linear_Regression.htm
• https://towardsdatascience.com/logistic-regression-detailed-overview-46c4da4303bc

8
THANK YOU