Scribd
Upload
2 views

Logistic Regression

Logistic regression is a supervised learning technique used for predicting categorical dependent variables based on independent variables, providing probabilistic outputs between 0 and 1. It utilizes the logistic function (sigmoid function) to map predicted values to probabilities and can classify observations using various data types. There are three types of logistic regression: binomial, multinomial, and ordinal, each catering to different types of dependent variables.

Uploaded by

soumyamahesh15
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
2 views

Logistic Regression

Logistic regression is a supervised learning technique used for predicting categorical dependent variables based on independent variables, providing probabilistic outputs between 0 and 1. It utilizes the logistic function (sigmoid function) to map predicted values to probabilities and can classify observations using various data types. There are three types of logistic regression: binomial, multinomial, and ordinal, each catering to different types of dependent variables.

Uploaded by

soumyamahesh15
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 10

Machine learning

Lecture: Logistic Regression


Logistic Regression
● Logistic regression comes under the Supervised Learning technique.
● It is used for predicting the categorical dependent variable using a given
set of independent variables.
● The outcome must be a categorical or discrete value. It can be either Yes or
No, 0 or 1, true or False, etc.
● But instead of giving the exact value as 0 and 1, it gives the
probabilistic values which lie between 0 and 1.
● It analyze the relationship between a set of independent variable and
dependent binary variables.
● It’s referred as regression because it takes the output of the linear
regression function as input and uses a sigmoid function to estimate the
probability for the given class.
● Logistic regression has the ability to provide possibilities and
classify new data using continuous and discrete data sets.
● In logistic regression we use the concept called threshold, which
defines the probability of either 0 or 1. The values above the
threshold tends to 1 and if it is lower than the threshold then it
tends to 0.
● Logistic Regression can be used to classify the observations using
different types of data and can easily determine the most effective
variables used for the classification.
Logistic Function
● Also known as the Sigmoid Function
● It is a mathematical function used to map the predicted values to the
probability
● It maps any value into another value within the range of 0 and 1. Since the
value must be between 0 and 1, it forms a curve of ‘s’ shape.
● The ‘S’ form is called the sigmoid function or the logistic function.
Terminologies
● Odds: It is the ratio of something occurring to something not occurring. it is
different from probability as the probability is the ratio of something occurring
to everything that could possibly occur.
● Log-odds: The log-odds, also known as the logit function, is the natural
logarithm of the odds. In logistic regression, the log odds of the dependent
variable are modeled as a linear combination of the independent variables
and the intercept.
Difference between logistic regression and linear regression
Linear Regression Logistic Regression

Linear regression is used to predict the Logistic regression is used to predict the
continuous dependent variable using a categorical dependent variable using a
given set of independent variables. given set of independent variables

In this we predict the value of continuous In this we predict values of categorical


variables variables

In this we find best fit line. In this we find S-Curve .

Least square estimation method is used Maximum likelihood estimation method is


for estimation of accuracy. used for Estimation of accuracy.

The output must be continuous Output is must be categorical value such


value,such as price,age,etc. as 0 or 1, Yes or no

It required linear relationship between It not required linear relationship.


dependent and independent variables.
Types of Logistic Regression
● Logistic regression can be classified into three types:
1. Binomial: There can only be two types of dependent variables, such as 0 or
For example, it could be used to predict whether a patient has a disease or not,
or whether a loan will be repaid or not.
2. Multinomial: There can be three or more possible unordered types of
dependent variables, such as the type of product a customer will buy, the rating
a customer will give a product, or the political party a person will vote for.
3. Ordinal: There can be three or more possible ordered types of dependent
variables, such as the level of customer satisfaction, the severity of a disease,
or the stage of cancer.

You might also like