Scribd
Upload
68 views6 pages

Experiment No 3 ML

This document describes an experiment to implement logistic regression from scratch and compare it to scikit-learn's logistic regression model. It introduces a Logistic Regression class to perform gradient descent optimization of weights on diabetes dataset. The custom model is trained and tested, achieving an accuracy score. This is then compared to the accuracy of scikit-learn's logistic regression model trained and tested on the same data.

Uploaded by

ANIKET THAKUR [UCOE- 4388]
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
68 views6 pages

Experiment No 3 ML

This document describes an experiment to implement logistic regression from scratch and compare it to scikit-learn's logistic regression model. It introduces a Logistic Regression class to perform gradient descent optimization of weights on diabetes dataset. The custom model is trained and tested, achieving an accuracy score. This is then compared to the accuracy of scikit-learn's logistic regression model trained and tested on the same data.

Uploaded by

ANIKET THAKUR [UCOE- 4388]
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 6

Experiment No: 3

Aim: A Case study on logistic regression and write a program for logistic
regression

Program:
# Importing libraries
import numpy as np
import pandas as pd
from sklearn.model_selection import train_test_split
import warnings
warnings.filterwarnings( "ignore" )

# to compare our model's accuracy with sklearn model


from sklearn.linear_model import LogisticRegression

# Logistic Regression
class LogitRegression() :
def __init__( self, learning_rate, iterations ) :
self.learning_rate = learning_rate
self.iterations = iterations

# Function for model training


def fit( self, X, Y ) :
# no_of_training_examples, no_of_features
self.m, self.n = X.shape
# weight initialization
self.W = np.zeros( self.n )
self.b = 0
self.X = X
self.Y = Y

# gradient descent learning

for i in range( self.iterations ) :


self.update_weights()
return self

# Helper function to update weights in gradient descent

def update_weights( self ) :


A = 1 / ( 1 + np.exp( - ( self.X.dot( self.W ) + self.b ) ) )

# calculate gradients
tmp = ( A - self.Y.T )
tmp = np.reshape( tmp, self.m )
dW = np.dot( self.X.T, tmp ) / self.m
db = np.sum( tmp ) / self.m

# update weights
self.W = self.W - self.learning_rate * dW
self.b = self.b - self.learning_rate * db

return self
# Hypothetical function h( x )

def predict( self, X ) :


Z = 1 / ( 1 + np.exp( - ( X.dot( self.W ) + self.b ) ) )
Y = np.where( Z > 0.5, 1, 0 )
return Y

# Driver code

def main() :

# Importing dataset
df = pd.read_csv( "diabetes.csv" )
X = df.iloc[:,:-1].values
Y = df.iloc[:,-1:].values

# Splitting dataset into train and test set


X_train, X_test, Y_train, Y_test = train_test_split(
X, Y, test_size = 1/3, random_state = 0 )

# Model training
model = LogitRegression( learning_rate = 0.01, iterations = 1000 )
model.fit( X_train, Y_train )
model1 = LogisticRegression()
model1.fit( X_train, Y_train)

# Prediction on test set


Y_pred = model.predict( X_test )
Y_pred1 = model1.predict( X_test )

# measure performance
correctly_classified = 0
correctly_classified1 = 0

# counter
count = 0
for count in range( np.size( Y_pred ) ) :
if Y_test[count] == Y_pred[count] :
correctly_classified = correctly_classified + 1
if Y_test[count] == Y_pred1[count] :
correctly_classified1 = correctly_classified1 + 1
count = count + 1

print( "Accuracy on test set by our model : ", (


correctly_classified / count ) * 100 )
print( "Accuracy on test set by sklearn model : ", (
correctly_classified1 / count ) * 100 )

if __name__ == "__main__" :
main()

Output Before Modification In Dataset:


Output After the Modification In Dataset:

Conclusion:
Thus we have studied the core concept of machine learning and steps
involved in developing a machine learning application about logistic regression.

You might also like