ML - Multiple Linear Regression

Sep 19, 2017Download as PPTX, PDF7 likes3,404 views

Abstract: This PDSG workshop introduces basic concepts of multiple linear regression in machine learning. Concepts covered are Feature Elimination and Backward Elimination, with examples in Python. Level: Fundamental Requirements: Should have some experience with Python programming.

Regression Methods in
Machine Learning
Multiple Linear Regression
Portland Data Science Group
Created by Andrew Ferlitsch
Community Outreach Officer
July, 2017

Multiple Linear Regression
X1 (Independent Variable)
Y (Dependent Variable) Hyperplane
• Used to Predict a correlation between more than one
independent variables and a dependent variable.
e.g., Income and Age is correlated with Spending
• When the data is plotted on a graph, there appears to
be a hyperplane relationship.
X2 (Independent Variable)

Simple vs. Multiple Linear Regression
• Simple Linear Regression – one independent variable.
y = b0 + b1x1
• Multiple Linear Regression – multiple independent
variables.
y = b0 + b1x1 + b2x2 … + bnxn
2nd independent
variable and
weight (coefficient)
nth independent
variable and
weight (coefficient)

Feature Elimination
ID Income Age Height Spending
37 18000 18 5’8”
38 75000 40 5’9”
39 27000 28 6’1”
40 24000 26 5’6”
41 45000 34 6’2”
• In a dataset, we may not want to keep all the independent
variables (features) in our model:
• More Features = More Complex Model
• If feature does not contribute to prediction, adds noise
to the model.
ID fields are like
random numbers –
do not contribute
to prediction.
Height not likely or
very little to
influence spending

Backward Elimination
• A method for identifying and removing independent
variables that do not contribute enough to the model.
• Steps:
• Fit (Train) the model with all the independent variables.
• Calculate the P-value of each independent variable.
• Eliminate independent variable with highest P-value above
threshold (e.g., 0.05 [5 percent]).
• Repeat (re-fit) until there are no independent variables with
P-value above threshold.
All Variables Train
Is Variable with highest
P-value > Threshold
DONE
Eliminate the variable

Multiple Linear Regression in Python
from sklearn.linear_model import LinearRegression # sci-kit learn library for linear regression
regressor = LinearRegression() # instantiate linear regression object
regressor.fit(X_train, y_train) # train (fit) the model
• Perform Linear Regression with all independent variables.
y_pred = regressor.predict( X_test ) # y_pred is the list of predicted results
• Run (Predict) the model on the test data.
• Analyze (View) the predicted values (y_pred) to the actual values (y_test)

Backward Elimination in Python
import statsmodels.formula.api as sm
X = np.append( arr = np.ones( (nrows,1 )).astype(int), values = X, axis = 1 )
• Prepare for Backward Elimination.
• The statsmodel does not take into account the constant b0.
• Need to fake it by adding a x0 = 1 independent variable for b0.
Function to create
column of ones
Append column
of ones to X
Create array of one
column of nrows
Append ones
to this array
X_opt = X[:, [0, 1, 2, 3, 4] ]
• Create array of optional independent variables (features) from which we
will eliminate independent variables.
All rows Start with all columns (i.e., 0, 1, 2 .. N)

Backward Elimination in Python (2)
ols = sm.OLS( endog = y, exog = X_opt).fit() # Create OLS object and fit the model
ols.summary() # Display Statistical Metrics including P-values
• Use the class Ordinary Linear Square (OLS) from stats model to train (fit)
the model and get P-values.
Independent
Variables
Dependent
Variable (Label)
• Example elimination of an independent variable (x2).
X_opt = X[:, [0,1,3,4,5]]
ols = sm.OLS( endog = y, exog = X_opt).fit()
ols.summary()
Eliminate x2 (2), where 0 is x0 (constant)
• Repeat elimination until independent variable with highest P-value is not
greater than the threshold (e.g., 0.05).

The document discusses stakeholders in business. It defines stakeholders as individuals or groups that are affected by or can affect a business's activities. It identifies common internal stakeholders as owners, managers, and employees, and external stakeholders as customers, suppliers, government, and the community. The document notes that stakeholders can have varying interests and levels of power over a business, and that balancing these interests is important for business success and social responsibility.

Artificial Intelligence in Healthcare.pdfayushiqss

Machine Learning with Decision treesKnoldus Inc.

Decision trees in Machine Learning Mohammad Junaid Khan

Crop predction ppt using ANNAstha Jain

The document summarizes a seminar presentation on crop prediction using an artificial neural network approach. It discusses using parameters like soil pH, nitrogen, phosphate, potassium, sunshine hours, rainfall and temperature as inputs to an ANN model to predict suitable crops. The backpropagation algorithm is used to train the multi-layer neural network to minimize error. The design flow involves data collection, building a prediction model through classification, and suggesting fertilizers. Future work may include developing regional language applications, detecting crop diseases, considering more parameters, and providing micronutrient information. The ANN approach is concluded to be a beneficial tool for crop prediction.

A* Search Algorithmvikas dhakane

blood physiologyNITISH SHAH

Bayesian Networks - A Brief IntroductionAdnan Masood

- A Bayesian network is a graphical model that depicts probabilistic relationships among variables. It represents a joint probability distribution over variables in a directed acyclic graph with conditional probability tables. - A Bayesian network consists of a directed acyclic graph whose nodes represent variables and edges represent probabilistic dependencies, along with conditional probability distributions that quantify the relationships. - Inference using a Bayesian network allows computing probabilities like P(X|evidence) by taking into account the graph structure and probability tables.

Dimensionality Reductionmrizwan969

This document discusses dimensionality reduction techniques for data mining. It begins with an introduction to dimensionality reduction and reasons for using it. These include dealing with high-dimensional data issues like the curse of dimensionality. It then covers major dimensionality reduction techniques of feature selection and feature extraction. Feature selection techniques discussed include search strategies, feature ranking, and evaluation measures. Feature extraction maps data to a lower-dimensional space. The document outlines applications of dimensionality reduction like text mining and gene expression analysis. It concludes with trends in the field.

Logistic Regression | Logistic Regression In Python | Machine Learning Algori...Simplilearn

This Logistic Regression Presentation will help you understand how a Logistic Regression algorithm works in Machine Learning. In this tutorial video, you will learn what is Supervised Learning, what is Classification problem and some associated algorithms, what is Logistic Regression, how it works with simple examples, the maths behind Logistic Regression, how it is different from Linear Regression and Logistic Regression applications. At the end, you will also see an interesting demo in Python on how to predict the number present in an image using Logistic Regression. Below topics are covered in this Machine Learning Algorithms Presentation: 1. What is supervised learning? 2. What is classification? what are some of its solutions? 3. What is logistic regression? 4. Comparing linear and logistic regression 5. Logistic regression applications 6. Use case - Predicting the number in an image What is Machine Learning: Machine Learning is an application of Artificial Intelligence (AI) that provides systems the ability to automatically learn and improve from experience without being explicitly programmed. - - - - - - - - About Simplilearn Machine Learning course: A form of artificial intelligence, Machine Learning is revolutionizing the world of computing as well as all people’s digital interactions. Machine Learning powers such innovative automated technologies as recommendation engines, facial recognition, fraud protection and even self-driving cars.This Machine Learning course prepares engineers, data scientists and other professionals with knowledge and hands-on skills required for certification and job competency in Machine Learning. - - - - - - - Why learn Machine Learning? Machine Learning is taking over the world- and with that, there is a growing need among companies for professionals to know the ins and outs of Machine Learning The Machine Learning market size is expected to grow from USD 1.03 Billion in 2016 to USD 8.81 Billion by 2022, at a Compound Annual Growth Rate (CAGR) of 44.1% during the forecast period. - - - - - - What skills will you learn from this Machine Learning course? By the end of this Machine Learning course, you will be able to: 1. Master the concepts of supervised, unsupervised and reinforcement learning concepts and modeling. 2. Gain practical mastery over principles, algorithms, and applications of Machine Learning through a hands-on approach which includes working on 28 projects and one capstone project. 3. Acquire thorough knowledge of the mathematical and heuristic aspects of Machine Learning. 4. Understand the concepts and operation of support vector machines, kernel SVM, naive bayes, decision tree classifier, random forest classifier, logistic regression, K-nearest neighbors, K-means clustering and more. 5. Be able to model a wide variety of robust Machine Learning algorithms including deep learning, clustering, and recommendation systems - - - - - - -

Logistic regression in Machine LearningKuppusamy P

Logistic regression is a predictive analysis algorithm that can be used for classification problems. It estimates the probabilities of different classes using the logistic function, which outputs values between 0 and 1. Logistic regression transforms its output using the sigmoid function to return a probability value. It is used for problems like email spam detection, fraud detection, and tumor classification. The independent variables should be independent of each other and the dependent variable must be categorical. Gradient descent is used to minimize the loss function and optimize the model parameters during training.

Machine learning session4(linear regression)Abhimanyu Dwivedi

Machine Learning-Linear regressionkishanthkumaar

Linear regression is a supervised machine learning technique used to model the relationship between a continuous dependent variable and one or more independent variables. It is commonly used for prediction and forecasting. The regression line represents the best fit line for the data using the least squares method to minimize the distance between the observed data points and the regression line. R-squared measures how well the regression line represents the data, on a scale of 0-100%. Linear regression performs well when data is linearly separable but has limitations such as assuming linear relationships and being sensitive to outliers and multicollinearity.

Logistic regressionYashwantGahlot1

Logistic regression is a machine learning classification algorithm that predicts the probability of a categorical dependent variable. It models the probability of the dependent variable being in one of two possible categories, as a function of the independent variables. The model transforms the linear combination of the independent variables using the logistic sigmoid function to output a probability between 0 and 1. Logistic regression is optimized using maximum likelihood estimation to find the coefficients that maximize the probability of the observed outcomes in the training data. Like linear regression, it makes assumptions about the data being binary classified with no noise or highly correlated independent variables.

Logistic Regression in Python | Logistic Regression Example | Machine Learnin...Edureka!

** Python Data Science Training : https://www.edureka.co/python ** This Edureka Video on Logistic Regression in Python will give you basic understanding of Logistic Regression Machine Learning Algorithm with examples. In this video, you will also get to see demo on Logistic Regression using Python. Below are the topics covered in this tutorial: 1. What is Regression? 2. What is Logistic Regression? 3. Why use Logistic Regression? 4. Linear vs Logistic Regression 5. Logistic Regression Use Cases 6. Logistic Regression Example Demo in Python Subscribe to our channel to get video updates. Hit the subscribe button above. Machine Learning Tutorial Playlist: https://goo.gl/UxjTxm

Linear regressionMartinHogg9

Feature selectiondkpawar

Feature selection is the process of selecting a subset of relevant features for model construction. It reduces complexity and can improve or maintain model accuracy. The curse of dimensionality means that as the number of features increases, the amount of data needed to maintain accuracy also increases exponentially. Feature selection methods include filter methods (statistical tests for correlation), wrapper methods (using the model to select features), and embedded methods (combining filter and wrapper approaches). Common filter methods include linear discriminant analysis, analysis of variance, chi-square tests, and Pearson correlation. Wrapper methods use techniques like forward selection, backward elimination, and recursive feature elimination. Embedded methods dynamically select features based on inferences from previous models.

Support vector machines (svm)Sharayu Patil

Naive Bayes PresentationMd. Enamul Haque Chowdhury

This document provides an overview of Naive Bayes classification. It begins with background on classification methods, then covers Bayes' theorem and how it relates to Bayesian and maximum likelihood classification. The document introduces Naive Bayes classification, which makes a strong independence assumption to simplify probability calculations. It discusses algorithms for discrete and continuous features, and addresses common issues like dealing with zero probabilities. The document concludes by outlining some applications of Naive Bayes classification and its advantages of simplicity and effectiveness for many problems.

Principal Component Analysis (PCA) and LDA PPT SlidesAbhishekKumar4995

Logistic regressionVenkata Reddy Konasani

This document provides an overview of logistic regression analysis. It introduces the need for logistic regression when the dependent variable is binary. Key concepts covered include the logistic regression model, interpreting the beta coefficients, assessing goodness of fit using various tests and metrics, and an example of fitting a logistic regression line to predict burger purchasing based on a customer's age. Students are instructed to use statistical software to estimate a logistic regression model and interpret the results.

Lasso and ridge regressionSreerajVA

The document discusses different types of linear regression models including simple linear regression, multiple linear regression, ridge regression, lasso regression, and elastic net regression. It explains the concepts of slope, intercept, underfitting, overfitting, and regularization techniques used to constrain model weights. Specifically, it describes how ridge regression uses an L2 penalty, lasso regression uses an L1 penalty, and elastic net uses a combination of L1 and L2 penalties to regularize linear regression models and reduce overfitting.

Support Vector Machinesnextlib

This document summarizes support vector machines (SVMs), a machine learning technique for classification and regression. SVMs find the optimal separating hyperplane that maximizes the margin between positive and negative examples in the training data. This is achieved by solving a convex optimization problem that minimizes a quadratic function under linear constraints. SVMs can perform non-linear classification by implicitly mapping inputs into a higher-dimensional feature space using kernel functions. They have applications in areas like text categorization due to their ability to handle high-dimensional sparse data.

K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...Simplilearn

This K-Means clustering algorithm presentation will take you through the machine learning introduction, types of clustering algorithms, k-means clustering, how does K-Means clustering work and at least explains K-Means clustering by taking a real life use case. This Machine Learning algorithm tutorial video is ideal for beginners to learn how K-Means clustering work. Below topics are covered in this K-Means Clustering Algorithm presentation: 1. Types of Machine Learning? 2. What is K-Means Clustering? 3. Applications of K-Means Clustering 4. Common distance measure 5. How does K-Means Clustering work? 6. K-Means Clustering Algorithm 7. Demo: k-Means Clustering 8. Use case: Color compression - - - - - - - - About Simplilearn Machine Learning course: A form of artificial intelligence, Machine Learning is revolutionizing the world of computing as well as all people’s digital interactions. Machine Learning powers such innovative automated technologies as recommendation engines, facial recognition, fraud protection and even self-driving cars.This Machine Learning course prepares engineers, data scientists and other professionals with knowledge and hands-on skills required for certification and job competency in Machine Learning. - - - - - - - Why learn Machine Learning? Machine Learning is taking over the world- and with that, there is a growing need among companies for professionals to know the ins and outs of Machine Learning The Machine Learning market size is expected to grow from USD 1.03 Billion in 2016 to USD 8.81 Billion by 2022, at a Compound Annual Growth Rate (CAGR) of 44.1% during the forecast period. - - - - - - What skills will you learn from this Machine Learning course? By the end of this Machine Learning course, you will be able to: 1. Master the concepts of supervised, unsupervised and reinforcement learning concepts and modeling. 2. Gain practical mastery over principles, algorithms, and applications of Machine Learning through a hands-on approach which includes working on 28 projects and one capstone project. 3. Acquire thorough knowledge of the mathematical and heuristic aspects of Machine Learning. 4. Understand the concepts and operation of support vector machines, kernel SVM, naive bayes, decision tree classifier, random forest classifier, logistic regression, K-nearest neighbors, K-means clustering and more. 5. Be able to model a wide variety of robust Machine Learning algorithms including deep learning, clustering, and recommendation systems - - - - - - -

Support Vector Machines ( SVM ) Mohammad Junaid Khan

Logistic regressionVARUN KUMAR

This document provides an introduction to logistic regression. It outlines key features such as using a logistic function to model a binary dependent variable that can take on values of 0 or 1. Logistic regression is a linear method that uses the logistic function to transform predictions. The document discusses applications in machine learning, medical science, social science, and industry. It also provides details on logistic regression models, including converting linear variables to logistic variables using a sigmoid function and examining the effects of varying the logistic growth and midpoint parameters on the logistic regression curve.

. An introduction to machine learning and probabilistic ...butest

This document provides an overview and introduction to machine learning and probabilistic graphical models. It discusses key topics such as supervised learning, unsupervised learning, graphical models, inference, and structure learning. The document covers techniques like decision trees, neural networks, clustering, dimensionality reduction, Bayesian networks, and learning the structure of probabilistic graphical models.

Presentation on machine learningJawaharlal Nehru Centre for Advanced Scientific Research

This document provides an overview of machine learning concepts including traditional programming vs machine learning, the machine learning workflow, and common machine learning algorithms like supervised learning, unsupervised learning, and reinforcement learning. It then discusses linear regression and issues like collinearity that can arise. Methods for addressing collinearity are presented, including partial least squares regression, ridge regression, and lasso regression. The document also covers preprocessing data and the concept of overfitting models.

Recommender SystemsJoão Paulo Leonidas Fernandes Dias da Silva

This document provides an overview of recommender systems including background information, implementation details, and a demonstration. It discusses machine learning applications like unsupervised learning, linear regression, and gradient descent algorithms. It covers content-based filtering using known product features and collaborative filtering to identify unknown product features. Examples are given on using linear regression and gradient descent to make predictions for skills data and handle unknown values.

More Related Content

What's hot (20)

Bayesian Networks - A Brief IntroductionAdnan Masood

Dimensionality Reductionmrizwan969

Logistic Regression | Logistic Regression In Python | Machine Learning Algori...Simplilearn

Logistic regression in Machine LearningKuppusamy P

Machine learning session4(linear regression)Abhimanyu Dwivedi

Machine Learning-Linear regressionkishanthkumaar

Logistic regressionYashwantGahlot1

Logistic Regression in Python | Logistic Regression Example | Machine Learnin...Edureka!

Linear regressionMartinHogg9

Feature selectiondkpawar

Support vector machines (svm)Sharayu Patil

Naive Bayes PresentationMd. Enamul Haque Chowdhury

Principal Component Analysis (PCA) and LDA PPT SlidesAbhishekKumar4995

Logistic regressionVenkata Reddy Konasani

Lasso and ridge regressionSreerajVA

Support Vector Machinesnextlib

K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...Simplilearn

Support Vector Machines ( SVM ) Mohammad Junaid Khan

Logistic regressionVARUN KUMAR

. An introduction to machine learning and probabilistic ...butest

Bayesian Networks - A Brief IntroductionAdnan Masood

Dimensionality Reductionmrizwan969

Logistic Regression | Logistic Regression In Python | Machine Learning Algori...Simplilearn

Logistic regression in Machine LearningKuppusamy P

Machine learning session4(linear regression)Abhimanyu Dwivedi

Machine Learning-Linear regressionkishanthkumaar

Logistic regressionYashwantGahlot1

Logistic Regression in Python | Logistic Regression Example | Machine Learnin...Edureka!

Linear regressionMartinHogg9

Feature selectiondkpawar

Support vector machines (svm)Sharayu Patil

Naive Bayes PresentationMd. Enamul Haque Chowdhury

Principal Component Analysis (PCA) and LDA PPT SlidesAbhishekKumar4995

Logistic regressionVenkata Reddy Konasani

Lasso and ridge regressionSreerajVA

Support Vector Machinesnextlib

K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...Simplilearn

Support Vector Machines ( SVM ) Mohammad Junaid Khan

Logistic regressionVARUN KUMAR

. An introduction to machine learning and probabilistic ...butest

Similar to ML - Multiple Linear Regression (20)

Presentation on machine learningJawaharlal Nehru Centre for Advanced Scientific Research

Recommender SystemsJoão Paulo Leonidas Fernandes Dias da Silva

机器学习AdaboostShocky1

This document discusses object detection using Adaboost and various techniques. It begins with an overview of the Adaboost algorithm and provides a toy example to illustrate how it works. Next, it describes how Viola and Jones used Adaboost with Haar-like features and an integral image representation for rapid face detection in images. It achieved high detection rates with very low false positives. The document also discusses how Schneiderman and Kanade used a parts-based representation with localized wavelet coefficients as features for object detection and used statistical independence of parts to obtain likelihoods for classification.

pca.pdf polymer nanoparticles and sensorsvincyshamleyeben

regression analysis presentation slides.nsnatraj23

Linear regression without tearsAnkit Sharma

This document provides an overview of linear regression analysis. It begins by defining regression analysis and describing its uses in prediction, forecasting, and understanding relationships between variables. It then covers simple and multivariate linear regression, discussing modeling relationships between one or more predictor and response variables. The document explains linear regression in R and how to evaluate model performance using analysis of variance (ANOVA) and other metrics like the coefficient of correlation. Key concepts like residuals, least squares estimation, and assumptions of linear regression are also introduced.

Non linear regression function -Introduction to EconomicsNgocducPham1

Lecture 4 - Linear Regression, a lecture in subject module Statistical & Mach...Maninda Edirisooriya

Regression: A skin-deep diveabulyomon

Linear Regression for Data Mining ApplicationSudiptaDas684406

cnn.pptx Convolutional neural network used for image classicationSakkaravarthiShanmug

Ch 6 Slides.doc/9929292929292919299292@:&:&:&9/92ohenebabismark508

Nonlinear regression functions allow the regression model to be nonlinear in one or more independent variables. There are two main approaches to modeling nonlinear relationships: polynomials and logarithmic transformations. Polynomials approximate the relationship with higher-order terms of the independent variable, such as quadratic or cubic terms. Logarithmic transformations model relationships in percentage terms by taking logarithms of variables. Both approaches can be estimated using ordinary least squares regression.

Linear Regression.pptxRamakrishna Reddy Bijjam

Linear regression establishes a relationship model between two variables, a predictor variable and a response variable. The relationship is represented by a linear equation where the exponent of both variables is 1, forming a straight line when graphed. Assumptions of linear regression include a linear relationship between variables, normally distributed residuals, and homoscedasticity. Linear regression is used to predict the response variable for new observations by fitting a linear model to observed data using functions like lm() and predict() in R.

Machine Learning Notes for beginners ,Step by stepSanjanaSaxena17

DataScienceUsingR-Dr.P.Rajesh.PRESENTATIONGayathriShiva4

Lec4(Multiple Regression) & Building a Model & Dummy Variable.pptxau1417257

Linear regression is a data analysis technique that predicts the value of unk...srisss369

Machine learning pt.1: Artificial Neural Networks ® All Rights ReservedJonathan Mitchell

This document provides an overview of machine learning concepts including classification, regression, artificial neural networks, and self-driving cars. It discusses topics such as probability basics, linear classification with logistic regression, perceptrons, neurons, forward and backpropagation, loss functions, and visualizing hidden layers in neural networks. The document is intended to introduce machine learning concepts relevant to applications like self-driving vehicles.

Class9_PCA_final.pptMaTruongThanh002937

PCA is a technique to reduce the dimensionality of multivariate data while retaining essential information. It works by transforming the data to a new coordinate system such that the greatest variance by any projection of the data lies on the first coordinate, called the first principal component. Subsequent components account for remaining variance while being orthogonal to previous components. PCA is performed by computing the eigenvalues and eigenvectors of the covariance matrix of the data, with the principal components being the eigenvectors. This allows visualization and interpretation of high-dimensional data in lower dimensions.

Lecture 8 about data mining and how to use it.pptxHedraAtif

Presentation on machine learningJawaharlal Nehru Centre for Advanced Scientific Research

Recommender SystemsJoão Paulo Leonidas Fernandes Dias da Silva

机器学习AdaboostShocky1

pca.pdf polymer nanoparticles and sensorsvincyshamleyeben

regression analysis presentation slides.nsnatraj23

Linear regression without tearsAnkit Sharma

Non linear regression function -Introduction to EconomicsNgocducPham1

Lecture 4 - Linear Regression, a lecture in subject module Statistical & Mach...Maninda Edirisooriya

Regression: A skin-deep diveabulyomon

Linear Regression for Data Mining ApplicationSudiptaDas684406

cnn.pptx Convolutional neural network used for image classicationSakkaravarthiShanmug

Ch 6 Slides.doc/9929292929292919299292@:&:&:&9/92ohenebabismark508

Linear Regression.pptxRamakrishna Reddy Bijjam

Machine Learning Notes for beginners ,Step by stepSanjanaSaxena17

DataScienceUsingR-Dr.P.Rajesh.PRESENTATIONGayathriShiva4

Lec4(Multiple Regression) & Building a Model & Dummy Variable.pptxau1417257

Linear regression is a data analysis technique that predicts the value of unk...srisss369

Machine learning pt.1: Artificial Neural Networks ® All Rights ReservedJonathan Mitchell

Class9_PCA_final.pptMaTruongThanh002937

Lecture 8 about data mining and how to use it.pptxHedraAtif

More from Andrew Ferlitsch (20)

AI - Intelligent AgentsAndrew Ferlitsch

Pareto Principle Applied to QAAndrew Ferlitsch

Abstract: This workshop teaches the application of statistics to the software quality assurance process. The course covers smoke testing, acceptance testing, Pareto principle, defect distributions, automated vs. manual testing, predicting effort, and experimental thoughts using Bellman equation approach and machine learning. Level: Intermediate Requirements: Some basic statistics knowledge is preferred and experience or exposure to the software quality assurance process.

Whiteboarding Coding Challenges in PythonAndrew Ferlitsch

Object Oriented Programming PrinciplesAndrew Ferlitsch

Python - OOP ProgrammingAndrew Ferlitsch

Python - Installing and Using Python and Jupyter NotepadAndrew Ferlitsch

Natural Language Processing - Groupings (Associations) GenerationAndrew Ferlitsch

Abstract: This PDSG workshop covers methods to automatically generate word groupings as associations, which can be used to teach associations between objects to pre-school and early school children. Ex. What item does not belong? Cat, Dog, Fire Truck, Bird In this presentation, I will cover how to build categorical and association dictionaries to automatically generate associations of the form, what item does not belong. Level: Intermediate Requirements: One should have some programming knowledge.

Natural Language Provessing - Handling Narrarive Fields in Datasets for Class...Andrew Ferlitsch

Abstract: It is common for government and public datasets to include narrative fields, such as inspection reports, incident reporting, surveys, 911 calls, fire response, etc. In addition to categorical fields, such as datetime, location, demographics, these datasets tend to include a narrative description (e.g., what happened). It is typically in the narrative field that the most interesting data resides for the purpose of classifying. The problem, is that since the narrative is human interpreted and entered, each entry may be unique and if we use the whole entry as a single value, one will end up with an overfitted model that works only on the training data. In this presentation, I will cover how natural language processing techniques are used to convert narrative fields into categorical data. Level: Intermediate Requirements: One should know basics of linear regression models. No prior programming knowledge is required.

Machine Learning - Introduction to Recurrent Neural NetworksAndrew Ferlitsch

Machine Learning - Introduction to Convolutional Neural NetworksAndrew Ferlitsch

Machine Learning - Introduction to Neural NetworksAndrew Ferlitsch

Python - Numpy/Pandas/Matplot Machine Learning LibrariesAndrew Ferlitsch

Machine Learning - Accuracy and Confusion MatrixAndrew Ferlitsch

Machine Learning - Ensemble MethodsAndrew Ferlitsch

Machine Learning - Dummy Variable ConversionAndrew Ferlitsch

Machine Learning - Splitting DatasetsAndrew Ferlitsch

Machine Learning - Dataset PreparationAndrew Ferlitsch

Machine Learning - Introduction to TensorflowAndrew Ferlitsch

Introduction to Machine LearningAndrew Ferlitsch

AI - Introduction to Dynamic ProgrammingAndrew Ferlitsch

Abstract: This PDSG workshop introduces basic concepts on dynamic programming. The course compares dynamic programming to traditional programming and walks attendees through examples to demonstrate both the difference and the concept. Level: Fundamental Requirements: Requires some prior programming knowledge and understanding of breadth first search (BFS) algorithm, which is used in the examples.