Statistical learning vs. Machine Learning
Download as PPTX, PDF0 likes382 views
This document compares and contrasts statistical learning and machine learning. While both aim to understand relationships between variables from data, they differ in their assumptions, techniques, and predictive power. Statistical models rely on assumptions of linearity, normality, and independence, while machine learning algorithms make fewer assumptions and can find complex, non-linear patterns in large datasets. Machine learning also requires less human effort than statistical modeling and generally has stronger predictive capabilities due to operating independently of assumptions. While distinct approaches, machine learning and statistical modeling are becoming increasingly similar and integrated in practice.
Ad
More Related Content
What's hot (20)
Similar to Statistical learning vs. Machine Learning (20)
Ad
Recently uploaded (20)
Ad
Statistical learning vs. Machine Learning
- 1. S TAT I S T I C A L L E A R N I N G V S . M A C H I N E L E A R N I N G
- 2. Venn diagram on the coverage of machine learning and statistical modeling in the universe of data science
- 3. DEFINITION • Machine Learning is … an algorithm that can learn from data without relying on rules- based programming. • Statistical Modelling is … formalization of relationships between variables in the form of mathematical equations.
- 4. A BUSINESS CASE Let us now see an interesting example published by McKinsey differentiating the two algorithms : – Case : Understand the risk level of customers churn over a period of time for a Telecom company – Data Available : Two Drivers – A & B – Next is a graph to understand the difference between a statistical model and a Machine Learning algorithm.
- 6. OBSERVATION • Statistical model is all about getting a simple formulation of a frontier in a classification model problem. Here we see a non linear boundary which to some extent separates risky people from non-risky people. But when we see the contours generated by Machine Learning algorithm, we witness that statistical modeling is no way comparable for the problem in hand to the Machine Learning algorithm. The contours of machine learning seems to capture all patterns beyond any boundaries of linearity or even continuity of the boundaries. This is what Machine Learning can do for you.
- 7. DIFFERENCES BETWEEN MACHINE LEARNING AND STATISTICAL MODELING • Given the flavor of difference in output of these two approaches, let us understand the difference in the two paradigms, even though both do almost similar job : – Schools they come from – When did they come into existence? – Assumptions they work on – Type of data they deal with – Nomenclatures of operations and objects – Techniques used – Predictive power and human efforts involved to implement • All the differences mentioned above do separate the two to some extent, but there is no hard boundary between Machine Learning and statistical modeling.
- 8. THEY BELONG TO DIFFERENT SCHOOLS • Machine Learning is … – a subfield of computer science and artificial intelligence which deals with building systems that can learn from data, instead of explicitly programmed instructions. • Statistical Modelling is … – a subfield of mathematics which deals with finding relationship between variables to predict an outcome
- 9. THEY CAME UP IN DIFFERENT ERAS Statistical modeling has been there for centuries now. However, Machine learning is a very recent development. It came into existence in the 1990s as steady advances in digitization and cheap computing power enabled data scientists to stop building finished models and instead train computers to do so. The unmanageable volume and complexity of the big data that the world is now swimming in have increased the potential of machine learning—and the need for it.
- 10. EXTENT OF ASSUMPTIONS INVOLVED • Statistical modeling work on a number of assumption. For instance a linear regression assumes : – Linear relation between independent and dependent variable – Homoscedasticity – Mean of error at zero for every dependent value – Independence of observations – Error should be normally distributed for each value of dependent variable • Similarly Logistic regressions comes with its own set of assumptions. Even a non linear model has to comply to a continuous segregation boundary. Machine Learning algorithms do assume a few of these things but in general are spared from most of these assumptions. The biggest advantage of using a Machine Learning algorithm is that there might not be any continuity of boundary as shown in the case study above. Also, we need not specify the distribution of dependent or independent variable in a machine learning algorithm.
- 11. TYPES OF DATA THEY DEAL WITH Machine Learning algorithms are wide range tools. Online Learning tools predict data on the fly. These tools are capable of learning from trillions of observations one by one. They make prediction and learn simultaneously. Other algorithms like Random Forest and Gradient Boosting are also exceptionally fast with big data. Machine learning does really well with wide (high number of attributes) and deep (high number of observations). However statistical modeling are generally applied for smaller data with less attributes or they end up over fitting.
- 12. Formulation Even when the end goal for both machine learning and statistical modeling is same, the formulation of two are significantly different. In a statistical model, we basically try to estimate the function “f” in Dependent Variable ( Y ) = f(Independent Variable) + error function Machine Learning takes away the deterministic function “f” out of the equation. It simply becomes Output(Y) ----- > Input (X) It will try to find pockets of X in n dimensions (where n is the number of attributes), where occurrence of Y is significantly different.
- 13. PREDICTIVE POWER AND HUMAN EFFORT • Nature does not assume anything before forcing an event to occur. • So the lesser assumptions in a predictive model, higher will be the predictive power. Machine Learning as the name suggest needs minimal human effort. Machine learning works on iterations where computer tries to find out patterns hidden in data. Because machine does this work on comprehensive data and is independent of all the assumption, predictive power is generally very strong for these models. Statistical model are mathematics intensive and based on coefficient estimation. It requires the modeler to understand the relation between variable before putting it in.
- 14. END NOTES It may seem that machine learning and statistical modeling are two different branches of predictive modeling, they are almost the same. The difference between these two have gone down significantly over past decade. Both the branches have learned from each other a lot and will further come closer in future. I hope we motivated you enough to acquire skills in each of these two domains and then compare how do they compliment each other.