Scribd
Upload
11 views

Math For ML

The document provides an overview of key mathematics topics for machine learning including linear algebra, statistics, probability, objective functions, regularization, information theory, optimization, and distributions. It outlines the main concepts within each topic at a high level.

Uploaded by

Omar Farooque
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
11 views

Math For ML

The document provides an overview of key mathematics topics for machine learning including linear algebra, statistics, probability, objective functions, regularization, information theory, optimization, and distributions. It outlines the main concepts within each topic at a high level.

Uploaded by

Omar Farooque
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 10

Machine Learning

Mathematics
Roadmap

Linear Algebra, Statistics, Probability, Objective Functions,


Regularization, Information Theory, Optimization, Distribution

Himanshu Ramchandani

https://www.linkedin.com/in/hemansnation/
Contents

FREE Resources -

Chapter 1 - Linear Algebra

Chapter 2 - Statistics

Chapter 3 - Probability

Chapter 4 - Objective Functions

Chapter 5 - Regularization

Chapter 6 - Information Theory

Chapter 7 - Optimization

Chapter 8 - Distribution
FREE Resources →
Mathematics for Machine Learning

Algebra, Topology, Differential Calculus, and Optimization Theory For Computer


Science and Machine Learning

All math topics for Machine Learning by Stanford

Stanford CS229: Machine Learning Course | Summer 2019 (Anand Avati)

Chapter 1 - Linear Algebra


Learn for FREE - Mathematics for ML - Linear
Algebra
Mathematics for Machine Learning - Linear Algebra

1 | Vectors

2 | Matrix

3 | Eigenvalues and Eigenvectors

3 | Factorization

4 | Singular Value Decomposition (SVD)

5 | Gradient

6 | Tensors

7 | Jacobian Matrix

8 | Curse of Dimensionality
Chapter 2 - Statistics
The Element of Statistical Learning

Elements of Statistical Learning: data mining, inference, and prediction. 2nd


Edition.

Statistics give us 2 tools descriptive and inferential

1 | Descriptive Statistics

1 | Variables

2 | Mean

3 | Median

4 | Mode

5 | Standard Deviation

6 | Variance

7 | Range

8 | Percentile

9 | Skewness

10 | Kurtosis

2 | Inferential Statistics

1 | Sampling Distributions

2 | Central Limit Theorem

3 | Hypothesis Testing

4 | Confidence Intervals
5 | T-Tests

6 | Analysis of Variance (ANOVA)

7 | Chi-Square Test

8 | Regression Analysis

9 | Bayesian Inference

10 | Maximum Likelihood Estimation (MLE)

Chapter 3 - Probability
Probability Theory: The Logic of Science

https://bayes.wustl.edu/etj/prob/book.pdf

1 | Probability Distribution

2 | Conditional Probability

3 | Bayes' Theorem

4 | Joint and Marginal Probabilities

5 | Independence and Conditional Independence


Chapter 4 - Objective Functions
1 | Mean Squared Error (MSE)

2 | Mean Absolute Error (MAE)

3 | Huber Loss

4 | Binary Cross-Entropy (Log Loss)

5 | Categorical Cross-Entropy

6 | Maximum Likelihood Estimation (MLE)

7 | Sparse Categorical Cross-Entropy

8 | Hinge Loss

9 | Kullback-Leibler Divergence

10 | Gini Impurity

11 | Others

Chapter 5 - Regularization
1 | L1 Regularization (Lasso Regression)

2 | L2 Regularization (Ridge Regression)

3 | Elastic Net Regularization

4 | Dropout Regularization

5 | Data Augmentation

6 | Early Stopping

7 | Max-Norm Regularization
8 | Batch Normalization

9 | Weight Decay

10 | Total Variation Regularization

Chapter 6 - Information Theory


Information Theory, Inference and Learning Algorithms

David MacKay: Information Theory, Pattern Recognition and Neural Networks: The
Book

1 | Entropy

2 | Conditional Entropy

3 | Joint Entropy

4 | Mutual Information

5 | Relative Entropy (Kullback-Leibler Divergence)

6 | Cross-Entropy

7 | Information Gain

8 | Shannon-Fano Coding

9 | Huffman Coding

10 | Data Entropy
Chapter 7 - Optimization
1 | Gradient Descent

2 | Stochastic Gradient Descent (SGD)

3 | Mini-Batch Gradient Descent

4 | Momentum

5 | Nesterov Accelerated Gradient (NAG)

6 | Adagrad (Adaptive Gradient Algorithm)

7 | RMSprop (Root Mean Square Propagation)

8 | Adam (Adaptive Moment Estimation)

Chapter 8 - Distribution
1 | Bernoulli Distribution

2 | Binomial Distribution

3 | Multinomial Distribution

4 | Normal (Gaussian) Distribution

5 | Uniform Distribution

6 | Exponential Distribution

7 | Poisson Distribution

Calculus

Calculus 1 | Math | Khan Academy


AI/ML Ideas, Strategies, Newsletter &
Community 🚀
(AI/ML Roadmap + 14 Hours AI/ML Workshop + 1000 AI
Product/Project Ideas → 21 Industries + AI Implementation
Strategy + AI Community).

Click Here to Subscribe and Get the Roadmap in Your


Email Inbox

https://embeds.beehiiv.com/efdd81cb-9fca-427d-b60d-d8
c2fabb1325
Community of 35k Data Professionals Join them 👉
LinkedIn (25,000+), Telegram (5,500+), Discord (1000+),

Instagram (4,100+), GitHub (1.9k)

About

Himanshu Ramchandani
The last AI Consultant you’ll ever hire or I’ll give you your money
back. Data & AI Solutions Consulting

Join Telegram:
https://t.me/+sREuRiFssMo4YWJl

Join the Discord Community:

https://discord.gg/q3svy4VEEs

You might also like