SlideShare a Scribd company logo
An Overview of
Machine Learning
Speaker: Yi-Fan Chang
Adviser: Prof. J. J. Ding
Date: 2011/10/21
 What is machine learning?
 Learning system model
 Training and testing
 Performance
 Algorithms
 Machine learning structure
 What are we seeking?
 Learning techniques
 Applications
 Conclusion
Outline & Content
 A branch of artificial intelligence, concerned with the
design and development of algorithms that allow
computers to evolve behaviors based on empirical data.
 As intelligence requires knowledge, it is necessary for
the computers to acquire knowledge.
What is machine learning?
Learning system model
Input
Sample
s
Learnin
g
Method
Syste
m
Training
Testing
Training and testing
Training
set
(observed)
Universal
set
(unobserve
d)
Testing set
(unobserve
d)
Data
acquisition
Practical
usage
 Training is the process of making the system able to
learn.
 No free lunch rule:
 Training set and testing set come from the same distribution
 Need to make some assumptions or bias
Training and testing
 There are several factors affecting the performance:
 Types of training provided
 The form and extent of any initial background knowledge
 The type of feedback provided
 The learning algorithms used
 Two important factors:
 Modeling
 Optimization
Performance
 The success of machine learning system also depends
on the algorithms.
 The algorithms control the search to find and build the
knowledge structures.
 The learning algorithms should extract useful information
from training examples.
Algorithms
 Supervised learning ( )
 Prediction
 Classification (discrete labels), Regression (real values)
 Unsupervised learning ( )
 Clustering
 Probability distribution estimation
 Finding association (in features)
 Dimension reduction
 Semi-supervised learning
 Reinforcement learning
 Decision making (robot, chess machine)
Algorithms
10
Algorithms
Supervised
learning
Unsupervised
learning
Semi-supervised
 Supervised learning
Machine learning structure
 Unsupervised learning
Machine learning structure
 Supervised: Low E-out or maximize probabilistic terms
 Unsupervised: Minimum quantization error, Minimum
distance, MAP, MLE(maximum likelihood estimation)
What are we seeking?
E-in: for training
set
E-out: for testing
set
Under-fitting VS. Over-fitting (fixed N)
What are we seeking?
error
(model = hypothesis + loss
functions)
 Supervised learning categories and techniques
 Linear classifier (numerical functions)
 Parametric (Probabilistic functions)
 Naïve Bayes, Gaussian discriminant analysis (GDA), Hidden
Markov models (HMM), Probabilistic graphical models
 Non-parametric (Instance-based functions)
 K-nearest neighbors, Kernel regression, Kernel density
estimation, Local regression
 Non-metric (Symbolic functions)
 Classification and regression tree (CART), decision tree
 Aggregation
 Bagging (bootstrap + aggregation), Adaboost, Random forest
Learning techniques
 Techniques:
 Perceptron
 Logistic regression
 Support vector machine (SVM)
 Ada-line
 Multi-layer perceptron (MLP)
Learning techniques
, where w is an d-dim vector (learned)
• Linear
classifier
Learning techniques
Using perceptron learning algorithm(PLA)
Trainin
g
Testing
Error rate:
0.10
Error rate:
0.156
Learning techniques
Using logistic regression
Trainin
g
Testing
Error rate:
0.11
Error rate:
0.145
 Support vector machine (SVM):
 Linear to nonlinear: Feature transform and kernel function
Learning techniques
• Non-linear case
 Unsupervised learning categories and techniques
 Clustering
 K-means clustering
 Spectral clustering
 Density Estimation
 Gaussian mixture model (GMM)
 Graphical models
 Dimensionality reduction
 Principal component analysis (PCA)
 Factor analysis
Learning techniques
 Face detection
 Object detection and recognition
 Image segmentation
 Multimedia event detection
 Economical and commercial usage
Applications
We have a simple overview of some
techniques and algorithms in machine
learning. Furthermore, there are more and
more techniques apply machine learning as
a solution. In the future, machine learning
will play an important role in our daily life.
Conclusion
[1] W. L. Chao, J. J. Ding, “Integrated
Machine Learning Algorithms for Human
Age Estimation”, NTU, 2011.
Reference
Ad

Recommended

Machine Learning Overview
Machine Learning Overview
Mykhailo Koval
 
Le Machine Learning de A à Z
Le Machine Learning de A à Z
Alexia Audevart
 
Introduction to machine learning and model building using linear regression
Introduction to machine learning and model building using linear regression
Girish Gore
 
“Introducing Machine Learning and How to Teach Machines to See,” a Presentati...
“Introducing Machine Learning and How to Teach Machines to See,” a Presentati...
Edge AI and Vision Alliance
 
ML Basics
ML Basics
SrujanaMerugu1
 
Introduction into machine learning
Introduction into machine learning
mohamed Naas
 
Machine Learning and Applications
Machine Learning and Applications
Geeta Arora
 
Generative Adversarial Networks : Basic architecture and variants
Generative Adversarial Networks : Basic architecture and variants
ananth
 
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Edureka!
 
Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)
Manjunath Sindagi
 
Pybcn machine learning for dummies with python
Pybcn machine learning for dummies with python
Javier Arias Losada
 
[系列活動] Machine Learning 機器學習課程
[系列活動] Machine Learning 機器學習課程
台灣資料科學年會
 
Introduction to machine learning
Introduction to machine learning
Sangath babu
 
Machine Learning for Dummies (without mathematics)
Machine Learning for Dummies (without mathematics)
Andrews Cordolino Sobral
 
Introduction to-machine-learning
Introduction to-machine-learning
Babu Priyavrat
 
Europython - Machine Learning for dummies with Python
Europython - Machine Learning for dummies with Python
Javier Arias Losada
 
Applications of Machine Learning
Applications of Machine Learning
Department of Computer Science, Aalto University
 
Using Deep Learning to Find Similar Dresses
Using Deep Learning to Find Similar Dresses
HJ van Veen
 
Machine Learning and Real-World Applications
Machine Learning and Real-World Applications
MachinePulse
 
Tutorial on Deep Generative Models
Tutorial on Deep Generative Models
MLReview
 
A Friendly Introduction to Machine Learning
A Friendly Introduction to Machine Learning
Haptik
 
Automatic Attendace using convolutional neural network Face Recognition
Automatic Attendace using convolutional neural network Face Recognition
vatsal199567
 
How machines can take decisions
How machines can take decisions
Deepu S Nath
 
林守德/Practical Issues in Machine Learning
林守德/Practical Issues in Machine Learning
台灣資料科學年會
 
Introduction to Machine Learning
Introduction to Machine Learning
Dr. Radhey Shyam
 
Machine learning basics
Machine learning basics
Akanksha Bali
 
Deep Learning: Chapter 11 Practical Methodology
Deep Learning: Chapter 11 Practical Methodology
Jason Tsai
 
機器學習速遊
機器學習速遊
台灣資料科學年會
 
Learning in Networks: were Pavlov and Hebb right?
Learning in Networks: were Pavlov and Hebb right?
Victor Miagkikh
 
New UI for Cost Center Planning
New UI for Cost Center Planning
tasmc
 

More Related Content

What's hot (20)

Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Edureka!
 
Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)
Manjunath Sindagi
 
Pybcn machine learning for dummies with python
Pybcn machine learning for dummies with python
Javier Arias Losada
 
[系列活動] Machine Learning 機器學習課程
[系列活動] Machine Learning 機器學習課程
台灣資料科學年會
 
Introduction to machine learning
Introduction to machine learning
Sangath babu
 
Machine Learning for Dummies (without mathematics)
Machine Learning for Dummies (without mathematics)
Andrews Cordolino Sobral
 
Introduction to-machine-learning
Introduction to-machine-learning
Babu Priyavrat
 
Europython - Machine Learning for dummies with Python
Europython - Machine Learning for dummies with Python
Javier Arias Losada
 
Applications of Machine Learning
Applications of Machine Learning
Department of Computer Science, Aalto University
 
Using Deep Learning to Find Similar Dresses
Using Deep Learning to Find Similar Dresses
HJ van Veen
 
Machine Learning and Real-World Applications
Machine Learning and Real-World Applications
MachinePulse
 
Tutorial on Deep Generative Models
Tutorial on Deep Generative Models
MLReview
 
A Friendly Introduction to Machine Learning
A Friendly Introduction to Machine Learning
Haptik
 
Automatic Attendace using convolutional neural network Face Recognition
Automatic Attendace using convolutional neural network Face Recognition
vatsal199567
 
How machines can take decisions
How machines can take decisions
Deepu S Nath
 
林守德/Practical Issues in Machine Learning
林守德/Practical Issues in Machine Learning
台灣資料科學年會
 
Introduction to Machine Learning
Introduction to Machine Learning
Dr. Radhey Shyam
 
Machine learning basics
Machine learning basics
Akanksha Bali
 
Deep Learning: Chapter 11 Practical Methodology
Deep Learning: Chapter 11 Practical Methodology
Jason Tsai
 
機器學習速遊
機器學習速遊
台灣資料科學年會
 
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Edureka!
 
Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)
Manjunath Sindagi
 
Pybcn machine learning for dummies with python
Pybcn machine learning for dummies with python
Javier Arias Losada
 
[系列活動] Machine Learning 機器學習課程
[系列活動] Machine Learning 機器學習課程
台灣資料科學年會
 
Introduction to machine learning
Introduction to machine learning
Sangath babu
 
Machine Learning for Dummies (without mathematics)
Machine Learning for Dummies (without mathematics)
Andrews Cordolino Sobral
 
Introduction to-machine-learning
Introduction to-machine-learning
Babu Priyavrat
 
Europython - Machine Learning for dummies with Python
Europython - Machine Learning for dummies with Python
Javier Arias Losada
 
Using Deep Learning to Find Similar Dresses
Using Deep Learning to Find Similar Dresses
HJ van Veen
 
Machine Learning and Real-World Applications
Machine Learning and Real-World Applications
MachinePulse
 
Tutorial on Deep Generative Models
Tutorial on Deep Generative Models
MLReview
 
A Friendly Introduction to Machine Learning
A Friendly Introduction to Machine Learning
Haptik
 
Automatic Attendace using convolutional neural network Face Recognition
Automatic Attendace using convolutional neural network Face Recognition
vatsal199567
 
How machines can take decisions
How machines can take decisions
Deepu S Nath
 
林守德/Practical Issues in Machine Learning
林守德/Practical Issues in Machine Learning
台灣資料科學年會
 
Introduction to Machine Learning
Introduction to Machine Learning
Dr. Radhey Shyam
 
Machine learning basics
Machine learning basics
Akanksha Bali
 
Deep Learning: Chapter 11 Practical Methodology
Deep Learning: Chapter 11 Practical Methodology
Jason Tsai
 

Viewers also liked (8)

Learning in Networks: were Pavlov and Hebb right?
Learning in Networks: were Pavlov and Hebb right?
Victor Miagkikh
 
New UI for Cost Center Planning
New UI for Cost Center Planning
tasmc
 
人機協作迎向Ai+世代
人機協作迎向Ai+世代
Steven Tseng
 
團隊經營學-團隊效能與提問領導
團隊經營學-團隊效能與提問領導
Steven Tseng
 
AI機器人正夯
AI機器人正夯
佳新 陳
 
擁抱人工智慧帶來的劇烈產業改變 @ Mix Taiwan
擁抱人工智慧帶來的劇烈產業改變 @ Mix Taiwan
Albert Y. C. Chen
 
人工智慧下的AOI變革浪潮:影像辨識技術的突破與新契機
人工智慧下的AOI變革浪潮:影像辨識技術的突破與新契機
Albert Y. C. Chen
 
Top 5 Deep Learning and AI Stories - October 6, 2017
Top 5 Deep Learning and AI Stories - October 6, 2017
NVIDIA
 
Learning in Networks: were Pavlov and Hebb right?
Learning in Networks: were Pavlov and Hebb right?
Victor Miagkikh
 
New UI for Cost Center Planning
New UI for Cost Center Planning
tasmc
 
人機協作迎向Ai+世代
人機協作迎向Ai+世代
Steven Tseng
 
團隊經營學-團隊效能與提問領導
團隊經營學-團隊效能與提問領導
Steven Tseng
 
AI機器人正夯
AI機器人正夯
佳新 陳
 
擁抱人工智慧帶來的劇烈產業改變 @ Mix Taiwan
擁抱人工智慧帶來的劇烈產業改變 @ Mix Taiwan
Albert Y. C. Chen
 
人工智慧下的AOI變革浪潮:影像辨識技術的突破與新契機
人工智慧下的AOI變革浪潮:影像辨識技術的突破與新契機
Albert Y. C. Chen
 
Top 5 Deep Learning and AI Stories - October 6, 2017
Top 5 Deep Learning and AI Stories - October 6, 2017
NVIDIA
 
Ad

Similar to An overview of machine learning (20)

An overview of machine learning
An overview of machine learning
KhaledAbdElFatha
 
Overview of machine learning
Overview of machine learning
AhmedHany131
 
An overview of machine learning
An overview of machine learning
piyush Kumar Sharma
 
Machine Learning Techniques all units .ppt
Machine Learning Techniques all units .ppt
vidhyav58
 
i2ml-chap1-v1-1.ppt
i2ml-chap1-v1-1.ppt
Sivamkasi64
 
AI_06_Machine Learning.pptx
AI_06_Machine Learning.pptx
Yousef Aburawi
 
Machine Learning an Research Overview
Machine Learning an Research Overview
Kathirvel Ayyaswamy
 
Machine_Learning.pptx
Machine_Learning.pptx
shubhamatak136
 
Lecture #05
Lecture #05
Konpal Darakshan
 
Lec 01
Lec 01
Islamia Univeristy Bahawalpur Bahawalnagar
 
22PCOAM16_MACHINE_LEARNING_UNIT_I_NOTES.pdf
22PCOAM16_MACHINE_LEARNING_UNIT_I_NOTES.pdf
Guru Nanak Technical Institutions
 
22PCOAM16_ML_Unit 1 notes & Question Bank with answers.pdf
22PCOAM16_ML_Unit 1 notes & Question Bank with answers.pdf
Guru Nanak Technical Institutions
 
Intro/Overview on Machine Learning Presentation
Intro/Overview on Machine Learning Presentation
Ankit Gupta
 
machinecanthink-160226155704.pdf
machinecanthink-160226155704.pdf
PranavPatil822557
 
Unit - 1 - Introduction of the machine learning
Unit - 1 - Introduction of the machine learning
Taranpreet Singh
 
Machine Can Think
Machine Can Think
Rahul Jaiman
 
Machine learning
Machine learning
Sandeep Singh
 
Introduction to Machine Learning
Introduction to Machine Learning
Shahar Cohen
 
Week 1.pdf
Week 1.pdf
AnjaliJain608033
 
module 6 (1).ppt
module 6 (1).ppt
AKSHAYAROHITHKB1
 
An overview of machine learning
An overview of machine learning
KhaledAbdElFatha
 
Overview of machine learning
Overview of machine learning
AhmedHany131
 
Machine Learning Techniques all units .ppt
Machine Learning Techniques all units .ppt
vidhyav58
 
i2ml-chap1-v1-1.ppt
i2ml-chap1-v1-1.ppt
Sivamkasi64
 
AI_06_Machine Learning.pptx
AI_06_Machine Learning.pptx
Yousef Aburawi
 
Machine Learning an Research Overview
Machine Learning an Research Overview
Kathirvel Ayyaswamy
 
Intro/Overview on Machine Learning Presentation
Intro/Overview on Machine Learning Presentation
Ankit Gupta
 
machinecanthink-160226155704.pdf
machinecanthink-160226155704.pdf
PranavPatil822557
 
Unit - 1 - Introduction of the machine learning
Unit - 1 - Introduction of the machine learning
Taranpreet Singh
 
Introduction to Machine Learning
Introduction to Machine Learning
Shahar Cohen
 
Ad

Recently uploaded (20)

Predicting Titanic Survival Presentation
Predicting Titanic Survival Presentation
praxyfarhana
 
Artigo - Playing to Win.planejamento docx
Artigo - Playing to Win.planejamento docx
KellyXavier15
 
PPT1_CB_VII_CS_Ch3_FunctionsandChartsinCalc.ppsx
PPT1_CB_VII_CS_Ch3_FunctionsandChartsinCalc.ppsx
animaroy81
 
NVIDIA Triton Inference Server, a game-changing platform for deploying AI mod...
NVIDIA Triton Inference Server, a game-changing platform for deploying AI mod...
Tamanna36
 
Informatics Market Insights AI Workforce.pdf
Informatics Market Insights AI Workforce.pdf
karizaroxx
 
定制OCAD学生卡加拿大安大略艺术与设计大学成绩单范本,OCAD成绩单复刻
定制OCAD学生卡加拿大安大略艺术与设计大学成绩单范本,OCAD成绩单复刻
taqyed
 
PPT2 W1L2.pptx.........................................
PPT2 W1L2.pptx.........................................
palicteronalyn26
 
Indigo dyeing Presentation (2).pptx as dye
Indigo dyeing Presentation (2).pptx as dye
shreeroop1335
 
Presentation by Tariq & Mohammed (1).pptx
Presentation by Tariq & Mohammed (1).pptx
AbooddSandoqaa
 
Measurecamp Copenhagen - Consent Context
Measurecamp Copenhagen - Consent Context
Human37
 
Starbucks in the Indian market through its joint venture.
Starbucks in the Indian market through its joint venture.
sales480687
 
Indigo_Airlines_Strategy_Presentation.pptx
Indigo_Airlines_Strategy_Presentation.pptx
mukeshpurohit991
 
美国毕业证范本中华盛顿大学学位证书CWU学生卡购买
美国毕业证范本中华盛顿大学学位证书CWU学生卡购买
Taqyea
 
Camuflaje Tipos Características Militar 2025.ppt
Camuflaje Tipos Características Militar 2025.ppt
e58650738
 
NASA ESE Study Results v4 05.29.2020.pptx
NASA ESE Study Results v4 05.29.2020.pptx
CiroAlejandroCamacho
 
624753984-Annex-A3-RPMS-Tool-for-Proficient-Teachers-SY-2024-2025.pdf
624753984-Annex-A3-RPMS-Tool-for-Proficient-Teachers-SY-2024-2025.pdf
CristineGraceAcuyan
 
11_L2_Defects_and_Trouble_Shooting_2014[1].pdf
11_L2_Defects_and_Trouble_Shooting_2014[1].pdf
gun3awan88
 
Data Visualisation in data science for students
Data Visualisation in data science for students
confidenceascend
 
Shifting Focus on AI: How it Can Make a Positive Difference
Shifting Focus on AI: How it Can Make a Positive Difference
1508 A/S
 
Mynd company all details what they are doing a
Mynd company all details what they are doing a
AniketKadam40952
 
Predicting Titanic Survival Presentation
Predicting Titanic Survival Presentation
praxyfarhana
 
Artigo - Playing to Win.planejamento docx
Artigo - Playing to Win.planejamento docx
KellyXavier15
 
PPT1_CB_VII_CS_Ch3_FunctionsandChartsinCalc.ppsx
PPT1_CB_VII_CS_Ch3_FunctionsandChartsinCalc.ppsx
animaroy81
 
NVIDIA Triton Inference Server, a game-changing platform for deploying AI mod...
NVIDIA Triton Inference Server, a game-changing platform for deploying AI mod...
Tamanna36
 
Informatics Market Insights AI Workforce.pdf
Informatics Market Insights AI Workforce.pdf
karizaroxx
 
定制OCAD学生卡加拿大安大略艺术与设计大学成绩单范本,OCAD成绩单复刻
定制OCAD学生卡加拿大安大略艺术与设计大学成绩单范本,OCAD成绩单复刻
taqyed
 
PPT2 W1L2.pptx.........................................
PPT2 W1L2.pptx.........................................
palicteronalyn26
 
Indigo dyeing Presentation (2).pptx as dye
Indigo dyeing Presentation (2).pptx as dye
shreeroop1335
 
Presentation by Tariq & Mohammed (1).pptx
Presentation by Tariq & Mohammed (1).pptx
AbooddSandoqaa
 
Measurecamp Copenhagen - Consent Context
Measurecamp Copenhagen - Consent Context
Human37
 
Starbucks in the Indian market through its joint venture.
Starbucks in the Indian market through its joint venture.
sales480687
 
Indigo_Airlines_Strategy_Presentation.pptx
Indigo_Airlines_Strategy_Presentation.pptx
mukeshpurohit991
 
美国毕业证范本中华盛顿大学学位证书CWU学生卡购买
美国毕业证范本中华盛顿大学学位证书CWU学生卡购买
Taqyea
 
Camuflaje Tipos Características Militar 2025.ppt
Camuflaje Tipos Características Militar 2025.ppt
e58650738
 
NASA ESE Study Results v4 05.29.2020.pptx
NASA ESE Study Results v4 05.29.2020.pptx
CiroAlejandroCamacho
 
624753984-Annex-A3-RPMS-Tool-for-Proficient-Teachers-SY-2024-2025.pdf
624753984-Annex-A3-RPMS-Tool-for-Proficient-Teachers-SY-2024-2025.pdf
CristineGraceAcuyan
 
11_L2_Defects_and_Trouble_Shooting_2014[1].pdf
11_L2_Defects_and_Trouble_Shooting_2014[1].pdf
gun3awan88
 
Data Visualisation in data science for students
Data Visualisation in data science for students
confidenceascend
 
Shifting Focus on AI: How it Can Make a Positive Difference
Shifting Focus on AI: How it Can Make a Positive Difference
1508 A/S
 
Mynd company all details what they are doing a
Mynd company all details what they are doing a
AniketKadam40952
 

An overview of machine learning

  • 1. An Overview of Machine Learning Speaker: Yi-Fan Chang Adviser: Prof. J. J. Ding Date: 2011/10/21
  • 2.  What is machine learning?  Learning system model  Training and testing  Performance  Algorithms  Machine learning structure  What are we seeking?  Learning techniques  Applications  Conclusion Outline & Content
  • 3.  A branch of artificial intelligence, concerned with the design and development of algorithms that allow computers to evolve behaviors based on empirical data.  As intelligence requires knowledge, it is necessary for the computers to acquire knowledge. What is machine learning?
  • 5. Training and testing Training set (observed) Universal set (unobserve d) Testing set (unobserve d) Data acquisition Practical usage
  • 6.  Training is the process of making the system able to learn.  No free lunch rule:  Training set and testing set come from the same distribution  Need to make some assumptions or bias Training and testing
  • 7.  There are several factors affecting the performance:  Types of training provided  The form and extent of any initial background knowledge  The type of feedback provided  The learning algorithms used  Two important factors:  Modeling  Optimization Performance
  • 8.  The success of machine learning system also depends on the algorithms.  The algorithms control the search to find and build the knowledge structures.  The learning algorithms should extract useful information from training examples. Algorithms
  • 9.  Supervised learning ( )  Prediction  Classification (discrete labels), Regression (real values)  Unsupervised learning ( )  Clustering  Probability distribution estimation  Finding association (in features)  Dimension reduction  Semi-supervised learning  Reinforcement learning  Decision making (robot, chess machine) Algorithms
  • 11.  Supervised learning Machine learning structure
  • 12.  Unsupervised learning Machine learning structure
  • 13.  Supervised: Low E-out or maximize probabilistic terms  Unsupervised: Minimum quantization error, Minimum distance, MAP, MLE(maximum likelihood estimation) What are we seeking? E-in: for training set E-out: for testing set
  • 14. Under-fitting VS. Over-fitting (fixed N) What are we seeking? error (model = hypothesis + loss functions)
  • 15.  Supervised learning categories and techniques  Linear classifier (numerical functions)  Parametric (Probabilistic functions)  Naïve Bayes, Gaussian discriminant analysis (GDA), Hidden Markov models (HMM), Probabilistic graphical models  Non-parametric (Instance-based functions)  K-nearest neighbors, Kernel regression, Kernel density estimation, Local regression  Non-metric (Symbolic functions)  Classification and regression tree (CART), decision tree  Aggregation  Bagging (bootstrap + aggregation), Adaboost, Random forest Learning techniques
  • 16.  Techniques:  Perceptron  Logistic regression  Support vector machine (SVM)  Ada-line  Multi-layer perceptron (MLP) Learning techniques , where w is an d-dim vector (learned) • Linear classifier
  • 17. Learning techniques Using perceptron learning algorithm(PLA) Trainin g Testing Error rate: 0.10 Error rate: 0.156
  • 18. Learning techniques Using logistic regression Trainin g Testing Error rate: 0.11 Error rate: 0.145
  • 19.  Support vector machine (SVM):  Linear to nonlinear: Feature transform and kernel function Learning techniques • Non-linear case
  • 20.  Unsupervised learning categories and techniques  Clustering  K-means clustering  Spectral clustering  Density Estimation  Gaussian mixture model (GMM)  Graphical models  Dimensionality reduction  Principal component analysis (PCA)  Factor analysis Learning techniques
  • 21.  Face detection  Object detection and recognition  Image segmentation  Multimedia event detection  Economical and commercial usage Applications
  • 22. We have a simple overview of some techniques and algorithms in machine learning. Furthermore, there are more and more techniques apply machine learning as a solution. In the future, machine learning will play an important role in our daily life. Conclusion
  • 23. [1] W. L. Chao, J. J. Ding, “Integrated Machine Learning Algorithms for Human Age Estimation”, NTU, 2011. Reference