Scribd
Upload
43 views5 pages

Adaboost Dataset X1 X2 Y

The document describes AdaBoost, an algorithm that uses decision stumps as weak learners to build an additive model in a stage-wise fashion. It shows three models being built on a dataset with 10 data points, each with 2 features (X1 and X2) and a binary target (Y). Each subsequent model focuses on the misclassified points from the previous model. The predictions from each model are summed to get the final boosted predictions, improving accuracy from the initial 90% to the final 80%.

Uploaded by

Weary Case
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
43 views5 pages

Adaboost Dataset X1 X2 Y

The document describes AdaBoost, an algorithm that uses decision stumps as weak learners to build an additive model in a stage-wise fashion. It shows three models being built on a dataset with 10 data points, each with 2 features (X1 and X2) and a binary target (Y). Each subsequent model focuses on the misclassified points from the previous model. The predictions from each model are summed to get the final boosted predictions, improving accuracy from the initial 90% to the final 80%.

Uploaded by

Weary Case
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
You are on page 1/ 5

AdaBoost

5
Dataset 4.5
X1 X2 Y
4
3.64754035 2.996793259 0
2.61266384 4.459457779 0 3.5
2.36335968 1.506982189 0
3
4.93260045 1.299008795 0
3.77615475 3.157451378 0 2.5
8.67396079 2.122873405 1 2
5.86159945 0.003512817 1
8.98467736 1.768161009 1 1.5
7.46738095 0.187045945 1 1
4.43628441 0.862698005 1
0.5
0
2 3 4 5 6 7
Model 1: Predictions
X1 X2 Y Weight X1 Split Group Prediction
3.64754035 2.996793259 0 0.1 4.93260045 LEFT 0
2.61266384 4.459457779 0 0.1 LEFT 0
2.36335968 1.506982189 0 0.1 LEFT 0
4.93260045 1.299008795 0 0.1 LEFT 0
3.77615475 3.157451378 0 0.1 LEFT 0
8.67396079 2.122873405 1 0.1 RIGHT 1
5.86159945 0.003512817 1 0.1 RIGHT 1
8.98467736 1.768161009 1 0.1 RIGHT 1
7.46738095 0.187045945 1 0.1 RIGHT 1
4.43628441 0.862698005 1 0.1 LEFT 0

Model 2: Predictions
X1 X2 Y Weight X2 Split Group Prediction
3.64754035 2.996793259 0 0.1 2.12287341 RIGHT 0
2.61266384 4.459457779 0 0.1 RIGHT 0
2.36335968 1.506982189 0 0.1 LEFT 1
4.93260045 1.299008795 0 0.1 LEFT 1
3.77615475 3.157451378 0 0.1 RIGHT 0
8.67396079 2.122873405 1 0.1 LEFT 1
5.86159945 0.003512817 1 0.1 LEFT 1
8.98467736 1.768161009 1 0.1 LEFT 1
7.46738095 0.187045945 1 0.1 LEFT 1
4.43628441 0.862698005 1 0.12457309 LEFT 1

Model 2: Predictions
X1 X2 Y Weight X2 Split Group Prediction
3.64754035 2.996793259 0 0.1 0.86269801 RIGHT 0
2.61266384 4.459457779 0 0.1 RIGHT 0
2.36335968 1.506982189 0 0.11521789 RIGHT 0
4.93260045 1.299008795 0 0.11521789 RIGHT 0
3.77615475 3.157451378 0 0.1 RIGHT 0
8.67396079 2.122873405 1 0.1 RIGHT 0
5.86159945 0.003512817 1 0.1 LEFT 1
8.98467736 1.768161009 1 0.1 RIGHT 0
7.46738095 0.187045945 1 0.1 LEFT 1
4.43628441 0.862698005 1 0.12457309 LEFT 1

Boosted Predictions
X1 X2 Model 1 Model 2 Model 3 Sum Prediction
3.64754035 2.996793259 -2.197224577 -1.4165484 -1.4527945 -5.0665675 0
2.61266384 4.459457779 -2.197224577 -1.4165484 -1.4527945 -5.0665675 0
2.36335968 1.506982189 -2.197224577 1.41654842 -1.4527945 -2.2334706 0
4.93260045 1.299008795 -2.197224577 1.41654842 -1.4527945 -2.2334706 0
3.77615475 3.157451378 -2.197224577 -1.4165484 -1.4527945 -5.0665675 0
8.67396079 2.122873405 2.197224577 1.41654842 -1.4527945 2.16097852 1
5.86159945 0.003512817 2.197224577 1.41654842 1.45279448 5.06656748 1
8.98467736 1.768161009 2.197224577 1.41654842 -1.4527945 2.16097852 1
7.46738095 0.187045945 2.197224577 1.41654842 1.45279448 5.06656748 1
4.43628441 0.862698005 -2.197224577 1.41654842 1.45279448 0.67211833 1
0
1

4 5 6 7 8 9 10

Error Weighted ErrorSum WeightSum Error MisclassificaStage Accuracy


0 0 1 0.1 0.1 2.19722458 90
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
1 0.1

Error Weighted ErrorSum WeightSum Error MisclassificaStage Accuracy


0 0 1.02457309 0.2 0.19520325 1.41654842 80
0 0
1 0.1
1 0.1
0 0
0 0
0 0
0 0
0 0
0 0

Error Weighted ErrorSum WeightSum Error MisclassificaStage Accuracy


0 0 1.05500887 0.2 0.18957187 1.45279448 80
0 0
0 0
0 0
0 0
1 0.1
0 0
1 0.1
0 0
0 0

Y Error Accuracy
0 0 100
0 0
0 0
0 0
0 0
1 0
1 0
1 0
1 0
1 0
Weight
0.1
0.1
0.1
0.1
0.1
0.1
0.1
0.1
0.1
0.1

You might also like