SlideShare a Scribd company logo
Context Recommendation
Using Multi-label Classification
Yong Zheng, Bamshad Mobasher, Robin Burke
Center for Web Intelligence, DePaul University, Chicago
IEEE/WIC/ACM Conference on Web Intelligence
Aug 14, Warsaw, Poland
Intro – Recommender Systems
• Information Overload Problem  IR and RS
• Recommender systems (RS) are the systems being
able to provide recommendations to the end users.
Currently, RS are popular everywhere:
• E-Commerce: Amazon, Ebay, Newegg, etc
• Social networks: Twitter, Facebook, etc
• Movie/Stream: Netflix, Movie Pilot, Youtube, etc
• Music: Pandora, Last.FM, etc
Intro – Type of Recommendations
• [Item Recommendations]
• [User Recommendations]
Intro – Context-aware Recommender
• Context-aware Recommender Systems (CARS)
CARS is a new type of RS which provide recommendations
by adapting to users’ contextual situations.
• Traditional RS: Users × Items  Ratings
• Contextual RS: Users × Items × Contexts Ratings
• Assumptions behind:
1). User may have different preferences in different contexts;
2). Contexts are important in decision-makings.
However, what CARS recommended are still items or users.
Companion
New Application: Context Recommender
• In this paper, we propose a new application: context
recommender (CR), which is able to recommend or
suggest appropriate contexts for users to select or
consume items.
• Sample of contexts: time, location, companion, etc
Context Rec
User RecItem Rec
Possible Examples (Amazon.com)
Note: They are not REAL applications/examples right now.
Possible Examples (IMDB.com)
Related Work
L. Baltrunas, et al. "Best usage context predictions for
music tracks", The 2nd Workshop on Context-aware
Recommender Systems, ACM RecSys, 2010
This is the only work related to context recommendation,
where the authors tried to provide suggestions of
appropriate contexts to listen to music tracks.
Pros: they proposed three KNN-based classifiers to
suggest appropriate contexts;
Cons: they proposed a specific application, but not a
general delineation of the problem of context
recommendations.
Contributions: Context Recommender
• We formally provide the definition of CR
• We propose the formal framework of CR applications
• We discuss the algorithmic paradigms for CR
• We examine the algorithms using multi-label classifications
Context Recommender
1. Definitions
Context recommenders are the systems being able to
recommend or suggest appropriate contexts for users to
select or consume items.
Examples:
When is the best season to travel to Poland for user Tom?
Who is the suggested companion to see “Titanic” with Tom?
This book is better to be gifted to Mom or Kids?
2. Research Problems
How to infer the appropriate contexts?
And those contexts should be personalized or not?
Example:
The best season to Poland is always the same for all the
users, or it could be personalized for different specific
users? E.g. Tom likes winter much more than summer,
where most users prefer summers in Poland.
Context Recommender
3. Context Recommendations App
• There could be many other types, for example, it could
be a group of users or items, instead of a single user or
item. E.g. what is the best season to Poland by this
group of travelers (e.g. Tour Group, etc), where the
suggested contexts should meet the requirement of the
group of users, instead of a single user.
• In this paper, we focus on the general form:
{User, Item}  Contexts; a pair of <user, item> as input
Input Output App
{User, Item} Contexts The best season to Poland for Tom
{User} Contexts The best travel season for Tom
{Item} Contexts The best travel season to Poland
Context Recommender
3. Algorithmic Paradigms
What are the possible algorithms to recommend contexts?
After analysis, we propose two series of frameworks:
1). Direct Context Prediction
We infer suggested contexts by <user, item, preferences>;
In other words, contexts are predicted based on users’
previous preference histories associated with <item,
contexts>
2). Indirect Context Recommendation
We reuse the context-aware recommendation algorithms:
In CARS,
Therefore, we vary the choices of contexts, and finally
recommend the contexts which can contribute to the best
ratings user will give to the item.
Context Recommender
3. Algorithmic Paradigms
Which algorithms can be applied in each category?
1). Direct Context Prediction
Classification algorithms are the popular ones which are
applied to this category, where they have been adopted in
context predictions in the pervasive computing area.
2). Indirect Context Recommendation
We reuse the context-aware recommendation algorithms;
Therefore, all available CARS algorithms can be applied to.
However, the drawback of this category is the high
computational cost if there are too many contextual
conditions in the data. And it also relies on how the CARS
algorithms perform.
In this paper, we focus on Direct Context Prediction using
multi-label classification algorithms.
Context Recommender
4. Why Multi-label Classifications (MLC)?
1).Binary Classification (is this an apple?)
2).Multi-class Classification (is it an apple|orange|pear?)
3).Multi-label Classification (<round, apple, fruit, Mac>)
In other words, MLC allows the system to
select more than 1 labels from the set.
Classification is used for context predictions;
and MLC just fits the requirement of context
recommendation task.
Context Recommender
4. Why Multi-label Classifications (MLC)?
Two series of MLC algorithms:
1). Transformation Algorithms
They can use traditional classification algorithms (e.g.
decision trees, SVM, etc), and they transform the MLC task
to multiple binary or multi-class classification tasks. So they
do not need to develop new algorithms.
E.g., binary relevance (BR), label powerset (LP), classifier
chains (CC), k-labelsets (RAkEL)
2). Adaptation Algorithms
Develop new classification algorithms to adapt to the MLC
task. E.g., Binary relevance KNN (BRKNN), Multi-label KNN
(MLKNN)
Context Recommender
5. Experiments and Evaluations (Algorithms)
Toolkit: Mulan (MLC toolkit) and Weka Java-based library
MLC algorithms: BR, LP, CC, RAkEL, MLKNN, BRKNN;
Classification methods used in BR, LP, CC and RAkEL:
KNNclassifier (KNN), decision trees (J48), naive bayes
(NB),Bayesian nets (BN) and support vector machine (SMO)
Baseline algorithms:
1).the three KNN classifiers: RatingBased (RB),
BestContextVectorBased (BCVB) and BestContextBased
(BCB) proposed by L. Baltrunas, et al
2).Non-personalized methods: such as most popular algs
Data # of users # of items # of ratings # of labels Rating scale
AdomMovie 69 176 1,010 8 1-13
LDOS 113 1186 2,094 17 1-5
TripAdvisor 2731 2269 14,175 5 1-5
Context Recommender
5. Experiments and Evaluations (Metrics)
Inputs: User, Item, Binary Preference (Good or Bad)
Outputs: A list of predicted contexts
Time =
Weekend
Time =
Weekday
Companion
= Kids
Companion
= Parents
Companion
= Girlfriend
Real 0 1 0 0 1
Prediction 1 0 0 0 1
Y is the set of TRUE labels in the ground truth, and Z is
the set of predicted TRUE labels. m = # of examples.
Another metric is hamming loss which measures the
average percentage of incorrectly predicted labels.
Context Recommender
6. Experimental Results
Due to limited time, we only present results on LDOS data.
Context Recommender
5. Experimental Results (findings)
1).Personalization is required, because personalized
algorithms work much better than the non-personalized
ones. i.e., simply recommending most popular ones (e.g.
most popular season people visiting Poland) is not enough;
2).LP algorithm using SMO as classifier is the best MLC
algorithms among all data sets and all methods examined.
They beat all the other algorithms. KNN-based approaches
worked bad, because context-aware data are usually sparse.
3).SMO is the best classifier used for MLC algorithms, but it
increases computation costs if data is large and there are
many contextual labels. The alternative choice is Bayesian
Nets which worked good and not time-consuming
4). About running performance: LP using SMO is the best
choice, but both LP and SMO increase computation costs if
data is large and there are many contextual labels.
Solutions:
a). Reduce the number of labels by pre-selections;
b). Choose LP using Bayesian Nets
Conclusions and Future Work
• We formally introduce and discuss the application and
research problem of context recommendations (CR). We
believe that context recommenders will provide many more
novel applications and new recommendation opportunities
for both practical use and the research community.
• We propose the formal framework of CR applications and
discuss the algorithmic paradigms for CR.
• We examine the algorithms using multi-label classifications,
and infer some significant findings and patterns as
introduced previously.
• Future work: Examine more other algorithms, and develop
new evaluation metrics for this domain.
References
• Context Recommendations
[1].Baltrunas, Linas, Marius Kaminskas, Francesco Ricci, Lior
Rokach, Bracha Shapira, and Karl-Heinz Luke. "Best usage
context prediction for music tracks." In Proceedings of the 2nd
Workshop on Context Aware Recommender Systems. 2010.
[2].Yong Zheng, Bamshad Mobasher, Robin Burke. "Context
Recommendation Using Multi-label Classification". In Proceedings
of the 13th IEEE/WIC/ACM International Conference on Web
Intelligence, 2014
• Multi-label Classifications
[1].Tsoumakas, Grigorios, and Ioannis Katakis. "Multi-label
classification: An overview." International Journal of Data
Warehousing and Mining (IJDWM) 3, no. 3 (2007): 1-13.
[2].Tsoumakas, Grigorios, Ioannis Katakis, and Ioannis Vlahavas.
"Mining multi-label data." In Data mining and knowledge
discovery handbook, pp. 667-685. Springer US, 2010.
Thanks!
Yong Zheng, Bamshad Mobasher, Robin Burke
Center for Web Intelligence, DePaul University, Chicago
IEEE/WIC/ACM Conference on Web Intelligence
Aug 14, Warsaw, Poland
[WI 2014]Context Recommendation Using Multi-label Classification
Ad

Recommended

[SOCRS2013]Differential Context Modeling in Collaborative Filtering
[SOCRS2013]Differential Context Modeling in Collaborative Filtering
YONG ZHENG
 
[CIKM 2014] Deviation-Based Contextual SLIM Recommenders
[CIKM 2014] Deviation-Based Contextual SLIM Recommenders
YONG ZHENG
 
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
YONG ZHENG
 
[UMAP2013] Recommendation with Differential Context Weighting
[UMAP2013] Recommendation with Differential Context Weighting
YONG ZHENG
 
[CARS2012@RecSys]Optimal Feature Selection for Context-Aware Recommendation u...
[CARS2012@RecSys]Optimal Feature Selection for Context-Aware Recommendation u...
YONG ZHENG
 
[SAC2014]Splitting Approaches for Context-Aware Recommendation: An Empirical ...
[SAC2014]Splitting Approaches for Context-Aware Recommendation: An Empirical ...
YONG ZHENG
 
[SAC 2015] Improve General Contextual SLIM Recommendation Algorithms By Facto...
[SAC 2015] Improve General Contextual SLIM Recommendation Algorithms By Facto...
YONG ZHENG
 
[WISE 2015] Similarity-Based Context-aware Recommendation
[WISE 2015] Similarity-Based Context-aware Recommendation
YONG ZHENG
 
Download
Download
butest
 
Recommender Systems: Advances in Collaborative Filtering
Recommender Systems: Advances in Collaborative Filtering
Changsung Moon
 
Matrix Factorization Techniques For Recommender Systems
Matrix Factorization Techniques For Recommender Systems
Lei Guo
 
Machine learning Algorithms with a Sagemaker demo
Machine learning Algorithms with a Sagemaker demo
Hridyesh Bisht
 
Matrix Factorization Technique for Recommender Systems
Matrix Factorization Technique for Recommender Systems
Aladejubelo Oluwashina
 
Algorithms Design Patterns
Algorithms Design Patterns
Ashwin Shiv
 
Evolving Reinforcement Learning Algorithms, JD. Co-Reyes et al, 2021
Evolving Reinforcement Learning Algorithms, JD. Co-Reyes et al, 2021
Chris Ohk
 
(Gaurav sawant &amp; dhaval sawlani)bia 678 final project report
(Gaurav sawant &amp; dhaval sawlani)bia 678 final project report
Gaurav Sawant
 
Recommendation and Information Retrieval: Two Sides of the Same Coin?
Recommendation and Information Retrieval: Two Sides of the Same Coin?
Arjen de Vries
 
AI: AI & Problem Solving
AI: AI & Problem Solving
DataminingTools Inc
 
Latent factor models for Collaborative Filtering
Latent factor models for Collaborative Filtering
sscdotopen
 
Item Based Collaborative Filtering Recommendation Algorithms
Item Based Collaborative Filtering Recommendation Algorithms
nextlib
 
Collaborative Filtering at Spotify
Collaborative Filtering at Spotify
Erik Bernhardsson
 
Deep reinforcement learning from scratch
Deep reinforcement learning from scratch
Jie-Han Chen
 
Cs583 recommender-systems
Cs583 recommender-systems
Aravindharamanan S
 
A Multiscale Visualization of Attention in the Transformer Model
A Multiscale Visualization of Attention in the Transformer Model
taeseon ryu
 
Using Interactive Genetic Algorithm for Requirements Prioritization
Using Interactive Genetic Algorithm for Requirements Prioritization
Francis Palma
 
Evaluation of subjective answers using glsa enhanced with contextual synonymy
Evaluation of subjective answers using glsa enhanced with contextual synonymy
ijnlc
 
Abstractive Text Summarization
Abstractive Text Summarization
Tho Phan
 
Abigail See - 2017 - Get To The Point: Summarization with Pointer-Generator N...
Abigail See - 2017 - Get To The Point: Summarization with Pointer-Generator N...
Association for Computational Linguistics
 
Recommender system algorithm and architecture
Recommender system algorithm and architecture
Liang Xiang
 
Tutorial: Context-awareness In Information Retrieval and Recommender Systems
Tutorial: Context-awareness In Information Retrieval and Recommender Systems
YONG ZHENG
 

More Related Content

What's hot (20)

Download
Download
butest
 
Recommender Systems: Advances in Collaborative Filtering
Recommender Systems: Advances in Collaborative Filtering
Changsung Moon
 
Matrix Factorization Techniques For Recommender Systems
Matrix Factorization Techniques For Recommender Systems
Lei Guo
 
Machine learning Algorithms with a Sagemaker demo
Machine learning Algorithms with a Sagemaker demo
Hridyesh Bisht
 
Matrix Factorization Technique for Recommender Systems
Matrix Factorization Technique for Recommender Systems
Aladejubelo Oluwashina
 
Algorithms Design Patterns
Algorithms Design Patterns
Ashwin Shiv
 
Evolving Reinforcement Learning Algorithms, JD. Co-Reyes et al, 2021
Evolving Reinforcement Learning Algorithms, JD. Co-Reyes et al, 2021
Chris Ohk
 
(Gaurav sawant &amp; dhaval sawlani)bia 678 final project report
(Gaurav sawant &amp; dhaval sawlani)bia 678 final project report
Gaurav Sawant
 
Recommendation and Information Retrieval: Two Sides of the Same Coin?
Recommendation and Information Retrieval: Two Sides of the Same Coin?
Arjen de Vries
 
AI: AI & Problem Solving
AI: AI & Problem Solving
DataminingTools Inc
 
Latent factor models for Collaborative Filtering
Latent factor models for Collaborative Filtering
sscdotopen
 
Item Based Collaborative Filtering Recommendation Algorithms
Item Based Collaborative Filtering Recommendation Algorithms
nextlib
 
Collaborative Filtering at Spotify
Collaborative Filtering at Spotify
Erik Bernhardsson
 
Deep reinforcement learning from scratch
Deep reinforcement learning from scratch
Jie-Han Chen
 
Cs583 recommender-systems
Cs583 recommender-systems
Aravindharamanan S
 
A Multiscale Visualization of Attention in the Transformer Model
A Multiscale Visualization of Attention in the Transformer Model
taeseon ryu
 
Using Interactive Genetic Algorithm for Requirements Prioritization
Using Interactive Genetic Algorithm for Requirements Prioritization
Francis Palma
 
Evaluation of subjective answers using glsa enhanced with contextual synonymy
Evaluation of subjective answers using glsa enhanced with contextual synonymy
ijnlc
 
Abstractive Text Summarization
Abstractive Text Summarization
Tho Phan
 
Abigail See - 2017 - Get To The Point: Summarization with Pointer-Generator N...
Abigail See - 2017 - Get To The Point: Summarization with Pointer-Generator N...
Association for Computational Linguistics
 
Download
Download
butest
 
Recommender Systems: Advances in Collaborative Filtering
Recommender Systems: Advances in Collaborative Filtering
Changsung Moon
 
Matrix Factorization Techniques For Recommender Systems
Matrix Factorization Techniques For Recommender Systems
Lei Guo
 
Machine learning Algorithms with a Sagemaker demo
Machine learning Algorithms with a Sagemaker demo
Hridyesh Bisht
 
Matrix Factorization Technique for Recommender Systems
Matrix Factorization Technique for Recommender Systems
Aladejubelo Oluwashina
 
Algorithms Design Patterns
Algorithms Design Patterns
Ashwin Shiv
 
Evolving Reinforcement Learning Algorithms, JD. Co-Reyes et al, 2021
Evolving Reinforcement Learning Algorithms, JD. Co-Reyes et al, 2021
Chris Ohk
 
(Gaurav sawant &amp; dhaval sawlani)bia 678 final project report
(Gaurav sawant &amp; dhaval sawlani)bia 678 final project report
Gaurav Sawant
 
Recommendation and Information Retrieval: Two Sides of the Same Coin?
Recommendation and Information Retrieval: Two Sides of the Same Coin?
Arjen de Vries
 
Latent factor models for Collaborative Filtering
Latent factor models for Collaborative Filtering
sscdotopen
 
Item Based Collaborative Filtering Recommendation Algorithms
Item Based Collaborative Filtering Recommendation Algorithms
nextlib
 
Collaborative Filtering at Spotify
Collaborative Filtering at Spotify
Erik Bernhardsson
 
Deep reinforcement learning from scratch
Deep reinforcement learning from scratch
Jie-Han Chen
 
A Multiscale Visualization of Attention in the Transformer Model
A Multiscale Visualization of Attention in the Transformer Model
taeseon ryu
 
Using Interactive Genetic Algorithm for Requirements Prioritization
Using Interactive Genetic Algorithm for Requirements Prioritization
Francis Palma
 
Evaluation of subjective answers using glsa enhanced with contextual synonymy
Evaluation of subjective answers using glsa enhanced with contextual synonymy
ijnlc
 
Abstractive Text Summarization
Abstractive Text Summarization
Tho Phan
 
Abigail See - 2017 - Get To The Point: Summarization with Pointer-Generator N...
Abigail See - 2017 - Get To The Point: Summarization with Pointer-Generator N...
Association for Computational Linguistics
 

Viewers also liked (20)

Recommender system algorithm and architecture
Recommender system algorithm and architecture
Liang Xiang
 
Tutorial: Context-awareness In Information Retrieval and Recommender Systems
Tutorial: Context-awareness In Information Retrieval and Recommender Systems
YONG ZHENG
 
genetic algorithm based music recommender system
genetic algorithm based music recommender system
neha pevekar
 
Matrix Factorization In Recommender Systems
Matrix Factorization In Recommender Systems
YONG ZHENG
 
Recommender system introduction
Recommender system introduction
Liang Xiang
 
Building a Recommendation Engine - An example of a product recommendation engine
Building a Recommendation Engine - An example of a product recommendation engine
NYC Predictive Analytics
 
Branch And Bound and Beam Search Feature Selection Algorithms
Branch And Bound and Beam Search Feature Selection Algorithms
Chamin Nalinda Loku Gam Hewage
 
Amazon Item-to-Item Recommendations
Amazon Item-to-Item Recommendations
Roger Chen
 
Recommender Systems (Machine Learning Summer School 2014 @ CMU)
Recommender Systems (Machine Learning Summer School 2014 @ CMU)
Xavier Amatriain
 
Developing Digital Literacy: 5 Ps for online learning
Developing Digital Literacy: 5 Ps for online learning
Rhona Sharpe
 
Solving the AL Chicken-and-Egg Corpus and Model Problem
Solving the AL Chicken-and-Egg Corpus and Model Problem
Dain Kaplan
 
Recommender.system.presentation.pjug.01.21.2014
Recommender.system.presentation.pjug.01.21.2014
rpbrehm
 
Multi Criteria Recommender Systems - Overview
Multi Criteria Recommender Systems - Overview
Davide Giannico
 
Your own recommendation engine with neo4j and reco4php - DPC16
Your own recommendation engine with neo4j and reco4php - DPC16
Christophe Willemsen
 
Summary of a Recommender Systems Survey paper
Summary of a Recommender Systems Survey paper
Changsung Moon
 
Profile injection attack detection in recommender system
Profile injection attack detection in recommender system
ASHISH PANNU
 
Recommendation Engine Project Presentation
Recommendation Engine Project Presentation
19Divya
 
Recommender Systems and Active Learning
Recommender Systems and Active Learning
Dain Kaplan
 
Online recommendations at scale using matrix factorisation
Online recommendations at scale using matrix factorisation
Marcus Ljungblad
 
Requirements for Processing Datasets for Recommender Systems
Requirements for Processing Datasets for Recommender Systems
Stoitsis Giannis
 
Recommender system algorithm and architecture
Recommender system algorithm and architecture
Liang Xiang
 
Tutorial: Context-awareness In Information Retrieval and Recommender Systems
Tutorial: Context-awareness In Information Retrieval and Recommender Systems
YONG ZHENG
 
genetic algorithm based music recommender system
genetic algorithm based music recommender system
neha pevekar
 
Matrix Factorization In Recommender Systems
Matrix Factorization In Recommender Systems
YONG ZHENG
 
Recommender system introduction
Recommender system introduction
Liang Xiang
 
Building a Recommendation Engine - An example of a product recommendation engine
Building a Recommendation Engine - An example of a product recommendation engine
NYC Predictive Analytics
 
Branch And Bound and Beam Search Feature Selection Algorithms
Branch And Bound and Beam Search Feature Selection Algorithms
Chamin Nalinda Loku Gam Hewage
 
Amazon Item-to-Item Recommendations
Amazon Item-to-Item Recommendations
Roger Chen
 
Recommender Systems (Machine Learning Summer School 2014 @ CMU)
Recommender Systems (Machine Learning Summer School 2014 @ CMU)
Xavier Amatriain
 
Developing Digital Literacy: 5 Ps for online learning
Developing Digital Literacy: 5 Ps for online learning
Rhona Sharpe
 
Solving the AL Chicken-and-Egg Corpus and Model Problem
Solving the AL Chicken-and-Egg Corpus and Model Problem
Dain Kaplan
 
Recommender.system.presentation.pjug.01.21.2014
Recommender.system.presentation.pjug.01.21.2014
rpbrehm
 
Multi Criteria Recommender Systems - Overview
Multi Criteria Recommender Systems - Overview
Davide Giannico
 
Your own recommendation engine with neo4j and reco4php - DPC16
Your own recommendation engine with neo4j and reco4php - DPC16
Christophe Willemsen
 
Summary of a Recommender Systems Survey paper
Summary of a Recommender Systems Survey paper
Changsung Moon
 
Profile injection attack detection in recommender system
Profile injection attack detection in recommender system
ASHISH PANNU
 
Recommendation Engine Project Presentation
Recommendation Engine Project Presentation
19Divya
 
Recommender Systems and Active Learning
Recommender Systems and Active Learning
Dain Kaplan
 
Online recommendations at scale using matrix factorisation
Online recommendations at scale using matrix factorisation
Marcus Ljungblad
 
Requirements for Processing Datasets for Recommender Systems
Requirements for Processing Datasets for Recommender Systems
Stoitsis Giannis
 
Ad

Similar to [WI 2014]Context Recommendation Using Multi-label Classification (20)

Recommenders Systems
Recommenders Systems
Tariq Hassan
 
Overview of recommender system
Overview of recommender system
Stanley Wang
 
PhD defense
PhD defense
Giuseppe Ricci
 
Filtering content bbased crs
Filtering content bbased crs
Aravindharamanan S
 
[AFEL] Neighborhood Troubles: On the Value of User Pre-Filtering To Speed Up ...
[AFEL] Neighborhood Troubles: On the Value of User Pre-Filtering To Speed Up ...
Emanuel Lacić
 
Recommender systems
Recommender systems
Tamer Rezk
 
Tag based recommender system
Tag based recommender system
Karen Li
 
Effective Cross-Domain Collaborative Filtering using Temporal Domain – A Brie...
Effective Cross-Domain Collaborative Filtering using Temporal Domain – A Brie...
IJMTST Journal
 
Sergey Nikolenko and Anton Alekseev User Profiling in Text-Based Recommende...
Sergey Nikolenko and Anton Alekseev User Profiling in Text-Based Recommende...
AIST
 
Mining Large Streams of User Data for PersonalizedRecommenda.docx
Mining Large Streams of User Data for PersonalizedRecommenda.docx
ARIV4
 
factorization methods
factorization methods
Shaina Raza
 
An Example of Predictive Analytics: Building a Recommendation Engine Using Py...
An Example of Predictive Analytics: Building a Recommendation Engine Using Py...
PyData
 
The Network Research Project (NRP) expectations are to explain.docx
The Network Research Project (NRP) expectations are to explain.docx
dennisa15
 
[UMAP 2016] User-Oriented Context Suggestion
[UMAP 2016] User-Oriented Context Suggestion
YONG ZHENG
 
Notes on Recommender Systems pdf 2nd module
Notes on Recommender Systems pdf 2nd module
PRABHAKARK24
 
[Decisions2013@RecSys]The Role of Emotions in Context-aware Recommendation
[Decisions2013@RecSys]The Role of Emotions in Context-aware Recommendation
YONG ZHENG
 
Towards a Quality Assessment of Web Corpora for Language Technology Applications
Towards a Quality Assessment of Web Corpora for Language Technology Applications
Marina Santini
 
Advances In Collaborative Filtering
Advances In Collaborative Filtering
Scott Donald
 
SEppt
SEppt
Hemankita Perabathini
 
Recommenders.ppt
Recommenders.ppt
NagendraBabu27244
 
Recommenders Systems
Recommenders Systems
Tariq Hassan
 
Overview of recommender system
Overview of recommender system
Stanley Wang
 
[AFEL] Neighborhood Troubles: On the Value of User Pre-Filtering To Speed Up ...
[AFEL] Neighborhood Troubles: On the Value of User Pre-Filtering To Speed Up ...
Emanuel Lacić
 
Recommender systems
Recommender systems
Tamer Rezk
 
Tag based recommender system
Tag based recommender system
Karen Li
 
Effective Cross-Domain Collaborative Filtering using Temporal Domain – A Brie...
Effective Cross-Domain Collaborative Filtering using Temporal Domain – A Brie...
IJMTST Journal
 
Sergey Nikolenko and Anton Alekseev User Profiling in Text-Based Recommende...
Sergey Nikolenko and Anton Alekseev User Profiling in Text-Based Recommende...
AIST
 
Mining Large Streams of User Data for PersonalizedRecommenda.docx
Mining Large Streams of User Data for PersonalizedRecommenda.docx
ARIV4
 
factorization methods
factorization methods
Shaina Raza
 
An Example of Predictive Analytics: Building a Recommendation Engine Using Py...
An Example of Predictive Analytics: Building a Recommendation Engine Using Py...
PyData
 
The Network Research Project (NRP) expectations are to explain.docx
The Network Research Project (NRP) expectations are to explain.docx
dennisa15
 
[UMAP 2016] User-Oriented Context Suggestion
[UMAP 2016] User-Oriented Context Suggestion
YONG ZHENG
 
Notes on Recommender Systems pdf 2nd module
Notes on Recommender Systems pdf 2nd module
PRABHAKARK24
 
[Decisions2013@RecSys]The Role of Emotions in Context-aware Recommendation
[Decisions2013@RecSys]The Role of Emotions in Context-aware Recommendation
YONG ZHENG
 
Towards a Quality Assessment of Web Corpora for Language Technology Applications
Towards a Quality Assessment of Web Corpora for Language Technology Applications
Marina Santini
 
Advances In Collaborative Filtering
Advances In Collaborative Filtering
Scott Donald
 
Ad

More from YONG ZHENG (16)

[ADMA 2017] Identification of Grey Sheep Users By Histogram Intersection In R...
[ADMA 2017] Identification of Grey Sheep Users By Histogram Intersection In R...
YONG ZHENG
 
[RIIT 2017] Identifying Grey Sheep Users By The Distribution of User Similari...
[RIIT 2017] Identifying Grey Sheep Users By The Distribution of User Similari...
YONG ZHENG
 
[WI 2017] Context Suggestion: Empirical Evaluations vs User Studies
[WI 2017] Context Suggestion: Empirical Evaluations vs User Studies
YONG ZHENG
 
[WI 2017] Affective Prediction By Collaborative Chains In Movie Recommendation
[WI 2017] Affective Prediction By Collaborative Chains In Movie Recommendation
YONG ZHENG
 
[IUI 2017] Criteria Chains: A Novel Multi-Criteria Recommendation Approach
[IUI 2017] Criteria Chains: A Novel Multi-Criteria Recommendation Approach
YONG ZHENG
 
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
YONG ZHENG
 
Tutorial: Context In Recommender Systems
Tutorial: Context In Recommender Systems
YONG ZHENG
 
Context-aware Recommendation: A Quick View
Context-aware Recommendation: A Quick View
YONG ZHENG
 
[UMAP 2015] Integrating Context Similarity with Sparse Linear Recommendation ...
[UMAP 2015] Integrating Context Similarity with Sparse Linear Recommendation ...
YONG ZHENG
 
[IUI2015] A Revisit to The Identification of Contexts in Recommender Systems
[IUI2015] A Revisit to The Identification of Contexts in Recommender Systems
YONG ZHENG
 
[RecSys 2014] Deviation-Based and Similarity-Based Contextual SLIM Recommenda...
[RecSys 2014] Deviation-Based and Similarity-Based Contextual SLIM Recommenda...
YONG ZHENG
 
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
YONG ZHENG
 
Slope one recommender on hadoop
Slope one recommender on hadoop
YONG ZHENG
 
A manual for Ph.D dissertation
A manual for Ph.D dissertation
YONG ZHENG
 
Attention flow by tagging prediction
Attention flow by tagging prediction
YONG ZHENG
 
[HetRec2011@RecSys]Experience Discovery: Hybrid Recommendation of Student Act...
[HetRec2011@RecSys]Experience Discovery: Hybrid Recommendation of Student Act...
YONG ZHENG
 
[ADMA 2017] Identification of Grey Sheep Users By Histogram Intersection In R...
[ADMA 2017] Identification of Grey Sheep Users By Histogram Intersection In R...
YONG ZHENG
 
[RIIT 2017] Identifying Grey Sheep Users By The Distribution of User Similari...
[RIIT 2017] Identifying Grey Sheep Users By The Distribution of User Similari...
YONG ZHENG
 
[WI 2017] Context Suggestion: Empirical Evaluations vs User Studies
[WI 2017] Context Suggestion: Empirical Evaluations vs User Studies
YONG ZHENG
 
[WI 2017] Affective Prediction By Collaborative Chains In Movie Recommendation
[WI 2017] Affective Prediction By Collaborative Chains In Movie Recommendation
YONG ZHENG
 
[IUI 2017] Criteria Chains: A Novel Multi-Criteria Recommendation Approach
[IUI 2017] Criteria Chains: A Novel Multi-Criteria Recommendation Approach
YONG ZHENG
 
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
[EMPIRE 2016] Adapt to Emotional Reactions In Context-aware Personalization
YONG ZHENG
 
Tutorial: Context In Recommender Systems
Tutorial: Context In Recommender Systems
YONG ZHENG
 
Context-aware Recommendation: A Quick View
Context-aware Recommendation: A Quick View
YONG ZHENG
 
[UMAP 2015] Integrating Context Similarity with Sparse Linear Recommendation ...
[UMAP 2015] Integrating Context Similarity with Sparse Linear Recommendation ...
YONG ZHENG
 
[IUI2015] A Revisit to The Identification of Contexts in Recommender Systems
[IUI2015] A Revisit to The Identification of Contexts in Recommender Systems
YONG ZHENG
 
[RecSys 2014] Deviation-Based and Similarity-Based Contextual SLIM Recommenda...
[RecSys 2014] Deviation-Based and Similarity-Based Contextual SLIM Recommenda...
YONG ZHENG
 
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
YONG ZHENG
 
Slope one recommender on hadoop
Slope one recommender on hadoop
YONG ZHENG
 
A manual for Ph.D dissertation
A manual for Ph.D dissertation
YONG ZHENG
 
Attention flow by tagging prediction
Attention flow by tagging prediction
YONG ZHENG
 
[HetRec2011@RecSys]Experience Discovery: Hybrid Recommendation of Student Act...
[HetRec2011@RecSys]Experience Discovery: Hybrid Recommendation of Student Act...
YONG ZHENG
 

Recently uploaded (20)

IPL_Logic_Flow.pdf Mainframe IPLMainframe IPL
IPL_Logic_Flow.pdf Mainframe IPLMainframe IPL
KhadijaKhadijaAouadi
 
Industrial internet of things IOT Week-3.pptx
Industrial internet of things IOT Week-3.pptx
KNaveenKumarECE
 
Modern multi-proposer consensus implementations
Modern multi-proposer consensus implementations
François Garillot
 
ElysiumPro Company Profile 2025-2026.pdf
ElysiumPro Company Profile 2025-2026.pdf
info751436
 
Machine Learning - Classification Algorithms
Machine Learning - Classification Algorithms
resming1
 
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...
resming1
 
Learning – Types of Machine Learning – Supervised Learning – Unsupervised UNI...
Learning – Types of Machine Learning – Supervised Learning – Unsupervised UNI...
23Q95A6706
 
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptx
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptx
moonsony54
 
362 Alec Data Center Solutions-Slysium Data Center-AUH-Adaptaflex.pdf
362 Alec Data Center Solutions-Slysium Data Center-AUH-Adaptaflex.pdf
djiceramil
 
How to Un-Obsolete Your Legacy Keypad Design
How to Un-Obsolete Your Legacy Keypad Design
Epec Engineered Technologies
 
System design handwritten notes guidance
System design handwritten notes guidance
Shabista Imam
 
May 2025: Top 10 Read Articles in Data Mining & Knowledge Management Process
May 2025: Top 10 Read Articles in Data Mining & Knowledge Management Process
IJDKP
 
Solar thermal – Flat plate and concentrating collectors .pptx
Solar thermal – Flat plate and concentrating collectors .pptx
jdaniabraham1
 
Fundamentals of Digital Design_Class_12th April.pptx
Fundamentals of Digital Design_Class_12th April.pptx
drdebarshi1993
 
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptx
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptx
resming1
 
Decoding Kotlin - Your Guide to Solving the Mysterious in Kotlin - Devoxx PL ...
Decoding Kotlin - Your Guide to Solving the Mysterious in Kotlin - Devoxx PL ...
João Esperancinha
 
AI_Presentation (1). Artificial intelligence
AI_Presentation (1). Artificial intelligence
RoselynKaur8thD34
 
machine learning is a advance technology
machine learning is a advance technology
ynancy893
 
20CE404-Soil Mechanics - Slide Share PPT
20CE404-Soil Mechanics - Slide Share PPT
saravananr808639
 
Mechanical Vibration_MIC 202_iit roorkee.pdf
Mechanical Vibration_MIC 202_iit roorkee.pdf
isahiliitr
 
IPL_Logic_Flow.pdf Mainframe IPLMainframe IPL
IPL_Logic_Flow.pdf Mainframe IPLMainframe IPL
KhadijaKhadijaAouadi
 
Industrial internet of things IOT Week-3.pptx
Industrial internet of things IOT Week-3.pptx
KNaveenKumarECE
 
Modern multi-proposer consensus implementations
Modern multi-proposer consensus implementations
François Garillot
 
ElysiumPro Company Profile 2025-2026.pdf
ElysiumPro Company Profile 2025-2026.pdf
info751436
 
Machine Learning - Classification Algorithms
Machine Learning - Classification Algorithms
resming1
 
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...
resming1
 
Learning – Types of Machine Learning – Supervised Learning – Unsupervised UNI...
Learning – Types of Machine Learning – Supervised Learning – Unsupervised UNI...
23Q95A6706
 
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptx
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptx
moonsony54
 
362 Alec Data Center Solutions-Slysium Data Center-AUH-Adaptaflex.pdf
362 Alec Data Center Solutions-Slysium Data Center-AUH-Adaptaflex.pdf
djiceramil
 
System design handwritten notes guidance
System design handwritten notes guidance
Shabista Imam
 
May 2025: Top 10 Read Articles in Data Mining & Knowledge Management Process
May 2025: Top 10 Read Articles in Data Mining & Knowledge Management Process
IJDKP
 
Solar thermal – Flat plate and concentrating collectors .pptx
Solar thermal – Flat plate and concentrating collectors .pptx
jdaniabraham1
 
Fundamentals of Digital Design_Class_12th April.pptx
Fundamentals of Digital Design_Class_12th April.pptx
drdebarshi1993
 
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptx
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptx
resming1
 
Decoding Kotlin - Your Guide to Solving the Mysterious in Kotlin - Devoxx PL ...
Decoding Kotlin - Your Guide to Solving the Mysterious in Kotlin - Devoxx PL ...
João Esperancinha
 
AI_Presentation (1). Artificial intelligence
AI_Presentation (1). Artificial intelligence
RoselynKaur8thD34
 
machine learning is a advance technology
machine learning is a advance technology
ynancy893
 
20CE404-Soil Mechanics - Slide Share PPT
20CE404-Soil Mechanics - Slide Share PPT
saravananr808639
 
Mechanical Vibration_MIC 202_iit roorkee.pdf
Mechanical Vibration_MIC 202_iit roorkee.pdf
isahiliitr
 

[WI 2014]Context Recommendation Using Multi-label Classification

  • 1. Context Recommendation Using Multi-label Classification Yong Zheng, Bamshad Mobasher, Robin Burke Center for Web Intelligence, DePaul University, Chicago IEEE/WIC/ACM Conference on Web Intelligence Aug 14, Warsaw, Poland
  • 2. Intro – Recommender Systems • Information Overload Problem  IR and RS • Recommender systems (RS) are the systems being able to provide recommendations to the end users. Currently, RS are popular everywhere: • E-Commerce: Amazon, Ebay, Newegg, etc • Social networks: Twitter, Facebook, etc • Movie/Stream: Netflix, Movie Pilot, Youtube, etc • Music: Pandora, Last.FM, etc
  • 3. Intro – Type of Recommendations • [Item Recommendations] • [User Recommendations]
  • 4. Intro – Context-aware Recommender • Context-aware Recommender Systems (CARS) CARS is a new type of RS which provide recommendations by adapting to users’ contextual situations. • Traditional RS: Users × Items  Ratings • Contextual RS: Users × Items × Contexts Ratings • Assumptions behind: 1). User may have different preferences in different contexts; 2). Contexts are important in decision-makings. However, what CARS recommended are still items or users. Companion
  • 5. New Application: Context Recommender • In this paper, we propose a new application: context recommender (CR), which is able to recommend or suggest appropriate contexts for users to select or consume items. • Sample of contexts: time, location, companion, etc Context Rec User RecItem Rec
  • 6. Possible Examples (Amazon.com) Note: They are not REAL applications/examples right now.
  • 8. Related Work L. Baltrunas, et al. "Best usage context predictions for music tracks", The 2nd Workshop on Context-aware Recommender Systems, ACM RecSys, 2010 This is the only work related to context recommendation, where the authors tried to provide suggestions of appropriate contexts to listen to music tracks. Pros: they proposed three KNN-based classifiers to suggest appropriate contexts; Cons: they proposed a specific application, but not a general delineation of the problem of context recommendations.
  • 9. Contributions: Context Recommender • We formally provide the definition of CR • We propose the formal framework of CR applications • We discuss the algorithmic paradigms for CR • We examine the algorithms using multi-label classifications
  • 10. Context Recommender 1. Definitions Context recommenders are the systems being able to recommend or suggest appropriate contexts for users to select or consume items. Examples: When is the best season to travel to Poland for user Tom? Who is the suggested companion to see “Titanic” with Tom? This book is better to be gifted to Mom or Kids? 2. Research Problems How to infer the appropriate contexts? And those contexts should be personalized or not? Example: The best season to Poland is always the same for all the users, or it could be personalized for different specific users? E.g. Tom likes winter much more than summer, where most users prefer summers in Poland.
  • 11. Context Recommender 3. Context Recommendations App • There could be many other types, for example, it could be a group of users or items, instead of a single user or item. E.g. what is the best season to Poland by this group of travelers (e.g. Tour Group, etc), where the suggested contexts should meet the requirement of the group of users, instead of a single user. • In this paper, we focus on the general form: {User, Item}  Contexts; a pair of <user, item> as input Input Output App {User, Item} Contexts The best season to Poland for Tom {User} Contexts The best travel season for Tom {Item} Contexts The best travel season to Poland
  • 12. Context Recommender 3. Algorithmic Paradigms What are the possible algorithms to recommend contexts? After analysis, we propose two series of frameworks: 1). Direct Context Prediction We infer suggested contexts by <user, item, preferences>; In other words, contexts are predicted based on users’ previous preference histories associated with <item, contexts> 2). Indirect Context Recommendation We reuse the context-aware recommendation algorithms: In CARS, Therefore, we vary the choices of contexts, and finally recommend the contexts which can contribute to the best ratings user will give to the item.
  • 13. Context Recommender 3. Algorithmic Paradigms Which algorithms can be applied in each category? 1). Direct Context Prediction Classification algorithms are the popular ones which are applied to this category, where they have been adopted in context predictions in the pervasive computing area. 2). Indirect Context Recommendation We reuse the context-aware recommendation algorithms; Therefore, all available CARS algorithms can be applied to. However, the drawback of this category is the high computational cost if there are too many contextual conditions in the data. And it also relies on how the CARS algorithms perform. In this paper, we focus on Direct Context Prediction using multi-label classification algorithms.
  • 14. Context Recommender 4. Why Multi-label Classifications (MLC)? 1).Binary Classification (is this an apple?) 2).Multi-class Classification (is it an apple|orange|pear?) 3).Multi-label Classification (<round, apple, fruit, Mac>) In other words, MLC allows the system to select more than 1 labels from the set. Classification is used for context predictions; and MLC just fits the requirement of context recommendation task.
  • 15. Context Recommender 4. Why Multi-label Classifications (MLC)? Two series of MLC algorithms: 1). Transformation Algorithms They can use traditional classification algorithms (e.g. decision trees, SVM, etc), and they transform the MLC task to multiple binary or multi-class classification tasks. So they do not need to develop new algorithms. E.g., binary relevance (BR), label powerset (LP), classifier chains (CC), k-labelsets (RAkEL) 2). Adaptation Algorithms Develop new classification algorithms to adapt to the MLC task. E.g., Binary relevance KNN (BRKNN), Multi-label KNN (MLKNN)
  • 16. Context Recommender 5. Experiments and Evaluations (Algorithms) Toolkit: Mulan (MLC toolkit) and Weka Java-based library MLC algorithms: BR, LP, CC, RAkEL, MLKNN, BRKNN; Classification methods used in BR, LP, CC and RAkEL: KNNclassifier (KNN), decision trees (J48), naive bayes (NB),Bayesian nets (BN) and support vector machine (SMO) Baseline algorithms: 1).the three KNN classifiers: RatingBased (RB), BestContextVectorBased (BCVB) and BestContextBased (BCB) proposed by L. Baltrunas, et al 2).Non-personalized methods: such as most popular algs Data # of users # of items # of ratings # of labels Rating scale AdomMovie 69 176 1,010 8 1-13 LDOS 113 1186 2,094 17 1-5 TripAdvisor 2731 2269 14,175 5 1-5
  • 17. Context Recommender 5. Experiments and Evaluations (Metrics) Inputs: User, Item, Binary Preference (Good or Bad) Outputs: A list of predicted contexts Time = Weekend Time = Weekday Companion = Kids Companion = Parents Companion = Girlfriend Real 0 1 0 0 1 Prediction 1 0 0 0 1 Y is the set of TRUE labels in the ground truth, and Z is the set of predicted TRUE labels. m = # of examples. Another metric is hamming loss which measures the average percentage of incorrectly predicted labels.
  • 18. Context Recommender 6. Experimental Results Due to limited time, we only present results on LDOS data.
  • 19. Context Recommender 5. Experimental Results (findings) 1).Personalization is required, because personalized algorithms work much better than the non-personalized ones. i.e., simply recommending most popular ones (e.g. most popular season people visiting Poland) is not enough; 2).LP algorithm using SMO as classifier is the best MLC algorithms among all data sets and all methods examined. They beat all the other algorithms. KNN-based approaches worked bad, because context-aware data are usually sparse. 3).SMO is the best classifier used for MLC algorithms, but it increases computation costs if data is large and there are many contextual labels. The alternative choice is Bayesian Nets which worked good and not time-consuming 4). About running performance: LP using SMO is the best choice, but both LP and SMO increase computation costs if data is large and there are many contextual labels. Solutions: a). Reduce the number of labels by pre-selections; b). Choose LP using Bayesian Nets
  • 20. Conclusions and Future Work • We formally introduce and discuss the application and research problem of context recommendations (CR). We believe that context recommenders will provide many more novel applications and new recommendation opportunities for both practical use and the research community. • We propose the formal framework of CR applications and discuss the algorithmic paradigms for CR. • We examine the algorithms using multi-label classifications, and infer some significant findings and patterns as introduced previously. • Future work: Examine more other algorithms, and develop new evaluation metrics for this domain.
  • 21. References • Context Recommendations [1].Baltrunas, Linas, Marius Kaminskas, Francesco Ricci, Lior Rokach, Bracha Shapira, and Karl-Heinz Luke. "Best usage context prediction for music tracks." In Proceedings of the 2nd Workshop on Context Aware Recommender Systems. 2010. [2].Yong Zheng, Bamshad Mobasher, Robin Burke. "Context Recommendation Using Multi-label Classification". In Proceedings of the 13th IEEE/WIC/ACM International Conference on Web Intelligence, 2014 • Multi-label Classifications [1].Tsoumakas, Grigorios, and Ioannis Katakis. "Multi-label classification: An overview." International Journal of Data Warehousing and Mining (IJDWM) 3, no. 3 (2007): 1-13. [2].Tsoumakas, Grigorios, Ioannis Katakis, and Ioannis Vlahavas. "Mining multi-label data." In Data mining and knowledge discovery handbook, pp. 667-685. Springer US, 2010.
  • 22. Thanks! Yong Zheng, Bamshad Mobasher, Robin Burke Center for Web Intelligence, DePaul University, Chicago IEEE/WIC/ACM Conference on Web Intelligence Aug 14, Warsaw, Poland