SlideShare a Scribd company logo
Utilizing additional information in
factorization methods
- Research overview -
- 11. April 2014 -
Balázs Hidasi
balazs@hidasi.eu
About me
• Datamining researcher at Gravity R&D
• PhD student at BME (BUTE)
• Research interests:
• Machine learning & Data mining
• Algorithm research and development
• Currently: recommender systems
• Previously: time series classification
Gravity R&D
• Recommender service provider, based in Hungary
• Founded by team Gravity after the Netflix Prize
• Started working there: January 2010
• Data analysis
• Algorithm development & implementation
• Research
Budapest University of Technology
and Economics
• Leading tech university in Hungary
• Faculty of Electrical Engineering and Informatics
• Computer science and engineering B.Sc./M.Sc.
• Ph.D. student since September 2011.
• Department of Telecommunications and Media
Informatics
• Data Science and Content Technologies Laboratory (DC
Lab)
RecSys research – aims & roots
• Aims: Developing novel algorithms that enable the usage
of additional information with factorization to improve
recommendation accuracy for implicit feedback based
recommendation tasks
• Roots:
• Implicit feedback
• Context
• Factorization
• In addition:
• ALS learning
• Recall based evaluation
Implicit feedback
• Transactions provide no explicit user preference
• View, buy, etc.
• Presence of an event  noisy positive feedback
• Absence of an event  ?
• Negative feedback is not available
Context
•
Factorization
•
ALS based learning
•
Recall based evaluation
• Recall: number of relevant and recommended items in
proportion to the number of relevant items
• @N: only topN items are considered
• Nowadays less common in RecSys
• MAP, NDCG
• Practical point of view
• Rank does not matter as long as the item is shown
• TopN list presented in chunks
• TopN list should contain the relevant items
• For many practical scenarios; there are exceptions
RecSys research – overview
• Injecting additional info into MF (through initialization)
• Context-aware methods: iTALS, iTALSx
• Scalability improvement: CD/CG learning
• General factorization framework
• Modeling context
• Pairwise ranking loss with ALS
Context-aware methods
•
Approximate ALS learning
(CG/CD)
•
CD learning
•
CG learning
•
LS/CD/CG comparison
• Little to none degradation in recall
• Training time: CG < CD < LS
• CD is unstable with models using members of higher order
0.00
100.00
200.00
300.00
400.00
500.00
600.00
700.00
800.00
900.00
1000.00
5
10
15
20
25
30
35
40
45
50
55
60
65
70
75
80
85
90
95
100
Runningtime(s)
Number of features (K)
iTALS iTALS-CG (N_I = 2) iTALS-CD (N_I = 2)
General factorization
framework
• Goal: fully flexible framework that allows
experimentation with arbitrary linear factorization
models
• State-of-the-art methods use fixed models/model-
classes
• Designed for implicit but supports explicit feedback as
well
• wRMSE+ALS based learning
• Approximate LS with CG for better scaling
• No restrictions on the number and meaning of the used
dimension
• Even items and/or users can be emitted
• Duplication of dimensions is allowed
General factorization
framework
•
General factorization
framework
User-item-context relations
• Basically 3 types:
• UCI: user-item relation is reweighted by the feature
vector of the current context
• IC: context dependent item bias
• UC: context dependent user bias
• Doesn’t play role in ranking
• Different context dimensions for different roles
Context modeling – Utility of
standard context dimensions
• Quality of context dimension
• Huge impact on accuracy
• Can we measure it?
• Which context for which role?
• CA item bias / CA user bias / reweighting user-item
relations
• Can it be predetermined?
• Usefulness of a context dimension
• Given a number of already defined dimension
• Can it be measured without training?
Context modeling – Non-standard
context dimensions
• Composite context
• E.g. transactions of the current session
• General factorization framework handles it
• Continuous context (& ordered context)
• E.g. time or distance based context
• Problems:
• Context-state rigidness
• Context-state ordinality
• Context-state continuity
• A solution: to be presented Sunday at CaRR 2014
Summary
• Context-aware factorization methods mainly for the implicit
feedback based problem
• From improved MF,
• through context-aware tensor methods
• to a fully flexible general framework
• On the way:
• Improving scalability
• Future:
• Context modeling
• Automatic model learning
• Option for pairwise ranking loss
Thanks for the attention!
Papers & slides available
through my website:
http://hidasi.eu
MF initia-
lization
iTALS
iTALSx
Scalability
CG/CD
General
Framework
Model
learning
Pairwise
ranking loss
Context
utility
estimation
Continuous
context
modeling
Implicit feedback; context; factorization; (ALS);

More Related Content

What's hot (20)

Challenging Common Assumptions in the Unsupervised Learning of Disentangled R...
Challenging Common Assumptions in the Unsupervised Learning of Disentangled R...Challenging Common Assumptions in the Unsupervised Learning of Disentangled R...
Challenging Common Assumptions in the Unsupervised Learning of Disentangled R...
Sangwoo Mo
 
Artificial Intelligence, Machine Learning and Deep Learning
Artificial Intelligence, Machine Learning and Deep LearningArtificial Intelligence, Machine Learning and Deep Learning
Artificial Intelligence, Machine Learning and Deep Learning
Sujit Pal
 
Generative Models for General Audiences
Generative Models for General AudiencesGenerative Models for General Audiences
Generative Models for General Audiences
Sangwoo Mo
 
Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial
Alexandros Karatzoglou
 
Foundations: Artificial Neural Networks
Foundations: Artificial Neural NetworksFoundations: Artificial Neural Networks
Foundations: Artificial Neural Networks
ananth
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language Processing
Sangwoo Mo
 
Deep Learning Models for Question Answering
Deep Learning Models for Question AnsweringDeep Learning Models for Question Answering
Deep Learning Models for Question Answering
Sujit Pal
 
Introduction To Applied Machine Learning
Introduction To Applied Machine LearningIntroduction To Applied Machine Learning
Introduction To Applied Machine Learning
ananth
 
Evolving a Medical Image Similarity Search
Evolving a Medical Image Similarity SearchEvolving a Medical Image Similarity Search
Evolving a Medical Image Similarity Search
Sujit Pal
 
Deep Learning For Practitioners, lecture 2: Selecting the right applications...
Deep Learning For Practitioners,  lecture 2: Selecting the right applications...Deep Learning For Practitioners,  lecture 2: Selecting the right applications...
Deep Learning For Practitioners, lecture 2: Selecting the right applications...
ananth
 
MaxEnt (Loglinear) Models - Overview
MaxEnt (Loglinear) Models - OverviewMaxEnt (Loglinear) Models - Overview
MaxEnt (Loglinear) Models - Overview
ananth
 
Learning to learn unlearned feature for segmentation
Learning to learn unlearned feature for segmentationLearning to learn unlearned feature for segmentation
Learning to learn unlearned feature for segmentation
NAVER Engineering
 
Deep Learning Enabled Question Answering System to Automate Corporate Helpdesk
Deep Learning Enabled Question Answering System to Automate Corporate HelpdeskDeep Learning Enabled Question Answering System to Automate Corporate Helpdesk
Deep Learning Enabled Question Answering System to Automate Corporate Helpdesk
Saurabh Saxena
 
Deep learning: the future of recommendations
Deep learning: the future of recommendationsDeep learning: the future of recommendations
Deep learning: the future of recommendations
Balázs Hidasi
 
An introduction to Machine Learning (and a little bit of Deep Learning)
An introduction to Machine Learning (and a little bit of Deep Learning)An introduction to Machine Learning (and a little bit of Deep Learning)
An introduction to Machine Learning (and a little bit of Deep Learning)
Thomas da Silva Paula
 
Deep Learning for Personalized Search and Recommender Systems
Deep Learning for Personalized Search and Recommender SystemsDeep Learning for Personalized Search and Recommender Systems
Deep Learning for Personalized Search and Recommender Systems
Benjamin Le
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
Girish Khanzode
 
Machine learning for_finance
Machine learning for_financeMachine learning for_finance
Machine learning for_finance
Stefan Duprey
 
DeepXplore: Automated Whitebox Testing of Deep Learning Systems
DeepXplore: Automated Whitebox Testing of Deep Learning Systems DeepXplore: Automated Whitebox Testing of Deep Learning Systems
DeepXplore: Automated Whitebox Testing of Deep Learning Systems
Jeongwhan Choi
 
Session-aware Linear Item-Item Models for Session-based Recommendation (WWW 2...
Session-aware Linear Item-Item Models for Session-based Recommendation (WWW 2...Session-aware Linear Item-Item Models for Session-based Recommendation (WWW 2...
Session-aware Linear Item-Item Models for Session-based Recommendation (WWW 2...
민진 최
 
Challenging Common Assumptions in the Unsupervised Learning of Disentangled R...
Challenging Common Assumptions in the Unsupervised Learning of Disentangled R...Challenging Common Assumptions in the Unsupervised Learning of Disentangled R...
Challenging Common Assumptions in the Unsupervised Learning of Disentangled R...
Sangwoo Mo
 
Artificial Intelligence, Machine Learning and Deep Learning
Artificial Intelligence, Machine Learning and Deep LearningArtificial Intelligence, Machine Learning and Deep Learning
Artificial Intelligence, Machine Learning and Deep Learning
Sujit Pal
 
Generative Models for General Audiences
Generative Models for General AudiencesGenerative Models for General Audiences
Generative Models for General Audiences
Sangwoo Mo
 
Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial
Alexandros Karatzoglou
 
Foundations: Artificial Neural Networks
Foundations: Artificial Neural NetworksFoundations: Artificial Neural Networks
Foundations: Artificial Neural Networks
ananth
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language Processing
Sangwoo Mo
 
Deep Learning Models for Question Answering
Deep Learning Models for Question AnsweringDeep Learning Models for Question Answering
Deep Learning Models for Question Answering
Sujit Pal
 
Introduction To Applied Machine Learning
Introduction To Applied Machine LearningIntroduction To Applied Machine Learning
Introduction To Applied Machine Learning
ananth
 
Evolving a Medical Image Similarity Search
Evolving a Medical Image Similarity SearchEvolving a Medical Image Similarity Search
Evolving a Medical Image Similarity Search
Sujit Pal
 
Deep Learning For Practitioners, lecture 2: Selecting the right applications...
Deep Learning For Practitioners,  lecture 2: Selecting the right applications...Deep Learning For Practitioners,  lecture 2: Selecting the right applications...
Deep Learning For Practitioners, lecture 2: Selecting the right applications...
ananth
 
MaxEnt (Loglinear) Models - Overview
MaxEnt (Loglinear) Models - OverviewMaxEnt (Loglinear) Models - Overview
MaxEnt (Loglinear) Models - Overview
ananth
 
Learning to learn unlearned feature for segmentation
Learning to learn unlearned feature for segmentationLearning to learn unlearned feature for segmentation
Learning to learn unlearned feature for segmentation
NAVER Engineering
 
Deep Learning Enabled Question Answering System to Automate Corporate Helpdesk
Deep Learning Enabled Question Answering System to Automate Corporate HelpdeskDeep Learning Enabled Question Answering System to Automate Corporate Helpdesk
Deep Learning Enabled Question Answering System to Automate Corporate Helpdesk
Saurabh Saxena
 
Deep learning: the future of recommendations
Deep learning: the future of recommendationsDeep learning: the future of recommendations
Deep learning: the future of recommendations
Balázs Hidasi
 
An introduction to Machine Learning (and a little bit of Deep Learning)
An introduction to Machine Learning (and a little bit of Deep Learning)An introduction to Machine Learning (and a little bit of Deep Learning)
An introduction to Machine Learning (and a little bit of Deep Learning)
Thomas da Silva Paula
 
Deep Learning for Personalized Search and Recommender Systems
Deep Learning for Personalized Search and Recommender SystemsDeep Learning for Personalized Search and Recommender Systems
Deep Learning for Personalized Search and Recommender Systems
Benjamin Le
 
Machine learning for_finance
Machine learning for_financeMachine learning for_finance
Machine learning for_finance
Stefan Duprey
 
DeepXplore: Automated Whitebox Testing of Deep Learning Systems
DeepXplore: Automated Whitebox Testing of Deep Learning Systems DeepXplore: Automated Whitebox Testing of Deep Learning Systems
DeepXplore: Automated Whitebox Testing of Deep Learning Systems
Jeongwhan Choi
 
Session-aware Linear Item-Item Models for Session-based Recommendation (WWW 2...
Session-aware Linear Item-Item Models for Session-based Recommendation (WWW 2...Session-aware Linear Item-Item Models for Session-based Recommendation (WWW 2...
Session-aware Linear Item-Item Models for Session-based Recommendation (WWW 2...
민진 최
 

Similar to Utilizing additional information in factorization methods (research overview, April 2014) (20)

Hybridisation Techniques for Cold-Starting Context-Aware Recommender Systems
Hybridisation Techniques for Cold-Starting Context-Aware Recommender SystemsHybridisation Techniques for Cold-Starting Context-Aware Recommender Systems
Hybridisation Techniques for Cold-Starting Context-Aware Recommender Systems
Matthias Braunhofer
 
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
YONG ZHENG
 
PhD defense
PhD defense PhD defense
PhD defense
Giuseppe Ricci
 
Experiments on Generalizability of User-Oriented Fairness in Recommender Systems
Experiments on Generalizability of User-Oriented Fairness in Recommender SystemsExperiments on Generalizability of User-Oriented Fairness in Recommender Systems
Experiments on Generalizability of User-Oriented Fairness in Recommender Systems
Hossein A. (Saeed) Rahmani
 
TFMAP: Optimizing MAP for Top-N Context-aware Recommendation
TFMAP: Optimizing MAP for Top-N Context-aware RecommendationTFMAP: Optimizing MAP for Top-N Context-aware Recommendation
TFMAP: Optimizing MAP for Top-N Context-aware Recommendation
Alexandros Karatzoglou
 
factorization methods
factorization methodsfactorization methods
factorization methods
Shaina Raza
 
The Factorization Machines algorithm for building recommendation system - Paw...
The Factorization Machines algorithm for building recommendation system - Paw...The Factorization Machines algorithm for building recommendation system - Paw...
The Factorization Machines algorithm for building recommendation system - Paw...
Evention
 
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
Daniele Malitesta
 
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Massimo Quadrana
 
Extending Recommendation Systems With Semantics And Context Awareness
Extending Recommendation Systems With Semantics And Context AwarenessExtending Recommendation Systems With Semantics And Context Awareness
Extending Recommendation Systems With Semantics And Context Awareness
Victor Codina
 
Context-aware similarities within the factorization framework (CaRR 2013 pres...
Context-aware similarities within the factorization framework (CaRR 2013 pres...Context-aware similarities within the factorization framework (CaRR 2013 pres...
Context-aware similarities within the factorization framework (CaRR 2013 pres...
Balázs Hidasi
 
Context-aware Recommendation: A Quick View
Context-aware Recommendation: A Quick ViewContext-aware Recommendation: A Quick View
Context-aware Recommendation: A Quick View
YONG ZHENG
 
Big Practical Recommendations with Alternating Least Squares
Big Practical Recommendations with Alternating Least SquaresBig Practical Recommendations with Alternating Least Squares
Big Practical Recommendations with Alternating Least Squares
Data Science London
 
Lessons learnt at building recommendation services at industry scale
Lessons learnt at building recommendation services at industry scaleLessons learnt at building recommendation services at industry scale
Lessons learnt at building recommendation services at industry scale
Domonkos Tikk
 
Learning to Rank for Recommender Systems - ACM RecSys 2013 tutorial
Learning to Rank for Recommender Systems -  ACM RecSys 2013 tutorialLearning to Rank for Recommender Systems -  ACM RecSys 2013 tutorial
Learning to Rank for Recommender Systems - ACM RecSys 2013 tutorial
Alexandros Karatzoglou
 
Continuous Evaluation of Collaborative Recommender Systems in Data Stream Man...
Continuous Evaluation of Collaborative Recommender Systems in Data Stream Man...Continuous Evaluation of Collaborative Recommender Systems in Data Stream Man...
Continuous Evaluation of Collaborative Recommender Systems in Data Stream Man...
Dr. Cornelius Ludmann
 
Factorization Machines and Applications in Recommender Systems
Factorization Machines and Applications in Recommender SystemsFactorization Machines and Applications in Recommender Systems
Factorization Machines and Applications in Recommender Systems
Evgeniy Marinov
 
Recsys 2014 Tutorial - The Recommender Problem Revisited
Recsys 2014 Tutorial - The Recommender Problem RevisitedRecsys 2014 Tutorial - The Recommender Problem Revisited
Recsys 2014 Tutorial - The Recommender Problem Revisited
Xavier Amatriain
 
Interactive Recommender Systems
Interactive Recommender SystemsInteractive Recommender Systems
Interactive Recommender Systems
Denis Parra Santander
 
My PhD trajectory
My PhD trajectoryMy PhD trajectory
My PhD trajectory
Stijn Geuens
 
Hybridisation Techniques for Cold-Starting Context-Aware Recommender Systems
Hybridisation Techniques for Cold-Starting Context-Aware Recommender SystemsHybridisation Techniques for Cold-Starting Context-Aware Recommender Systems
Hybridisation Techniques for Cold-Starting Context-Aware Recommender Systems
Matthias Braunhofer
 
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
YONG ZHENG
 
Experiments on Generalizability of User-Oriented Fairness in Recommender Systems
Experiments on Generalizability of User-Oriented Fairness in Recommender SystemsExperiments on Generalizability of User-Oriented Fairness in Recommender Systems
Experiments on Generalizability of User-Oriented Fairness in Recommender Systems
Hossein A. (Saeed) Rahmani
 
TFMAP: Optimizing MAP for Top-N Context-aware Recommendation
TFMAP: Optimizing MAP for Top-N Context-aware RecommendationTFMAP: Optimizing MAP for Top-N Context-aware Recommendation
TFMAP: Optimizing MAP for Top-N Context-aware Recommendation
Alexandros Karatzoglou
 
factorization methods
factorization methodsfactorization methods
factorization methods
Shaina Raza
 
The Factorization Machines algorithm for building recommendation system - Paw...
The Factorization Machines algorithm for building recommendation system - Paw...The Factorization Machines algorithm for building recommendation system - Paw...
The Factorization Machines algorithm for building recommendation system - Paw...
Evention
 
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
Daniele Malitesta
 
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Massimo Quadrana
 
Extending Recommendation Systems With Semantics And Context Awareness
Extending Recommendation Systems With Semantics And Context AwarenessExtending Recommendation Systems With Semantics And Context Awareness
Extending Recommendation Systems With Semantics And Context Awareness
Victor Codina
 
Context-aware similarities within the factorization framework (CaRR 2013 pres...
Context-aware similarities within the factorization framework (CaRR 2013 pres...Context-aware similarities within the factorization framework (CaRR 2013 pres...
Context-aware similarities within the factorization framework (CaRR 2013 pres...
Balázs Hidasi
 
Context-aware Recommendation: A Quick View
Context-aware Recommendation: A Quick ViewContext-aware Recommendation: A Quick View
Context-aware Recommendation: A Quick View
YONG ZHENG
 
Big Practical Recommendations with Alternating Least Squares
Big Practical Recommendations with Alternating Least SquaresBig Practical Recommendations with Alternating Least Squares
Big Practical Recommendations with Alternating Least Squares
Data Science London
 
Lessons learnt at building recommendation services at industry scale
Lessons learnt at building recommendation services at industry scaleLessons learnt at building recommendation services at industry scale
Lessons learnt at building recommendation services at industry scale
Domonkos Tikk
 
Learning to Rank for Recommender Systems - ACM RecSys 2013 tutorial
Learning to Rank for Recommender Systems -  ACM RecSys 2013 tutorialLearning to Rank for Recommender Systems -  ACM RecSys 2013 tutorial
Learning to Rank for Recommender Systems - ACM RecSys 2013 tutorial
Alexandros Karatzoglou
 
Continuous Evaluation of Collaborative Recommender Systems in Data Stream Man...
Continuous Evaluation of Collaborative Recommender Systems in Data Stream Man...Continuous Evaluation of Collaborative Recommender Systems in Data Stream Man...
Continuous Evaluation of Collaborative Recommender Systems in Data Stream Man...
Dr. Cornelius Ludmann
 
Factorization Machines and Applications in Recommender Systems
Factorization Machines and Applications in Recommender SystemsFactorization Machines and Applications in Recommender Systems
Factorization Machines and Applications in Recommender Systems
Evgeniy Marinov
 
Recsys 2014 Tutorial - The Recommender Problem Revisited
Recsys 2014 Tutorial - The Recommender Problem RevisitedRecsys 2014 Tutorial - The Recommender Problem Revisited
Recsys 2014 Tutorial - The Recommender Problem Revisited
Xavier Amatriain
 

More from Balázs Hidasi (10)

Egyedi termék kreatívok tömeges gyártása generatív AI segítségével
Egyedi termék kreatívok tömeges gyártása generatív AI segítségévelEgyedi termék kreatívok tömeges gyártása generatív AI segítségével
Egyedi termék kreatívok tömeges gyártása generatív AI segítségével
Balázs Hidasi
 
The Effect of Third Party Implementations on Reproducibility
The Effect of Third Party Implementations on ReproducibilityThe Effect of Third Party Implementations on Reproducibility
The Effect of Third Party Implementations on Reproducibility
Balázs Hidasi
 
Context aware factorization methods for implicit feedback based recommendatio...
Context aware factorization methods for implicit feedback based recommendatio...Context aware factorization methods for implicit feedback based recommendatio...
Context aware factorization methods for implicit feedback based recommendatio...
Balázs Hidasi
 
Approximate modeling of continuous context in factorization algorithms (CaRR1...
Approximate modeling of continuous context in factorization algorithms (CaRR1...Approximate modeling of continuous context in factorization algorithms (CaRR1...
Approximate modeling of continuous context in factorization algorithms (CaRR1...
Balázs Hidasi
 
Az implicit ajánlási probléma és néhány megoldása (BME TMIT szeminárium előad...
Az implicit ajánlási probléma és néhány megoldása (BME TMIT szeminárium előad...Az implicit ajánlási probléma és néhány megoldása (BME TMIT szeminárium előad...
Az implicit ajánlási probléma és néhány megoldása (BME TMIT szeminárium előad...
Balázs Hidasi
 
iTALS: implicit tensor factorization for context-aware recommendations (ECML/...
iTALS: implicit tensor factorization for context-aware recommendations (ECML/...iTALS: implicit tensor factorization for context-aware recommendations (ECML/...
iTALS: implicit tensor factorization for context-aware recommendations (ECML/...
Balázs Hidasi
 
Initialization of matrix factorization (CaRR 2012 presentation)
Initialization of matrix factorization (CaRR 2012 presentation)Initialization of matrix factorization (CaRR 2012 presentation)
Initialization of matrix factorization (CaRR 2012 presentation)
Balázs Hidasi
 
ShiftTree: model alapú idősor-osztályozó (VK 2009 előadás)
ShiftTree: model alapú idősor-osztályozó (VK 2009 előadás)ShiftTree: model alapú idősor-osztályozó (VK 2009 előadás)
ShiftTree: model alapú idősor-osztályozó (VK 2009 előadás)
Balázs Hidasi
 
ShiftTree: model alapú idősor-osztályozó (ML@BP előadás, 2012)
ShiftTree: model alapú idősor-osztályozó (ML@BP előadás, 2012)ShiftTree: model alapú idősor-osztályozó (ML@BP előadás, 2012)
ShiftTree: model alapú idősor-osztályozó (ML@BP előadás, 2012)
Balázs Hidasi
 
ShiftTree: model based time series classifier (ECML/PKDD 2011 presentation)
ShiftTree: model based time series classifier (ECML/PKDD 2011 presentation)ShiftTree: model based time series classifier (ECML/PKDD 2011 presentation)
ShiftTree: model based time series classifier (ECML/PKDD 2011 presentation)
Balázs Hidasi
 
Egyedi termék kreatívok tömeges gyártása generatív AI segítségével
Egyedi termék kreatívok tömeges gyártása generatív AI segítségévelEgyedi termék kreatívok tömeges gyártása generatív AI segítségével
Egyedi termék kreatívok tömeges gyártása generatív AI segítségével
Balázs Hidasi
 
The Effect of Third Party Implementations on Reproducibility
The Effect of Third Party Implementations on ReproducibilityThe Effect of Third Party Implementations on Reproducibility
The Effect of Third Party Implementations on Reproducibility
Balázs Hidasi
 
Context aware factorization methods for implicit feedback based recommendatio...
Context aware factorization methods for implicit feedback based recommendatio...Context aware factorization methods for implicit feedback based recommendatio...
Context aware factorization methods for implicit feedback based recommendatio...
Balázs Hidasi
 
Approximate modeling of continuous context in factorization algorithms (CaRR1...
Approximate modeling of continuous context in factorization algorithms (CaRR1...Approximate modeling of continuous context in factorization algorithms (CaRR1...
Approximate modeling of continuous context in factorization algorithms (CaRR1...
Balázs Hidasi
 
Az implicit ajánlási probléma és néhány megoldása (BME TMIT szeminárium előad...
Az implicit ajánlási probléma és néhány megoldása (BME TMIT szeminárium előad...Az implicit ajánlási probléma és néhány megoldása (BME TMIT szeminárium előad...
Az implicit ajánlási probléma és néhány megoldása (BME TMIT szeminárium előad...
Balázs Hidasi
 
iTALS: implicit tensor factorization for context-aware recommendations (ECML/...
iTALS: implicit tensor factorization for context-aware recommendations (ECML/...iTALS: implicit tensor factorization for context-aware recommendations (ECML/...
iTALS: implicit tensor factorization for context-aware recommendations (ECML/...
Balázs Hidasi
 
Initialization of matrix factorization (CaRR 2012 presentation)
Initialization of matrix factorization (CaRR 2012 presentation)Initialization of matrix factorization (CaRR 2012 presentation)
Initialization of matrix factorization (CaRR 2012 presentation)
Balázs Hidasi
 
ShiftTree: model alapú idősor-osztályozó (VK 2009 előadás)
ShiftTree: model alapú idősor-osztályozó (VK 2009 előadás)ShiftTree: model alapú idősor-osztályozó (VK 2009 előadás)
ShiftTree: model alapú idősor-osztályozó (VK 2009 előadás)
Balázs Hidasi
 
ShiftTree: model alapú idősor-osztályozó (ML@BP előadás, 2012)
ShiftTree: model alapú idősor-osztályozó (ML@BP előadás, 2012)ShiftTree: model alapú idősor-osztályozó (ML@BP előadás, 2012)
ShiftTree: model alapú idősor-osztályozó (ML@BP előadás, 2012)
Balázs Hidasi
 
ShiftTree: model based time series classifier (ECML/PKDD 2011 presentation)
ShiftTree: model based time series classifier (ECML/PKDD 2011 presentation)ShiftTree: model based time series classifier (ECML/PKDD 2011 presentation)
ShiftTree: model based time series classifier (ECML/PKDD 2011 presentation)
Balázs Hidasi
 

Recently uploaded (20)

Cell_Presentatn_Class8_Vaishnavi.pptx uuu
Cell_Presentatn_Class8_Vaishnavi.pptx uuuCell_Presentatn_Class8_Vaishnavi.pptx uuu
Cell_Presentatn_Class8_Vaishnavi.pptx uuu
dhabaleyash11
 
Niosomes- Non ionic surfactant vesicle ( Karina Changrani)
 Niosomes- Non ionic surfactant vesicle ( Karina Changrani) Niosomes- Non ionic surfactant vesicle ( Karina Changrani)
Niosomes- Non ionic surfactant vesicle ( Karina Changrani)
3012KarinaChangrani
 
APPLIED VETEINARY ANATOMy presentation in veterinary
APPLIED VETEINARY ANATOMy presentation in veterinaryAPPLIED VETEINARY ANATOMy presentation in veterinary
APPLIED VETEINARY ANATOMy presentation in veterinary
mythi170320000
 
Fetal Monitoring of 2nd yr ncm109 .pptx
Fetal Monitoring of 2nd yr ncm109  .pptxFetal Monitoring of 2nd yr ncm109  .pptx
Fetal Monitoring of 2nd yr ncm109 .pptx
JullianaPatriceAngel
 
Liver Abscess.pptx surgical site infenctions
Liver Abscess.pptx surgical site infenctionsLiver Abscess.pptx surgical site infenctions
Liver Abscess.pptx surgical site infenctions
AyuubMohamed6
 
Insights to Narcotic Drugs by Urmila Nirmal
Insights to Narcotic Drugs by Urmila NirmalInsights to Narcotic Drugs by Urmila Nirmal
Insights to Narcotic Drugs by Urmila Nirmal
urvi1504nirmal
 
The COCONUT Natural Products Database, Talk at ICCS 2025
The COCONUT Natural Products Database, Talk at ICCS 2025The COCONUT Natural Products Database, Talk at ICCS 2025
The COCONUT Natural Products Database, Talk at ICCS 2025
Christoph Steinbeck
 
Aliphatic-Hydrocarbons-Q1-CON-CHEMs.pptx
Aliphatic-Hydrocarbons-Q1-CON-CHEMs.pptxAliphatic-Hydrocarbons-Q1-CON-CHEMs.pptx
Aliphatic-Hydrocarbons-Q1-CON-CHEMs.pptx
onram453
 
Analytical techniques in dry chemistry for heavy metal analysis and recent ad...
Analytical techniques in dry chemistry for heavy metal analysis and recent ad...Analytical techniques in dry chemistry for heavy metal analysis and recent ad...
Analytical techniques in dry chemistry for heavy metal analysis and recent ad...
Archana Verma
 
International Journal of Pharmacological Sciences (IJPS)
International Journal of Pharmacological Sciences (IJPS)International Journal of Pharmacological Sciences (IJPS)
International Journal of Pharmacological Sciences (IJPS)
journalijps98
 
Glymphatic system dysfunction and neurodegeneration
Glymphatic system dysfunction and neurodegenerationGlymphatic system dysfunction and neurodegeneration
Glymphatic system dysfunction and neurodegeneration
KanakChaudhary10
 
Chemistry Quick Notes By MdcatAcademy.com ..pdf
Chemistry Quick Notes By MdcatAcademy.com ..pdfChemistry Quick Notes By MdcatAcademy.com ..pdf
Chemistry Quick Notes By MdcatAcademy.com ..pdf
salimullahk05
 
Multi-View Design Patterns & 
Responsive Visualization for
Genomics Data
Multi-View Design Patterns & 
Responsive Visualization for
Genomics DataMulti-View Design Patterns & 
Responsive Visualization for
Genomics Data
Multi-View Design Patterns & 
Responsive Visualization for
Genomics Data
sehilyi
 
The Lecture Include code of practice.pptx
The Lecture Include code of practice.pptxThe Lecture Include code of practice.pptx
The Lecture Include code of practice.pptx
KashiAli7
 
Hydatid Cyst Disease (Echinococcosis).pptx
Hydatid Cyst Disease (Echinococcosis).pptxHydatid Cyst Disease (Echinococcosis).pptx
Hydatid Cyst Disease (Echinococcosis).pptx
AyuubMohamed6
 
Cytoskeleton__with_anno_1683089530723.pdf
Cytoskeleton__with_anno_1683089530723.pdfCytoskeleton__with_anno_1683089530723.pdf
Cytoskeleton__with_anno_1683089530723.pdf
raorajveer1612
 
Cerebrospinal Fluid Leakage Post-Lumbar Puncture: A Narrative Review
Cerebrospinal Fluid Leakage Post-Lumbar  Puncture: A Narrative ReviewCerebrospinal Fluid Leakage Post-Lumbar  Puncture: A Narrative Review
Cerebrospinal Fluid Leakage Post-Lumbar Puncture: A Narrative Review
karishmayjm
 
Grammar-Based 
Interactive Visualization of Genomics Data
Grammar-Based 
Interactive Visualization of Genomics DataGrammar-Based 
Interactive Visualization of Genomics Data
Grammar-Based 
Interactive Visualization of Genomics Data
sehilyi
 
Forensic-Photography-Preliminary Module.pptx
Forensic-Photography-Preliminary Module.pptxForensic-Photography-Preliminary Module.pptx
Forensic-Photography-Preliminary Module.pptx
JayarrLlagas1
 
robotics in microbiology and it's implications pptx
robotics in microbiology and it's implications pptxrobotics in microbiology and it's implications pptx
robotics in microbiology and it's implications pptx
pelegoodluck1
 
Cell_Presentatn_Class8_Vaishnavi.pptx uuu
Cell_Presentatn_Class8_Vaishnavi.pptx uuuCell_Presentatn_Class8_Vaishnavi.pptx uuu
Cell_Presentatn_Class8_Vaishnavi.pptx uuu
dhabaleyash11
 
Niosomes- Non ionic surfactant vesicle ( Karina Changrani)
 Niosomes- Non ionic surfactant vesicle ( Karina Changrani) Niosomes- Non ionic surfactant vesicle ( Karina Changrani)
Niosomes- Non ionic surfactant vesicle ( Karina Changrani)
3012KarinaChangrani
 
APPLIED VETEINARY ANATOMy presentation in veterinary
APPLIED VETEINARY ANATOMy presentation in veterinaryAPPLIED VETEINARY ANATOMy presentation in veterinary
APPLIED VETEINARY ANATOMy presentation in veterinary
mythi170320000
 
Fetal Monitoring of 2nd yr ncm109 .pptx
Fetal Monitoring of 2nd yr ncm109  .pptxFetal Monitoring of 2nd yr ncm109  .pptx
Fetal Monitoring of 2nd yr ncm109 .pptx
JullianaPatriceAngel
 
Liver Abscess.pptx surgical site infenctions
Liver Abscess.pptx surgical site infenctionsLiver Abscess.pptx surgical site infenctions
Liver Abscess.pptx surgical site infenctions
AyuubMohamed6
 
Insights to Narcotic Drugs by Urmila Nirmal
Insights to Narcotic Drugs by Urmila NirmalInsights to Narcotic Drugs by Urmila Nirmal
Insights to Narcotic Drugs by Urmila Nirmal
urvi1504nirmal
 
The COCONUT Natural Products Database, Talk at ICCS 2025
The COCONUT Natural Products Database, Talk at ICCS 2025The COCONUT Natural Products Database, Talk at ICCS 2025
The COCONUT Natural Products Database, Talk at ICCS 2025
Christoph Steinbeck
 
Aliphatic-Hydrocarbons-Q1-CON-CHEMs.pptx
Aliphatic-Hydrocarbons-Q1-CON-CHEMs.pptxAliphatic-Hydrocarbons-Q1-CON-CHEMs.pptx
Aliphatic-Hydrocarbons-Q1-CON-CHEMs.pptx
onram453
 
Analytical techniques in dry chemistry for heavy metal analysis and recent ad...
Analytical techniques in dry chemistry for heavy metal analysis and recent ad...Analytical techniques in dry chemistry for heavy metal analysis and recent ad...
Analytical techniques in dry chemistry for heavy metal analysis and recent ad...
Archana Verma
 
International Journal of Pharmacological Sciences (IJPS)
International Journal of Pharmacological Sciences (IJPS)International Journal of Pharmacological Sciences (IJPS)
International Journal of Pharmacological Sciences (IJPS)
journalijps98
 
Glymphatic system dysfunction and neurodegeneration
Glymphatic system dysfunction and neurodegenerationGlymphatic system dysfunction and neurodegeneration
Glymphatic system dysfunction and neurodegeneration
KanakChaudhary10
 
Chemistry Quick Notes By MdcatAcademy.com ..pdf
Chemistry Quick Notes By MdcatAcademy.com ..pdfChemistry Quick Notes By MdcatAcademy.com ..pdf
Chemistry Quick Notes By MdcatAcademy.com ..pdf
salimullahk05
 
Multi-View Design Patterns & 
Responsive Visualization for
Genomics Data
Multi-View Design Patterns & 
Responsive Visualization for
Genomics DataMulti-View Design Patterns & 
Responsive Visualization for
Genomics Data
Multi-View Design Patterns & 
Responsive Visualization for
Genomics Data
sehilyi
 
The Lecture Include code of practice.pptx
The Lecture Include code of practice.pptxThe Lecture Include code of practice.pptx
The Lecture Include code of practice.pptx
KashiAli7
 
Hydatid Cyst Disease (Echinococcosis).pptx
Hydatid Cyst Disease (Echinococcosis).pptxHydatid Cyst Disease (Echinococcosis).pptx
Hydatid Cyst Disease (Echinococcosis).pptx
AyuubMohamed6
 
Cytoskeleton__with_anno_1683089530723.pdf
Cytoskeleton__with_anno_1683089530723.pdfCytoskeleton__with_anno_1683089530723.pdf
Cytoskeleton__with_anno_1683089530723.pdf
raorajveer1612
 
Cerebrospinal Fluid Leakage Post-Lumbar Puncture: A Narrative Review
Cerebrospinal Fluid Leakage Post-Lumbar  Puncture: A Narrative ReviewCerebrospinal Fluid Leakage Post-Lumbar  Puncture: A Narrative Review
Cerebrospinal Fluid Leakage Post-Lumbar Puncture: A Narrative Review
karishmayjm
 
Grammar-Based 
Interactive Visualization of Genomics Data
Grammar-Based 
Interactive Visualization of Genomics DataGrammar-Based 
Interactive Visualization of Genomics Data
Grammar-Based 
Interactive Visualization of Genomics Data
sehilyi
 
Forensic-Photography-Preliminary Module.pptx
Forensic-Photography-Preliminary Module.pptxForensic-Photography-Preliminary Module.pptx
Forensic-Photography-Preliminary Module.pptx
JayarrLlagas1
 
robotics in microbiology and it's implications pptx
robotics in microbiology and it's implications pptxrobotics in microbiology and it's implications pptx
robotics in microbiology and it's implications pptx
pelegoodluck1
 

Utilizing additional information in factorization methods (research overview, April 2014)

  • 1. Utilizing additional information in factorization methods - Research overview - - 11. April 2014 - Balázs Hidasi [email protected]
  • 2. About me • Datamining researcher at Gravity R&D • PhD student at BME (BUTE) • Research interests: • Machine learning & Data mining • Algorithm research and development • Currently: recommender systems • Previously: time series classification
  • 3. Gravity R&D • Recommender service provider, based in Hungary • Founded by team Gravity after the Netflix Prize • Started working there: January 2010 • Data analysis • Algorithm development & implementation • Research
  • 4. Budapest University of Technology and Economics • Leading tech university in Hungary • Faculty of Electrical Engineering and Informatics • Computer science and engineering B.Sc./M.Sc. • Ph.D. student since September 2011. • Department of Telecommunications and Media Informatics • Data Science and Content Technologies Laboratory (DC Lab)
  • 5. RecSys research – aims & roots • Aims: Developing novel algorithms that enable the usage of additional information with factorization to improve recommendation accuracy for implicit feedback based recommendation tasks • Roots: • Implicit feedback • Context • Factorization • In addition: • ALS learning • Recall based evaluation
  • 6. Implicit feedback • Transactions provide no explicit user preference • View, buy, etc. • Presence of an event  noisy positive feedback • Absence of an event  ? • Negative feedback is not available
  • 10. Recall based evaluation • Recall: number of relevant and recommended items in proportion to the number of relevant items • @N: only topN items are considered • Nowadays less common in RecSys • MAP, NDCG • Practical point of view • Rank does not matter as long as the item is shown • TopN list presented in chunks • TopN list should contain the relevant items • For many practical scenarios; there are exceptions
  • 11. RecSys research – overview • Injecting additional info into MF (through initialization) • Context-aware methods: iTALS, iTALSx • Scalability improvement: CD/CG learning • General factorization framework • Modeling context • Pairwise ranking loss with ALS
  • 16. LS/CD/CG comparison • Little to none degradation in recall • Training time: CG < CD < LS • CD is unstable with models using members of higher order 0.00 100.00 200.00 300.00 400.00 500.00 600.00 700.00 800.00 900.00 1000.00 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 Runningtime(s) Number of features (K) iTALS iTALS-CG (N_I = 2) iTALS-CD (N_I = 2)
  • 17. General factorization framework • Goal: fully flexible framework that allows experimentation with arbitrary linear factorization models • State-of-the-art methods use fixed models/model- classes • Designed for implicit but supports explicit feedback as well • wRMSE+ALS based learning • Approximate LS with CG for better scaling • No restrictions on the number and meaning of the used dimension • Even items and/or users can be emitted • Duplication of dimensions is allowed
  • 20. User-item-context relations • Basically 3 types: • UCI: user-item relation is reweighted by the feature vector of the current context • IC: context dependent item bias • UC: context dependent user bias • Doesn’t play role in ranking • Different context dimensions for different roles
  • 21. Context modeling – Utility of standard context dimensions • Quality of context dimension • Huge impact on accuracy • Can we measure it? • Which context for which role? • CA item bias / CA user bias / reweighting user-item relations • Can it be predetermined? • Usefulness of a context dimension • Given a number of already defined dimension • Can it be measured without training?
  • 22. Context modeling – Non-standard context dimensions • Composite context • E.g. transactions of the current session • General factorization framework handles it • Continuous context (& ordered context) • E.g. time or distance based context • Problems: • Context-state rigidness • Context-state ordinality • Context-state continuity • A solution: to be presented Sunday at CaRR 2014
  • 23. Summary • Context-aware factorization methods mainly for the implicit feedback based problem • From improved MF, • through context-aware tensor methods • to a fully flexible general framework • On the way: • Improving scalability • Future: • Context modeling • Automatic model learning • Option for pairwise ranking loss
  • 24. Thanks for the attention! Papers & slides available through my website: http://hidasi.eu MF initia- lization iTALS iTALSx Scalability CG/CD General Framework Model learning Pairwise ranking loss Context utility estimation Continuous context modeling Implicit feedback; context; factorization; (ALS);