phd defense: dynamic generation of personalized hybrid recommender systems

56
Dynamic Generation of Personalized Hybrid Recommender Systems Simon Dooms Public PhD Presentation December 19, 2014. Belgium.

Upload: simon-dooms

Post on 17-Jul-2015

312 views

Category:

Data & Analytics


6 download

TRANSCRIPT

Page 1: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Dynamic Generation of Personalized Hybrid Recommender Systems

Simon DoomsPublic PhD Presentation

December 19, 2014. Belgium.

Page 2: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

News Movies

RestaurantsHotelsBooks

TV shows

Clothes

Apps Laptops

CultureBars Recipes

Comic books Perfume

Conferences

Websites

GamesColors

There’s too much of everything

Page 3: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Spotify’s music catalog contains 20 million songs

Every minute 100 hours of video uploaded to

YouTube

Every 5 minutes a new book on Amazon

We can’t have it all

News Movies

RestaurantsHotelsBooks

TV shows

Clothes

Apps Laptops

CultureBars Recipes

Comic books Perfume

Conferences

Websites

GamesColors

Page 4: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

The Solution?

Page 5: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Recommender Systems

Content-based FilteringItemAttributeKNNFactorWiseMatrixFactorization

MatrixfactorizationItemKNN

SigmoidCombinedAsymmetricFactorModel

SigmoidItemAsymmetricFactorModel

SigmoidUserAsymmetricFactorModel GlobalAverage

ItemAverage

SVDPlusPlus

TimeAwareBaselineWithFrequencies

SlopeOneUserKNN

BiPolarSlopeOne

LatentFeatureLogLinearModel

SVD

Collaborative FilteringBiasedMatrixFactorization

Random Items

SigmoidSVDPlusPlus

CoClusteringUserItemBaseline

TimeAwareBaseline

Probability-based Extended Profile Filtering

Page 6: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Recommender Systems

Content-based FilteringItemAttributeKNNFactorWiseMatrixFactorization

MatrixfactorizationItemKNN

LatentFeatureLogLinearModel

SVD

Collaborative FilteringBiasedMatrixFactorization

Random Items

SigmoidSVDPlusPlusTimeAwareBaseline

Probability-based Extended Profile Filtering

Page 7: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

AanbevelingssystemenWhat’s the challenge?

Content-based FilteringItemAttributeKNNFactorWiseMatrixFactorization

MatrixfactorizationItemKNN

LatentFeatureLogLinearModel

SVD

Collaborative FilteringBiasedMatrixFactorization

Random Items

SigmoidSVDPlusPlusTimeAwareBaseline

Probability-based Extended Profile Filtering

Page 8: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

How to select the best system for a given context, user or domain?

Page 9: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Goal

Dynamic Generation of Personalized Hybrid Recommender Systems

The title

Page 10: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Goal

Dynamic Generation of Personalized Hybrid Recommender Systems

Page 11: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Goal

Dynamic Generation of Personalized Hybrid Recommender Systems

Page 12: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Goal

Dynamic Generation of Personalized Hybrid Recommender Systems

Page 13: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Goal

Dynamic Generation of Personalized Hybrid Recommender Systems

Page 14: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Goal

Page 15: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

We Need Data

Products

Preferences

Page 16: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

MovieLens Netflix

(Old) Data is available

Page 17: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

MovieLens Netflix

1994 1995 1997

(Old) Data is available

Page 18: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

Old Data Old Recommendations

(Old) Data is available

but…

Page 19: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

+

Searching Recent Data

Page 20: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data Searching Recent Data

Page 21: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

“I rated #IMDb”

Found it!

Page 22: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

Collected during 1 year, 9 months

320 000 ratings

MovieTweetings Dataset

30 000 users

20 000 movies

Found it!

Page 23: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Goal

Page 24: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Goal

Page 25: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems
Page 26: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems
Page 27: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

+ + + +

Page 28: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Personalized

Page 29: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Personalized

Optimization Problem

Page 30: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

Optimization

Training EvaluateCombine

Page 31: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

Optimization

Training EvaluateCombine

Page 32: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

Optimization

Training EvaluateCombine

Page 33: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Data

Optimization

Training Evaluate

+

Combine

Page 34: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Repeat

Data

Optimization

Training Evaluate

+ = 25

= 50

= 75

Adapt

Combine

Page 35: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Optimize

Fold

dat

aset

s

Slow (hours)

All

dat

a

Fast (seconds)

Full Model

Page 36: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Optimize

Fold

dat

aset

s

Slow (hours)

All

dat

a

Fast (seconds)

New Ratings: no re-training required

Page 37: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Optimization Results

It works

… in theory

Page 38: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Real-life evaluation?

Goal

Page 39: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

User Evaluation

Google Chrome Extension

Page 40: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Movie Recommendations

Recent Movies

Page 41: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Interaction

Recent Movies

Movie Recommendations

Page 42: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Interaction

Recent Movies

Movie Recommendations

Page 43: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Interaction

Recent Movies

Evaluation

Explicit

Movie Recommendations

Page 44: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Interaction

Recent Movies

Evaluation

Explicit

ImplicitClick Tracking & Logging

Movie Recommendations

Page 45: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Movie Recommendations: Results

Interactive users use the system more often

All users are different

Explicit & Implicit evaluation was positive

Page 46: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Goal Achieved

Page 47: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

User Interface Design Experiments

But wait … there’s more!

Page 48: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

High-Performance Calculation Research

User Interface Design Experiments

But wait … there’s more!

Page 49: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

High-Performance Calculation Research

User Interface Design Experiments

But wait … there’s more!

Page 50: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

High-Performance Calculation Research

User Interface Design Experiments

But wait … there’s more!

Page 51: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Rating systems, online experiments

High-Performance Calculation Research

User Interface Design Experiments

But wait … there’s more!

Page 52: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Conclusion

Page 53: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

A dynamic, personalized hybrid recommender system works

All users are unique

Interactive systems are the future

Conclusion

Page 54: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

You might also like…

My PhD dissertation for more details:

Google Scholar for my publications

Slideshare for my presentations and posters

Github for my public code and data

http://bit.ly/simonphd

https://github.com/sidooms

Page 55: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

That’s all folks!

More questions? Contact me!

https://twitter.com/sidooms

simon [dot] dooms [at gmail dot] com

Page 56: PhD Defense: Dynamic Generation of Personalized Hybrid Recommender Systems

Dynamic Generation of Personalized Hybrid Recommender Systems

Simon DoomsPublic PhD Presentation

December 19, 2014. Belgium.