building recommendation systems on social data @kth - futurefriday - march 2014

23
Computing in Social Networks: Building Recommendation Systems on Social Data

Upload: nima-dokoohaki

Post on 06-Dec-2014

399 views

Category:

Technology


0 download

DESCRIPTION

My talk entitled" Computing in Social Networks: Building Recommendation Systems on Social Data " Given at Future Friday event, KTH ICT March 2014 The talk is televised by Swedish TV Kunskapkanalen/ UR Samtid

TRANSCRIPT

Page 1: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

Computing in Social Networks:Building Recommendation Systems on Social Data

Page 2: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

2NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Outlook

Introduction

Recommender Systems

Examples of recommender systems

Challenges with recommendation research

Social networks and recommendations

Show case of experimental work on:

Trust-aware recommendations

Privacy preserving recommendations

Diversity and opinions

Conclusion

Page 3: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

3NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Personalization and recommendations

Problem: • Information overload…

Personalization and Profiles• Users want to get personalized experience and at the same time don’t want

to share a lot of their personal information.

Recommendation systems• Referred to as a range of algorithms which suggest a collection of items to

users, based on the knowledge of their profiles or previous interactions.

Recommendation systems types:• Collaborative filtering (User-based)• Content-based filtering (Item-based)• Hybrid filtering (Mix of users and content)

Page 4: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

4NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Applications of Recommendation Systems

Page 5: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

5NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Important Challenges in Recommendation Research

1. Explaining the recommendations

It increases the trust of users as they know what is the basis of the suggestions

2. Preserving the user privacy

How to make good recommendations without ignoring user privacy

3. Diversity and novelty of recommendations

Recommenders suggest similar stuff to what you have seen, it is important to get

Page 6: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

6NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Social networks

Social networks [Wasserman et al, 1994]• Focus of fields such as behavioral,

marketing, economics, etc.

Relationships types• Interactions, social relations

Explicit relationships• Relations in online social networks

like in facebook, linkedin, etc).

Implicit relationships• Computed based on users

behavior. For instance rating movies, music, etc.

Image: https://www.facebook.com/notes/facebook-engineering/visualizing-friendships/

Page 7: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

7NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Benefits of using social networks for recommendations

• Take advantage of social network structure:• Trust, social and structural Influence, transitivity, etc.

• Resilient against fraud, spam and fake accounts• Identity and connections of the people on a social

network helps on dealing with bad guys

• Cold start problem • System always has people to suggest (as long as they

are connected to the social network)

Page 8: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

8NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Experimental work with trust and recommendations• Extracting trust networks from

• Getting better reach to items and users for improved guessing of items to suggest.

• Using trust (networks) to improve accuracy of recommendations generated• Accurate suggestions of movies to watch, people to

follow, etc.

Page 9: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

9NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Visualization of Trust Relations in Ciao Dataset

In Nima Dokoohaki, Shahab Mokarizadeh, Mihhail Matskin, Ramona Bunea. Correlating Trust and Privacy in Recommender Systems, Special Issue on Web Intelligence and Personalization on Social Media, Web Intelligence and Agent Systems An International Journal. IOS Press, 2014. (submitted for review)

Page 10: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

10NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Trust networks and recommendations:Data: Ratings Profiles to Trust Networks

Page 11: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

11NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Trust networks and recommendations:Impact of Trust Metric on Generated Networks Structure

Generated Trust Networks for Top-10 Trustworthy Users (n= 5, m= 5): Without T-index

Generated Trust Networks for Top-10 Trustworthy Users (n= 5, m=5): With T-index (= 100)

Soude Fazeli, Alireza Zarghami, Nima Dokoohaki, Mihhail Matskin,Mechanizing Social Trust-Aware Recommenders with T-index Augmented Trustworthiness,In proceedings of the 7th International Conference on Trust, Privacy & Security in Digital Business (Trustbus 2010)

Nima Dokoohaki
Add publications to each slide
Page 12: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

12NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Trust networks and recommendations:Prediction accuracy against the variations of Trustworthiness and Neighborhood size

Soude Fazeli, Alireza Zarghami, Nima Dokoohaki, Mihhail Matskin,Elevating Prediction Accuracy in Trust-aware Collaborative Filtering Recommenders through T-index Metric and TopTrustee lists,In the Journal of Emerging Technologies in Web Intelligence (JETWI), Special Issue On Web Personalization, Reputation and Recommender Systems, 2010.

Page 13: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

13NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Trust networks and recommendationsRating Prediction Accuracy against network (neighborhood) size

Influence of search range on item coverage and prediction accuracy for Epinions dataset.

Stefan Magureanu, Nima Dokoohaki, Shahab Mokarizadeh, Mihhail Matskin,Epidemic Trust-Based Recommender Systems , In proceedings of 2012 ASE/IEEE International Social Computing Conference (SocialCom2012)

Page 14: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

14NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Experimental work with Privacy and recommendations• Proposing for software architectures that improve privacy of

recommendations

• How much data should the system use, can we control this amount ?

• Can we use enough data and still get decent suggestions ?

Page 15: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

15

Privacy and recommendations:Component Architectures for Preserving Privacy during Computations

NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Nima Dokoohaki, Cihan Kaleli, Huseyin Polat and Mihhail Matskin,Achieving Optimal Privacy in Trust-Aware Collaborative Filtering Recommender Systems, The Second International Conference on Social Informatics (SocInfo 10)

Ramona Bunea, Shahab Mokarizadeh, Nima Dokoohaki and Mihhail Matskin, Exploiting Dynamic Privacy in Socially Regularized Recommenders,PinSoDa: Privacy in Social Data, in conjunction with the 11th IEEE International Conference on Data Mining (ICDM 2012)

Page 16: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

16

Privacy and recommendations:Comparing performance of recommendations generated

Ramona Bunea, Shahab Mokarizadeh, Nima Dokoohaki and Mihhail Matskin, Exploiting Dynamic Privacy in Socially Regularized Recommenders,PinSoDa: Privacy in Social Data, in conjunction with the 11th IEEE International Conference on Data Mining (ICDM 2012)

Page 17: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

17NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Experimental work with diversity and opinions recommendations• How to diversify the recommendations

• What models can be proposed to give better summary of reviews

• How to improve the recommendations of opinions in terms of accuracy and scalability• What models can be proposed to find more similar

people to read their Tweets.

Page 18: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

18NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Data: From Review Profiles to Topic models

Page 19: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

19NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Recommending Summarized Reviews:Comparing Customer Ratings and estimated Sentiments

Ralf Krestel, Nima DokoohakiDiversifying Review Rankings, Special issue on Big Social Data Analytics, Elsevier Journal of Neural Networks, 2014. Submitted for review.

Page 20: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

20NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Diversifying Summarized Reviews:Comparing Recency of Summarization Strategy Comparing LDA and LM

Page 21: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

21

Recommending Tweets:Visualizing variations of topics for #wikileaks and #eurozone tweets, 2011

Extended results from: Nima Dokoohaki, Mihhail Matskin,Mining Divergent Opinion Trust Networks through Latent Dirichlet Allocation, In proceedings of 2012 IEEE/ACM International Conference on Social Network Analysis and Mining (ASONAM 2012)

Page 22: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

22NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Recommending Users: Link Prediction on inferred trust relations, tweets from 2009

AUROC vs Number of Topics (Cosine)AUROC vs Number of Topics (KLD)

Extended results from: Nima Dokoohaki, Mihhail Matskin,Mining Divergent Opinion Trust Networks through Latent Dirichlet Allocation, In proceedings of 2012 IEEE/ACM International Conference on Social Network Analysis and Mining (ASONAM 2012)

Page 23: Building Recommendation Systems on Social Data @KTH - FutureFriday - March 2014

24NIMA DOKOOHAKI, [email protected] POSTDOCTORAL RESEARCHER SEMINAR @ FUTURE FRIDAY 2014 KTH/ICT, STOCKHOLM, SWEDEN

Conclusion

• This trail of research and education will continue under the trends of data science and big data.

• KTH and other European institutions are planning to design and offer study programs on data science and analytics to students, hopefully very soon…

• Thank you!