Upload File

a user-centric evaluation of recommender algorithms for an event recommendation system

  • Home
  • Education
  • A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System
13
A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System Simon Dooms, Toon De Pessemier, Luc Martens @sidooms

Upload: simon-dooms

Post on 10-May-2015

452 views

Category:

Education


1 download

Report

Tags:

DESCRIPTION

Describing the setup and results of a user-centric online experiment where 5 different recommendation algorithms are tested on a Belgium events website.

TRANSCRIPT

Page 1: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

A User-centric Evaluation of Recommender Algorithms for an Event Recommendation SystemSimon Dooms, Toon De Pessemier, Luc Martens

@sidooms

Page 2: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

Introduction

10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 2

• Online context• Cultural events• 30,000 items

Recommender System?

Concl.ResultsQuestionsAlgorithmsFeedbackExperimentIntroIntro

Page 3: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

The Experiment

Invitation mailDAY 1

Closed questionnaireDAY 56

DAY 41

End tracking

DAY 45

Send out recs

DAY 50Reminder mail

Reminder mailDAY 28

Concl.ResultsQuestionsAlgorithmsFeedbackIntroExperimentExperiment

10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 3

Page 4: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

FeedbackConcl.ResultsQuestionsAlgorithms

FeedbackFeedbackExperimentIntro

10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 4

Page 5: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

Algorithms

Content-Based CBUser-Based Collaborative Filtering UBCFHybrid recommender CB+UBCFSingular Value Decomposition SVDRandom recommender RAND

Concl.ResultsQuestionsAlgorithmsAlgorithmsFeedbackExperimentIntro

10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 5

Page 6: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

QuestionnaireConcl.Results

QuestionsQuestionsAlgorithmsFeedbackExperimentIntro

10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 6

AccuracyFamiliarity

NoveltyDiversity

TransparencySatisfaction

TrustUsefulness

Page 7: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

Results

612 users

Concl.ResultsResultsQuestionsAlgorithmsFeedbackExperimentIntro

10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 7

232 users193 users

Page 8: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

Concl.ResultsResultsQuestionsAlgorithmsFeedbackExperimentIntro

Average scores per question and algorithm

Accuracy Familiarity Novelty Diversity Trans. Satisfaction Trust Usefulness10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 8

Page 9: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

Concl.ResultsResultsQuestionsAlgorithmsFeedbackExperimentIntro

Average scores per question and algorithm

Accuracy Satisfaction910/23/2011 Simon Dooms - Ghent University - UCERSTI 2

Page 10: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

CorrelationsConcl.

ResultsResultsQuestionsAlgorithmsFeedbackExperimentIntro

10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 10

AccuracyFamiliarity

NoveltyDiversity

TransparencySatisfaction

TrustUsefulness

Page 11: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

RegressionsConcl.

ResultsResultsQuestionsAlgorithmsFeedbackExperimentIntro

10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 11

Page 12: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

Conclusions

• Online user-centric evaluation experiment• 5 popular algorithms: CB, UBCF, CB+UBCF, SVD, RAND

• CB+UBCF winner algorithm• SVD ‘loser’ algorithm• Accuracy and Transparency Satisfaction• Diversity NOT correlated with Satisfaction

Concl.Concl.ResultsQuestionsAlgorithmsFeedbackExperimentIntro

10/23/2011 Simon Dooms - Ghent University - UCERSTI 2 12

Page 13: A User-centric Evaluation of Recommender Algorithms for an Event Recommendation System

Simon Dooms, Toon De Pessemier, Luc Martens

A User-centric Evaluationof Recommender Algorithms for an Event Recommendation System

With the support of IWT Vlaanderen and FWO Vlaanderen


Requesting a Letter of Recommendation via … a Letter of Recommendation via MySacState Students should personally request a letter of recommendation from their recommender before

RECOMMENDER SYSTEMS WITH TRUST-BASED ...leichen/courses/comp5331/presentations...recommendation in social networks.” Proceedings of the fourth ACM conference on Recommender systems

Exploit Side Information for Recommender Systemweb.geni-pco.com/icwe2019/tutorial5.pdfrecommender system, recommendation, side information, knowledge graph … Overview of Recommender

Recommender Systems Laboratoriodia.apice.unibo.it/download/labs/recommendation-lab.pdf · Recommendation • L’oiettivo dell’eseritazione è fornire agli utenti del sito di e

The News Recommendation Evaluation Lab (NewsREEL)irml.dailab.de/wp-content/uploads/2016/07/20160711... · 2016-07-18 · The News Recommendation Evaluation Lab (NewsREEL) Recommender

User Modeling and Recommender Systems: recommendation algorithms

inter.tbs.tu.ac.thinter.tbs.tu.ac.th/wp-content/uploads/2018/02/... · Recommendation Form for Graduate Studyl (Academic Advisor) Recommender: This recommendation will ìN?main confidential

HYBRIDIZATION OF WEB PAGE RECOMMENDER SYSTEMS BASED …ijcert.org/ems/ijcert_papers/V6I501.pdf · recommendation. Machine Learning techniques used for recommender system are Clustering,

Recommendation Architecture - OpenTable - RecSys 2014 - Large Scale Recommender Systems

Performance of Recommender Algorithms on Top-N Recommendation Tasks

Mealionaire: A context-aware and ontology-based mobile recommender system for personalized cuisine recommendation

User-Centric Evaluation of a K-Furthest Neighbor Collaborative Filtering Recommender Algorithm

AppFunnel: A Framework for Usage-centric Evaluation of Recommender Systems that Suggest Mobile Applications

SEMANTIC RECOMMENDER SYSTEMS - deimURVdeim.urv.cat/~itaka/itaka2/PDF/acabats/PhD_Thesis/BorrasTesi.pdf · semantic recommender systems. Both content-based recommendation techniques

MSW Field Instructor Recommendation...MSW Field Instructor Recommendation TO THE RECOMMENDER: Pleaseype t the applicant's name below, along with yourinformation.These are professionalreferences;

International Studies Program - Waseda University · recommendation letter. Recommender must submit the recommendation letter from the “online submission system”, by following

Performance of Recommender Algorithms on Top-N Recommendation Tasks Gabriel Vargas Carmona 22.06.12

User-centric vs. System-centric Evaluation of Recommender ... · PDF fileUser-centric vs. System-centric Evaluation of Recommender Systems . Paolo Cremonesi. 1, Franca Garzotto , Roberto

Machine Learning Project Recommender Systempages.cpsc.ucalgary.ca/~mrichter/ML/Older... · Clear Goal • Recommender System for Music. • e.g. similar to Amazon’s Recommendation

Fuzzy Logic Based Recommender System · Fuzzy Logic Based Recommender System ... The goal of this project is to study recommendation engines and identify the shortcomings of traditional

Evaluating the Accuracy and Utility of Recommender Systems · Cremonesi - Recommender Systems Evaluation: A 3D Benchmark. Pro-ceedings of the Workshop on Recommendation Utility Evaluation:

Part IV: Recommendation with Deep Learning¤¾会计算_part4.pdf · • Product recommendation – Recurrent Neural Networks • POI recommendation . Overview of recommender systems

Variational Bayesian Context-aware Representation for Grocery Recommendation · 2020. 2. 11. · state-of-the-art grocery recommendation methods. KEYWORDS Context-Aware, Recommender

LNCS 8119 - User-Centric vs. System-Centric Evaluation of ... · Keywords: Recommender systems, E-tourism, Evaluation, Decision Making. 1 Introduction Recommender Systems (RSs) aim

Recommendation (Recommender) Systems - UZH

Confidential Letter of Recommendation PDF Electronic ......Confidential Letter of Recommendation — PDF Electronic Submission — Drexel University Instructions for Recommender: Drexel

A User-centric Evaluation of Recommender Algorithms for an Event

In-the-know: Recommendation Framework for City-supported ...faculty.missouri.edu/calyamp/publications/intheknow-recommender... · In-the-know: Recommendation Framework for City-supported

Pharos Social Map Based Recommendation For Content Centric Social Websites

Research on Personalized Recommendation in E …recommendation technique. Key words — Recommender System, Collaborative Filtering, Data Mining, Data Sparsity, Cold-Start I. INTRODUCTION

Networks for Web-Scale Recommender Systems Graph … · 2019-11-10 · Networks for Web-Scale Recommender Systems ... Recommender systems Graph-structured data essential for recommendation

Scienstein: A Research Paper Recommender System · DSI, Recommendation, Recommender Systems, Research paper. I. I. NTRODUCTION. Many scientists consider the search for related work

Recommender Systems an Introduction Chapter03 Content-based Recommendation

Recommendation Engine Acceleration Recommendation Engines · * Benchmarks obtained with Apache Spark framework; other recommender engine software may deviate from these results *

Explaining the user experience of recommender systemsAn integrated view on the user experience of recommender systems can be obtained by means of user-centric development (McNee et