Data Modeling in IPTV and OTT Recommender Systems

Download Data Modeling in IPTV and OTT Recommender Systems

Post on 23-Jan-2018

573 views

Category:

Data & Analytics

0 download

Embed Size (px)

TRANSCRIPT

<ol><li> 1. 1 DATA MODELING IN IPTV AND OTT RECOMMENDER SYSTEMS INFORMATION FLOW FROM INTERACTION TO PERSONALIZED RECOMMENDATIONS Dvid Zibriczky, ImpressTV Neo4j Meetup 2016-02-18 </li><li> 2. 2 Introduction </li><li> 3. 3 Who we are? Acquisition of IPTV, OTT and media business line of Gravity R&amp;D (July 2014) Technical Centre in Budapest, sales and management from the UK What we are doing? Providing personalized recommendations, data analytics, targeted advertising and audience measurement for corporate clients Main domains: Video-On-Demand, Linear TV, OTT, Advertisements About ImpressTV </li><li> 4. 4 More time spent watching media contents than ever Hundreds of channels, ten thousands of movies, millions of user uploaded videos Heterogeneous mixture of devices and items Massive consumption information Cloudization and centralization Then and Now </li><li> 5. 5 Source: http://bigscreenglobal.com/ </li><li> 6. 6 What is a Recommender System? </li><li> 7. 7 For the consumers Content discovery (relevance, time, information filtering) Exploring new preferences (habits, engagement) For the business Improving KPIs, balancing consumption (long tail contents) Promotions, targeting, campaign, analytics, reporting For the recommender system vendors Data integration/modeling, insights, data science, optimization, research Technology challenges, deployment, maintenance What does a Recommender System mean in TV business? </li><li> 8. 8 Data modeling </li><li> 9. 9 Data sources Interactions: Sources: Remote controller + interface, touchpad, mouse, keyboard Explicit / implicit feedbacks: Rating, like, (click) / buy, watch, record, subscribe, channel switch Context: Time, date, device, duration, price Item catalog: Sources: TV provider, external sources (Freebase, DBPedia, IMDb, ) Metadata: Descriptive (title, synopsis), technical (schedule, resolution, item type), commercial (price) User catalog: Sources: Internal, social network Metadata: Gender, age group, location Recommendation request: user id, item ids, device, location, time, session id </li><li> 10. 10 Lets build some graphs! </li><li> 11. Consumers (Mary) (Mark) (John) </li><li> 12. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents </li><li> 13. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents Star Wars IV. VOD (SD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 News BBC HD 07:00 Items Inception (HD) VOD/SVOD Linear (EPG items) CatchUp </li><li> 14. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents Star Wars IV. VOD (SD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 News BBC HD 07:00 Items HBO SD HBO 2 SD BBC HD Inception (HD) TV Channels </li><li> 15. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents Star Wars IV. VOD (SD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 News BBC HD 07:00 Items HBO SD HBO 2 SD BBC HD Friends Series Movie Channels Products Inception (HD) Star Wars Package Inception TVOD ($11.99) ($9.99) ($2.99) VOD/SVOD/Channel products </li><li> 16. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents Star Wars IV. VOD (SD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 News BBC HD 07:00 Items HBO SD HBO 2 SD Friends Series Movie Channels Products Inception (HD) Star Wars Package ($11.99) ($9.99) ($2.99) Inception TVOD Interface BBC HD Devices (remote controller, mouse, touch pad) </li><li> 17. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents Star Wars IV. VOD (SD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 News BBC HD 07:00 Items HBO SD HBO 2 SD Friends Series Movie Channels Products Inception (HD) Star Wars Package ($11.99) ($9.99) ($2.99) Inception TVOD (19:25; 1136s) (19:00) (16:13; 3715s) (20:10; 1135s) Interface BBC HD (21:11; 3651s; 5*) Implicit/Explicit feedbacks + context </li><li> 18. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents Star Wars IV. VOD (SD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 News BBC HD 07:00 Items HBO SD HBO 2 SD Friends Series Movie Channels Products Inception (HD) Star Wars Package ($11.99) ($9.99) ($2.99) Inception TVOD (19:25; 1136s) (19:00) (21:11; 3651s; 5*) (16:13; 3715s) (20:10; 1135s) Interface TV provider related space BBC HD </li><li> 19. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents Star Wars IV. VOD (SD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 News BBC HD 07:00 Items HBO SD HBO 2 SD Friends Series Movie Channels Products Inception (HD) Star Wars Package ($11.99) ($9.99) ($2.99) Inception TVOD (19:25; 1136s) (19:00) (21:11; 3651s; 5*) (16:13; 3715s) (20:10; 1135s) Interface TV provider related space TopGear S01 Friends S01 Friends S02 Collections BBC HD </li><li> 20. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents Star Wars IV. VOD (SD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 News BBC HD 07:00 Items HBO SD HBO 2 SD Friends Series Movie Channels Products Inception (HD) Star Wars Package ($11.99) ($9.99) ($2.99) Inception TVOD (19:25; 1136s) (19:00) (21:11; 3651s; 5*) (16:13; 3715s) (20:10; 1135s) Interface TV provider related space TopGear S01 Friends S01 Friends S02 Collections Movies Series Shows Domains Domain dependent contents BBC HD </li><li> 21. Friends S01E01 Friends S02E05 Consumers Friends S01E02 News 2016-02- 18 07:00 (Mary) (John) (Mark) Contents Star Wars IV. VOD (SD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 News BBC HD 07:00 Items HBO SD HBO 2 SD Friends Series Movie Channels Products Inception (HD) Star Wars Package ($11.99) ($9.99) ($2.99) Inception TVOD (19:25; 1136s) (19:00) (21:11; 3651s; 5*) (16:13; 3715s) (20:10; 1135s) Interface TV provider related space TopGear S01 Friends S01 Friends S02 Collections Movies Series Shows Domains TV Domain dependent contents Musics Books BBC HD </li><li> 22. Movies Series Shows Friends S01E01 Friends S02E05 Star Wars IV. VOD (SD) Inception (HD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Male Action Inception HBO 20:00 Domain dependent contents Collections Contents Items Products Interface Consumers TV Friends S01E02 Domains TV provider related space News 2016-02- 18 07:00 News News BBC HD 07:00 Harrison Ford Female Comedy HBO SD HBO 2 SD HD SD Friends Series Star Wars Package TopGear S01 Friends S01 Friends S02 Musics (19:25; 1136s) (19:00) (16:13; 3715s) ($11.99) Movie Channels ($9.99) (8880s; 20:00-22:28) (Mary) (John) (Mark) (20:10; 1135s) Inception TVOD ($2.99) (21:11; 3651s; 5*) BBC HD Meta data Books </li><li> 23. Movies Series Shows Friends S01E01 Friends S02E05 Star Wars IV. VOD (SD) Inception (HD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Male Action Inception HBO 20:00 Domain dependent contents Collections Contents Items Products Interface Consumers TV Friends S01E02 Domains TV provider related space News 2016-02- 18 07:00 News News BBC HD 07:00 Harrison Ford Female Comedy HBO SD HBO 2 SD HD SD Friends Series Star Wars Package TopGear S01 Friends S01 Friends S02 Musics (19:25; 1136s) (19:00) (16:13; 3715s) ($11.99) Movie Channels ($9.99) (8880s; 20:00-22:28) (Mary) (John) (Mark) (20:10; 1135s) Inception TVOD ($2.99) (21:11; 3651s; 5*) BBC HD Meta data Books </li><li> 24. 24 Graph representation Nodes Entities: Users, items, contents, product, collections Metadata: Genres, actors, category tree nodes, gender, age group Node properties: Auxiliary meta data (e.g. descriptions) Edges Interactions: Implicit/explicit feedbacks Metadata containment, relations Edge properties: Context, direction </li><li> 25. 25 Unification challenges PVR LiveTV CatchUp SVOD TVOD ADs Devices Social Networks Metadata sources TV items (providers) </li><li> 26. 26 Recommendations </li><li> 27. 27 Evolution of the Recommender Problem Source: http://www.slideshare.net/xamat/recsys-2014-tutorial-the-recommender-problem-revisited </li><li> 28. 28 </li><li> 29. 29 Collaborative Filtering </li><li> 30. Movies Series Shows Friends S01E01 Friends S02E05 Star Wars IV. VOD (SD) Inception (HD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Male Action Inception HBO 20:00 Domain dependent contents Collections Contents Items Products Interface Consumers TV Friends S01E02 Domains TV provider related space News 2016-02- 18 07:00 News News BBC HD 07:00 Harrison Ford Female Comedy HBO SD HBO 2 SD HD SD Friends Series Star Wars Package TopGear S01 Friends S01 Friends S02 Musics (19:25; 1136s) (19:00) (16:13; 3715s) ($11.99) Movie Channels ($9.99) (8880s; 20:00-22:28) (Mary) (John) (Mark) (20:10; 1135s) Inception TVOD ($2.99) (21:11; 3651s; 5*) BBC HD Meta data Books </li><li> 31. Movies Series Shows Friends S01E01 Friends S02E05 Star Wars IV. VOD (SD) Inception (HD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Male Action Inception HBO 20:00 Domain dependent contents Collections Contents Items Products Interface Consumers TV Friends S01E02 Domains TV provider related space News 2016-02- 18 07:00 News News BBC HD 07:00 Harrison Ford Female Comedy HBO SD HBO 2 SD HD SD Friends Series Star Wars Package TopGear S01 Friends S01 Friends S02 Musics (19:25; 1136s) (19:00) (16:13; 3715s) ($11.99) Movie Channels ($9.99) (8880s; 20:00-22:28) (Mary) (John) (Mark) (20:10; 1135s) Inception TVOD ($2.99) (21:11; 3651s; 5*) BBC HD Meta data Books </li><li> 32. Star Wars IV. VOD (SD) Inception (HD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 Items Products Interface Consumers News BBC HD 07:00 HBO SD HBO 2 SD Friends Series Star Wars Package (19:25; 1136s) (19:00) (16:13; 3715s) ($11.99) Movie Channels ($9.99) (8880s; 20:00-22:28) (Mary) (John) (Mark) (20:10; 1135s) Inception TVOD ($2.99) (21:11; 3651s; 5*) BBC HD </li><li> 33. Star Wars IV. VOD (SD) Inception (HD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Inception HBO 20:00 Items Consumers News BBC HD 07:00 (8880s; 20:00-22:28) (Mary) (John) (Mark) </li><li> 34. 34 Collaborative Filtering / Graph representation The Matrix The Matrix 2 The Matrix 3 Twilight </li><li> 35. 35 Collaborative Filtering / Matrix representation The Matrix The Matrix 2 The Matrix 3 Twilight R The Matrix The Matrix 2 Twilight The Matrix 3 User 1 1 1 ? ? User 2 1 1 0 0 User 3 1 0 1 1 User 4 1 0 0 1 ? ? </li><li> 36. 36 Collaborative Filtering / Binary preference matrix R The Matrix The Matrix 2 Twilight The Matrix 3 User 1 1 1 ? ? User 2 1 1 0 0 User 3 1 0 1 1 User 4 1 0 0 1 </li><li> 37. 37 Collaborative Filtering / Implicit MF R The Matrix The Matrix 2 Twilight The Matrix 3 User 1 User 2 User 3 User 4 Q PT : preference matrix : user feature matrix : item feature matrix : #users : #items : #features , ~ = T </li><li> 38. 38 Collaborative Filtering / Implicit MF / Weighted Sum of Squared Errors R The Matrix The Matrix 2 Twilight The Matrix 3 User 1 1 1 ? ? User 2 1 1 0 0 User 3 1 0 1 1 User 4 1 0 0 1 C The Matrix The Matrix 2 Twilight The Matrix 3 User 1 c11 c12 1 1 User 2 c21 c22 1 1 User 3 c31 1 c33 c34 User 4 c41 1 1 1 , = = (,) Objective Function: </li><li> 39. 39 Collaborative Filtering / Implicit MF / Alternating Least Squares R The Matrix The Matrix 2 Twilight The Matrix 3 User 1 User 2 User 3 User 4 Q 0.1 -0.4 0.8 0.3 0.6 0.7 -0.1 0.8 PT -0.2 0.6 0.6 0.4 0.7 -0.2 0.5 -0.2 ~ = T Ridge Regression = T 1 = T 1 </li><li> 40. 40 Collaborative Filtering / Implicit MF / Alternating Least Squares R The Matrix The Matrix 2 Twilight The Matrix 3 User 1 User 2 User 3 User 4 Q 0.3 -0.3 0.6 0.2 0.7 0.8 0.2 0.7 PT -0.2 0.6 0.6 0.4 0.7 -0.2 0.5 -0.2 Ridge Regression = T 1 = T 1 ~ = T </li><li> 41. 41 Collaborative Filtering / Implicit MF / Alternating Least Squares R The Matrix The Matrix 2 Twilight The Matrix 3 User 1 User 2 User 3 User 4 Q 0.3 -0.3 0.6 0.2 0.7 0.8 0.2 0.7 PT -0.2 0.7 0.6 0.5 0.8 -0.2 0.6 -0.2 Ridge Regression = T 1 = T 1 ~ = T </li><li> 42. 42 Collaborative Filtering / Implicit MF / Alternating Least Squares R The Matrix The Matrix 2 Twilight The Matrix 3 User 1 0.02 0.45 User 2 User 3 User 4 Q 0.3 -0.3 0.6 0.2 0.7 0.8 0.2 0.7 PT -0.2 0.7 0.6 0.5 0.8 -0.2 0.6 -0.2 ~ = T </li><li> 43. 43 Content-based Filtering </li><li> 44. Movies Series Shows Friends S01E01 Friends S02E05 Star Wars IV. VOD (SD) Inception (HD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Male Action Inception HBO 20:00 Domain dependent contents Collections Contents Items Products Interface Consumers TV Friends S01E02 Domains TV provider related space News 2016-02- 18 07:00 News News BBC HD 07:00 Harrison Ford Female Comedy HBO SD HBO 2 SD HD SD Friends Series Star Wars Package TopGear S01 Friends S01 Friends S02 Musics (19:25; 1136s) (19:00) (16:13; 3715s) ($11.99) Movie Channels ($9.99) (8880s; 20:00-22:28) (Mary) (John) (Mark) (20:10; 1135s) Inception TVOD ($2.99) (21:11; 3651s; 5*) BBC HD Meta data Books </li><li> 45. Star Wars IV. VOD (SD) Inception (HD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Action Inception HBO 20:00 Contents Items Products Interface Consumers News News BBC HD 07:00 Harrison Ford Comedy HBO SD HBO 2 SD HD SD Friends Series Star Wars Package (16:13; 3715s) Movie Channels (8880s; 20:00-22:28) (John) (20:10; 1135s) Inception TVOD BBC HD </li><li> 46. Star Wars IV. VOD (SD) Inception (HD) Star Wars VII. VOD (HD) Inception CatchUp feb 17 Inception HBO2 22:00 Friends S01E01 SVOD Inception PVR 20:00 Action Inception HBO 20:00 Contents Items Products Consumers News News BBC HD 07:00 Harrison Ford Comedy HD SD (8880s; 20:00-22:28) (John) </li><li> 47. 47 Content-based Filtering / Cosine Similarity (1/6) Sci-Fi RomanceAdventure The Matrix The Matrix 2...</li></ol>

Recommended

View more >