Upload File

real time visibility of iptv subscriber experience … › conferences › 2009 ›...

  • Home
  • Documents
  • REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management
21
REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE AND VIEWING ACTIVITY Alan Clark CEO, Telchemy Incorporated

Upload: others

Post on 28-Jun-2020

3 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

REALTIMEVISIBILITYOFIPTVSUBSCRIBEREXPERIENCEANDVIEWINGACTIVITY

AlanClark

CEO,TelchemyIncorporated

Page 2: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

Outline

•  STB‐centricperformancemanagement?

•  MeasuringIPTVsubscriberexperience–how and why? 

•  ViewingacGvity–ra+ngs in real +me •  AgentsinSetTopBoxes•  IPTVPerformanceManagementArchitecture•  Summary–implementaGonstatusandbenefits

Page 3: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

STB‐CENTRICPERFORMANCEMANAGEMENT

•  IntelligentperformancemonitoringagentsinSTB’smeasuresubscriberQoE,viewingstaGsGcs….

•  STBagents“push”compactreportstomanagementmiddleware

•  ManagementmiddlewarecollectsandreportsrealGmeperformancedata

Middleware Metrics

Real-Time Dashboard

STB

Page 4: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

IPTVSERVICEMODEL

Channel

Multicast IP network

GPON or DSL

Page 5: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

CHANNELPROBLEM

Channel

Multicast IP network

GPON or DSL

*

*

*

Page 6: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

ROUTER/MSANPROBLEM

Channel

Multicast IP network

GPON or DSL

*

*

*

*

Page 7: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

BANDWIDTHPROBLEM

Channel

Multicast IP network

GPON or DSL

*

*

*

Page 8: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

STB‐CENTRICPERFORMANCEMANAGEMENT

•  STBagentsmeasurequalityandviewingacGvity

•  DataincorporatedintoreportsupportsrealGmecorrelaGon•  ManagementmiddlewarecorrelatesarrivingdatainrealGme,

idenGfiesproblemsandreportsrealGmeperformancedata

Middleware Metrics

Real-Time Dashboard

STB

Page 9: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

WHYSTB‐BASEDAGENTS?

•  Providesnearreal‐GmevisibilityofQoE–  dataisreportedwithinminutes

•  ProacGvelydetectsproblemsaffecGngservice– Middlewarecorrelatesarrivingreportsastheyarrive

•  Providesfeedbackfromcustomerpremise–  Networkprobesdon’tseeintothecustomerhome

•  Morescalableandlessexpensivethannetworkbasedprobes

Page 10: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

MEASURINGSUBSCRIBEREXPERIENCE

•  Goal– MeasureIPTVservicequalitydeliveredtoeachsubscriber–  Determineimpactofsignificantvideoencodingortransmissionproblemsondecodedvideo

–  IdenGfysourceofproblems

•  AdvantagesofSTBbasedapproach–  ProacGve–seeproblemsquickly

–  CorrelaGonofSTBreportscanidenGfywiderangecommonfactorsinrealGme

–  Candetectoutages(i.e.absenceofreports)

Page 11: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

MEASURINGVIEWINGACTIVITY

•  Goal–  IdenGfychannelwatchedbysubscriber,trackGmeonchannel

–  AggregatetogiverealGmevisibilityofviewersperchannel

•  AdvantagesofSTBbasedapproach–  CoversenGresubscriberbase(notsampled)–  DataavailableinnearrealGme

–  Providesdataonlesswatchedchannels(whichsamplingapproachescan’t)

Page 12: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

AGENTSINSETTOPBOXES

NWI/F

VideoDecoder

VideoOutput

EPG

IPTV Set Top Box

Low complexity IPTV performance monitoring agent (~5-10% of STB CPU)

SQlive

DRM

Page 13: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

STBAGENTARCHITECTURE

ContentAnalysis

MPEGDemux

PerceptualQualityModel

PlayoutBuffer

Emulator

I/B/Pframe

detecGon

MPEGTR101290Metrics

Blank,FrozenImage

DetecGonMoGon

BlockinessModel

PerFrameQualityI/B/P

framedetecGon

Codec/BandwidthModel

ReportGeneraGon

SQlive

Page 14: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

STBREPORT

Interval‐ Cross‐channel metrics, overall experience 

‐  Correla+on tags 

Per‐Channel‐ detailed metrics, QoE scores, Video MOS 

‐ MPEG transport metrics… ‐ Time spent on channel 

Page 15: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

MIDDLEWARE

TaskArea

Service Quality

Problem: Types

Packet Loss

Congestion

Delay

………..

Problems: Correlation

Core Network

Access Network

Customer Premise

…….

Alerts User Impact Alert Rate

5m 15m 1h 6hr 24hr 7d

5m 15m 1h 6hr 24hr 7d

5m 15m 1h 6hr 24hr 7d

5m 15m 1h 6hr 24hr 7d

5 4 3 2 1

Top Channels

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Lowest Quality Channels

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

ReportCollecGon

CorrelaGon

ReporGng

TaskArea

Service Quality

Problem: Types

Packet Loss

Congestion

Delay

………..

Problems: Correlation

Core Network

Access Network

Customer Premise

…….

Alerts User Impact Alert Rate

5m 15m 1h 6hr 24hr 7d

5m 15m 1h 6hr 24hr 7d

5m 15m 1h 6hr 24hr 7d

5m 15m 1h 6hr 24hr 7d

5 4 3 2 1

Top Channels

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Lowest Quality Channels

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Web GUI Dashboards

Pre-correlated data in database

Page 16: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

MIDDLEWARE–IDENTIFYINGPROBLEMS

Head End

Subscriber A

Subscriber B

Subscriber C

Subscriber D

Correlate by channel and by correlation tags to identify type and scope of problems

Tags

Tags

Tags

Tags

Page 17: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

MIDDLEWARE–VIEWINGSTATISTICS

Subscriber A

Subscriber B

Subscriber C

Subscriber D

Correlate by channel and by correlation tags to identify type and scope of problems

Tags

Tags

Tags

Tags

Current viewers per channel

Page 18: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

MIDDLEWARE–VIEWINGSTATISTICS

•  SeeviewingacGvitywithin(typically)10‐15minutes

•  StaGsGcsspanallchannelsbeingwatched(downto1subscriber)

•  StaGsGcsareanonymizedbutretainscorrelaGondata

•  ProvidefeedbacktoadverGsersonviewingacGvityandquality

•  Granularitysufficientforadtracking

TaskArea

Service Quality

Problem: Types

Packet Loss

Congestion

Delay

………..

Problems: Correlation

Core Network

Access Network

Customer Premise

…….

Alerts User Impact Alert Rate

5m 15m 1h 6hr 24hr 7d

5m 15m 1h 6hr 24hr 7d

5m 15m 1h 6hr 24hr 7d

5m 15m 1h 6hr 24hr 7d

5 4 3 2 1

Top Channels

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Lowest Quality Channels

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

Channel 10

5m 15m 1h 6hr 24hr 7d

Top Channels

Channel 12 Channel 47 Channel 33 Channel 10 Channel 71 Channel 62 Channel 15 Channel 27 Channel 10 Channel 05

Lowest Quality Channels

Channel 15 Channel 03 Channel 45 Channel 17 Channel 06 Channel 59 Channel 14 Channel 34 Channel 51 Channel 54

Page 19: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

IPTVPERFORMANCEMANAGEMENTARCHITECTURE

Channel GPON or DSL

MiddlewareFuncGons

CollecGon/CorrelaGon

AgentConfiguraGon

Agent in STB or ONU

Page 20: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

RELATEDSTANDARDSACTIVITIES

•  ITU‐T–  IPTVQoEMeasurement–ITU‐TSG12P.NAMS–  PerformanceManagementReporGngModels–ITU‐TP.IPTV‐PMR

•  ATISIIFQOSMTaskForce–  ATIS0800008QoSMetricsforLinearBroadcast

•  IndustryForums–  BroadbandForum–  VSF

Page 21: REAL TIME VISIBILITY OF IPTV SUBSCRIBER EXPERIENCE … › Conferences › 2009 › STB_2009_telchemy.pdf– IPTV QoE Measurement – ITU‐T SG12 P.NAMS – Performance Management

SUMMARY

•  STB‐centricperformancemanagement– MeasuringIPTVsubscriberexperience – MeasuringviewingacGvity 

–  AgentsinSetTopBoxes–  IPTVPerformanceManagementArchitecture

•  ImplementaGonStatus–  Earlycommercialdeployment

–  IntegratedintoseveralmajorSTBproductranges

•  QuesGons?


IPTV Index System White Paper - huawei/media/CNBG/Downloads...IPTV index system is divided into three levels: user experience QoE layer, service KQI layer and network KPI layer. At

Mobile Network Testing ENSURING QOE IN 5G NETWORKS · INTERACTIVITY SCORE –THE QOE MODEL 27 For emulating ‘real’ applications we will apply a generic QoE model The QoE model

On QoE Metrics and QoE Fairness for Network & Traffic Management

SG12 L1 - Rotating Equipment (Pumps)

ITU-T SG12 overview Performance, QoS and QoE · ITU-T SG12 overview Performance, QoS and QoE 1. ... – development of multimedia quality assessment methodologies, ... Analysis methods

IPTV STB and QoS/QoE Speaker ：林裕強 Date ： 2010/11/5

SG12 ApoEinl 1808 F - Schwabe Austria

automatic testing and measurement of QoE in IPTV

Overview of SG12 Regional Group for Africa

QoS/QoE Issues on IPTVC0%CC%C7... · 2012-03-20 · 3 1.1 iptv 품질관리배경및구성도 qos/qoe를고려한iptv 서비스품질관리중요성 bcn 홖경에서의다양한개인맞춤형멀티미디어서비스제공

IPTV QoE Monitoring

White Paper Ensure IPTV Quality of Experience › files › files › jdsu_protokol analiza... · Step 3: Write test plans and select appropriate test tools to measure IPTV QoE. Step

Decompiling QoE

53405712 SG12 L1 Rotating Equipment Pumps

İnternet Protokolü Televizyon (IPTV) Hizmetinin …ilef.ankara.edu.tr/wp-content/uploads/id_3_1_2.pdfExprience - QoS/QoE), güvenlik, etkileşim ve güvenilirlik sağlayacak şekilde

Ist-muse.org On the Enhancement of QoE for IPTV Services through Knowledge Plane Development Bart De Vleeschauwer Wim Van de Meerssche Pieter Simoens Filip

Multi-Resolution Multimedia QoE Models for IPTV Applicationsfaculty.missouri.edu/calyamp/publications/iptv_perf_ijdmb11.pdfordered and time-ordered FIFO. We evaluate the performanceof

&RQVWUXFWLRQ3DUWV FRP Replacement Part Diagrams SG12 ...€¦ · sg12 grinders form gomxxxxxxxx, version 1.0, authorization: xxx, page: reference number part number description qty

IPTV Index System White Paper - · PDF filenetwork KPI layer. ... QoE refers to industry standard vMOS and HUAWEI's U-vMOS. ... IPTV index system white paper Issue 1.0 (2017-08-23)

Testing MPEG based IP video QoE/QoS - AVOTELTesting IPTV/VoD media streams over converged IP or Triple Play networks is a daunting and somewhat unfamiliar area for many. IPTV has added

Emerging Trends in 5G/IMT2020 - SLT.co · capabilities (G.fast and Optics) in ITU-T SG15 •Identify QoS/QoE requirements in ITU-T SG12 and Security capability in ITU-T SG17 •VR/AR

IP Video Quality Testing Oct 2008. 2 Agenda Video Networks IP Video QoS QoS and QoE mapping vs Network Segments IPTV testing Trouble-shooting Noise Analysis

City klinikka liikahikoilun hoito botoxilla turvallisesti ja nopeasti - sg12

Old Chapel, Whempstead Road Whempstead, Ware SG12€0PL€¦ · Old Chapel, Whempstead Road Guide price £995,000 Whempstead, Ware SG12€0PL. A pretty local landmark, this enchanting,

IPTV Application Development | Channel development with Newvue IPTV platform provider | IPTV app dev | application developers IPTV | IPTV OTT middleware development

Www.symmetricom.com QoE Division Yves Cognet CTO Quality of Experience metrics for IPTV

Skripsi qoe

automatic testing and measurement of QoE in IPTV72.52.166.148/conferences2009/filesINTERNET09/IARIA IPTV QoE v1… · Set-top box: IPTV client, DRM, video decoder Subscriber identification

User-centered Research at FTW, QoE and the ACE Project · QoE for Mobile Broadband Services - QoE for web browsing, downloads, etc. - QoE prediction in 3G networks via passive monitoring

IPTV Quality Monitoring and Testing Products...Cable TV IPTV Satellite TV DVB-T Broadcast Center Headend Corporate IPTV Campus IPTV ISP with IPTV Hospitality IPTV IPTV Lab IPTV Manufacturer

CDR QoE RGS CDR QoE RGS Help available from >

SG12 (Noviembre-Diciembre 2006)

SG12-110 Gill Singh

Paper Quantifying the Suitability of Reference Signals for ... · Paper Quantifying the Suitability of Reference Signals for the Video Streaming Analysis for IPTV ... QoE/QoS measurements

Introduction to ITU Regional Group of SG12 for Africa