mark stephenson

7/28/2019 Mark Stephenson

1/28

Presented by:

6/24/2013 1

Achieving Maximum Quality Assurancefor Video Distribution

Mark Stephenson


2/28

2

Psytechnics is a BT spin-out (2000) Strong credentials

12+ years research in BT 5 ITU-T world standards

P.862 PESQ P.862.2 Wideband PESQ P.562 Call Clarity Index P.563 [passive voice waveform] J.144 Broadcast video

35+ patents

200,000+ subjective test scores 30+ licensees

Now supporting the industrys transition toCustomer experience management

About Psytechnics

About Psytechnics
http://bt.com/index.jsp?obsOID=30777&obsPage=/index.jsp&vStore=1128&obsType=LINK&obsNoSee=true


3/28

3

Presentation Outline

Industry Landscape

Network management today What do we mean by quality?

Conventional metrics dont get you there

Usefulness of network and end-point

instrumentation Early handset deployments

Multi-media agents for 3G video services


4/28

4

Migration of existing networks to IMS for NGN and 3G

Wireless being challenged from fixed and new entrant

WLAN operators

Innovation required in tariffs, new services and

applications -Video and Data Services

Fixed mobile convergence / mobile substitution

threatened

Changing / Uncertain regulatory environment

The Telecoms Environment


5/28

5

Top Line - Drive up ARPU per subscriber withinnovative and high quality content and services

Bottom Line - Drive down OPEX cost migration to IP

core in UMTS release 4 Reduce Subscriber Churn Limiting the cost ofcustomer Acquisition (typical churn rates >30%)

Customers EXPECT good speech, audio and videoquality

Customers are more demanding, want moreservices, with better quality NOW

Managing Customer Satisfaction is the keychallenge associating the brand with Quality andthen delivering this for all service categories

Wireless Operator Challenges


6/28

6

Observation

Managing voice

audio and video quality arecritical success factors for

wireless carriers


7/28

7

What is Quality?

Customer

Customer Experience

and Opinion

Mean Opinion Score (MOS)

5

4

3

2

1

5Excellent

4Good

3Fair

2Poor

1Bad

Excellent

Good

Fair

Poor

Bad


8/28

8

Customer Experience: Mean Opinion Score

5Excellent

3Fair

2Poor

1Bad

4Good

*


9/28

9

Service management

decisions are typically based

on technical measurements

in the network

e.g.

-Mobile: Radio Signal (RxQual,

RxLev, BER), Customer Surveys

and/or complaints, Network KPIs

-IP Telephony: packet loss, jitter &

delay used to estimate VoIP

network quality

Failure of conventional performance metrics - how is

service Quality Measured today?


10/28

10

Beyond Simple Networks statistics

Simple network statistics

such as packet loss level will

not mirror users perception

1% packet loss(evenly distributed)

1% packet loss(bursty)

1% packet loss(jitter)

3 examples with same content, bit rate, frame rate,

codec and level packet loss but different MOS values


11/28

11

Service Quality Management Today

Video SMS Voice MMS

N

etworkLayer

ServiceLay

er

BTS SGSN

GGSN

BSC

MSC/VLR

HLR

BGW

Node B RNC

ATM IP SDH

Network Assurance

Management

Event Streams

Inventory

Management

Performance

Managementcalculate

Subscriber

Estimate Service Impact
http://images.google.co.uk/imgres?imgurl=http://www.alcatel.ru/products/transmission/all/su/a5620nm/5620.jpg&imgrefurl=http://www.alcatel.ru/products/fixed/all/access-networks/a5620nm/&h=201&w=180&sz=7&tbnid=51mO-JsEZFUJ:&tbnh=98&tbnw=88&start=41&prev=/images%3Fq%3Dnetwork%2Bmanager%26start%3D40%26hl%3Den%26lr%3D%26sa%3DN


12/28

12

The consequences of this to the Network Operator

Delivery of less than optimum service levels onincreasingly complex/mixed mode networks

New services commissioning timeline increased

dramatically Unnecessary Resource required to firefight 000s of

non customer-impacting alarms

Miss-targeting of spend on:

Infrastructure,Maintenance,Customer Support

Quality SLAs are impossible to implement for mixedmedia services across multi mode networks/devices

Which all contribute and lead to....Customer Dissatisfaction


13/28

13

Service Quality Management Tomorrow

Video SMS Voice MMS

N

etworkLayer

ServiceLay

er

BTS SGSN

GGSN

BSC

MSC/VLR

HLR

BGW

Node B RNC

ATM IP SDH

Network Assurance

Management

Event Streams

Inventory

Management

Performance

Managementcalculate

Subscriber

Estimate Service Impact

CustomerExperience

Database Server

Psytechnicsembedded agent

True Customer Experience
http://images.google.co.uk/imgres?imgurl=http://www.alcatel.ru/products/transmission/all/su/a5620nm/5620.jpg&imgrefurl=http://www.alcatel.ru/products/fixed/all/access-networks/a5620nm/&h=201&w=180&sz=7&tbnid=51mO-JsEZFUJ:&tbnh=98&tbnw=88&start=41&prev=/images%3Fq%3Dnetwork%2Bmanager%26start%3D40%26hl%3Den%26lr%3D%26sa%3DN


14/28

14

Evolution of Video Services

Still image capture & sharing (MMS)

Video download & play, capture & sharing (video MMS)

Video streaming

Video telephony: real-time person-to-person video call

Multicasting


15/28


16/28

16

Video Quality Issues: Streaming

Codecs and players Encoding bit rates and frame rates

Server

Transmission bit rates (network bandwidth)

Device buffering capacity

StreamingServer


17/28

17

Video Quality Issues - Video Telephony

Codecs and players Encoding bit rates

Error profile

Transmission bit rates (network bandwidth)

Latency: end-to-end video delay

Network

M bil Vid C d


18/28

Mobile Video Codecs

File format

File

extension Video codec

Standard/

Proprietary

Examples of

phones

RealMedia .rv,.rm RealVideo 8RealNetworks

proprietary codec

Nokia 6600, 3650,

N-gage, Siemens

SX1

Windows

Media.wmv

Windows

Media Video

8

Microsoftsproprietary codec

for Smartphones

and PC pocket

phones

Motorola MPx200,Samsung i600

O2 XDAII,

Samsung i700,

Siemens SX56

3GPP .3gp

H.263

MPEG-4

Visual Simple

Profile

International

standard

All phones must

support 3GPP

standard


19/28

19

Infrastructure for Mobile Video Services

Devices Network

ContentApplications


20/28


21/28

21

IP Parametric Video Quality MeasurementKnown

input/referencevideo

Output/degradedvideo

Coder Decoder

Perceptual

MOS

5Excellent

4Good

3Fair

2Poor

1Bad

Other

metrics

Network/Transmission chain

impairments

Perceptual video model

Live IP traffic


22/28

22

Extract Talker

Characteristics

Vocal Tract

Parameter

Extraction

Error

Identification

12 3 4

5

6

1

2

3456

Handset application

User experience measured by handset agent


23/28

23

Handset agent applications

2G and 3G voice wav

eform

3G multi-media Passive monitor using a population of handsets :- mobile operator enterprise clients

- deployment via employed workforce- Complement to existing drive tests

- Real time view of network performance

2G and 3G - Voice waveform analysis for voice services

3G - IP-bearer analysis for audio and video, multi-media


24/28

24

Mobile multi-media

Wireless Access e.g. WiFi or dual mode

2G/3G

UMAN

Handset Agent2G voice waveform

3G voice waveform

3G IP multimedia

Customer centric performance overview

Handset agents reveal customer usage/experience

Network probe for uplink performance and signalling

Database

quality analysis

Network

Management

System

Content Server Broadcast Feed

ContentAssurance

Content

Psytechnics

voice monitor

Psytechnics

video monitor

Multi-media

Monitor Platform

External probeor embedded


25/28

25

Network monitoring and

management views

Customer centric performance overview

MOS thresholds and alarms

Detailed diagnostics

Rapid detection of service affecting faults


26/28

26

Quality Assurance for Video services

Network Build Phase - Active End to End Testing for VideoStreaming and Video Telephony services

Network and End User Service Assurance

Monitor service quality by passively monitoring the delivery network

Monitor service delivery by passively monitoring by use of mobilehandset agent

Content - Optimise encoding parameters for different contenttypes for video streaming services


27/28

27

Psytechnics Video Quality

Software measurementagents for network build andoptimisation applications

Modelled on complex, multi-vendor, multi-operatornetworks

Designed for use across allnetwork technologies andservices

Quality measurement helpsservice providers balance

quality and cost whenlaunching and managing allvideo services

MOS prediction


28/28

Presented by:

6/24/2013 28

[email protected]+447884 310132

www.psytechnics.com
mailto:[email protected]:[email protected]://www.psytechnics.com/http://www.psytechnics.com/mailto:[email protected]

mark stephenson

Documents