aws re:invent 2016: architecting a 24x7 live linear broadcast for 100% availability on aws (ctd201)

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 1

Jesse Rosenzweig – Chief Technology Officer, AWS Elemental

Euan McLeod – Global Head of Live Video Streaming, Amazon Video

November 29, 2016

CTD201

Better than BroadcastArchitect 24/7 Live Linear Video Experiences on AWS

2

Overview

• Multiscreen content delivery demands

• How AWS enables live linear workflows

• Building advanced media workflows

• Amazon Video – real-time workflow implementation

3

Delivering multiscreen contentMarkets

Enterprise Government

Broadcasters

Content programmers

Pay TV operators

Content

Live

On demand

S3

Displays

Devices

AWS acquired Elemental Technologies in October 2015

4

Live is more than linear

LIVE CONTENT

Historically dominated by broadcasts

Record, rewind, start over

Expected to always be included

ADVANCED FEATURES

5

Trade capital expense

for variable expense

Pay for media you store

and process, as you go

Benefit from massive

economies of scale

Media focused storage and

compute solutions

Stop guessing capacity

Handle unpredictable and

bursty media needs

Increase speed and agility

Decrease time-to-market, test out

new approaches

Go global in minutes

Global availability

instantly, with no commit

Cloud meets the demands of multiscreen

6

Advanced 24/7 live video delivery challenges

• Incoming streams come in many streaming types and are high bandwidth

• Maintain the reliable, robust viewing experience consumers expect

• Continued evolution of the consumer experience

• Unpredictable capacity requirements

Live Source Display Devices

7

Highly reliable content ingest

INGEST

Satellite, Fiber,

IP Network

SOURCE

LOAD BALANCER

CDN 2

CDN X

Amazon

CloudFront

ELEMENTAL CLOUDAWS REGION 2

INGEST LOGIC

DISPLAY DEVICES

Redundant

feeds

Amazon

RDS

Amazon

S3

LOAD BALANCER

ELEMENTAL CLOUDAWS REGION 2

INGEST LOGIC

Amazon

RDS

Amazon

S3

AWS Direct

Connect

AWS Direct

Connect

8

High availability, high quality ingest options

Broad range of content sources

• Same inputs as on premises

• Fiber and satellite and Internet sources

• No compromise contribution format support

• 4:2:2, high bit rate, advanced caption/metadata

Reliable real-time video transfer

• AWS Direct Connect for highest privacy and QoS

• Enable contribution over the public Internet

9

LOAD BALANCER

CDN 2

CDN X

Amazon

CloudFront

ELEMENTAL CLOUDAWS REGION 2

INGEST LOGIC

Reliable processing enabling advanced experiences

DISPLAY DEVICES

Redundant

Feeds

PROCESSSING

Amazon

RDS

Amazon

S3

LOAD BALANCER

ELEMENTAL CLOUDAWS REGION 2

Direct

Connect

INGEST LOGIC

Amazon

RDS

Amazon

S3

Satellite, Fiber,

IP Network

SOURCE

AWS Direct

Connect

AWS Direct

Connect

10

Pay-as-you-go video processing and storage

Content creation and delivery on demand

• Same workflow and resiliency for events and 24/7 application

• Create channels on demand

Scalable cloud storage

• Continuous content archiving

• Eliminate physical storage constraints

11

Delivery and playback

LOAD BALANCER

CDN 2

CDN X

Amazon

CloudFront

ELEMENTAL CLOUDAWS REGION 2

INGEST LOGIC

DISPLAY DEVICES

Redundant

Feeds

Amazon

RDS

Amazon

S3

LOAD BALANCER

ELEMENTAL CLOUDAWS REGION 2

Direct

Connect

INGEST LOGIC

Amazon

RDS

Amazon

S3

Satellite, Fiber,

IP Network

SOURCE

AWS Direct

Connect

AWS Direct

Connect

12

Satellite and

Fiber Network

SOURCE

LOAD BALANCER

CDN 2

CDN X

Amazon

CloudFront

ELEMENTAL CLOUD

LOAD BALANCER

AWS REGION 2

AWSDirect

Connect

INGEST LOGIC

AWS REGION 1

AWSDirect

Connect

INGEST LOGIC

ELEMENTAL CLOUD

End-end agility, scalability, resiliency

Origin

Cache

DISPLAY DEVICES

Video

Player Video

Player

Redundant

Feeds

13

Amazon Video live streaming

Euan McLeod

14

Case study: Amazon Video live streaming

15

Type of Amazon Video live delivery

• Ad hoc events

• Tentpole events

• 24/7 live linear

16

MACKLEMORELIVE

17

18

CNN News Source let us know that

they included the story in today’s

“Hollywood Minute,” which went out to

their 1,000+ affiliates.

19

Walkthrough / demo of Amazon Video interface?

20

Premium video: the core of

what we’re offering

HOW WE LOOK AT QUALITY

Tradeoffs

become

important

Delivering quality video

experience

21

Tradeoffs

become

important

Delivering Quality Video

experience

Reliability

Playback

start time

Video

quality

Priority of tradeoffs

We set goals for all, and we invent

new technologies to push the

boundary where these tradeoffs

must be made.

1

23

HOW WE LOOK AT QUALITY

22

Premium video: the core of

what we’re offering

Measuring

and improving

playback

HOW WE LOOK AT QUALITY

Tradeoffs

become

important

Delivering quality video

experience

23

Premium video: the core of

what we’re offering

Customer

trust

HOW WE LOOK AT QUALITY

Measuring

and improving

playback

Tradeoffs

become

important

Delivering quality video

experience

24

Satellite and

Fiber Network

SOURCE

LOAD BALANCER

CDN 2

CDN X

Amazon

CloudFront

ELEMENTAL CLOUD

LOAD BALANCER

AWS REGION 2

AWSDirect

Connect

INGEST LOGIC

AWS REGION 1

AWSDirect

Connect

INGEST LOGIC

ELEMENTAL CLOUD

Amazon

Redshift

Amazon

SQS

Amazon

EC2

Amazon

SNS

OTHER AWS SERVICES USED

Amazon

Route 53

Amazon Video live streaming workflow

Origin

Cache

DISPLAY DEVICES

Video

Player Video

Player

Key Server DRM License Server

Redundant

Feeds

Monitoring System

Optimization Services

(Origin/CDN Selection,,

Heuristics, Manifest)

Policy Management

QoS Events

25

Redundant Feeds

BROADCAST

CENTER

LOAD BALANCER

CDN 2

CDN X

Amazon

CloudFront

ELEMENTAL CLOUD

LOAD BALANCER

AWS REGION 2

AWSDirect

Connect

INGEST LOGIC

AWS REGION 1

AWSDirect

Connect

INGEST LOGIC

ELEMENTAL CLOUD

Amazon

Redshift

Amazon

SQS

Amazon

EC2

Amazon

SNS

OTHER AWS SERVICES USED

Amazon

Route 53

Amazon Video scheduled broadcast / event workflow

Origin

Cache

DISPLAY DEVICES

Video

Player Video

Player

Key Server DRM License Server

Monitoring System

Optimization Services

(Origin/CDN Selection,,

Heuristics, Manifest)

Policy Management

QoS Events

BROADCAST

CENTER

26

Advanced monetization

Recommendation ticker

27

Media streaming specific improvements to CloudFront

Intelligent prefetching

5 Mbps

2.5 Mbps

1 Mbps

512 Kbps

256 Kbps

Dynamic manifest support

CloudFront

edge

Prefetch video fragments into cache at

the requested and adjacent bit rates to

reduce cache misses

AV URL vending

service

Dynamic manifest

service

Media FragmentsMedia

fragments

Built support for requesting a dynamically

generated manifest to optimize bit rate

availability based on device to improve

quality of playback

.m3u8

28

More popular titles Less popular titles

% o

f sessio

ns w

ith

ou

t err

ors

an

d r

eb

uff

ers

CloudFrontOther

CDNs

METRO ARCHITECTURE

CloudFront

We also use AWS innovation for VOD content

• Achieved through

adjacent prefetching

• And other video packet

delivery optimization

29

• Large-scale deployment of high quality video via the

cloud is now possible and is happening

• Cloud workflows can be engineered to be as resilient

and reliable as on-premises workflows

• Consumers expect a rich dynamic viewing experience

that is best built on AWS / Elemental

Conclusion

Thank you!

30