aws 2013 la media event: scalable media processing

42
Scalable Media Processing David Sayed Principal Product Manager, Amazon Elastic Transcoder Amazon Web Services © 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

Upload: david-sayed

Post on 06-Apr-2017

825 views

Category:

Technology


6 download

TRANSCRIPT

Page 1: AWS 2013 LA Media Event: Scalable Media Processing

Scalable Media ProcessingDavid SayedPrincipal Product Manager, Amazon Elastic TranscoderAmazon Web Services

© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

Page 2: AWS 2013 LA Media Event: Scalable Media Processing

Agenda

• Media workflows• Where AWS fits• Scalability• Cloud media processing approaches• Amazon Elastic Transcoder• Visual effects example• Broadcast playout to web publishing example

Page 3: AWS 2013 LA Media Event: Scalable Media Processing

“I think cinema, movies and magic have always been closely associated. The very earliest people who made film were magicians.” — Francis Ford

Coppola

Page 4: AWS 2013 LA Media Event: Scalable Media Processing

Between This Glass…

Page 5: AWS 2013 LA Media Event: Scalable Media Processing

… And This Glass

Page 6: AWS 2013 LA Media Event: Scalable Media Processing

Media Workflows: The Real Magic

Page 7: AWS 2013 LA Media Event: Scalable Media Processing

Media Workflows: The Real Magic

Insert your

favorite workflows

here

Page 8: AWS 2013 LA Media Event: Scalable Media Processing

Media Workflows: The Real Magic

Insert a few more workflows

here

Networks

Theatrical

DVD/BD

Online

Mobile Apps

Archive

MSOs

Page 9: AWS 2013 LA Media Event: Scalable Media Processing

Media Workflows: The Real Magic

Insert a few more workflows

here

Networks

Theatrical

DVD/BD

Online

Mobile Apps

Archive

MSOs

Page 10: AWS 2013 LA Media Event: Scalable Media Processing

Media Workflows: The Real Magic

Insert even more workflows

here

Featurettes

Interviews

2D Movie

3D Movie

Archive Materials

Stills

Networks

Theatrical

DVD/BD

Online

Mobile Apps

Archive

MSOs

Page 11: AWS 2013 LA Media Event: Scalable Media Processing

Where AWS Fits Into Media Processing

Storage & Content Delivery

Deployment & Management

Application ServicesDatabaseCompute &

Networking

Page 12: AWS 2013 LA Media Event: Scalable Media Processing

Where AWS Fits Into Media Processing

Storage & Content Delivery

Deployment & Management

Application ServicesDatabaseCompute &

Networking

Inge

st

Inde

x

Proc

es s

Pack

ag e

Prot

ect

QC Auth

.

Trac

k

Play

back

Page 13: AWS 2013 LA Media Event: Scalable Media Processing

Where AWS Fits Into Media Processing

Amazon Web Services

Inge

st

Inde

x

Proc

es s

Pack

ag e

Prot

ect

QC Auth

.

Trac

k

Play

back

Media Asset Management

Analytics and Monetization

Page 14: AWS 2013 LA Media Event: Scalable Media Processing

Scalability

Page 15: AWS 2013 LA Media Event: Scalable Media Processing

Scalability, Is It Really That Important?

The business wants the new library of content they just signed on the VOD site yesterday.

Page 16: AWS 2013 LA Media Event: Scalable Media Processing

Scalability, Is It Really That Important?

A major event is taking place and will be live streamed to a worldwide audience.

Page 17: AWS 2013 LA Media Event: Scalable Media Processing

Scalability, Is It Really That Important?

A second screen app ties-in with a prime time event and may have millions of simultaneous users.

Page 18: AWS 2013 LA Media Event: Scalable Media Processing

Scalability == Agility

Page 19: AWS 2013 LA Media Event: Scalable Media Processing

Media Processing Approaches

3 Phases

Page 20: AWS 2013 LA Media Event: Scalable Media Processing

Cloud Media Processing Approaches: Phase 1

Phase 1• Lift processing

from on-premise and shift to the cloud

Page 21: AWS 2013 LA Media Event: Scalable Media Processing

Cloud Media Processing Approaches: Phase 2

Phase 1• Lift processing

from on-prem and shift to the cloud

Phase 2• On-prem and cloud

hybrid model• Refactor workflow

and cloud-optimize

Page 22: AWS 2013 LA Media Event: Scalable Media Processing

Cloud Media Processing Approaches: Phase 3

Phase 1• Lift processing from

on-prem and shift to the cloud

Phase 2• On-prem and cloud

hybrid model• Refactor workflow

and cloud-optimize

Phase 3• Cloud-native

architecture

Page 23: AWS 2013 LA Media Event: Scalable Media Processing

A Transcoding Example

“Lift and Shift”• Run existing

transcoding software on AWS

Page 24: AWS 2013 LA Media Event: Scalable Media Processing

A Transcoding Example

“Lift and Shift”• Run existing transcoding

software on AWS

Hybrid and Refactor• Run cloud versions of

existing transcoding software

• E.g. Digital Rapids, Elemental, Harmonic, Sorenson, Telestream

Page 25: AWS 2013 LA Media Event: Scalable Media Processing

A Transcoding Example

“Lift and Shift”• Run existing transcoding

software on AWS

Hybrid and Refactor• Run cloud versions of

existing transcoding software

• E.g. Digital Rapids, Elemental, Harmonic, Sorenson, Telestream

Cloud Native• Managed cloud

transcoding service• E.g. Amazon Elastic

Transcoder, Encoding.com, Zencoder

Page 26: AWS 2013 LA Media Event: Scalable Media Processing

Amazon Elastic Transcoder

• Built in response to customer demand• Designed for file-based high volume

transcoding• Simple, low-cost pricing starting at 1.5

cents per minute of output• Focused on OTT delivery formats

Page 27: AWS 2013 LA Media Event: Scalable Media Processing

Amazon Elastic Transcoder Features

• Fully managed cloud transcoding service• Elastically scalable• Output to MP4, WebM and HLS• Integration across AWS services• Available in multiple AWS regions• API and SDK driven

Page 28: AWS 2013 LA Media Event: Scalable Media Processing

How To Scale With Elastic Transcoder

• Architect around Elastic Transcoder• Use transcoding pipelines

Page 29: AWS 2013 LA Media Event: Scalable Media Processing

Amazon Elastic Transcoder Block Diagram

Transcoding Pipeline 1

Transcoding Pipeline 2

Transcoding Pipeline 4

Kindle Fire720p Custom

Transcoding Job n Transcoding Job 2 Transcoding Job 1

Amazon S3 Input Bucket

Amazon S3 Input Bucket

Amazon S3 Output Bucket

Amazon S3 Output Bucket

Amazon S3 Output Bucket

Page 30: AWS 2013 LA Media Event: Scalable Media Processing

How To Scale With Elastic Transcoder

• Architect around Elastic Transcoder• Use transcoding pipelines• Use notifications

Page 31: AWS 2013 LA Media Event: Scalable Media Processing

Cloud Media Processing Summary

• Three different ways to transcode in the cloud1. Lift and Shift2. Hybrid and/or refactor3. Cloud-native

• The right answer? It depends on your scenario

Page 32: AWS 2013 LA Media Event: Scalable Media Processing

A Visual Effects Example

Page 33: AWS 2013 LA Media Event: Scalable Media Processing

Visual Effects in Cloud

“Atomic Fiction has figured out how to use cloud computing to its advantage, recently delivering 400 shots in only four months for Flight, Zemeckis’ return to live action. It’s a business model that’s being viewed as the future of the industry.”

Bill DesowitzOwner ImmersedInMovies.com

Contibuting Editor to Animation Scoop

Page 34: AWS 2013 LA Media Event: Scalable Media Processing

<video>

Page 35: AWS 2013 LA Media Event: Scalable Media Processing

Visual Effects Summary

• High-resolution pre-release material• Only pay for what you use• Elasticity: scalability when you need it• Standard visual effects workflow using

ZYNC plug-ins with Maya, Mental Ray and Nuke

Page 36: AWS 2013 LA Media Event: Scalable Media Processing

A Broadcaster Example:Playout to Web Publishing

Page 37: AWS 2013 LA Media Event: Scalable Media Processing

Project Objective

• Get broadcast content to VOD player ASAP• Enable editorial clipping and review• Create many different renditions for

output devices• Elastically scale for high-demand

situations (e.g. breaking news and sporting events)

• Deliver agility for different types of processing

Page 38: AWS 2013 LA Media Event: Scalable Media Processing

Playout To Web Workflow

SDI Feed

Program Data Feed

Broadcast Encoder

Live Ingest Logic

Business Rules

Amazon Elastic Transcoder

Elemental Transcoder

DRM

QC

Editorial Clipping

MAM

Amazon S3Re-assembled

Mezzanine

Amazon S3Distribution Renditions

Page 39: AWS 2013 LA Media Event: Scalable Media Processing

Best Practices For This Project

• Componentize, decouple and be stateless• Design for failure• If data is in motion, use queues• Run at least 3 of everything• Log everything• Use frameworks where possible

Page 40: AWS 2013 LA Media Event: Scalable Media Processing

Project Results

• Quicker turnaround time• Only pay for what they use• Ability to support greater number of target

platforms• Extremely resilient• Better control over assets

Page 41: AWS 2013 LA Media Event: Scalable Media Processing

Parting Thoughts

• Using AWS for scalable media processing is a reality

• Different ways to architect:– Lift and shift– Hybrid and refactor– Cloud-native

• Start now

Page 42: AWS 2013 LA Media Event: Scalable Media Processing

More Information

aws.amazon.com/digital-mediaaws.amazon.com/architecture

aws.amazon.com/training/architectureaws.amazon.com/elastictranscoder

www.linkedin.com/in/davidsayed