introduction to cloud computing & potential broadcast...

44
Page: Cloud 101: Clifton Final CLOUD 101 Introduction to Cloud Computing & Potential Broadcast Applications Ron W. Clifton CliftonGroup International Limited

Upload: others

Post on 30-Jul-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 1

CLOUD 101 Introduction to Cloud Computing & Potential Broadcast Applications

Ron W. Clifton CliftonGroup International Limited

Page 2: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 2

Objective and Outline Provide an introduction to cloud computing technologies and discuss some potential applications for public broadcasting

• Part I: The cloud computing model • Part II: Potential broadcasting

applications

Page 3: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 3

Part I

Introduction to Cloud Computing

Page 4: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 4

Is Cloud real or is it just hype?

Page 5: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 5

It’s real!

Page 6: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 6

Demand Driving the Cloud

Source: CA Technologies

…business demand is outpacing budgets and resources – as well as traditional means of delivery

Previous Steady State

Recession & Credit Crisis

Business IT Demand

Growing alignment gap

IT Budgets &Resources

2003 - 2008 2008 - 2009 New Normal

Page 7: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 7

Evolution of Cloud Computing • Industry survey (2011):

• 80% of enterprises surveyed had deployed at least one cloud service.

• Over 50% have deployed six or more cloud services, while maintaining legacy infrastructures.

Distributed

Internet

Virtual

CLOUD

Mainframe

Source: CA Technologies

Page 8: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 8

Defining Cloud Computing The National Institute of Standards and

Technology (NIST) Cloud Computing Model Enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.

Page 9: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 9

Defining Cloud Computing

Cloud computing is more than just “doing stuff in the cloud”

Software as a Service (SaaS)

Platform as a Service (PaaS)

Infrastructure as a Service (IaaS)

THREE SERVICE MODELS

Broad Network Access

Rapid Elasticity

Measured Service

On-Demand Self Service

Resource Pooling

FIVE MAJOR CHARACTERISTICS

PRIVATE PUBLIC HYBRID COMMUNITY FOUR DEPLOYMENT

MODELS

Page 10: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 10

Four Deployment Models

Public Public Cloud Service over Internet

Utility Computing Model Uses OpEx

Multiple tenants

Public Hybrid Cloud

2 or more Public, Private or Community Combination OpEx & CapEx

Resource portability Federated Clouds

Public Private Cloud

Service over Internet Grid Computing Model

Uses CapEx Solo Tenant

Public Community Cloud

Public, Private or Hybrid Federated Clouds

OpEx (Users), CapEx (Community) Resource Portability

Source: Wikipedia and Sam Johnston

Public

Public

Private/ Internal

Public/ External

Amazon (AWS)

Google Apps Eng

AT&T

Microsoft Azure

The Cloud

On Premises/ Internal

“Cloud in a Box” – Azure for Enterprise – MS+HP - IBM Cloudburst - Eucalyptus cloud SW ~private AWS

Off Premises/ Third Party

HYBRID

Page 11: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 11

Evolution of the Cloud

Source: Dell

Distribution in 3-5 years

Distribution today

Traditional Virtualized Private Cloud

Public Cloud

Page 12: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 12

Private Clouds: Government View

• 72%: Control over physical security • 61%: Compliance with Fed regs & specs • 56%: Superior data protection • 43%: Ability to share IT resources within

agency and with other agencies • 38%: Ability to respond to user req’ts

Source: Information Week Analytics/Information Week Government 2011

Benefits of Private Clouds for the Federal Government

Page 13: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 13

Three Service Models

Source: derived from Microsoft

PaaS

Networking

Storage

Servers

Virtualization

O/S

Middleware

Runtime

Data

Applications

SaaS

Networking

Storage

Servers

Virtualization

O/S

Middleware

Runtime

Data

Applications

Legacy

Networking

Storage

Servers

Virtualization

O/S

Middleware

Runtime

Data

Applications

= YOU provide & manage

IaaS

Networking

Storage

Servers

Virtualization

O/S

Middleware

Runtime

Data

Applications

= VENDOR provides & manages

Page 14: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 14

Five Major Characteristics

Example: HP Blade Server

Broad Network Access

Rapid Elasticity

Measured Service

On-Demand Self Service

Provisioning Layer

Virtualization & Resource Pooling

Virtual/ Physical SW

Stacks Stateless Compute Logically

Configurable Network

Page 15: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 15

The Scalable/Elastic Cloud

Source: Multiple

Actual Demand

Scalable Cloud Elasticity

Automated Trigger Actions

Page 16: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 16

Example Industry Structure

e.g. VMWare. Oracle. Xen, HP, Dell, and many others

e.g. Cloud.com, RackSpace, Eucalyptus and many others

e.g. RightScale, Abiquo and others

e.g. Terremark, Amazon, OpSource, SHI, & many others

Virtualization – e.g. Hypervisor

Provisioning (single cloud)

Cloud Management (multiple clouds)

Service Providers

Cloud Migration Consultants e.g. CA Technologies, Fujitsu and many others

CPU/ Servers Storage Network

Load Balancing

Page 17: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 17

Sample Cloud Vendors

Page 18: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 18

Example Cloud vendors

Page 19: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 19

Example Cloud Vendor Pricing

source: cloudorado.com (a particular sample day)

Page 20: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 20

Sample Cloud Applications • Application

Hosting • Backup & Storage • Content Delivery • Databases • E-Commerce • Enterprise IT

• High Performance Computing

• On-Demand Workforce • Media Hosting • Search Engines • Web Hosting • Development

Page 21: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 21

Examples: media in the Cloud

Page 22: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 22

Example: media in the Cloud

Page 23: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 23

Part II

Potential Broadcasting Applications

Page 24: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 24

The Paradigm Shift • The technology exists today to implement the

complete broadcast workflow from ingest to transmission in the cloud

• There are many excellent public cloud options but for Broadcast, a private/hybrid community cloud configuration may be ideal (e.g. station groups)

Page 25: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 25

Why Cloud and why now?

Public Cloud Solutions for Broadcasting

M&E Market and Broadcast Industry Drivers/Trends • IP Connectivity & File Based Workflow • OTT Content Delivery & Mobile devices • TV Everywhere • Emerging standards

• Move from legacy H/W to S/W • Dedicated and virtualized server

implementations • Cloud services

Cloud Computing Industry Trends • Second gen cloud computing technologies & standards • Availability of mature private & hybrid cloud solutions • Low cost terrestrial broadband connectivity

Page 26: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 26

Typical Historical Media Workflow

Derived from: SMPTE and others

ACQUIRE PREP PRODUCE TRANSMIT

ARCHIVE (e.g. LTO)

Server

Page 27: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 27

File-Based Workflow

Derived from: Broadcast Engineering & SMPTE

P2

PD

SxS

CF

Field Production

Work in progress

Audio AAF

NLE

Playout

Graphics Archive

MXF

MXF

MXF, IMX, DV AVC, J2K

MXF

News Live Production

Page 28: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 28

Examples: Cloud Functionality • Ingest &Transcoding • Media asset

management (MAM) • Hosting for OTT

delivery (linear and COD)

• File-based workflow

• Archival & Disaster recovery

• QC/test and verify all formats

• Developmental stress testing and simulation

Page 29: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 29

The Ingest Challenge

STUDIOS

PRODUCTION

Affiliate & Syndicated Feeds

OB/SNG/DSNG Feeds

User Generated Content (UGC)

Various tape and hard drive formats

Other Content

Other Content

(e.g. Ads)

Public Internet

Page 30: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 30

The Ingest Challenge Ingest conversion to file based format for editing, archival and proxy access - real time as well as file based. Today’s ingest examples:

• Tape input from legacy sources and raw multi-year archives (Sony, DV, HD, HDSR, IMX)

• File formats (e.g. DNX-145, XD CAM 50, QTIME 45m, IMX-30/40/50, MXF, J2K)

• Web UGC: cell phone, QuickCam, Home

Page 31: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 31

Brute Force Approach

UGC

Public

P1 P2 P3 P4

C0 C1 C2 C3

Cloud Functionality

Production Workflow

Common dBase Other

“FAT PIPES!”

Ingest &

Transcode

Page 32: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 32

The Cloud Paradigm Shift

“THIN PIPES!”

Public

P1 P2 P3

C1 C2 C3 C4

Production Workflow

Common dBase(s)

UGC

Other

P4

Ingest &

Transcode

Page 33: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 33

The Cloud Paradigm Shift Inherently native multiplatform OTT delivery

Page 34: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 34

The Cloud Paradigm Shift Native multi-cloud connectivity

for backup, diversity, regulations, DRM etc..

Page 35: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 35

Cloud Transcoding Concepts

Pub

lic

Ingest & Manage Content

Linear & File

Based VOD/COD

dBase

USERS: U1

Transcoder

U2

Transcoder

U3

Transcoder

- OR - Transcoders

U1 USERS: U1 U1

Page 36: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 36

Example Cloud Transcoding

Source: KulaByte

101010010111 Origin Encode

Public Cloud Encoding

Content Distribution

Capture Input Format

Bit Rate

RTMP (Flash)

HTTP (iPAD,

ROKU …)

RTSP (Android,

BB … 720p 2.50 Mbps X X

2.25 Mbps X X 2.20 Mbps X X

540p 1.75 Mbps X X 1.50 Mbps X X

480p 1.25 Mbps X X 1.00 Mbps X X

360p 750 Kbps X X 288p 500 Kbps X X 270p 250 Kbps X X X 180p 150 Kbps X X X

Page 37: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 37

Media Asset Management (MAM) SaaS and Cloud-Based Outlook:

“Some of the biggest challenges to the SaaS model have traditionally been around security, robustness and infrastructure. Technological advances, declining storage costs and the proliferation of high-speed broadband have transformed the business landscape and the SaaS model is no longer seen as a risky option.”

Source: Frost and Sullivan

Page 38: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 38

Cloud Archival Concepts

Manage Archival Cache Manage

LTO

LTO PRIMARY

LTO BACKUP P1 P2 P3

Production Workflow

P4

Public

C1 C2 C3 C4

Common dBase(s)

UGC

Other

Ingest &

Transcode

Example LTO tapes (Linear Tape Open)

Page 39: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 39

Cloud Archival Concepts

Manage Archival Cache Manage

LTO

LTO PRIMARY

P1 P2 P3

Production Workflow

P4

Public

C1 C2 C3 C4

Common dBase(s)

UGC

Other

Ingest &

Transcode

LTO BACKUP

Page 40: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 40

Cloud Archival Concepts

Manage Archival

Manage LTO

LTO PRIMARY

LTO BACKUP

P1 P2 P3

Production Workflow

P4

Public

C1 C2 C3 C4

Common dBase(s)

UGC

Other

Ingest &

Transcode

Low Latency Cache

Cache

Cache

Low latency mid-term cache on demand

Disaster Recovery

Note: Cloud spinning disk archival is catching up. See Cloud 102 for AWS Glacier discussion

Page 41: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 41

Cloud transmission – why not?

Public

P1 P2 P3

C1 C2 C3 C4

Production Workflow

Common dBase(s)

UGC

Other

P4

Remote Transmitter

Ingest &

Transcode

It’s being done today!

Page 42: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 42

Summary • The technologies exist today to implement the

complete end-to-end broadcast workflow using cloud computing technologies

• This is a natural migration from our legacy

broadcast infrastructure and the way of the future

Page 43: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 43

For further reading …

Page 44: Introduction to Cloud Computing & Potential Broadcast ...bento.cdn.pbs.org/.../04/18/clifton_cloud_101_v02.pdf · 4/18/2013  · Cloud 101: Clifton Final Page: 1 CLOUD 101 Introduction

Page: Cloud 101: Clifton Final 44

Thank you for your time

Q&A?

(see also Cloud 102 tomorrow) Ron Clifton, BASc, MASc, PEng CliftonGroup International Ltd

[email protected]