the role of wan optimization in cloud infrastructures › ... › cloud ›...

30
The Role of WAN Optimization in Cloud Infrastructures Josh Tseng, Riverbed Technology Author: Josh Tseng, Riverbed Technology

Upload: others

Post on 10-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization

in Cloud Infrastructures

Josh Tseng, Riverbed Technology

Author: Josh Tseng, Riverbed Technology

Page 2: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 2 2

SNIA Legal Notice

The material contained in this tutorial is copyrighted by the SNIA unless otherwise noted. Member companies and individual members may use this material in presentations and literature under the following conditions:

Any slide or slides used must be reproduced in their entirety without modification The SNIA must be acknowledged as the source of any material used in the body of any document containing material from these presentations.

This presentation is a project of the SNIA Education Committee. Neither the author nor the presenter is an attorney and nothing in this presentation is intended to be, or should be construed as legal advice or an opinion of counsel. If you need legal advice or a legal opinion please contact your attorney. The information presented herein represents the author's personal opinion and current understanding of the relevant issues involved. The author, the presenter, and the SNIA do not assume any responsibility or liability for damages arising out of any reliance on or use of this information. NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK.

Page 3: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 3

Agenda Topics

Importance of the WAN and the Cloud What is WAN Optimization and how does it work? Key considerations when deploying WAN optimization into the Cloud

Placement Scalability Non-interoperability

Page 4: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 4

The Beer Factory (Werner Vogels, CTO Amazon)

Page 5: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 5

Cloud/Utility Computing

Your Business Shared Power

Utility

Page 6: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 6

Cloud/Utility Computing

The WAN is a core component of The Cloud

Your Business

WAN

File Servers

Mail Servers Application

Servers

Disk-based Backup

Storage

Shared Data Center Facility

The “Cloud”

Page 7: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 7

Elasticity and Economic Benefits

Cloud provider realizes quantities of scale Cloud provider gets large serving multiple customers Per-unit provisioning costs decrease with size

Expand IT resources on demand Cloud provider provisions resources Procurement of IT resources hidden from consumer

Cloud provider provides focus and expertise Focus creates superior expertise delivering IT resources Superior expertise leads to improved IT performance and efficiency

Page 8: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 8

Largely same existing physical WAN infrastructure used to access Cloud

Same WAN links with bandwidth and latency Cloud data centers are potentially “far away”

Cloud infrastructure supports many enterprises Large scale drives lower per-unit cost for data center services

All employees will be “remote” from their data Even single-location companies will be remote from their data HQ employees previously local to servers, but not with Cloud model

Issues with migrating to the Cloud

Page 9: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 9

WAN Performance Bottlenecks

Typical WAN Performance Results– UP TO 20x SLOWER

Login “Reports” Tab Upload 3MB doc Download

Action/ Latency ~ LAN (<10ms)

WAN (~100ms)

WAN (~200ms)

2.08 1.19

26.74 10

23.08 9.80

88.54 38

34.54 22.62

109.03 40

The “distance” problem

Latency and application chattiness Slower application access

• •

“Skinny Straw” problem

Thousands of companies Millions of users Varied bandwidth

• • •

Public/Private Cloud

(Sec)

(Sec)

(Sec)

(Sec)

Page 10: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 10

Bottleneck #1: Bandwidth Limitations

Lots of data needs to be sent over limited WAN bandwidth

Congestion problems lead to miserable performance Typically 1.5 Mbps to 10Mbps

Files Email Web Apps Database Data

Backup VOIP

WAN Pipe

Page 11: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 11

Fixing Bottleneck #1: Bandwidth Limitations

Disk-based deduplication technology Identify redundant data at the byte level, not application (e.g., file) level Use disks to store vast dictionaries of byte sequences for long periods of time Use symbols to transfer repetitive sequences of byte-level raw data Only deduplicated data stored on disk

Page 12: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 12

Disk-based Data Reduction

WAN

Reconstructed Files & Data Request

Files & Data

DATA CENTER BRANCH OFFICE

60 to 90 percent data reduction

Page 13: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 13

CLIENT SERVER

File

File

Bottleneck #2: Application “Chattiness”

Interactive apps, underlying protocols require 100s or 1000s of round trips for one operation!

Web-based applications CRM Document Management Call Center Apps Project Mgmt Apps Accounting Apps Other Custom Apps

Legacy apps: Common Internet File System (CIFS) Messaging Application Programming Interface (MAPI) UNIX File Sharing (NFS)

HTTP GET

GET GIFs

HTTP GET

HTTP POST

HTTP GET

HTTP POST

Page 14: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 14

Fixing Bottleneck #2: Application-Level Chattiness

Application-specific chattiness mitigation modules HTTP, CIFS, MAPI, MAPI2003, NFS, etc…

Protocol-compliant read-aheads to pre-fetch data Pipeline delivery of all application data Eliminate chattiness over the WAN

Page 15: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 15

Request

WAN optimizer completes transaction locally

Addressing Application-Level Chattiness

WAN DATA CENTER BRANCH OFFICE

Page 16: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 16

Addressing Application-Level Chattiness

Optimized WAN Transfer

WAN DATA CENTER BRANCH OFFICE

WAN optimizer completes transaction locally

Page 17: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 17

Throughput achieved through WAN optimization

Actual Results: Atlanta to Malaysia E1 (2 Mbps) WAN connection (~150ms RT latency)

WAN Optimization Device Deployed

Page 18: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 18

Bandwidth reduction achieved through WAN optimization

% Data reduction on WAN

Before-optimization data volume

After-optimization data volume

% of overall traffic before optimization

79GB of data was reduced to 13GB (83% reduced) 66GB of data was removed from the International links at Malaysia

email

DB

Asset

Page 19: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 19

WAN optimization solution components

Physical Appliances Must physically deploy into infrastructure Maximize performance/cost

Software/Virtual appliances Flexible; spin up as needed Does not need

Software clients WAN optimization from anywhere

Traffic interception options Required for scaling through load balancing Physical and virtual devices available

Page 20: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved.

Key Considerations for Cloud Deployment

Placement: Where to put WAN optimization devices WAN optimization is a symmetric technology (devices on both sides of WAN) Where does device go in Cloud?

Scalability: Cloud infrastructures are large WAN opt must scale for Cloud infrastructures

Non-interoperability: WAN optimization involves proprietary technologies

Devices from Vendor A don’t interoperate with Vendor B Devices placed in Cloud must match devices in enterprise Vendor selection is key consideration

20

Page 21: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved.

Placement of WAN optimization devices

For Private Cloud (dedicated) environments Deploy physical or virtual WAN optimization appliances

For IaaS Cloud environments: Deploy virtual WAN optimization appliances

For PaaS Cloud environments Install WAN optimization software

For SaaS Cloud environments WAN optimization devices can’t be deployed into Cloud provider’s infrastructure Most SaaS vendors don’t offer WAN optimization Must find another way

21

Page 22: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved.

Deploying WAN opt into the Cloud

22

Branches Data Centers

Enterprise WAN

Mobile Worker

IaaS SaaS PaaS

?

Page 23: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved.

What about SaaS deployments?

In 2010 SaaS was 73% of Cloud market according to market analysts

SaaS growth projections as high as 25% CAGR or more

SaaS providers don’t provide access to infrastructure Customers cannot install own appliances or software into SaaS Cloud

1000’s of SaaS providers worldwide Most don’t know about WAN optimization Few are willing to deploy WAN optimization devices Not practical to expect all your SaaS providers to deploy your WAN optimization devices

23

Page 24: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved.

Content Delivery Networks (CDN’s)

CDN: System of local caching servers that serve copies of frequently-accessed data to users WAN optimization available from CDN provider

WAN optimization available on 90,000+servers at 3000+ Points-of-Presence (POP) around the world At least one POP is local to most SaaS providers

CDN provider can host server-side WAN optimization software

Local WAN optimization devices peers with instances at CDN provider POP

24

Page 25: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved.

CDN-hosted WAN optimization

25

Branches Data Centers

Enterprise WAN

Content Delivery Network

Mobile Worker

SaaS Vendor #1

SaaS Vendor #2 SaaS

Vendor #3

SaaS Vendor #4

Page 26: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved.

Scalability

SaaS/CDN infrastructures are HUGE Hundreds or thousands of customers Thousands of POPs Tens of thousands of servers Hundreds of thousands of end-users

A WAN optimization product that cannot scale will not be deployed by your CDN or SaaS provider

Not all can scale to the requirements of CDN or SaaS network infrastructures A WAN optimization product that works for your enterprise may not work in the Cloud

26

Page 27: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved.

WAN Optimization Interoperability

Interoperability requires one standard vendor across all infrastructures

WAN Optimization uses proprietary technologies Vendor A devices will not interoperate with Vendor B Same vendor everywhere—enterprise, Cloud, mobile

Vendor selection is key consideration Must choose vendor product supported by SaaS/CDN provider SaaS/CDN provider can only use products that scale A product that works for your enterprise may not work in the SaaS/CDN infrastructure

27

Page 28: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 28

WAN optimization and the Cloud

File Servers

Mail Servers

Disk-based Backup

Storage

Enterprise Data Center Remote Offices

Mobile Employees

Traveling Professionals

Work-at-home Employees

Cloud Filers

Cloud Email Cloud

Applications

Cloud Storage

Headquarters Employees

Application Servers

Cloud: IaaS, PaaS, SaaS

Enterprise WAN

Content Delivery Network (CDN)

Page 29: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved.

Summary Thoughts

Cloud computing allows consolidation and sharing of IT resources

Similar to consolidation and sharing of power/other resources

WAN optimization key to allowing Cloud computing WAN optimization increases capacity and performance of the WAN infrastructure

Key issues must be addressed to deploy WAN optimization for the Cloud

Placement, Scalability, and Non-interoperability

29

Page 30: The Role of WAN Optimization in Cloud Infrastructures › ... › cloud › JoshTseng_The_Role_of_WAN_Opt_… · The Role of WAN Optimization . in Cloud Infrastructures . oJ sh Tseng,

The Role of WAN Optimization in Cloud Infrastructures © 2012 Storage Networking Industry Association. All Rights Reserved. 30 30

Q&A / Feedback

Please send any questions or comments on this presentation to SNIA: [email protected]

Many thanks to the following individuals for their contributions to this tutorial.

- SNIA Education Committee

Joseph White Mark Day Rob Peglar

Wendy Betts Steve Riley