aspera on demand: optimizing cloud usage with high-speed big data transport june 2016
TRANSCRIPT
![Page 1: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/1.jpg)
Optimizing Cloud Usage with High-Speed Big Data Transport June 2016
![Page 2: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/2.jpg)
![Page 3: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/3.jpg)
•
•
•
•
![Page 4: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/4.jpg)
•
•
•
•
•
•
•
•
•
•
•
![Page 5: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/5.jpg)
![Page 6: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/6.jpg)
![Page 7: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/7.jpg)
•
•
•
•
•
•
•
•
•
•
•
•
Note: Table displays throughput degradation of TCP transfers on a 1Gbps network as estimated round trip time and packet loss increases with distance.
![Page 8: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/8.jpg)
•
•
•
•
•
•
•
•
•
•
•
•
•
Note: The relative bandwidth utilization for FASP transfers over a 1 Gbps network are immune to latency (distance) with very little effect from packet loss.
![Page 9: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/9.jpg)
![Page 10: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/10.jpg)
•
•
![Page 11: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/11.jpg)
•
•
•
•
•
![Page 12: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/12.jpg)
•
•
•
•
•
•
•
•
•
•
•
•
![Page 13: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/13.jpg)
![Page 14: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/14.jpg)
![Page 15: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/15.jpg)
![Page 16: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/16.jpg)
![Page 17: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/17.jpg)
•
•
•
HTTP
Key Value
H(URL) R1, R2, R3
Data Nodes Master Database Mapping Object ID to File Data Replicas and Storing Metadata
![Page 18: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/18.jpg)
![Page 19: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/19.jpg)
![Page 20: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/20.jpg)
•
•
•
•
•
•
•
•
•
•
•
•
•
![Page 21: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/21.jpg)
•
•
•
•
•
•
![Page 22: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/22.jpg)
••
•
•
![Page 23: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/23.jpg)
•
•
•
•
•
•
•
•
•
![Page 24: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/24.jpg)
•
•
•
•
•
•
•
•
•
•
•
•
•
•
![Page 25: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/25.jpg)
•
•
• •
![Page 26: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/26.jpg)
•
•
•
•
![Page 27: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/27.jpg)
Utilization > high w/m Available Pool
New Cl ients connect to “available” pool
Exis ting cl ient
transfers
Console
•Col lect / aggregate transfer data • Transfer activity /
reporting (UI, API)
Shares •User management • Storage access control
• Cluster Manager for Auto-scale and Scaled DB
• Console Management UI + Reporting API • Enhanced Client for Shares
Authorizations • Unified Access to Files/Directories
(Browser, GUI, Commend Line, SDK)
Scaling Parameters • Min/max number of t/s • Utilization low/high
watermark
• Min number of t/s in “available” pool
• Min number of idle t/s in ”available” pool
Management and Reporting
Cluster Manager • Monitor cluster nodes • Determine eligibility for
transfer scale up / down
• Create / remove db with replicas
• Add / remove node
Scale DB Persistence Layer
![Page 28: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/28.jpg)
• Deep system integration
between Akamai NetStorage
and Aspera FASP
• Maximum speed upload
directly to NetStorage
![Page 29: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/29.jpg)
• Single platform for ingest and geo-
distributed replication
• Highly redundant, geographically
dispersed storage, 34+ locations
![Page 30: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/30.jpg)
NetStorage Upload Acceleration +
![Page 31: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/31.jpg)
![Page 32: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/32.jpg)
•
•
•
•
•
•
![Page 33: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/33.jpg)
•
•
•
![Page 34: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/34.jpg)
![Page 35: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/35.jpg)
![Page 36: Aspera On Demand: Optimizing Cloud Usage with High-Speed Big Data Transport June 2016](https://reader031.vdocuments.net/reader031/viewer/2022030317/5a66541f7f8b9a212b8b48b3/html5/thumbnails/36.jpg)