Upload File

london ceph day: erasure coding: purpose and progress

  • Home
  • Travel
  • London Ceph Day: Erasure Coding: Purpose and Progress
14
Erasure Code in Ceph

Upload: inktank

Post on 16-Jan-2015

1.383 views

Category:

Travel


1 download

Report

Tags:

DESCRIPTION

Loic Dachary, Senior Developer, CloudWatt

TRANSCRIPT

Page 1: London Ceph Day: Erasure Coding: Purpose and Progress

Erasure Code in Ceph

Page 2: London Ceph Day: Erasure Coding: Purpose and Progress

Save Space

Page 3: London Ceph Day: Erasure Coding: Purpose and Progress

XOR

Page 4: London Ceph Day: Erasure Coding: Purpose and Progress

3 peta => 1.3 peta

Page 5: London Ceph Day: Erasure Coding: Purpose and Progress

Harder object mutations / recovery

Page 6: London Ceph Day: Erasure Coding: Purpose and Progress

Simple operations and tiering

Replicated Erasure Coded

Page 7: London Ceph Day: Erasure Coding: Purpose and Progress

Promoted to replica on read

Replicated Erasure Coded

Page 8: London Ceph Day: Erasure Coding: Purpose and Progress

Sam & David : refactor

Page 9: London Ceph Day: Erasure Coding: Purpose and Progress

Andreas & Loic : erasure code

Page 10: London Ceph Day: Erasure Coding: Purpose and Progress

Target : February 2014

Page 11: London Ceph Day: Erasure Coding: Purpose and Progress

Why save space before shortage ?

Page 12: London Ceph Day: Erasure Coding: Purpose and Progress

Alpha testers

Page 13: London Ceph Day: Erasure Coding: Purpose and Progress

Sponsors and developers

Page 14: London Ceph Day: Erasure Coding: Purpose and Progress

[email protected]

Artwork GPLv3+ Tartaruga Feliz


Fredrick Ishengoma - Erasure Coding Based Hadoop Distributed File System

Giza: Erasure Coding Objects across Global Data Centersnews.cs.nyu.edu/~jinyang/pub/giza-atc17.pdfGiza: Erasure Coding Objects across Global Data Centers Yu Lin Chen, NYU & Microsoft

Erasure Coding for Cloud Storage Systems: A Surveyiqua.ece.toronto.edu/papers/junli-survey13.pdf · Jun Li et al.: Erasure Coding for Cloud Storage Systems: A Survey 261 from disks

Erasure Coding in Windows Azure Storage

OFVWG: Erasure Coding RDMA Offload · Erasure coding (generalize RAID) • There are different types of erasure codes (Reed-Solomon, Cauchy and other MDS codes). • The mathematical

Erasure Coding in Windows Azure Storage - USENIX · Erasure Coding in Windows Azure Storage Cheng Huang, Huseyin Simitci, Yikang Xu, Aaron Ogus, Brad Calder, Parikshit Gopalan, Jin

Storage tiering and erasure coding in Ceph (SCaLE13x)

Hierarchical Erasure Coding: Making Erasure Coding Usable ... · 3 Today’s Presenters Vishnu Vardhan (@vardhanv) Sr. Mgr, Product Management, Object Storage, NetApp Corporation

Distributed Hosting of Web Content with Erasure Coding …€¦Distributed Hosting of Web Content with Erasure Coding and Unequal Weight Assignment Jin Li+ and Cha Zhang* +Microsoft

Fredrick Ishengoma - HDFS+- Erasure Coding Based Hadoop Distributed File System

Erasure Coding for Real-Time Streaming

Wesley Leggette Cleversafe - Storage Networking Industry ...What is Erasure Coded Storage? ! The evolution of Erasure Coded storage ! From first- to third-generation erasure coding

ERASURE CODING AND CACHE TIERING - SCALE 16x · Cache tiering Erasure coding ... – OpenStack, CloudStack, Nebula, Ganeti, Proxmox

Erasure Code in Ceph Loic Dachary @ Red Hat · Erasure Code in Ceph Loic Dachary @ Red Hat. Save Space. 5 minutes role playing game. XOR. 3 peta => 1.3 peta. Harder object mutations

Less is More: 2X Storage Efficiency with HDFS Erasure Coding

Codes for Big Data: Erasure Coding for Distributed … for Big Data: Erasure Coding for Distributed Storage P. Vijay Kumar Professor, Department of Electrical Communication Engineering

図でわかるHDFS Erasure Coding

High-performance vehicular connectivity with opportunistic erasure coding

Erasure Code in Ceph

Research on Efficient Erasure-Coding- Based Cluster ...acs.ict.ac.cn/ncis2014/slides/pNCIS2014-Keynote-PCLee.pdf · Research on Efficient Erasure-Coding-Based Cluster Storage Systems

The Pros and Cons of Erasure Coding & Replication …...The Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage Platforms Abhijith Shenoy – Engineer, Hedvig

ERASURE CODING AND CACHE TIERING - SNIA · – OpenStack, CloudStack, Nebula, Ganeti, Proxmox ... ERASURE CODING OBJECT REPLICATED POOL CEPH STORAGE CLUSTER ERASURE CODED POOL CEPH

Erasure Coding in Windows Azure Storage - SNIA · Erasure Coding in Windows Azure Storage Cheng Huang Microsoft Corporation . Joint work with Huseyin Simitci, Yikang Xu, Aaron Ogus,

Ceph Day 2015 - Erasure Coding

Native erasure coding support inside hdfs presentation

Polar Coding for the Binary Erasure Channel

Optimize Storage Efficiency & Performance with Erasure Coding

Tutorial on Erasure Coding for Storage Applications, Part 1web.eecs.utk.edu/~plank/plank/papers/2013-02-11-FAST-Tutorial.pdf · Tutorial on Erasure Coding for Storage Applications,

How Does Erasure Coding Protect Data?

Quick Faq - Erasure Coding

Tutorial on Erasure Coding for Storage Applications, Part 1web.eecs.utk.edu/.../papers/2013-02-11-FAST-Tutorial.pdf · 2013-02-21 · A non-systematic erasure code stores only coding

Erasure coding and AONT algorithm selection for Secure ...ece.gmu.edu/.../F13_Project_Resources/F12_secure_storage_slides.pdf · Erasure coding and AONT algorithm selection for Secure

On error and erasure correction coding for networks and deadlines

Erasure Coding for Big-data Systems: Theory and Practice · forward in exploring new avenues for erasure coding—in particular for “hot” (more-frequently accessed) data—by

Accelerated Erasure Coding: The New Frontier of Software ......Title: Accelerated Erasure Coding: The New Frontier of Software Defined Storage Author: DineshKumar Bhaskaran Created