storage visibility and optimization. a story of ceph

17
© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved. Storage Visibility and Optimization A Story of Ceph

Upload: yathiraj-udupi

Post on 19-Jan-2015

277 views

Category:

Technology


2 download

DESCRIPTION

The slidedeck for the presentation by my team at the Atlanta Openstack Summit 2014.

TRANSCRIPT

Page 1: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential Cisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.

Storage Visibility and OptimizationA Story of Ceph

Page 2: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential Cisco ConfidentialCisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.

Cloud/Big-data Winnovation Team

Alex [email protected]

Damian Van [email protected]

Ailing [email protected]

Marc [email protected]

Matt [email protected]

Pengfei [email protected]

Kai [email protected]

Xinyuan [email protected]

Debo [email protected]

Yathiraj [email protected]

Page 3: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Why do we need storage visibility?

Page 4: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

OpenStack Storage

Openstack APIs

Cinder

????

Swift Glance

Page 5: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

The Storage Jungle

Page 6: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Why is visibility useful?

Optimal object distribution

Failure detection

Make underlying configuration

easier

Performance tuning

Page 7: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Case Study: Ceph

Source: http://ceph.com/docs/master/architecture/

Page 8: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Case Study: Ceph

hash(“foo”) % 128 = 0x3f

“bar’ = 2

Page 9: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Visibility in Ceph

Page 10: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

The visibility we want in Ceph

Visual monitoring

Object distribution

OSD real time status

Visual management of

crush rules

Page 11: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Page 12: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Ceph Horizon Panel Demo

Page 13: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Use case: Identify bottlenecks

Page 14: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Page 15: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

OptimizationRebalance storage nodes dynamically

Preview changes (Future work)

Change configuration automatically (Future work)

Page 16: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Conclusion

Reduce downtime

Increase storage performance

Provide analytics and historical data

More insights to follow!

Page 17: Storage visibility and Optimization.  A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Thank you.

Please answer our survey online: