storage visibility and optimization. a story of ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential Cisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.

Storage Visibility and OptimizationA Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential Cisco ConfidentialCisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.

Cloud/Big-data Winnovation Team

Alex Holdenajonasho@cisco.com

Damian Van Vuurendvanvuur@cisco.com

Ailing Zhangailzhang@cisco.com

Marc Solanasmsolanas@cisco.com

Matt Weeksmaweeks@cisco.com

Pengfei Zhangpenfzhan@cisco.com

Kai Zhangkazhang2@cisco.com

Xinyuan Huangxinyuahu@cisco.com

Debo Duttadedutta@cisco.com

Yathiraj Udupiyudupi@cisco.com

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Why do we need storage visibility?

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

OpenStack Storage

Openstack APIs

Cinder

????

Swift Glance

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

The Storage Jungle

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Why is visibility useful?

Optimal object distribution

Failure detection

Make underlying configuration

easier

Performance tuning

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Case Study: Ceph

Source: http://ceph.com/docs/master/architecture/

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Case Study: Ceph

hash(“foo”) % 128 = 0x3f

“bar’ = 2

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Visibility in Ceph

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

The visibility we want in Ceph

Visual monitoring

Object distribution

OSD real time status

Visual management of

crush rules

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Ceph Horizon Panel Demo

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Use case: Identify bottlenecks

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

OptimizationRebalance storage nodes dynamically

Preview changes (Future work)

Change configuration automatically (Future work)

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Conclusion

Reduce downtime

Increase storage performance

Provide analytics and historical data

More insights to follow!

© 2013 Cisco and/or its affiliates. All rights reserved.Cisco

Confidential

Thank you.

Please answer our survey online: