network visibility for efficient openstack operations
Post on 12-Sep-2014
242 views
DESCRIPTION
The slidedeck presented by me and my team at the Atlanta Openstack Summit 2014.TRANSCRIPT
![Page 1: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/1.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential Cisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.
Network VisibilityFor Efficient OpenStack Operations
![Page 2: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/2.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential Cisco ConfidentialCisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.
The Cloud / Big-Data Winnovation Team
Alex [email protected]
Damian Van [email protected]
Ailing [email protected]
Marc [email protected]
Matt [email protected]
Pengfei [email protected]
Xinyuan [email protected]
Debo [email protected]
Yathiraj [email protected]
![Page 3: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/3.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Today...
![Page 4: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/4.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential Cisco ConfidentialCisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.
![Page 5: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/5.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Outline• Data Gathering Architecture
• Network Visibility
• Network Analysis
• Conclusion
![Page 6: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/6.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Virtual status
Performance
Why is my job slow?
Operators
Physical status
Hotspots
What are they doing in my cloud?
Users
![Page 7: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/7.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
![Page 8: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/8.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Network flowsNew ceilometer agent
Collects and aggregates data from Neutron
VM-VM flow traffic insight
![Page 9: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/9.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Application logs
OpenStack Logs
Server Syslogs
VM Syslogs
Application (Hadoop, etc) Logs
...
![Page 10: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/10.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
AVOS: Analytics and Visualization on OpenStack Demo
![Page 11: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/11.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.
Data Insights
![Page 12: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/12.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Data insights - What is going on in a Hadoop cluster?
Net
wor
k flo
ws
(bit/
s)
Outgoing network flows from VMs
Time (s) Time (s)
Incoming network flows to VMs
Net
wor
k flo
ws
(bit/
s)
![Page 13: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/13.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Data insights - What is going on in a Hadoop cluster?
Time (s)
Net
wor
k flo
ws
(bit/
s)
Outgoing network flows
master <-> slave
![Page 14: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/14.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Data insights - What is going on in a Hadoop cluster?
Time (s)
Net
wor
k flo
ws
(bit/
s)
Outgoing network flows
slave <-> slave
![Page 15: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/15.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Data insights - How to troubleshoot?
Normal Server down
![Page 16: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/16.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Data insights - How to troubleshoot?
INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream … java.io.IOException: Bad connect ack with firstBadLink as 192.168.0.7:…
INFO org.apache.hadoop.hdfs.DFSClient: Abandoning blk_…
INFO org.apache.hadoop.hdfs.DFSClient: Excluding datanode 192.168.0.7:…
WARNING nova.compute.manager … [instance: 6a475088-...] Instance shutdown by itself. Calling the stop API." …
![Page 17: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/17.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
● Collect Multiple Metrics● Analyze Patterns● Classify Cloud States
Data insights - How to detect abnormals?
![Page 18: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/18.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Future PlansNetwork Distance
Data-driven Diagnoses
More data sources & integrated analysis
![Page 19: Network visibility for efficient Openstack operations](https://reader033.vdocuments.net/reader033/viewer/2022052819/5412af1c8d7f72314e8b46ab/html5/thumbnails/19.jpg)
© 2013 Cisco and/or its affiliates. All rights reserved.Cisco
Confidential
Thank you.Please take our survey:
http://goo.gl/CMAZje