mpls diagnostics overview - cisco.com

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID 1

MPLS DiagnosticsExpert (MDE)

Overview

Stuart Parham


MDE Hot NewsNetwork Management Product Of The Year!

MDE wins 2008 Network Computing award: March 13 2008

As voted by readers of Network Computing - a UK Trade Magazine

Cisco MPLS Diagnostics Expert


Product Positioning

The Cisco MPLS Diagnostics Expert (MDE) is anautomated, workflow-based network managementapplication that troubleshoots and diagnoses problemsin Multiprotocol Label Switching (MPLS) VPNs

The Cisco MPLS Diagnostics Expert offers customersthe capability to reduce, by an order of magnitude, theamount of time required to diagnose MPLS-relatednetwork outages - in many cases from hours to minutes


Overview


Executive Summary

MDE Reduces Mean Time To Repair

Value of MDE is higher the further out it is used –ideally Level 1/Helpdesk/Customer SupportOrganization

MDE is Unique – it is different from and complementaryto Micromuse/Smarts/HPOV

MDE has a clear and simple Return on Investment(RoI) – often within one year


The Business Problem: Overview

Outage Detection

Complexity of IP/MPLS networks e.g.LSP Black holes in MPLS core

Network Configuration changes …typically cause 50% of network outages

Access circuit issues –typically 70-80% ofcustomer support calls

Customer network problems – all toooften “MPLS VPN outage” root cause

Need for MPLS skills on the Helpdesk

NOC Organizational “hand-overs”

Front-line helpdesk -> Level 2 support –>Level 3 support/Design Engineering)

LSP

PE P

CE

Real life customer problem …delete VPNV4 address familyon route reflector … tookhours to find & diagnose

Real life customer problem …Inconsistency between MPLSforwarding table on CPU &Line Card … few hours outage


Cisco MPLS Diagnostics Expert (MDE)Product Overview

Automated Troubleshooting and Diagnosisfor SP + Enterprise of MPLS VPN problems- 80/20 Rule

Unique Failure Scenario Knowledge Base

Automatic use of IOS MPLS OAM – LSPPing & Traceroute

Diagnoses problems in MPLS VPN core,edge and access … and can isolateproblems to the end customer network!

Reduces MPLS outages from hours tominutes using MPLS VPN FailureKnowledge Base developed by NMTG –with TAC & ITD support

Diagnoses complex MPLS core LSP“blackholes” via Cisco IOS MPLS OAMsupport – LSP ping & traceroute

Access Circuit test first (most problemshere)


Cisco MPLS Diagnostics Expert (MDE)Product Overview (Cont)

Supporting wide range of networkinfrastructures – including -

TE networks (via TE Tunnel ping/trace)

IP Unnumbered

Access Circuit routing protocols

Channelized & Multi-link Interfaces

Usable by, and Empowers, the NOCHelpdesk

Accelerates NOC Organizational Handovervia detailed Test Log- all steps logged

Unique Cisco capability, complementary toexisting, traditional fault NMSs

Deployable in customers who don’t use ISCas well as those who do

Comprehensive patent filed on MDEalgorithms Codename: Sedna


New for MDE 2.1

End User Productivity – GUIEnhancements

Multiple Test Types

MDE now supports 5 test types

Up from the single CE-CE test type inMDE 2.0

Including PE-PE and CE-PE test options

Search for Device or Interface by VRFName

Simpler test end point selection

Network Infrastructure SupportIOS XR Support

Transparent troubleshooting inmixed IOS/IOS XR networks

/31 Networks Supported

Support for multiple-loopback networks

Updated IOS support – including12.2(31)SB, 12.2(33)SRB

Third party P role device support –localisation around these (no login)


MPLS Diagnostics Expert - Customer ROICost Savings & Opportunity Cost Benefit

Value of Competitive Advantage Generated From…. (Economic Value Add) …Fire-fighting Design Engineers can deliver next year’s MPLSservices – Opportunity Cost

Customer Satisfaction UP/Customer Churn DOWN

Trouble-ticket resolution time DOWN from ~ 3 hours to ….

Reduction in complex cases DOWN from 8+ hours to ….

Mitigate risk of MPLS core outages in particular

Profitability increase – less $$ payout for SLA breaches

OPEX reductionReduce Mean Time To Repair–NOC staff savings

Put advanced MPLS IOS CLI tools into hands of Helpdesk

Reduce outages in cases from hours to minutes

Additional applications in post-provisioning verification etc

The Strategic View - “The Cisco MPLS Diagnostics Expert could change the

Entire Dynamics of our Service Helpdesk operation” – European SP


What isTroubleshootingand Diagnostics


Assurance Process BreakdownWhere MDE Fits

TroubleDetection

TroubleIsolation

ServiceRestoration

TroubleReporting

~10% ~10%~45%

Total Cost per Trouble Ticket

~35%

Where MDE fits

Proportionof TT

manual cost- typical

Where Fault NMS Fits

Traditional Fault NMS MDE Focus Areas


Where MDE Fits … The MDE Value Proposition

MDE has key role in AutomatedPost-Provisioning Verification

“Up to 75% of our provisioningcosts are in testing that theprovisioning operation has beensuccessful” – Tier 1 ServiceProviders

Source: Bell Labs, 2004

IP VPN Design, Provisioning

& Testing Costs

Re

lati

ve

Co

st

LSP

PE P

CE

Strategic NetworkProtection – Black HoleDiagnosis

Major city PoP out for10.5 hours …. routerlabelling issue

MDE diagnoses in ~ 5minutes

Day to daytroubleshooting

Operational costreduction

Empoweringlevel 1 support

Assurance Provisioning


The TraditionalApproach


Fault in MPLS CoreLSP “blackhole” (Real Life) Example

LSP

Real life example: Fault occurs on line

card, partial failure, forwarding ASIC

affected, traffic “disappears”. No

alarm generated. “Blackhole”

PEP


How you find fault location in other vendor’snetworks … or Pre Cisco IOS 12.0(27)S

LSP

The fault is here … but you had to check

70 out of 100 P/PE nodes before you

found the location of this “black hole”

… but what is root cause?And this one …

And this oneThen this one

Check this node,

using MIBs & CLI

Real Life Example … Took 17 Hours of Outage to Find and Diagnose


The Cisco MPLSDiagnostics

Expert Approach


How you find fault location and root underlying cause withCisco IOS Instrumentation + Cisco MPLS Diagnostics Expert

LSP

Node affected localised directly by Cisco

MPLS Diagnostics Expert & IOS

instrumentation from 12.0(27)S

Cisco MPLS Diagnostics Expert provides

automated diagnosis of root cause

Cisco MPLS Diagnostics Expert

encapsulates Cisco TAC IP - Over

~140 potential failure scenarios

checked automatically


Type in simple details

e.g. Customer Edge IP

addresses, Or Search

Inventory by VRF … and

press “OK” to start

With Simplification and AccelerationCisco MPLS Diagnostics Expert

For the novice …

Simple GUI telling you

where problem is, what

is underlying root cause

… and recommended

action … ~140 potential

failure scenarios

checked automatically –

repeatable process

For the expert - All CLI detailsfor subsequent analysis


Summary: Why Use Cisco MPLS Diagnostics Expert

Cisco MPLS Diagnostics Expert – Automated troubleshooting &Diagnostics for MPLS VPN networks – SP + Enterprise

Reduces troubleshooting times, in cases from hours to minutes

Ease of use for Helpdesk, Diagnostics Detail for 2nd Line Support

Repeatable software vs “Humans do forget”

Encapsulates & Automates Cisco internal experience & intellectualproperty in troubleshooting MPLS networks in software

Works for customers who do or don’t use ISC Provisioning

More info …. www.cisco.com/go/mde & www.cisco.com/go/isc


Q and A

mpls diagnostics overview - cisco.com

Documents