network services benchmarking (nsb)
TRANSCRIPT
Network Services Benchmarking (NSB)
Xavier Simonart Nicholas Hamblin
Notices and disclaimers
Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. No computer system can be absolutely secure. Check with your system manufacturer or retailer or learn more at www.intel.com.
Intel and the Intel logo, are trademarks of Intel Corporation in the U.S. and/or other countries.
*Other names and brands may be claimed as the property of others.
© Intel Corporation
2
Confid
en
tial
NFV Benchmarking
3
How to Benchmark and optimize NFVi & Network Services on these systems successfully today?
How to Benchmark and optimize NFVi & Network services in the future?
4
WHY NETWORK SERVICE Benchmarking?(NFV Community Driven Benchmarking)
4
General Lack of Telco Grade
Conformance/ Benchmarks
Unclear Network Workload
Dimensions and Stress Vectors
Missing System Level Capacity Requirements
Network Workload Scalability/ Agility Implications on NFV
Operators lack comprehensive information for TCO models to plan, procure and deploy NFV
NFV Ecosystem Acceleration
1
Dimension network workloads and stress vectors for different market segments
2
Deliver reference VNFs
3
Develop a common reference set of
benchmarks for VNFs
4
Contribute test suites to measure system level requirements for test
methodology and KPIs
5
Upstream/downstream adoption within open source communities
Confid
en
tial
NSB/Yardstick Benefits
5
Service Providers
✓ Easier TCO evaluation✓ ONE tool and methodology for NFVi and VNF performance evaluation✓ Reduced TTM for new services via improved onboarding process
SI✓ Easier TCO evaluation✓ ONE tool and methodology for NFVi and VNF performance evaluation✓ Reduced cost of onboarding process
ISVs OSVs
✓ Improved adoption of NFV technologies✓ Clear visibility of performance and applicability advantages
OEM ✓ Performance tweaks/BKM’s better exposed to industry
Confid
en
tial
What is NSB
No unified tool for VNF/NFVi Benchmarking
No unified methodology
Onboarding & Benchmarking process long
and effort prone
NSB is an Intel initiated Yardstick extension
helping out in automated onboarding and
characterization of NFVi’s & VNF’s under
consistent methodology
Industry Problem
What is NSB
6
One tool for three different environments
One tool to compare VNFs & NFVis
Integrated VNF, NFVi and network KPIs presentation
Scale up scenarios
Acceleration of characterization process
Solution offering
Scale up with cores and network ports
Openstack* context with SR-IOV support
Re-use of existing Openstack* VIM setup/run test cases
without destroying the VNF
New Features
Confid
en
tial
7
NSB Solution OfferingSupported VNFs
CG-NAT
ACL
Firewall
PE
SampleVNF
vRouter
Firewall
Commercial VNF
L2 FWD
L3 FWD
MPLS TAG
ACL
LB
Buffering
PROX(NFVi)
BNG
System Under TestSystem Under Test
OS, Hypervisor, Soft Switch
VNF
Instr
um
en
tatio
n
Hardware Platform
Receiver / Measurements
Receiver / Measurements
Instrumentation
Traffic GeneratorTraffic Generator
Instrumentation
Test Cases, VNFs, Test Vectors, KPIs
Control
Data collectionTREX
Pktgen
IXIA IxNetwork*
PROX
Supported Traffic Generators
8 8
NSB Program Path To Adoption
VNF Identification aligned VNF Identification aligned to Segment Business
KPI Selection
Test Case Definition
Framework Enhancements
Pilot Characterization report per Network Function
Scale out through engagements and marketing collateral
YARDSTICK
Iterative approach
to Network Function
enablement
within NSB
NSB Status
NFVi / VNF characterization Whitepapers with OSVs
Support for additional VNFs
Community contributing code to Yardstick NSB.
SPs evaluation of NSB
Agreement with key VNF Vendors on publication of Characterization Report
Support for vEPC and vCPE
Completed
In Progress
Future
✓ NFVi characterization support in framework
✓ vFW and vRouter VNF supported in framework
✓ Scale up supported in framework
✓ Agreements with OSVs, OEMs/ODMs on NFVi & VNF Characterization
✓ Service Agents onboarded (SIs)
9
Tieto, leading Nordic software & services
1968
Projects annually
Employing
3000
1.5Serving Nordic
clients since
900Around
customers
Turnover of
approximately
14 000experts globally,
in close to
20 countries
Servingcustomers in over
85
€ billion
countries
worldwide
Investments in technology
and services more than
130€ million*per year
*incl. capital expenditure and
operational costs
around
Confidentia
l
System integration with Tieto
Profit from our experience✓ Advisory consulting
✓ Evaluation, Benchmarking and Training
✓ Integration and Verification
✓ Platform, Open Source, VNF
✓ Multi Vendor integration
✓ Support & Maintenance
✓ R&D and customization services
✓ Lab capacity
11
COTS HW
NFV, SDN,Container Cloud
VNF Onboarding
Tieto experience base for NSB
Orc
he
stra
tion
Ec
os
ys
tem
What are we working on, right now…
12
NFV platform development
projects
Open source Software Defined Infrastructure
SmartNIC and FPGA
➢ Support for complex workloads (vEPC)
➢ Automated deployment of OVS-DPDK
➢ Automated scale-up and scale-out
➢ SRIOV context
➢ Sample VNFs configuration for high
performance
➢ Kubernetes support test cases
➢ Reporting
Tieto Experiences from using NSB
13
✓ Consistent Benchmarking methodology
✓ OpenSource solution
✓ Flexible workload modelling
✓ Easy to deploy
✓ Integrates Grafana
✓ Easy integration for commercial VNFs
✓ Good integration with Openstack*
Next Steps+
Tieto as Intel’s scaling partner for NSB
Initial & Extended Trainings
Enablement Integration and benchmarking
support
Full VNF & NFVi Characterization
support
VNF
NFVi
COTS HW optimization
NFVi and VNF NSB/Yardstick
Integration
Public Joint Benchmarking/Charact
erization reports
Commercial NFVi/VNF easier to onboard and benchmark by Industry
partnering Tieto with Customer
NS
B/Y
ard
stic
k N
SB
14
JOIN US
Engage with Industry projectsOPNFV*, Yardstick, Functest
Contribute to NSB withScenarios and use cases/KPIs
Test Harness development
Open Source VNFs
Need help with NSB enabling?
Engage with
16
MicroservicesHeading for Cloud Native
17
Traditional network function on proprietary infrastructure
Shift node into Virtual Machine
Cloud Native Microservices, distributed and decomposed
OS
NF
NF
OS
NF
NF
VNF
VM
VM
VNF
VM
VM
Benchmarking and installation
per node
Benchmarking of HW per nodeand VNF
MA
NO
OR
CH
ES
TR
AT
ION
Benchmarking per service or group of functions (on a Cloud or
specialized HW setup)
StatelessService Layer
Edge Region Central
Cont
VM
Cont
Cont
Network slice
Distrib. DB
Several large service providers, incl. AT&T, BT, CenturyLink, and Telefonica, have publicly embraced the move to a micro services architecture. AT&T has highlighted how micro services will play a role in their goal to virtualize 75% of their telco network by 2020.