a connectionist approach to dynamic resource management for virtualised network functions
TRANSCRIPT
![Page 1: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/1.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
A Connectionist Approach to Dynamic ResourceManagement for Virtualised Network Functions
Rashid Mijumbiβ, Sidhant Hasijaβ, Steven Davyβ, Alan Davyβ,Brendan Jenningsβ and Raouf Boutabaβ
βTelecommunications Software and Systems Group, Waterford Institute ofTechnology, Ireland
β D.R. Cheriton School of Computer Science, University of Waterloo, Waterloo,Ontario, N2L 3G1, Canada
Montreal, Canada, November 1, 2016
![Page 2: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/2.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Presentation Outline
1 Introduction: Network Functions Virtualisation
2 Problem: Efficient vs Reliable Resource Management
3 Proposed Approach: Graph Neural Networks
4 Solution Model: GNN-based Dynamic Resource Management
5 Performance Evaluation
6 Conclusion and Future Work
![Page 3: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/3.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Network Functions Virtualisation
Increasing CAPEX and OPEX
The short lifetime of the NAs leads to increased CapitalExpenses (CAPEXs).
When NAs are specialised, they require specialisedmaintenance and limits flexibility, leading to increasedOperating Expenses (OPEXs).
Declining Revenues
Competition with over-the-top providers
Inability to quickly provide new services
Separation between infrastructure and ServiceOptimization of resource Usage and routing beyond BGP
![Page 4: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/4.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Network Functions Virtualisation
Physical Resources
Virtual Resources
Services
Network Function Virtualization Infrastructure
Man
age
me
nt
and
Orc
he
stra
tio
n
Computing, Storage, Network Resources
Virtual Network Functions
Computing, Storage, Network Resources
Man
age
me
nt
and
Orc
he
stra
tio
n
VNF 1 VNF 2 VNF 3 VNF n. . .
.Source: R. Mijumbi, J. Serrat, J. L. Gorricho, N. Bouten, F. De Turck, R. Boutaba, βNetwork FunctionVirtualization: State-of-the-art and Research Challengesβ, IEEE Communications Surveys and Tutorials. 2016.
![Page 5: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/5.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Problem: Efficiency vs Reliability
NFV Essential for 5G, Supporting Critical Applications
NFV will be an important building block for 5G
5G is expected to support critical infrastructure
Efficiency and reliability are important KPIs for 5G
Source: http://telematicswire.net/ec-plans-future-of-5g-for-automotive/
![Page 6: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/6.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
State-of-the-art
1 High VM provisioning time threatens reliability in criticalapplications such as M2M
1
10
100
1000
1 2 4 8 16 32
Number of Virtual Machines
Tota
l Pro
visi
onin
g Ti
me
(s)
Eucalyptus OpenStack OpenNebula
.Adapted from: Mike Jones et al. βScalability of VM Provisioning Systemsβ, 20th Annual IEEE High PerformanceExtreme Computing Conference(HPEC), September 2016, Waltham, MA USA.
![Page 7: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/7.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Our Proposal
Objective
Predict VNF Resource Requirements so as:
To avoid resources are not unnecessarily kept active/standbyWhile ensuring reliable performance
Idea
Topology-aware Resource Management
Motivation: VNFC Dependencies
Virtualization container such as a
VM
VNFC 1
VNF 1 VNF 2
VNFC 1
VNFC 2 VNFC 3
VNF 4
VNFC 1
VNF 3
Service Function Chain based on Virtualised Network Functions
VNFC 3 VNFC 4
VNFC 2 VNFC 5
π2
π3 π4
π5
π32
π21
π14
π46π31
π15
π51π0
π7
π8
VNF 1
VNF 2
VNF 3
VNF 4
π5
π41
π6π0
π41
π4
π₯4
π₯1
π1
π14
π31
π3π₯3
π13
VNFC π1
Neighbourhood of VNFC π1
π1
π12
π13π23
π03
VNFC 1
VNF 2π2
VNFC State VNFC Features
π3
π1
π 3
π3
π 2
π2
π4
π5
π 1π1
π 1 π1
π 3π3
π 2 π2
π 4 π4
π 1 π1
π 1π1
π 5π5
π1
π 1 π1
βπ€
ππ€
o1
π5π 5 π5
ππ€
βπ€
π4
π 4 π4
βπ€
ππ€
o4
o5
π2π 2 π2
ππ€
βπ€
π3
π 3 π3
βπ€
ππ€
o3
o2
βπ€
βπ€
βπ€
βπ€
βπ€π₯2
π₯3
π₯1
π₯5
π₯4
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€. . .
. . .
. . .
. . .
. . .
π 5
π 1
π 3
π 2 o2
o3
o1
o5
o4
π0 π1 π2 ππ
ππ€
ππ€
ππ€
ππ€
ππ€
π 4
π2
π4
π5
π1
π3
VNFC 1
![Page 8: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/8.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Graph Neural Networks (GNN)
A supervised learning model aimed at solving problems in thegraphical domain.
Node, π4 Node, π3
Node, π1 Node, π2
Node, n
VNFC Features, ππ Neighbourhood, , πβ
Using fn and n?, a state sn, and an output on for each node nare determined using equations (1) and (2) respectively.
sn =βmβn?
hw(fn, fm, sm
),βn (1)
on = gw(sn, fn
), βn (2)
![Page 9: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/9.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
GNN-based Dynamic Resource Management
Features ππof VNFC
Features ππ
of all VNFCβs Neighbours
βπ€ ππ€
VNFC Stateπ π
Output(Resource Forecast)
FNN FNN
States π πof all Neighbours
VNFC States
SFC Features
Output Computation
State Computation
3 4
1
2
Comprised of four main components: (1) SFC features, (2)VNFC states, (3) state computation, and (4) outputcomputation.
![Page 10: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/10.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
SFC Features
Observations or monitoring data from the VNFCsInclude network parameters (such as CPU or RAM utilisationlevels) that can be measured.
fn =
cnmn
dn
(3)fnm =
[bnmdnm
](4)
-SFC modelled as a directed graph G (N, L)
Virtualization container such as a
VM
VNFC 1
VNF 1 VNF 2
VNFC 1
VNFC 2 VNFC 3
VNF 4
VNFC 1
VNF 3
Service Function Chain based on Virtualised Network Functions
VNFC 3 VNFC 4
VNFC 2 VNFC 5
π2
π3 π4
π5
π32
π21
π14
π46π31
π15
π51π0
π7
π8
VNF 1
VNF 2
VNF 3
VNF 4
π5
π41
π6π0
π41
π4
π₯4
π₯1
π1
π14
π31
π3π₯3
π13
VNFC π1
Neighbourhood of VNFC π1
π1
π12
π13π23
π03
VNFC 1
VNF 2π2
VNFC State VNFC Features
π3
π1
π 3
π3
π 2
π2
π4
π5
π 1π1
π 1 π1
π 3π3
π 2 π2
π 4 π4
π 1 π1
π 1π1
π 5π5
π1
π 1 π1
βπ€
ππ€
o1
π5π 5 π5
ππ€
βπ€
π4
π 4 π4
βπ€
ππ€
o4
o5
π2π 2 π2
ππ€
βπ€
π3
π 3 π3
βπ€
ππ€
o3
o2
βπ€
βπ€
βπ€
βπ€
βπ€π₯2
π₯3
π₯1
π₯5
π₯4
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€. . .
. . .
. . .
. . .
. . .
π 5
π 1
π 3
π 2 o2
o3
o1
o5
o4
π0 π1 π2 ππ
ππ€
ππ€
ππ€
ππ€
ππ€
π 4
π2
π4
π5
π1
π3
VNFC 1
![Page 11: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/11.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
VNF States
Virtualization container such as a
VM
VNFC 1
VNF 1 VNF 2
VNFC 1
VNFC 2 VNFC 3
VNF 4
VNFC 1
VNF 3
Service Function Chain based on Virtualised Network Functions
VNFC 3 VNFC 4
VNFC 2 VNFC 5
π2
π3 π4
π5
π32
π21
π14
π46π31
π15
π51π0
π7
π8
VNF 1
VNF 2
VNF 3
VNF 4
π5
π41
π6π0
π41
π4
π₯4
π₯1
π1
π14
π31
π3π₯3
π13
VNFC π1
Neighbourhood of VNFC π1
π1
π12
π13π23
π03
VNFC 1
VNF 2π2
VNFC State VNFC Features
π3
π1
π 3
π3
π 2
π2
π4
π5
π 1π1
π 1 π1
π 3π3
π 2 π2
π 4 π4
π 1 π1
π 1π1
π 5π5
π1
π 1 π1
βπ€
ππ€
o1
π5π 5 π5
ππ€
βπ€
π4
π 4 π4
βπ€
ππ€
o4
o5
π2π 2 π2
ππ€
βπ€
π3
π 3 π3
βπ€
ππ€
o3
o2
βπ€
βπ€
βπ€
βπ€
βπ€π₯2
π₯3
π₯1
π₯5
π₯4
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€. . .
. . .
. . .
. . .
. . .
π 5
π 1
π 3
π 2 o2
o3
o1
o5
o4
π0 π1 π2 ππ
ππ€
ππ€
ππ€
ππ€
ππ€
π 4
π2
π4
π5
π1
π3
VNFC 1
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€π 3
π 4
π 1
βπ€
βπ€π 2
π2 π3
π1
π4
βπ€π 5
π5
π4
π3π2
π1
π5
![Page 12: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/12.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
State Computation (1)
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€π 3
π 4
π 1
βπ€
βπ€π 2
π2 π3
π1
π4
βπ€π 5
π5
π4
π3π2
π1
π5
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(1)
π 2(1)
π 1(1)
π 5(1)
π 4(1)
π 2(0)
π 1(0)
π 3(0)
π 1(0)
π 3(0)
π 1(0)
π 5(0)
π 4(0)
π 1(0)
π 1(0)
π2 , π3
π1 , π2
![Page 13: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/13.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
State Computation (2)
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(2)
π 2(2)
π 1(2)
π 5(2)
π 4(2)
π 2(1)
π 1(1)
π 3(1)
π 1(1)
π 3(1)
π 2(1)
π 5(1)
π 4(1)
π 1(1)
π 1(1)
π2 , π3
π1 , π2
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(1)
π 2(1)
π 1(1)
π 5(1)
π 4(1)
π 2(0)
π 1(0)
π 3(0)
π 1(0)
π 3(0)
π 2(0)
π 5(0)
π 4(0)
π 1(0)
π 1(0)
π2 , π3
π1 , π2
Iteration 1 Iteration 2
![Page 14: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/14.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
State Computation (3)
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(1)
π 2(1)
π 1(1)
π 5(1)
π 4(1)
π 2(0)
π 1(0)
π 3(0)
π 1(0)
π 3(0)
π 2(0)
π 5(0)
π 4(0)
π 1(0)
π 1(0)
π2 , π3
π1 , π2
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(2)
π 2(2)
π 1(2)
π 5(2)
π 4(2)
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(3)
π 2(3)
π 1(3)
π 5(3)
π 4(3)
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(π)
π 2(π)
π 1(π)
π 5(π)
π 4(π)
. . .
. . .
. . .
. . .
. . .
. . .
. . .
. . .
. . .
. . .
Iteration 1 Iteration 3Iteration 2 Iteration T
State Computation
![Page 15: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/15.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Output computation
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(1)
π 2(1)
π 1(1)
π 5(1)
π 4(1)
π 2(0)
π 1(0)
π 3(0)
π 1(0)
π 3(0)
π 2(0)
π 5(0)
π 4(0)
π 1(0)
π 1(0)
π2 , π3
π1 , π2
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(2)
π 2(2)
π 1(2)
π 5(2)
π 4(2)
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(3)
π 2(3)
π 1(3)
π 5(3)
π 4(3)
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
βπ€
π 3(π)
π 2(π)
π 1(π)
π 5(π)
π 4(π)
. . .
. . .
. . .
. . .
. . .
. . .
. . .
. . .
. . .
. . .
π5ππ€
π4ππ€
π1ππ€
π2ππ€
π3ππ€
Iteration 1 Iteration 3Iteration 2 Iteration T
State ComputationOutput Computation
![Page 16: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/16.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Summary
1
2
3
0
![Page 17: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/17.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Implementation Setup
Bono Sprout
Ralf Homer Homestead
HSS Mirror
cassandra
XDMS
cassandra
Rf CTF
memcached
I/S-CSCF BGCF
memcachedP-CSCF, WebRTC
Clearwater virtualised IMS
SNMPUEs
SIPp
GNN-based Dynamic Resource
ManagementDNS
Heat Orchestration
SIP
CACTIMonitoring
SUT
![Page 18: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/18.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Evaluation Details
Setup Parameters and Comparisons
1 100K Users, Call initiation/end based on Poisson/Exponential,
2 Each call transmits media extracted from real Skype traffictraces
3 All VNFCs polled every 15s, History/Forecasting is 20episodes,
4 Experiment 1: 10,000 data points for training FNNs
5 Experiment 2: Trained System used to determine accuracy on1,000 measurements
6 Experiment 3: Predictions used to effect resource allocations(Spin-up at 40%, Spin down at 20%)
7 Comparisons: Static, Manual, Automated
![Page 19: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/19.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Evaluations (1)
0
10
20
30
40
50
60
0 200 400 600 800 1000
RM
SE
Training Iteration, each involving 10,000 examples
Ralf Bono Sprout
Homestead Homer Total
0.00
0.20
0.40
0.60
0.80
1.00
0 200 400 600 800 1000
% C
PU U
tlis
atio
n
Test Number
Actual Output Expected Output
0.00
0.50
1.00
1.50
2.00
2.50
3.00
0 200 400 600 800 1000
Del
ay (
ms)
Test Number
Actual Output Expected Output
0.5
0.6
0.7
0.8
0.9
1
0 200 400 600 800 1000
% D
elay
Pre
dic
tio
n E
rro
r
Test Number
Error 100 period Mov. Avg.
![Page 20: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/20.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Evaluations (2)
0
0.2
0.4
0.6
0.8
1
100 400 700 1000
% C
PU U
tilis
atio
n
Test Number
Static Manual Automated
0.00
0.50
1.00
1.50
2.00
2.50
3.00
100 400 700 1000
Del
ay (m
s)
Test Number
Static Manual Automated
0
2
4
6
8
100 400 700 1000
Dro
pped
Cal
lsTh
ousa
nds
Test Number
Static Manual Automated
0
10
20
30
40
100 400 700 1000
Dro
pped
Cal
lsTh
ousa
nds
Test Number
Static Manual Automated
![Page 21: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/21.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Conclusion and Future Work
Conclusion
Topology-aware approach to automated and dynamicresource management approach for NFV environments.
Implemented in a real environment involving a virtualisedIMS, and using real VoIP traces,
Prediction accuracy of about 90%, and enhance theprocessing delay and call drop rate by 29% and 27%respectively.
Future Work
Improve generalisation accuracy by considering error functionswith different penalty terms.
More efficient ways of training the SFC encoding network.
![Page 22: A Connectionist Approach to Dynamic Resource Management for Virtualised Network Functions](https://reader031.vdocuments.net/reader031/viewer/2022022202/5880522b1a28ab22088b5eab/html5/thumbnails/22.jpg)
Introduction Problem Proposed Approach Solution Model Evaluation Conclusion
Thank You
THANK YOU!Contact: [email protected]