xen on arm: status and performance
TRANSCRIPT
![Page 1: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/1.jpg)
18 August 2014
Xen on ARMHow fast is it, really?
Stefano Stabellini
![Page 2: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/2.jpg)
Status
![Page 3: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/3.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Xen Project 4.4 release: statusFeatures:● 64-bit guest support in ARMv8● stable hypercall ABI● basic lifecycle operations● memory ballooning● scheduler configurations, vcpu pinning, cpu pools
HCL (not inclusive):● ARMv8 FVP● Arndale board● Allwinner Sunxi (Cubieboard 2)● TI OMAP5● Applied Micro X-Gene
© 2014 Citrix
![Page 4: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/4.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Linux v3.13+: status
● dom0 and domU● 32-bit and 64-bit● SMP● swiotlb-xen● PV drivers
○ disk○ network○ console○ framebuffer○ keyboard○ mouse
© 2014 Citrix
![Page 5: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/5.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Coming in Xen 4.5● irq latency reduction: no maintenance interrupts● support for interrupt priorities● irq migration: physical follow virtual● multi-grants support● SMMU support● Device Assignment on ARM● Xen UEFI host support● GICv3 support● support for up to 1TB of guest RAM● super pages support● support for sparse memory map● support for 48-bit physical addresses● QEMU PV backend on ARM: framebuffer,
mouse, keyboard, multi-console© 2014 Citrix
● MiniOS on ARM● PSCI v0.2
![Page 6: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/6.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Coming in Xen 4.5● irq latency reduction: no maintenance interrupts● support for interrupt priorities● irq migration: physical follow virtual● multi-grants support● SMMU support● Device Assignment on ARM● Xen UEFI host support● GICv3 support● support for up to 1TB of guest RAM● super pages support● support for sparse memory map● support for 48-bit physical addresses● QEMU PV backend on ARM: framebuffer,
mouse, keyboard, multi-console© 2014 Citrix
● MiniOS on ARM● PSCI v0.2
![Page 7: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/7.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
xen-devel traffic
© 2014 Citrix
![Page 8: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/8.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Maintainers & reviews
© 2014 Citrix
![Page 9: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/9.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Coming in Xen 4.5: performance improvements
● irq latency reduction: no maintenance interrupts● support for interrupt priorities● irq migration: physical follow virtual● multi-grants support● super pages support● support for up to 1TB of guest RAM● support for sparse memory map● support for 48-bit physical addresses
© 2014 Citrix
![Page 10: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/10.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
irq latency reduction: no maintenance interrupts
DomU
Xen
irq 109
virq 109
DomU
Xen
EOI
DomU
Xen
Maintenance interrupt
GICH_LRWrite
GICH_LRClear
© 2014 Citrix
![Page 11: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/11.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
irq latency reduction: no maintenance interrupts
DomU
Xen
irq 109
virq 109
DomU
Xen
EOI
DomU
Xen
Maintenance interrupt
GICH_LRWrite
GICH_LRClear
© 2014 Citrix
![Page 12: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/12.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Coming in Xen 4.5: performance improvements
● irq latency reduction: no maintenance interrupts● support for interrupt priorities● irq migration: physical follow virtual● multi-grants support● super pages support● support for up to 1TB of guest RAM● support for sparse memory map● support for 48-bit physical addresses
© 2014 Citrix
![Page 13: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/13.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
irq migration: physical follow virtual
vcpu0 vcpu1
pcpu0 pcpu1
irq 109
virq 109
© 2014 Citrix
![Page 14: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/14.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
irq migration: physical follow virtual
vcpu0 vcpu1
pcpu0 pcpu1
irq 109
virq 109
© 2014 Citrix
![Page 15: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/15.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
irq migration: physical follow virtual
vcpu0 vcpu1
pcpu0 pcpu1
irq 109
virq 109
© 2014 Citrix
![Page 16: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/16.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Coming in Xen 4.5: performance improvements
● irq latency reduction: no maintenance interrupts● support for interrupt priorities● irq migration: physical follow virtual● multi-grants support● super pages support● support for up to 1TB of guest RAM● support for sparse memory map● support for 48-bit physical addresses
© 2014 Citrix
![Page 17: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/17.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
multi-grants support
© 2014 Citrix
Backend Frontend
PagePage
Page
Grant
Grant
![Page 18: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/18.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
multi-grants support
© 2014 Citrix
Backend Frontend
PagePage
Page
Grant
Grant
mfn
==
mfn
![Page 19: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/19.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
multi-grants support
© 2014 Citrix
Backend Frontend
PagePage
Page
Grant
Grant
mfn
==
mfn
mfn_to_pfn
??
![Page 20: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/20.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
multi-grants support
© 2014 Citrix
Backend Frontend
PagePage
Page
Grant
Grant
Pagepfn == mfn
mfn
==
mfn
mfn_to_pfn
??
![Page 21: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/21.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Coming in Xen 4.5: performance improvements
● irq latency reduction: no maintenance interrupts● support for interrupt priorities● irq migration: physical follow virtual● multi-grants support● super pages support● support for up to 1TB of guest RAM● support for sparse memory map● support for 48-bit physical addresses
© 2014 Citrix
![Page 22: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/22.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Coming in Xen 4.5: hardware and interfaces
● SMMU support● Xen UEFI host support● PSCI v0.2● GICv3 support
© 2014 Citrix
![Page 23: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/23.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Coming in Xen 4.5: features
● (Non-PCI) Device Assignment on ARM● QEMU PV backend on ARM: framebuffer, mouse, keyboard, multi-console● MiniOS on ARM
© 2014 Citrix
![Page 24: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/24.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Looking ahead
● save/restore and live-migration● PCI device assignment
● IOMMU emulation for remote processors● GICv2m support● SMMUv2 support● ACPI support
© 2014 Citrix
![Page 25: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/25.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Embedded and Automotive
● Embedded and Automotive Xen Project initiativehttp://xenproject.org/about/events/viewevent/146-webinar-virtualization-in-the-automotive-industry-2.html
● Embedded and Automotive PV drivers projecthttp://xenproject.org/developers/teams/embedded-and-automotive.htmlhttp://wiki.xenproject.org/wiki/Embedded_and_Automotive_PV_Drivers/Roadmap
© 2014 Citrix
![Page 26: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/26.jpg)
Benchmarks
![Page 27: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/27.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Execution environment
● Linux v3.15-rc8dom0, domU and native kernel
● Xen v4.5-unstable+
● QEMU-KVM v2.0.0
● OpenSUSE 13.1
© 2014 Citrix
Applied Micro X-Gene Intel Xeon CPU X5650
ARMv8 64-bit 8 cores 2.4 Ghz x86_64 2 sockets x 6 cores 2.67 Ghz
![Page 28: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/28.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Kernbenchvirtualization overhead (percentage) - Lower is better
© 2014 Citrix
![Page 29: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/29.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
PBZIP2virtualization overhead (percentage) - Lower is better
© 2014 Citrix
![Page 30: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/30.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
FIO rand-rwvirtualization overhead (percentage) - Lower is better
© 2014 Citrix
![Page 31: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/31.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
SPECjbb2005virtualization overhead (percentage) - Lower is better
© 2014 Citrix
![Page 32: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/32.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
PGBenchvirtualization overhead (percentage) - Lower is better
© 2014 Citrix
![Page 33: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/33.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
PGBenchvirtualization overhead (percentage) - Lower is better
© 2014 Citrix
![Page 34: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/34.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
PGBenchvirtualization overhead (percentage) - Lower is better
© 2014 Citrix
![Page 35: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/35.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
PGBenchvirtualization overhead (percentage) - Lower is better
© 2014 Citrix
120
![Page 36: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/36.jpg)
Benchmarks by
![Page 37: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/37.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
SpecINT 2006Xen on ARM virtualization overhead (percentage) - Lower is better
2%
© 2014 Citrix
![Page 38: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/38.jpg)
Conclusions
![Page 39: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/39.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
● many new features coming● good performance results● still lots of room for improvement
Conclusions
© 2014 Citrix
![Page 40: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/40.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
● need more reviewers
Conclusions
© 2014 Citrix
![Page 41: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/41.jpg)
Questions?
![Page 42: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/42.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
More information
● http://www.xenproject.org
● Xen on ARM @wiki.xenproject.org http://goo.gl/FKNXe
● Xen on ARM whitepaper http://goo.gl/vWMn7D
● http://lists.xenproject.org/mailman/listinfo/xen-devel
© 2014 Citrix
![Page 43: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/43.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Work better. Live Better.
Citrix
© 2014 Citrix
![Page 44: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/44.jpg)
Slide parking lot
![Page 45: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/45.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
IPerf
Linerate
© 2014 Citrix
![Page 46: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/46.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
FIOXen on ARM virtualization overhead (percentage) - Lower is better
© 2014 Citrix
![Page 47: Xen on ARM: status and performance](https://reader034.vdocuments.net/reader034/viewer/2022051318/5863b5711a28ab0e30915856/html5/thumbnails/47.jpg)
© 2013 Citrix | Confidential – Do Not Distribute
Reading xen-devel
© 2014 Citrix