evolution of opnfv ci system - linux foundation...
TRANSCRIPT
![Page 1: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/1.jpg)
Evolution of OPNFV CI system:
what already exists and what can be introduced
Jun Li ([email protected])
San Francisco 09/11/2015
![Page 2: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/2.jpg)
2
The Continuous Integration (CI) infra used today
Reference http://artifacts.opnfv.org/octopus/docs/opnfv-ci-infrastructure.html
![Page 3: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/3.jpg)
3
Jenkins, the CI engine
Jenkins runs tests and automates some parts of project operations
Jenkins focuses on building/testing software projects continuously and monitoring
executions of externally-run jobs
Jenkins supports plugins, which allows to be extended to meet specific requirements
The Jenkins jobs are defined by Jenkins Job builder(JJB) in human readable YAML format
![Page 4: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/4.jpg)
4
The number of patch commit and author is growing fast
With 10 labs(include LF lab), while no efficient job scheduler(some labs are not connected stable)
Do we need a log tool?
And more …
Some problems occur
![Page 5: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/5.jpg)
5
Which tools can be introduced?
![Page 6: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/6.jpg)
6
Zuul scheduler, the main component of Zuul, it receives
events related to proposed changes, triggers tests based on
those events, and reports back
Zuul merger, set temporary Git repositories and branches up
in order to ease the preparation of jobs environments.
Jenkins slave 1
Jenkins slave 2
Zuul (gating) and Gearman (job scheduling)
![Page 7: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/7.jpg)
7
Reference http://status.openstack.org/zuul/
Zuul pipeline(check, gate, post, etc)
Zuul solves,
1) Testing in parallel
2) Cross projects dependencies
One use case, Zuul used in OpenStack
![Page 8: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/8.jpg)
8
ElasticSearch ELK stack: gather/store/visualize syslogs
![Page 9: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/9.jpg)
9
how should be the evolution of the CI infra??
![Page 10: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/10.jpg)
10
Evolution of CI system
Github Mirror
Remote Git Repository
Gerrit
Developers
Pipy repository Ubuntu, Centos,
etc, mirrors
Repository of Steady version
openstack/opendaylight, etc
…
… …
Jenkin masters
Jenkin slaves & plugins for test
… Log servers & log searcher
Zuul Gearman
Gating, work scheduler
Scripts to get the mirrors & test depended packages for Build, use nodepool for image management.
Puppet/Hiera manages the servers
OPNFV Mirror
![Page 11: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/11.jpg)
11
Demo links
https://www.youtube.com/watch?v=fOYdsNdkCuw
![Page 12: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/12.jpg)
12
Any Questions ?
![Page 13: Evolution of OPNFV CI system - Linux Foundation Eventsevents17.linuxfoundation.org/sites/events/files/slides/evolution of...for reference purpose only and constitutes neither an offer](https://reader030.vdocuments.net/reader030/viewer/2022041219/5e083cbd3f951d4551705c3c/html5/thumbnails/13.jpg)
Copyright©2015 Huawei Technologies Co., Ltd. All Rights Reserved.
The information in this document may contain predictive statements including, without limitation,
statements regarding the future financial and operating results, future product portfolio, new technology,
etc. There are a number of factors that could cause actual results and developments to differ materially
from those expressed or implied in the predictive statements. Therefore, such information is provided
for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the
information at any time without notice.