evansdata_devrel_2016-devops
TRANSCRIPT
Developer Relations and the Impact of DevOpsEvans Data DevRel ConferenceMarch 21 – 22, 2016
Larry McDonoughDirector Product Mgmt.Ecosystem ServicesVMware @Lmcdunna
2
Agenda
DevOps!
DevOps!
DevOps! DevOps!
DevOps!
DevOps!
• VMware
• What is Ecosystem Services at VMware?• VMware’s products, technology partner ecosystem,
certifications, • Engagement, Conferences, Portals, Forums, Social
Media,
• How are our Developers Changing?• Surveys, Market Research
• DevOps and the Forces acting on todays developer• Agile/Scrum/Lean, OSS, Cloud, Mobile, SaaS,
Containers, …
• Observations of Impact of DevOps
• Additional Resources
3
Founded in 1998
Revenues of $6.57 Billion in 2015
More than 15,000 employees worldwide
serving more than 500,000 customers
Headquartered in Palo Alto, California
with offices in more than 100 countries
About VMware
CONFIDENTIAL 4
VMware’s Worldwide Presence
Europe, Middle East, and Africa (EMEA)
Americas Asia Pacific & Japan(APJ)
5
VMware History of Investment and Innovation
2006Launch of VMware
Solution Exchange and Certification Program.
Release of VMware Infrastructure 3.
2001VMware ESX Server
1.0 released.
IBM, Dell, Compaq and HP join VMware
Partner Program.1998
VMware Founded
200380% of Fortune
100 companies work with VMware
2008VMware Wins 200th award.
Introduction of VMware vCloud
initiative.
2011VMware unveils
management portfolio for the cloud era.
VMware vFabric 5, and VMware vSphere 5
comprehensive cloud infrastructure suite.
Completion of 30th acquisition
2014VMware acquires
2004First VMworld
Conference
2010VMware positioned
in Leaders Quadrant of the Magic Quadrant for x86 server virtualization infrastructure (Gartner)
2013Launch of Hybrid
Service and Introduction of VMware Horizon Suite and Software- Defined
Data Center architecture
2015Launch ofvSphere 6.
99% of Fortune 100
companies workwith VMware.
2007VMware becomes 4th-largest software
company in the world.
Introduction of VMware ESXi Hypervisor.
2012VMware acquires
Nicira
6
Industry Accolades and AwardsMore than 300 industry accolades and awards have
recognized VMware’s innovation and strategic excellence.
InfoWorld 2015 Technology of the Year award
(VMware Virtual SAN)
Our Company
Fortune 100 Best Companies to
Work for in the US (2015)
Computerworld’s 100 Best Places
to Work in IT(2014)
CRN’s Mobility Vendor of the Year
(2014)
Our Products
Best of Interop 2015 Performance/Management/
Monitoring Winner(VMware vRealize Operations 6)
2015 SC MagazineBest Mobile Security
Solution Winner(AirWatch by VMware)
2014 Virtualization Review Reader’s Choice Awards
and Ultimate Buyer’s Guide Winner (9 categories)
2014 Best of Microsoft’s TechEd North America in the virtualization category
(VMware Virtual SAN)
7
Solutions for Unified Hybrid Cloud and Business MobilityUnified Hybrid Cloud
Only VMware unifies your private, public and managed clouds into one hybrid cloud so you can innovate like a
startup and deliver like an enterprise
Any Application, Anywhere
UnifiedPlatform
OpenManagement
Software-Defined Data Center
Private
Your Data Center
Public
vCloud Air
Managed
vCloud Air Network
Traditional Applications Modern, Cloud ApplicationsBusiness Mobility: Applications / Devices / Content
ITUser
Workspace Services
Identity
Software-Defined Data Center
Catalog Gateway Social
Desktop Mobile Content
VMware Workspace Suite
Business MobilityVMware uniquely spans mobile, desktop, and infrastructure to support innovative business strategies while protecting
IP, data, and business operations.
8
Strong Software-Defined Data Center Customer Momentum
500,000 Customers99% of Fortune 100
99.8% of Fortune 50099.7% of Fortune 1000
vCloud Suite(Compute + Management)
Ecosystem Services at VMwareSupporting our Technology Integration Partners
Ecosystem Services
• Program Management– Onboarding & enablement– Issue Management
• Product Management– Tools & technologies access
(APIs, SDKs, Web Portals)– Internal & external developers
• Partner Management– Engagement services– Engineering services
• Certifications Management– Tests, guidelines, best practices
10
Storage
Compute Management
MobilityNetwork & Security
vCloud Air
TechnologyIntegrationPartners
developercenter.vmware.comAll the resources developers need to design and build solutions
for the Software Defined Data Center
Built for Developers and DevOps!
Provides SDKs, API References, Tools &
Docs
Blogs, Forums, Samples and Github integration SSO with “My VMware”
account
Personalized, private content for partners
One-on-One case management (DCPN)
Architecture Diagrams
@vmwaredevcenter
Programs, Services & Certifications
Open Partner
Surveys & Market ResearchObserving our developers
Annual Ecosystem Services Survey
• Was 2x/year surveying half each time
• 2864 individual invitations total invited
• 142 individual responses to the survey (4.9%)
• 227 Partners were invited to participate
• 73 Companies responded (32%)
• They identified their roles as (Top 5)• “Engineering” (30%),
• “Development” (18%),
• “Certification “ (12%),
• “Management / Director” (8.6%),
• “Product Management” (7.2%)
(0%)
5%
10%
15%
20%
25%
30%
35%
2013 2014 2015 Primary Roles
14
15
Evans Data Cloud Development Survey
16
Cloud Development Survey 2015: Volume I, © 2015 Evans Data Corp.
What Motivates Developers?
17
Community
Commercial Success
Personal Fulfillment
What do Developers Care About?
18
Source: Vision Mobile, Developer Programs Benchmarking Report 2015http://www.visionmobile.com/product/developer-programs-benchmarking-2015/
Development is ChangingMain forces acting on developers…
Application Design is Changing
Properties of a Microservice Small code base Easy to scale, deploy and throw away Autonomous Resilient
Benefits of a Microservices Architecture A highly resilient, scalable and resource
efficient application Enables smaller development teams Teams free to use the right languages and
tools for the job Rapid application development
21
12-Factor Apps
I. CodebaseOne codebase tracked in revision control, many deploys
II. DependenciesExplicitly declare and isolate dependencies
III. ConfigurationStore configuration data in the environment
IV. Backing ServicesTreat backing services as attached resources
V. Build, release, runStrictly separate build and run stages
VI. ProcessesExecute the app as one or more stateless processes
VII. Port bindingExport services via port binding
VIII. ConcurrencyScale out via the process model
IX. DisposabilityMaximize robustness with fast startup and graceful shutdown
X. Dev/prod parityKeep development, staging, and production as similar as possible
XI. LogsTreat logs as event streams
XII. Admin processesRun admin/management tasks as one-off processes
Source: http://12factor.net/
“In the modern era, software is commonly delivered as a service: called web apps, or software-as-a-service. The twelve-factor app is a methodology for building software-as-a-service apps.”
22
What are the Industry Trends Driving Change?
© IDC “The New Developer Landscape, Understanding the Modern Software Developer”, by Al Hilwa, IDC Directions, March 2nd, 2016 San Jose CA
■ Mobile/IoT continue to drive back-end cloud services adoption and continued surfacing of API revolution
■ Rise of background processing: Lambda, iron.io, back-end IoT processing engines – rise of microservices
■ Open source is the new open standards – lock-in mitigation and strategic safety
■ Linux, Apache, Eclipse, Git, Android, OpenStack, Firefox, Cloud Foundry, OpenShift, Hadoop…
■ IaaS continues to dominate and embrace PaaS
■ PaaS as a set of platform services, not just compute workload
■ Container revolution ushers in new modalities for DevOps – shift from VM-centric dev workflows
■ Containers as building blocks of modern PaaS and units of microservices architecture
23
•“ I want to release the smallest amount of code, using the smallest number of people, with the least amount of ceremony possible, as frequently as possible.”
Source: Erik Kastner, Etsy.com
Developers Are The Driving Force in IT
24
What is DevOps?
26
What Exactly Is DevOps?Wikipedia
“a software development method that stresses communication, collaboration, integration, automation, and measurement of cooperation between software developers and other information-technology (IT) professionals.” https://en.wikipedia.org/wiki/DevOps
Adam Jacob’s DevOps Kung fu“A cultural and professional movement, focused on how we build and operate high velocity organizations, born from the experiences of its practitioners.” https://github.com/chef/devops-kungfu
Cloud Technology Partners“DevOps: A cultural shift or movement that encourages great collaboration (aka teamwork) to foster building better quality software more quickly with more reliability.” http://www.cloudtp.com/2014/05/22/devops-organizational-change-agent/
Jez Humble“a cross-functional community of practice dedicated to the study of building, evolving, and operating rapidly changing, secure, resilient systems at scale.” https://www.youtube.com/watch?v=L1w2_AY82WY
27
“Shadow IT”
Reference: http://blog.landesk.com/en/category/landesk-management-suite/
• Business units believe they can develop faster– Driven by developers!
• Most prevalent in SaaS environments
• Won’t fly in Enterprise environments, especially those servicing regulated industries
• Not seen as a bad thing necessary for innovation incubation
28
DevOps is Not New
Source: http://www.agileweboperations.com/lean-agile-devops-related
1. Lean is the basis of Agile
2. Build product development flow on top of Lean
3. DevOps is the cultural aspect of concentrating on business results rather than technical details
2008
2012
29
DevOps is A Holistic Systems View
Idea Application Code
DeployedApplication
Business Development Operations
Agile Development DevOpsfixes this fixes this
Business Process
Source: http://dev2ops.org/2010/02/what-is-devops/
30
Software Development Methodologies
By SPEC India, “Waterfall to Agile to DevOps – A Cultural and Technological Shift”http://blog.spec-india.com/from-waterfall-to-agile-to-devops-a-cultural-and-technological-shiftPosted on December 29, 2015
31
Software Development Methodologies
By SPEC India, “Waterfall to Agile to DevOps – A Cultural and Technological Shift”http://blog.spec-india.com/from-waterfall-to-agile-to-devops-a-cultural-and-technological-shiftPosted on December 29, 2015
Deploys!
32
CI/CD
Continuous Integration (CI) is a development practice that requires developers to integrate code into a shared repository several times a day. Each check-in is then verified by an automated build, allowing teams to detect problems early.
“Continuous deployment is the next step of continuous delivery: Every change that passes the automated tests is deployed to production automatically. Continuous deployment should be the goal of most companies that are not constrained by regulatory or other requirements.”
“Continuous delivery is a series of practices designed to ensure that code can be rapidly and safely deployed to production by delivering every change to a production-like environment and ensuring business applications and services function as expected through rigorous automated testing.”
Continuous Integration
Source: https://insights.sei.cmu.edu/devops/2015/01/continuous-integration-in-devops-1.html
Source: https://puppetlabs.com/blog/continuous-delivery-vs-continuous-deployment-whats-diff
33
DevOps Has Many Non-technical ChallengesChange Organization
VP ofOperations
VP ofDevelopment
Layers of Middle
Management
Layers of Middle
Management
Sys Admin Developer
VP ofProduct
Layers of Middle
Management
Sys Admin Developer
CIO CIO
Incentivized to innovate and release
Report to same manager. Incentivized to work together to develop and release
Build Trust
Empower People to
Take Action
Update Roles and
Responsibilities
34
VMware and DevOps
ESXi
Photon Platform
Container Container
NSX
DevOps
IT Ops Developer
NSX
Storage
vSphere
Services
35
DevOps Enables High Business Performance
Source: State of DevOps Report, 2013 and 2014
High performers are more agile 30x
Faster in shipping code
8,000xFaster in completing
deployments
High performers are more reliable 2x
The change success rate
12xFaster meant time to recover
(MTTR)
High performers win in the marketplace
2xMore likely to exceed profitability, market share & productivity goals
50%Higher market capitalization
growth over 3 years
IT Drives These Changes
Compared to peers across the industry, high-performing IT organizations experience:
36Source: https://puppetlabs.com/2015-devops-report
60xfewer failures
168xfaster failurerecovery time
30xmore frequentdeployments
200xshorter
lead times
VMware IT Adopts DevOpsAcross 9 Small to Medium projects to test the waters…
38
In A Nutshell – What Slows Us Down?
Application Delivery
Feature Delivery
• Requirements -> Development -> Release -> Operations
• These are sequential with too much reliance on documentation
• No ability to release features when ready – wait for a release
• Environment wait time and dependencies
• Too many hand-offs and downtimes for code deployments
• Development resources spend time on non development activities
39
VMware IT Tested DevOps on 9 Small-Medium Pilot Projects
Percentage improvement on key parameters
RESOURCE EFFICIENCY
DEPLOY FREQ
TIME TO MARKET [SPEED]
APP QUALITY
DevOps…
Transforming
People
Transforming
Processes
Transforming
Technology
Improvements
DevOps transformation across People – Process – Technology to support faster delivery
“COST SAVING
“
40
• Moved up the value chain to engage early and deeply with business to add new functional capabilities
• Modified business engagement model to introduce BSAs into early discussions with the business units
Key Initiatives
• Align processes and phase gates to cater to both Traditional IT, emphasizing scalability, efficiency, safety and accuracy and Nimble IT, non-sequential, emphasizing agility and speed
Business System Analyst Transformation
Bi-Modal IT
Benefits of People Transformation
RESOURCE EFFICIEENCY
APP QUALITY
TIME TO MARKET (SPEED)
COST SAVING
15%
10%
8%
10%
10%
COST SAVING
DEPLOY FREQ
TIME TO MARKET [SPEED]
APP QUALITY
RESOURCE EFFICIENCY • Broke down department, technology and process
barriers and built trust in each other
• Defined new role, titles and responsibilities
• Ensured focus was on business services, not technology
Developers & Ops TransformationProjects9
Percentage improvement on key parameters
People Transformation
People
70PEOPLE
41
RESOURCE EFFICIEENCY
APP QUALITY
TIME TO MARKET (SPEED)
COST SAVING
5%
10%
6%
10%
5%
• Business Assurance rather than Quality Assurance
• Automation first – Test Design Automation, Test Execution Automation and Test Analytics Automation
• Shift Left - Building a team of QA BAs
Key Initiatives
9PROJECTS
Percentage improvement on key parameters
• Transform the methodology to enable seamless business capability delivery
• Enabled continuous requirements gathering and refinement
• Enabled business access to developers for faster delivery on trivial use cases
• Modified business engagement model to introduce BSAs into early discussions with the business unit
Continuous Delivery Framework
QA/QE Transformation
COST SAVING
DEPLOY FREQ
TIME TO MARKET [SPEED]
APP QUALITY
RESOURCE EFFICIENCY
Benefits of Process TransformationProcess Transformation
People Process
42
• Deployment Automation using vRealize suite for faster deployment (Continuous Integration and Deploy), addressing the Last mile problem.
• Reduce Deployment complexity and guarantee portability using containerization (Better Together)
• Adopt Micro Services to orchestrate and achieve feature velocity.
• Enabling mobile moments across business capabilities
VMware on VMware
Containerization and VMs
Mobile First/Only
Service Virtualization
• Service Virtualization enabling us to deliver solutions – Faster, Cheaper and Better
Data Transformation• Proactively address the data need – Invent before
the need [Data Lakes]
Benefits of Technology TransformationTechnology Transformation
9PROJECTS
RESOURCE EFFICIEENCY
APP QUALITY
TIME TO MARKET (SPEED)
COST SAVING
10%
5%
COST SAVING
DEPLOY FREQ
TIME TO MARKET [SPEED]
APP QUALITY
RESOURCE EFFICIENCY
5%
5%
6%
Key Initiatives Percentage improvement on key parameters
TechnologyPeople Process
43
DevOps does offer real savings!
VMware IT saw 20 – 30% across the board
Focus on PEOPLE and PROCESS first
Technology and Tooling improvements not as important as people think
Developer Relations therefore needs to address the organizational changes and process changes first.
Key Observations from our DevOps Test
RESOURCE EFFICIEENCY
APP QUALITY
TIME TO MARKET (SPEED)
COST SAVING
10%
5%
30%
25%
25%
20%
20%COST SAVING
DEPLOY FREQ
TIME TO MARKET [SPEED]
APP QUALITY
RESOURCE EFFICIENCY
5%
5%
6%
Percentage improvement on key parameters
TechnologyPeople Process
15%
10%
8%
10%
10%
5%
10%
6%
10%
5%
Developer Relations and theImpact of DevOps
Best Practices Around Developing a Community
45
OSTechnology
Community Content
Code Sample
Support Outreach
Evangelists
Impacting Support & Communications
46
Encourage Peer Support
- Talk to developers- Email support - Issue tracker- Social media
Stack Overflow has become the primary source of developer Q&A with over 16
million solutions provided and 8 million developers using the site every day
47
Impacting Roles
IT Practitioner • New agile development requirements• Need education on DevOps to be part of the conversation• Developers applying pressure to change IT software stacks
IT Operations• Tools automating application deployment, bypassing ITOPS• Tools administration is a new position ITOPS can manage• Tools include: Puppet, Chef, Jenkins, Ansible
Developer• Clouds allowing developer to control deployment • Tools automate nightly builds, testing, and deployment• Developer can now choose platform technology stacks
Impacting our Organization ( New Cloud-Native Applications BU)
VMware’s CNA Mission:
Make the Developer a First-Class User of the Data Center
• Turn the datacenter into an API
• Elevate infrastructure abstractions to expose developer-centric concepts
• Build technologies that span the app lifecycle
• Empower operations teams to manage Cloud-Native applications
• Build to and support open systems and standards
CONFIDENTIAL 49
Impacting MarketingLaunched a new program for DevOps: VMware {code}
Objectives:Awareness &
Downloads
• VMware {code} program
• Audience acquisition
• VMworld {code} sessions
• Build awareness and shift perceptions within devops, developer, and administration communities
• Acquire new audiences and build communities
• Drive downloads and demand for open source and licensed product
ProgramsEvents, Communities,
and Audience Acquisition
• Defining the narrative
• Events
• Speakers & code
Observations on DevOps Impact
• The DEVELOPER is driving IT INNOVATION and product choices
• The KEY INFLUENCERS for innovation are coming from external OSS Contributors– Increasing investment in OSS Participation
• Our traditional IT/ITOPS customer needs help not only to stay relevant in this latest shift, but also to ADD VALUE to their enterprise– Cloud-Native Apps Business Unit
• Ensure our PRODUCTS and SERVICES integrate well into the DevOps process– Integrate with key tools
• Be where the INFLUENTIAL developers go– Git Hub, Stack Overflow, the right conferences
• Launching VMware {code} brand on dev portal and in VMworld to drive awareness and engagement with dev audience (new audience and roles for us)
• “SaaS’ing” our Products in Ecosystem Services– Launched Validation as a Service in 2015
50
on Developer Products, Services, & Outreach
51
Puppet Labs in partnership with IT REVOLUTION
AdditionalResources THE PHOENIX PROJECT: A NOVEL ABOUT IT, DEVOPS,
AND HELPING YOUR BUSINESS WIN“The Phoenix Project is a great way to get non-technical managers to understand what developers do.
Every person involved in a failed IT project should be forced to read this book.”–Tim O'Reilly, Founder & CEO, O'Reilly Media
“The Phoenix Project is a must read for business and IT executives struggling with the growing complexity of IT.”
–Jim Whitehurst, President and CEO, Red Hat, Inc.
“This is the IT swamp draining manual for anyone who is neck deep in alligators”–Adrian Cockroft, Cloud Architect at Netflix
Additional Links• devopscafe.org –podcast interviews, great guest speakers• cloudcast.net –podcast interviews, great speakers, short• dev2ops.org – videos, resources, conference info, etc.• conferences.oreilly.com/velocity – major DevOps focus• events.itrevolution.com – DevOps Enterprise Summit• devopssummit.sys-con.com – DevOps at Cloud Expo• devopsdays.org – find an event near you• puppetlabs.com/2015-devops-report – annual report on DevOps
#DOES15
FreeState of
API Reports
2016
SmartBear
apigee
52
53
XebiaLabs Periodic Table of DevOps Tools
Thank You
Larry McDonoughDirector Product Mgmt.Ecosystem ServicesVMware @Lmcdunna
BACKUP SLIDESThank You
56
VMware DevOps Technologies
vSphere and vRealize• vSphere ready for Agile deployment of traditional apps NOW • Tool vendors provide vSphere integration modules• vSphere offers Speed, Security & Stability for Agile workloads• Codestream can integrate larger complex deployment
vCloud Air • VMware’s hybrid cloud offering enables choice for workloads• With enabled tools, IT Operations can control distributions• Puppet, Chef, Jenkins, Ansible can deploy to vCloud Air
New Cloud Native Architecture
• VMware’s Cloud-Native Applications tech best for containers• vSphere announces new integrated container technology VIC• Projects Photon, Lightwave and vSphere Integrated Containers
show VMware leadership in container-based microservices architecture
57
CDStackTestStack
ControlStack
ArtifactStack
CommitStackCIStack
CodeStack
ConfigStack
FeedBackStack
Continuous DevOps Stack: Traditional Apps, Open Tools
PlanStack
Geany
ASD/vRO Gerrit Trigger
Plugins Artifactoy
CodestreamvRAvRO
vRAvROpsvRLIvRB
Issues
vSphere, vSAN, NSX, vRealize SuitevRealize Orchestrator
SDDC, IaaS, Foundation
Agile
DevOpsLightweight Containers
Developers
The New App
DevOps has driven innovation in container
technology.
Agile development demands DevOps.
1000s deploys/ day
Competitiveness demands agile development.
Enterprises are embracing.
The new app is king, and developers are the
new kingmakers.
The Developer is now King and drives major changes
59
The Software Development Lifecycle (SDLC)
Build/Continuous Integration
Source Code Management
Repository
Testing Frameworks
Provision and Deploy
1. Commit/Check-in
5. Monitor
2. Build & Test
4. Deploy
vRA
3. Artifacts
VMware Cloud-Native Apps Stack
vSphere
vSphere Integrated Containers
vRealize Automation, vRealize Operations,vRealize Log Insight
PivotalCloud Foundry
VMware NSX, VMware Virtual SAN
vRealize Code Stream
Chef,Ansible
JFrogArtifactory
Repository Config. Mgmt.
Git,Perforce
Code Repo
Jenkins,Bamboo
CI/CD
Developer Laptop
Development Lifecycle
Production Stack
Vagrant,Panamax
VMwareAppCatalyst
Photon Platform vCloud Air
Docker, Kubernetes,Mesos, Lattice
60
61
GartnerPredicts 2015: Application Development• Key Findings
– DevOps practices are emerging among mainstream IT organizations to manage faster and more reliable software delivery; but more so than technology, these initiatives depend on organizational and process innovations as a prerequisite to success
• Recommendations– Use a bimodal approach and redefine roles to learn and adapt lean IT practices– Create a joint team with both development and operations skills to identify and create a culture and
unified process view of DevOps
• Strategic planning assumptions– By 2018, the majority of software projects, as measured by the Gartner CIO survey, will be agile centric– By 2019, DevOps initiatives will cause 50% of enterprises to implement automated configuration and
release management of the application life cycle
Gartner, 11/19/2014, Predicts 2015: Application Development Mark Driver, Nathan Wilson, Jim Duggan, Ronni J. Colville, Jason Wong, Laurie F. Wurster, Thomas E. Murphy, Yefim V. Natis, Magnus Revang