leveraging analytics for devops

Sumo Logic Confidential

Michael FloydHead of Developer Programs

Leveraging Analytics for DevOpsBuilding, Running and Securing Modern Applications


Agenda

•Three Pillars of the Digital Transformation•The DevOps Conundrum•Pain points for DevOps Teams•Gauging the Health of your release cycles•Visibility Through Real-time Monitoring •Sumo Logic Solutions


A Perfect Storm - Shift in App DevelopmentCompanies are retooling their entire technology stack, adopting cloud services, and building continuous delivery processes to unlock agility

___________________________

1. The rise of public cloud platforms like AWS2. New technologies like Docker containers 3. DevOps adoption - Frequent release, automate more

____________________________

We are generating an ever-increased variety, velocity, and volume of data.

Sumo Logic helps customers build, run, and secure their applications with confidence in this new world. We help developers get deep, real-time visibility into their entire toolchain and production environment to help create better software faster.


Digital Transformation

DevOps Adoption

• More than 80% of companies are engaged in Digital

transformation initiatives

• Cross-functional DevOps and Continuous Delivery

• CD is having a significant impact on revenue growth

*EMA Automating for Digital Transformation Survey (Oct ‘15)

* 2016 State of DevOps Report, Puppet Labs


The DevOps ConundrumCustomers want reliable, cloud-hosted software applications they can trust to be fast, highly available, easy to use, and bug free.

___________________________

To meet these challenges, DevOps teams are adopting continuous delivery as a way to deliver higher quality software more frequently.

____________________________

Frequent releases leads to greater complexity. Automation obscures complexity. DevOps needs visibility across the DevOps toolchain.

DevOps requires a new breed of log analytics tools that runs at cloud-scale, employs predictive algorithms, and can be integrated with a host of DevOps tools throughout the entire continuous delivery pipeline, not just server data.

DevOps Pain Points


DevOps Leads to Complexity

Stages of a release cycle: • Commit Stage -

– Pull code from the DB, Compile– Commit tests– Assemble code profiling and analysis– Store reports, metadata, binaries to artifact

repository• Acceptance Stage -

– Configure environment– Deploy binaries– Run smoke test, acceptance tests, UAT

• Capacity Stage• Production Stage


Why is this important?

Machine data comes from:Applications

• App data • System data• Network data

DevOps Tools• Database• Source Control• Continuous Integration• Repo Management• Configuration Management• Build• Release Automation• Testing

We are generating an ever-increasing variety, velocity, and volume of data


The DevOps Challenge

No Consistency • Ops is spending more time troubleshooting • Development is drawn into production

troubleshooting• Performance and availability problems have

increased

No Centralization — Simply put, log data is everywhere

• Logs are distributed across locations in the cloud or various servers

• Many locations of various logs on each server• SSH, GREP, and RegEx doesn’t scale

No Visibility - High-value data is buried in petabytes• Expertise required to mine data• Meaningful views are difficult to assemble• No real-time visibility• Immense size of Log Data

DevOps teams are challenged by accelerated release cycles that lead to new deployment complexity, increased performance and availability issues, and difficulty syncing multiple development workstreams.

Accelerate Cloud Adoption

Visibility and Automation

Real Time and Continuous


How Can Sumo Logic Help?Benefits

Real-time visibility into your application at every stage of the lifecycle

No integration issues - Monitor machine data anywhere, independent of its source, location or format

No more parsing data. DevOps teams can focus on their jobs instead of supporting a log analytics tool

Significantly reduce time developers spend troubleshooting issues in production (up to 90%)

Improved application performance - Monitor and diagnose performance and availability issues in real time

Streamline frequent release cycles, improve software quality

Improve staff efficiency - get a centralized viewpoint that both DevOps and IT Ops can share

Immediate time to value & reduced TCO via SaaS

Sumo Logic practices DevOps, releases latest code to product weekly. Status is publicly available at http://status.sumologic.com/


DataDirect Cloud

IndustryData Connectivity

Sumo Logic Use CaseDev, DevOps, IT Ops

Business Case● Provides data connectivity via OData, ODBC, JDBC.● Collection of Sumologic dashboards that measure key

metrics focused around DataDirect Cloud user experiences.

● Engineering actively monitors the DCCC to detect anomalies in usage patterns and take appropriate actions

● Intuit uses it for real-time connectivity for 10,000 Salesforce users to Oracle data behind their corporate firewall.

● For monitoring JVM memory, code was developed using JMX to feed metrics from AWS into Sumologic providing a 360 view of the systems.

“Sumologic has delivered big data analytics throughout the organization, and we did not have to engage our data scientists for the project.”

-- Eric Brown, Cloud Engineering Manager

Customer Insights

https://www.youtube.com/watch?v=ijEy9jCyous


Github AnalyticsGauging the health of your release cycle


Github Basics

Git - 42.9% of all developers; most widely used SCM toolGitHub - 12 million users and more than 31 million repositoriesUses Cases:

• Open source contribution• Traditional Software Development (private)• Content creation (Gists, wikis)• Social sharing


Github Workflow and Continuous Delivery

Workflow:•Create a branch•Add commits •Open a PR•Deploy•Merge


Gauging the Health of Your Releases

Anticipate potential volatility or risk. Indicators of a risky release include:

• Large volume of files committed, lines changed just before a release.

• Large number of PRs opened and left unattended.• Large number of reopened issues.• Significant changes in the branches of specific projects.


Github v3 APIs


Sumo Logic DashboardingMonitoring and charting allows you to visualize trends in activity, repo data in real time.

COMMITS• Commits over time• Commits by

repository• Top 10 Commits by

user

PULL REQUESTS• Pull Requests over

time• Pull Requests

opened by repository

• Pull Requests opened since…

ISSUES• Open, closed over

time• Open, closed by

repository• Oldest Open issues


What can your Repo Tell You?


Visibility into Team Productivity

• Number of commits, pull requests, issues. • Comment activity • Impact of a pull request: the number of both files and lines

added or deleted.• Impact of a process/policy change on team/individual

productivity.


Securing Intellectual Property

•Monitor and identify potential security breaches.•What is considered “normal” access and usage?• Pull, push, change visibility, merge and close PRs • Look for trends that identify patterns • Create a baseline of what’s “normal.”

• Where does your organization’s intellectual property reside and who has access to that IP?


Application Visibility at Every StageSumo Logic delivers a comprehensive strategy for monitoring, tracking and troubleshooting applications at every stage of the build, test, deliver, and deploy release cycle. We help organizations like Chef, Pingboard and Outsmart Games to gain visibility across the entire continuous delivery pipeline as they release frequently and automate more.

Streamline Continuous Delivery

1. Get real-time visibility into your apps from code to deployment.2. Free-up developer resources - No more parsing data. Reduce time

developers spend troubleshooting. Focus on their jobs instead of supporting a log analytics tool.

3. Avoid tools integration hassles - Monitor machine data anywhere, independent of its source, location or format.

4. Deliver software quality - Monitor, track and troubleshoot your entire application stack from code to Docker containers, continuous integration to continuous delivery.

5. Improve staff efficiency - Get a centralized viewpoint that both Dev and Ops can share.


Where Sumo Logic Helps


Summary

• Look for Indicators of a risky release• Consider the number files, lines added/deleted• Use trends to determine Impact of a pull request,

policy or process change.• Set a baseline for “normal” access and usage• Identify where intellectual property resides, who has

access


Thank You

Go to devops.sumologic.com

Michael [email protected]

leveraging analytics for devops

Data & Analytics