splunk

Download Splunk

If you can't read please download the document

Upload: mycellwasstolencom

Post on 17-Aug-2015

435 views

Category:

Education


5 download

TRANSCRIPT

  1. 1. Splunk CloudSplunk Cloud Priyanka Wadhwa Knoldus Software LLP Priyanka Wadhwa Knoldus Software LLP
  2. 2. Agenda What is Splunk ? Why Splunk ? Splunk Products Splunk Cloud Installation Guide Generating Logs Demo What is Splunk ? Why Splunk ? Splunk Products Splunk Cloud Installation Guide Generating Logs Demo
  3. 3. What is splunk ? What do we do when you need information about the state of our application, machine or software? We look at its logfiles. They tell us the state it is in and what happened recently. Splunk started out as a kind of Google for Logfiles. It does a lot more today but log processing is still at the products core. It stores all your logs and provides very fast search capabilities roughly in the same way Google does for the internet.
  4. 4. Brief History... Splunk is an American multinational corporation based in San Francisco, California, which produces software for searching, monitoring, and analyzing machine-generated big data. Splunk (the product) captures, indexes and correlates real-time data in a searchable repository from which it can generate graphs, reports, alerts, dashboards and visualizations. The company was started in 2003 by co-founders Michael Baum, Rob Das and Erik Swan. With Splunk we can onboard, enrich and analyze machine data faster than ever before.
  5. 5. We see data everywhere. We offers the leading platform for Operational Intelligence. We look closely at what others ignore (machine data) and find what others never see: insights that can help make your company to be more productive, profitable, competitive and secure. - Splunk
  6. 6. Work ... Turning Machine Data Into Insights : Machine-generated data is one of the fastest growing and complex areas of big data. It's also one of the most valuable, containing a definitive record of all user transactions, customer behavior, machine behavior, security threats, fraudulent activity and more. Splunk turns machine data into valuable insights. Turning Machine Data Into Insights : Machine-generated data is one of the fastest growing and complex areas of big data. It's also one of the most valuable, containing a definitive record of all user transactions, customer behavior, machine behavior, security threats, fraudulent activity and more. Splunk turns machine data into valuable insights.
  7. 7. How Splunk instruments your site?
  8. 8. Why splunk ? Index, (no) Schema, Events : Database requires you to define tables and fields before you can store data whereas Splunk accepts almost anything immediately after installation. Splunk does not have a fixed schema. Instead, it performs field extraction at search time. Many log formats are recognized automatically. This approach allows for great flexibility. Just as Google crawls any web page without knowing anything about a sites layout, Splunk indexes any kind of machine data that can be represented as text. Scalability, (no) Backend : Splunk stores data directly in the file system. Installation is superfast Scalability is easy No single point of failure Infinite retention without losing granularity
  9. 9. Splunk Products Splunk Enterprise Splunk Cloud Slunk Light Hunk Splunk Mint App for Enterprise Security Splunk App for Stream Apps and add-ons
  10. 10. Splunk Cloud Splunk Cloud is backed by a 100% uptime SLA, scales to over 10TB/day, and offers a highly secure environment. Up to 10x Bursting : Splunk Cloud supports up to 10x bursting over licensed data volumes. Reliable Performance : Dedicated cloud environments help ensure your service performance is not impacted by the actions of another customer. 100% Uptime SLA : Splunk Cloud is backed by a 100% uptime SLA. "Splunk Cloud has widened our user base. Our operations folks use Splunk, our application people use Splunk and our security people use Splunk. Splunk Cloud gives you applications that let you get a huge amount of value from your data." -Sr. Director of Information Security
  11. 11. Splunk Cloud installation.. Step-1 : Signup over splunk : https://www.splunk.com Step-2 : Select Splunk Cloud from Splunk products available. Step-3 : Go for your own online sandbox. You will get a cloud URL, click over your cloud URL and start setting up credentials for your Splunk Cloud. Step-4 : It will redirect to its dashboard. Now click : settings icon (left top upper corner) an goto the Universal Forwarder. Step-5 : Follow the installation steps written and add Splunk Universal Forwarder.
  12. 12. Lets setup Splunk Universal Forwarder
  13. 13. Some useful Splunk Commands... To Stop the splunk server: $ sudo ./splunk stop To Start the splunk server: $ sudo ./splunk start To Check status of splunk server : $ sudo ./splunk status To Check list of app: $ sudo ./splunk list app To Remove an app: $sudo ./splunk remove app To check list of monitors: $sudo ./splunk list monitor
  14. 14. Splunk Sandbox... The Splunk Online Sandbox is a free and personal online environment where you can explore the Splunk Enterprise features. Using the Splunk Online Sandbox, you can search, analyze, and visualize your own data or pre-populated data sets. You may index up to 5GB of data per day, up to a total of 28GB of data in your sandbox.
  15. 15. API sp.js provides a common set of tracking methods: sp.track(event, properties, fn) sp.trackLink(links, event, properties) sp.pageview(url) sp.identify(userId, userTraits)
  16. 16. sp.track(event, properties, fn) : Track a custom event (i.e. user action) along with a set of associated event properties. sp.trackLink(links, event, properties) : Track link clicks, including outbound links, with a custom event and custom properties. Tracking occurs before page changes. This automatically records properties such as the anchor (a) tag's href and text.
  17. 17. sp.pageview(url) Tracks a 'pageview' event including document title and referrer. This is automatically called by default. sp.identify(userId, userTraits) Associate a user with an ID, and record user-specific traits or persistent properties. These persistent properties will be automatically added as properties to any subsequent tracked event.
  18. 18. Generating Splunk Logs... This is a Node.js backend collector for client-side data that is tracked by sp.js Analytics JavaScript library. All tracked events are collected in events.log. Install with Node.js package manager npm and Start the collector server by typing: * You will observe the logs getting tracked in you terminal with every action you perform over your web-page wherein the logs are placed for tracking.
  19. 19. To use sp.js, simply paste the following snippet of code before the closing tag on your page:
  20. 20. Log Tracking
  21. 21. Splunk data Visualization
  22. 22. Reference https://github.com/splunk/splunk-demo-collector-for-analyticsjs#api http://blogs.splunk.com/2013/10/17/still-using-3rd-party-web-analytics-pro
  23. 23. Thanks :)Thanks :)