how edmodo uses splunk for real-time tag-based reporting of aws billing and usage

15

How Edmodo Uses Splunk App for AWS Jack Murgia NetOps Architect [email protected]

Upload: cloudcontroller

Post on 13-Jan-2015

811 views

Category:

Technology

0 download

Report

Download

Tags:

Embed Size (px):

DESCRIPTION

Don't pay up to 10% of your monthly AWS bill to report on AWS charges and Instance usage with products like Cloudability and Cloudcheckr. Get a Splunk! free license and the free app Splunk App for AWS usage tracking (http://apps.splunk.com/app/1274/). This presentation from splunk > live! San Francisco 2013 shows how Edmodo stays on top of Reserved Instance usage and uses AWS resource tag-based reporting to help teams manage their AWS usage,

TRANSCRIPT

Page 1: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

How Edmodo Uses Splunk App for AWS

Jack MurgiaNetOps [email protected]

Page 2: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

28,000,000+TOTAL USERS AROUND THE WORLD

Edmodo is the largest social learning network

in the world

Page 3: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

20M+ Registered Users

The Edmodo user base has grown REALLY FAST and so has our AWS usage.

Dec 09 Dec 12Dec 10 Dec 11

2,000,000

6,000,000

10,000,000

18,000,000

14,000,000

20M+ users

4.8M users

1.1M users225K users

Investors

• New Features

▸ Require new backend clusters

• More Employees

▸ Launch more development servers

• New Investors

▸ Want assurances we spend money wisely

Page 4: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

100’s of production, development, reporting and

operations instances are managed on Amazon Web Services Elastic Compute

Cloud.

20 employees across 5 teams can launch EC2 instances.

Page 5: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

We tried lots of slow, pricey, hosted apps.None had what we REALLY Needed …

Page 6: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Real Time RI vs On-Demand UsageDo we have enough RI coverage? Are our RIs being used?

Page 7: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Getting Usage Data In front of TeamsMaking Real Time Usage Data Visible Encourages Action

Problem:

The default Splunk for AWS App configuration is based on billing “subaccounts”, which Edmodo does not use.

Edmodo uses tags to differentiate between cost centers.

Page 8: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Use These Tags: Product, Service, SpaceConfigurable Metadata Available for All AWS Resources

• Product

▸ designation is derived from the end user perspective. Where component resources serve overlapping Products, the Product designation is that which uses/requires a resource most or the resource's reason for existing.

• Service is the primary function of the resource. Examples are

▸ mysql

▸ apache

▸ active-directory

• Space a logical workplace designation. Examples are:

▸ Development

▸ Production

Page 9: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Edit the Splunk For AWS Scripts for Tagsget_instances.py and get_ops.py

Page 10: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Create Lookup Tables For The TagsSimple .csv files are referenced by dashboard view files

Page 11: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Personalize Your Dashboard ViewsThe Dashboard XML format is easy to customize

Page 12: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Drill Down Into Usage Data by TagsTeams Can Now Evaluate Usage For The Services They Manage

Page 13: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Drill Down Into Usage Data by TagsTeams Can Now Evaluate Usage For The Services They Manage

Page 14: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Drill Down Into Usage Data by TagsTeams Can Now Evaluate Usage For The Services They Manage

Page 15: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

Download Tag Customizations

http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz

http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz

http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz

http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz

http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz

http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz

http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz

Splunk conf2014 - Onboarding Data Into Splunk

Industrial Data Internet of Things splunk (REST API, SDKs) splunk . TESCO splunk 500 Y—Jt1-3— 41328 . SHANON 1/5 splunk . htt . (500MB/B) s lunk splunk . Created Date:

データ分析プラットフォーム「Splunk」eww.gp-club.panasonic.co.jp/data/splunk/splunk.pdfTitle データ分析プラットフォーム「Splunk」 Author パナソニック

Splunk Spark Integration - GitHub Pageslitaotao.github.io/files/4. splunk_spark.pdf · Splunk Spark Integration ... • Splunk"products:""! Splunk"Enterprise"! ... splunk_spark Created

Splunk vs. ELK The Risk Focus Way · The difference between Splunk and Elastic at a usage level is neatly illustrated with the case of public cloud billing analyses. For AWS and Google

Monitoring Docker Containers with Splunk - Splunk .conf · Splunk and Docker – At A Glance Visibility in your Container Environments Delivering Splunk as Containers Monitoring for

Splunk Cloud Product Briefwinncom.com.ua/wp-content/uploads/2018/07/splunk-Log_Flow.pdf · Extend Benefits With Splunk Apps Splunk Cloud includes support for premium solutions such

インストールマニュアル Splunk Enterprise 6.2docs.splunk.com/images/8/8b/Splunk-6.2.0-ja_JP-Installation.pdf · Splunk Enterprise インストールマニュアルによう

Splunk in Rakuten: Splunk as a Service for all

Splunk .conf2011: Splunk for Fraud and Forensics at Intuit

stoQ’ing your Splunk - SANS · PDF filestoQ’ingyour Splunk Ryan Kovar, Splunk Marcus LaFerrera, PUNCH SANS DFIR 2016

Islands*of*Splunk* - .conf2017 | The 8th Annual Splunk ... · Background*! Splunk*administrators*are*increasingly*required*to*provision*Splunk* as*aservice*oﬀering*to*mulJple*customers*

FireEye Splunk InterFireEye + Splunk: Intermediate Guidemediate Guide

Splunk Conf2010: Corporate Express presents Splunk with SAP

Instructional Design Project: Edmodo 101 Corretta Clark ... · EDMODO 101 2 Instructional Design Project: Edmodo 101 Edmodo has surfaced as a centralized learning environment for

Program Overview - Splunk...mission-critical services. None. Splunk Enterprise System Administration Splunk Enterprise Data Administration Splunk Cloud Administration Implementing

Splunk のご紹介 - hitachi.co.jp · Splunkの歴史. 5 . 2006 . Splunk 1 . Splunk 2 . 2007 . Splunk 3 . 2009 . Splunk 4 . 2010 . Splunk 4.1 . 2011 Splunk 4.2 . App for Enterprise

Splunk Cloud の製品概要 › ... › product-briefs › splunk-cloud.pdfSplunk App で機能を強化 Splunk Cloud は、Splunk Enterprise Security や Splunk IT Service Intelligence

Fortscale Splunk Integrationinfo.fortscale.com/hubfs/UEBA Content/Fortscale Splunk Integration.pdf · Fortscale Splunk Integration ... Fortscale digests access and authentication

Deploying Splunk. Arquitetura e dimensionamento do Splunk

Splunk For IT Operational Intelligence · • Splunk Apps –Splunk App for VMware –Splunk Apps for Citrix & Hyper V –Splunk App for Microsoft Exchange –Splunk App for Active

Agency Chargeback Models to Enable Enterprise Splunk ......Workshops: Get Splunk Hands -on Experience Attend a Splunk Workshop Upcoming Schedule December 1: Introduction to Splunk

Splunk conf2014 - Splunk Monitoring - New Native Tools for Monitoring your Splunk Deployment

Splunk conf2014 - Splunk for Data Science

Tenable and Splunk Integration · Splunk Splunkreceivesvulnerabilitydatacollectedby SecurityCenter Nessus NessusHost Scans,Nes-susPlugins Splunk SplunkreceivesvulnerabilitydatacollectedbyNes-

Splunk Review - University of Birmingham · Ref: Splunk Review, Dec 2014 Mohammad Rameez Shafsad [email protected] Indexing 2.2.1 Searching using splunk Splunk uses

Referent / Redner Benjamin Tiggemann · 2015-07-08 · Splunk for Exchange Splunk for Enterprise Security* Splunk for Vmware Splunk for PCI Compliance* Splunk for Windows Splunk for

SPLUNK® ENTERPRISE - CDWwebobjects.cdw.com/.../Splunk/Product-Brief-Splunk-Enterprise-The... · Splunk Enterprise collects data from any source, including logs, clickstreams, sensors,

SplunkingYour Mobile Apps - .conf19 | Splunk · Introducing Splunk for Mobile Intelligence (Splunk MINT) Deploying Splunk MINT – Intro to SDKs – Getting Started Using Splunk MINT

Splunk For IT Operational Intelligenceuploads.integrity360.com/1425903243-Splunk-for-IT-Operations.pdf · • Splunk Apps –Splunk App for VMware –Splunk Apps for Citrix & Hyper

ReversingLabs Explainable Threat Intelligence Enriches ... Data Sheets/RL-Splunk...sent to Splunk. • In Splunk, the TitaniumScale report is correlated with other available Splunk

EDMODO EDMODO PRESENTACION ELABORADA POR KEYRA MILENIA ZAMBRANO G 20112004025 ADILIAN TERESA APLICANO G 20122001719 EDMODO EDMODO PRESENTACION ELABORADA

Rivium Splunk Windows · o Splunk Enterprise Security * o uberAgent* o Splunk App for Web Analytics Common Splunk Apps & Add-ons 15 SplunkingWIndows o Splunk Add-on for Microsoft

データ分析プラットフォーム「Splunk」 - Panasonicdl.it-sol.jpn.panasonic.com/data/splunk/splunk.pdfTitle データ分析プラットフォーム「Splunk」 Author パナソニック

Edmodo Instruction Manual - PDSTpdst.ie/sites/default/files/Edmodo Instructions.pdf · 2 Introduction to Edmodo What is Edmodo? Edmodo is a free social learning platform for teachers,