listen to your data™mattturck.com/wp-content/uploads/2012/03/splunk... · 2011, splunk inc. 7...
TRANSCRIPT
Copyright©2011,SplunkInc. Listentoyourdata.
Listentoyourdata™
Copyright©2011,SplunkInc. Listentoyourdata.
February23,2012
StephenSorkinVPEngineering
SplunkingBigData
Copyright©2011,SplunkInc. Listentoyourdata.3
BigDatavs.BarackObamaSearchVolumeLast12Months
BarackObama
BigData
Copyright©2011,SplunkInc. Listentoyourdata.4
TradiKonalApproachesSolveaDifferentProblemStored
Digita
lInformaK
on(exabytes)
BusinesstransacKondata StandardizaKonissues Accessibility Economics
Unstructured, non‐standarddata Addressedbynew
technologiesRela5onalDatabaseEra
BigDataEra
Copyright©2011,SplunkInc. Listentoyourdata.5
SplunkisaBigDataSoluKon
Readywhenyouare
Performanceatscale
Powerfulall‐in‐onesoluKon
Easytodownloadanddeploy
Pre‐integrated,end‐to‐endfuncKonality
Alltheenterprise‐gradefeaturesyouexpect!
ProvenatmulK‐terabytescaleperday
UpwardsofPBundermanagement
3,300+customers
Collectsdatafromtensofthousandsofsources
Advancedreal‐Kmeandhistoricalanalysisofdata
Fast,customvisualizaKonsforITandbusinessusers
Copyright©2011,SplunkInc. Listentoyourdata.6
CustomerFacingData
OutsidetheDatacenter
Applica5ons Weblogs Log4J,JMS,JMX .NETevents Codeandscripts
Networking ConfiguraKons syslog SNMP nealow
Databases ConfiguraKons Audit/querylogs Tables Schemas
Virtualiza5on&Cloud Hypervisor GuestOS,Apps Cloud
Linux/Unix ConfiguraKons syslog Filesystem ps,iostat,top
Windows Registry Eventlogs Filesystem sysinternals
Logfiles Configs Messages TrapsAlerts
Metrics Scripts TicketsChanges
Click‐streamdata Shoppingcartdata OnlinetransacKondata
Manufacturing,logisKcs…
CDRs&IPDRs PowerconsumpKon RFIDdata GPSdata
SplunkCollectsandIndexesAnyMachineData
Copyright©2011,SplunkInc. Listentoyourdata.7
SplunkCollectsandIndexesAnyMachineData
CustomerFacingData
OutsidetheDatacenter
Applica5ons Weblogs Log4J,JMS,JMX .NETevents Codeandscripts
Networking ConfiguraKons syslog SNMP nealow
Databases ConfiguraKons Audit/querylogs Tables Schemas
Virtualiza5on&Cloud Hypervisor GuestOS,Apps Cloud
Linux/Unix ConfiguraKons syslog Filesystem ps,iostat,top
Windows Registry Eventlogs Filesystem sysinternals
Logfiles Configs Messages TrapsAlerts
Metrics Scripts TicketsChanges
Click‐streamdata Shoppingcartdata OnlinetransacKondata
Manufacturing,logisKcs…
CDRs&IPDRs PowerconsumpKon RFIDdata GPSdataNoupfrontschema
NocustomconnectorsNoRDBMSNoneedtofilter/forward
• Anyamount,anylocaKon,anysource.
Copyright©2011,SplunkInc. Listentoyourdata.8
SELECTcustomers.*FROMcustomersWHEREcustomers.customer_idNOTIN(SELECTcustomer_idFROMordersWHEREyear(orders.order_date)=2004)
RDBMS/SQL–Early‐structureBinding
Structure Data
• Schema–createdatdesign(me
• Queries–understoodatdesign(meformaximumperformance
• Homogeneous–mustfitintotablesorbeconvertedtofitintotables
• Mustexactlymatchconstraints
Copyright©2011,SplunkInc. Listentoyourdata.9
Late‐structureBinding
Structure Data
• Schema‐less• Createdatsearch
(me• Queries/Searches
canbead‐hoc
• Heterogeneous–cancomefromanytext‐basedsource
• Constantlychanging
• Noconversionrequired,noconstraints
Copyright©2011,SplunkInc. Listentoyourdata.10
MassiveLinearScalabilitytoTensofTBs/Day
Senddatafrom1000sofserversusingcombinaKonofSplunkForwarders,syslog,WMI,messagequeues,orotherremoteprotocols
Autoload‐balancedforwardingtoasmanySplunkIndexersasyouneedtoindexterabytes/day
OffloadsearchloadtoSplunkSearchHeads
Copyright©2011,SplunkInc. Listentoyourdata.
Listentoyourdata™