big data perspective (ui)
TRANSCRIPT
We Make Hadoop Fly
Ninja is the SolutionVision
AunifiedOperationalAnalyticsApplianceforBigData
• Createunifiedmonitoringplatformforvariouscriticalcomponents• Createcartridgebasedsystemwherenewcomponentscanbeadded• Improvebusinesscontinuity&reduceplatformmonitoringcost• CreateabetterROIcalculationapplicationbasedonaggregateddata• Applymachinelearningtomoveawayfromthresholdbasedmonitoring• Built-inrecommendationandremediationforgeneratedanalytics
The TeamNinja is the SolutionOurTeamWhoweare?
AvkashChauhan,Founder- DeepexpertiseindistributeddataplatformsincludingHadoop,withvariouspublicationsandspeakingengagements.WorkedatMicrosoft,Platfora&experienceincludes:
§17+yearsintechindustry,workedwith15+fortune#100companiesworldwide§Largescaledistributedapplicationdevelopmentandperformanceexpert§CoreDeveloperandproductimplementationspecialistforMicrosoftAzure,HDInsight&Platfora.§Microsoftdistinguishedengineer,keyarchitectonHadoopimplementationforAzure.
HenryOhara,Architect(Backendengineer)- Hasacareerofdesigninganddevelopingscalablebackendsystemsforover21+years.
§FoundingmemberofYahoo’smobilesearchteamservicingover30millionusers.§DevelopedarecommendationsystemforYahoo'smediasite.§Developedtop#1applicationtomanagesecureenterprisecommunicationinJapanformobile
HamidBehnam,UXEngineer–• Over7+yearsoffrontendengineeringanddevelopmentexperiencewithastronginterestinJavaScript• Expertincreatingcomplex&multilayerwebapplicationusingJavaScriptframeworks• Amazingworkethic
SalSferlazza,principleinvestor&chairmanofboard– LaunchCapital.co• Overall21+yearsintechindustryfromdevelopertoCTOtoCEO• WorkedatAndersonConsulting,QuestSoftware,SonicWALL,Dell• Total5exitsinlast10years,3oftheexitsareinMSPspace
Board
Engineering
The TeamNinja is the SolutionSummaryArchitectureComplete
HadoopCluster
SystemCollectionServer
HadoopV1CollectionServer
HadoopV2CollectionServer
WebServer TimeSeriesDB
SchedulerServer
AnalysisServer
RESTful Interface
AJAX
• MajorHadoopDistributions• Amazon&HDInsight• ClusterDeploymentplatform• OnPremise• AnyHadoopFarm
HTML5,CSS,JavaScript,KnockoutAndD3
PostgresDB
ServerinteractionoverREST(admin/communication)
KAFKAStreams Messaging
Server
Noninvasiveappliancedesign&Selfservingdeploymentmodel
Jetty+JAX-RS
UXSingleclickaccess,Crossclusterviews,drilldownapproach
Technology&UXSelfdescribinghealthinfo
Ninja is the SolutionUXPowerfulcentralizedconfigurations,inasimpleeasytouseformat
Technology&UX
Ninja is the SolutionUXUnprecedentedvisibilityanddatapresentationsthroughvarietyofgraphs(Deep-diveclusterviewshowingdetailsaboutmachinesandusage)
Technology&UX
Ninja is the SolutionUXEasytouseandunderstandStatusDashboard:
Technology&UX
Ninja is the SolutionUXIntegratedCrossClusterViewsandfullscaleintegratedsearch
Technology&UX
Ninja is the SolutionUXStunningvisualsandverydetailsdatavisualizationthroughwidgetsdesigns
Technology&UXLast2hoursworth
ofdata
Selectupto24hoursworthofdata
Reloadthepagefrom1–10minutesinterval
Ninja is the SolutionUXAnyactivepageordashboardcanbeconvertedtoHODmodejustbysingleclick
HOD(HeadoverDisplay)Mode
ClickmeforHODmode
Ninja is the SolutionUXBestHadoopJobAnalysis..ByBatch,ByType,Justchooseanything
Technology&UX
Ninja is the SolutionUXBestHadoopJobAnalysis:SelectTaskandfindanysysteminfoduringthetasklife
Technology&UX
Ninja is the SolutionUXDynamicviewstoimportantdatai.e.HDFSFilesandFolderViewer
Technology&UX
Ninja is the SolutionUXWidgetBasedUI,extensiblefor10s ofthousandsusersand100s ofthousandsdynamicpages
Technology&UX
Ninja is the SolutionUXUserspecificdatavisualization,Eachuserhashisownview,makeyourowndesignlayout..
Technology&UX
Ninja is the SolutionUXMakeyourowndashboardandsharewithothers(CreatescheduledReportslater)
Technology&UX
Ninja is the SolutionUXSchedulealertsonanycollecteddataandcombineitwithotherdatasimultaneously
SchedulingComplexAlerts
Ninja is the Solution360Monitoring
Underclusterutilizationbasedon300+datapointsatanygiventime
ClusterUtilization(Daily/Weekly/Hourly)
Time ChooseCPU/Memory/Disk/Networkatindividualentitylevel
AnalysisshowshighI/Otimespentfordiskdm-0around3:00AMWed5th Aprilinonly2machineshdn2andhdn1
Ninja is the Solution360Monitoring
System&HadoopJobsMonitoringatonesinglepage
3600 Monitoring
Ninja is the SolutionUXAnypageordashboardcangeneratePDF/PNGreportaswellasnewreportscanbecreated
GeneratingReports(PDF/PNG)
GeneratereportfromtoolboxChoose
reportstypeasPDForPNG
EmailReportdirectlytosomeone
Downloadreport
immediately
Ninja is the SolutionUXAnypageordashboardcangeneratePDF/PNGreportaswellasnewreportscanbecreated
SchedulingReports(Email)
Schedulereportfromtoolbox
Enableordisablereporting
Selecthow/whenyouwanttoget
report
ChooseWeekly,Daily,Hourly
(onceorRepeat)Addany
persontogetthereportinto
Ninja is the SolutionSummaryContact
Founder&PrincipalBigDataPerspectiveLLC657MissionSt.Suite602,SanFrancisco,CA94105E:[email protected] M:650-713-9055
AvkashChauhan