webinar - the 360-degree approach to managing a data lake

13
Webinar: The 360-Degree Approach to Managing a Data Lake August 31, 2016

Upload: zaloni

Post on 21-Jan-2017

187 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Webinar - The 360-Degree Approach to Managing a Data Lake

Webinar: The 360-Degree Approach to Managing a Data Lake

August 31, 2016

Page 2: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

• Award-winning provider of enterprise data lake management solutions:

Integrated data lake management platform

Self-service data preparation

• Data Lake Design and Implementation Services: POC, Pilot, Production, Operations, Training

• Data Science Professional Services

Delivering on the business of big data

Financed by top-tier technology investors:

Page 3: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

Meet today’s speakers

Adam Diaz, Director of Field Engineering, Zaloni

Adam is a long time technologist working in the software industry for roughly twenty years. He manages the day to day operations of the Zaloni Field Engineering team responsible for product technical support of sales, marketing and partnership activities.

Kelly Hopkins Schupp, VP, Data-driven Marketing, Zaloni

Kelly has 20 years of experience in the enterprise software and technology industry. She serves as Zaloni’s brand steward and is deeply passionate about the impact of data-driven marketing on businesses today.

Page 4: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

Increased Agility

New Insights

Improved Scalability

Data lakes are central to the modern data architecture

Page 5: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

Data lake – the challenges and the solution

• Ingestion

• Lack of Visibility

• Privacy and Compliance

• Quality Issues

• Reliance on IT

• Reusability

• Rate of Change

• Skills Gap

• Complexity

Managing: Delivering:

Govern the data in the lake

• Cleanse• Secure

• Operationalize

Enable the data lake • Ingest

• Organize• Catalog

Building:

Engage the business• Discover

• Enrich• Provision

Page 6: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

• Leverage the full power of a scale-out architecture with an actionable, scalable data lake

Data Lake 360 ° : Zaloni’s holistic approach to actionable big data

1. Enable the lake

2. Govern the data

• Improve data visibility, reliability and quality to reduce time-to-insight

3. Engage the business

• Safeguard sensitive data and enable regulatory compliance

• Foster a data-driven business through self-service data discovery and preparation

Page 7: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

Data lake reference architectureConsumptio

n ZoneSource System

File Data

DB Data

ETL Extracts

Streaming

TransientLoading

Zone

Raw Data Refined Data

Trusted Data

DiscoverySandbox

Original unaltered

data attributes

Tokenized Data

APIs

Reference Data Master Data

Data WranglingData DiscoveryExploratory Analytics

Metadata Data Quality Data Catalog Security

Data Lake

Integrate to common formatData ValidationData CleansingAggregationsOLTP or ODS

Enterprise Data

Warehouse

Logs(or other unstructured

data)

Cloud Services

Business AnalystsResearchersData Scientists

Page 8: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

Ingest Organize Enrich Engage

• Managed ingestion• Metadata

management• Data lineage

• Data quality

• Data privacy and security

• Data lifecycle management

• Data catalog• Self-service

data preparation

Manage the complete data pipeline

Page 9: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

Multiple cluster management with Bedrock

Single management console for Ground and

Cloud Hadoop management

Bedrock Workflow Executors

Bedrock Data Collectors

Persistent Cluster Metadata Data Quality

Data Catalo

gSecurity

Files Streams

9

Object Stores

Bedrock Data Management

Transient Cluster

Page 10: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

Demo

Zaloni Confidential and Proprietary

Page 11: Webinar - The 360-Degree Approach to Managing a Data Lake

Challenge: To develop a multi-vendor loyalty program required gathering information from a wide variety of sources, bring it all into a unified platform, and give marketers access to the data for customer targeting.Solution: Zaloni built a data lake to house all customer data, as well as an interactive visualization platform that enabled marketers to profile customers on selection (based on demographics, geography, etc.) for analysis.

Zaloni Enables 360˚ Customer View For Effective Loyalty Program

GLOBAL CREDIT CARD ISSUER Industry: Financial ServicesCompany Description: Global credit card issuerTechnical Use Case: Data Lake 360˚ - Agile AnalyticsBusiness Use Case: Customer 360˚ - Behavioral Analytics and Customer Segmentation Big Data Technologies: Zaloni Professional Services, MapR, ElasticsearchDeployment: On premises

Zaloni Confidential and Proprietary - Provided under NDA

At a Glance

1Mcustomer sign-ups 22Musers

collecting data from 1M+hits/day

on the customer

Results

in 3 weeks system

Page 12: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Underpins Data Platform for News and Entertainment Network

MEDIA & ENTERTAINMENT COMPANYIndustry: Media and

EntertainmentCompany Description: News and Entertainment Network Technical Use Case: Data Lake 360˚: Agile Analytics, Data Discovery PortalBusiness Use Case: Improve Customer Experience, Drive Dynamic Ad PricingBig Data Technologies: Bedrock, Mica, Pivotal, Spark, Hive, MapReduceDeployment: On premises

Zaloni Confidential and Proprietary - Provided under NDA

At a Glance

Challenge: The company needed a data platform for advertising analytics and audience measurement in order to drive dynamic pricing and various other use cases during key sporting event-based entertainment broadcasting.Solution: Zaloni Bedrock and Mica were used to create an enterprise-wide data lake for managed ingestion of multiple data sources, standardization and consumption using a scale out Hadoop platform.

310%MORE DATAPROCESSED

220%IMPROVEMENT

in performance

Results

0 DAYSDATA DELIVERY

MISSED

9.5BAD CLICKRECORDS

processed in 17 days

Page 13: Webinar - The 360-Degree Approach to Managing a Data Lake

Zaloni Confidential and Proprietary - Provided under NDA

Wherever you are in your journey, we can help….

Products & Solutions: Data Lake 360°

White Paper Bedrock Overview Mica Overview

To Learn More:

[email protected] Contact Us Form 919-323-4050 x7085

Custom & Packaged Services: Readiness

Assessments Quick Starts Custom

implementations