pradeep vivaki tdwi cloud bi summit scottsdale

17
Creating a Rainbow of BI Solutions in the Cloud Pradeep Ananthapadmanabhan CTO, Vivaki Sunday, Dec. 2, 2012

Upload: pradeep-ananthapadmanabhan

Post on 14-Apr-2016

8 views

Category:

Documents


3 download

DESCRIPTION

Cloud BI Solutions

TRANSCRIPT

Page 1: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Creating a Rainbow of BI

Solutions in the Cloud

Pradeep Ananthapadmanabhan

CTO, Vivaki

Sunday, Dec. 2, 2012

Page 2: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Who is Vivaki • Addressable Trading Desk Unit of Publicis Groupe

2

Page 3: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Our Business : Data-driven Marketing

3

Page 4: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Challenges : Unprecedented Volume

4

Page 5: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Challenges : Unprecedented Velocity

5

Page 6: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Challenges : Unprecedented Variety

6

Data Source Data Format

Advertising Cookie Data Text Files with customer

information delivered via FTP

Periodic database dumps

from Advertising platform

provider

XML files delivered via FTP

Facebook data JSON Files pulled in via API

calls

Competitive search data HTML Files directly scraped

from the web.

Page 7: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Brief history… • Portfolio of analytic solutions assembled from various

acquisitions

– Version 1.0 typically built for a single agency

– Challenge in scaling to a broader solution

• 1st generation of solutions to be in the cloud

– Migrated from diverse data center locations

– Cloud migration beginnings in 2008

7

Page 8: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Picking the Right Cloud Vendor Business Considerations Technical Considerations

1. Industry-leading platform

2. Continuous Innovation

3. Competitive pricing

1. Breadth of Solution Offerings

2. Robust eco-system of tools and

technologies

3. Access to development resources

4. Global footprint

5. Commitment to highest-levels of

industry security

8

Page 9: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Variety of Data Analytics Solutions

9

Data

Solutions Planning

Solutions

Insights

Solutions Workflow

Solutions

Page 10: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Diverse Software Stack

10

Page 11: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Broad Cloud Toolset

11

6. Identity & Access

Management

7. Simple Email Service

8. Simple Notification Service

9. Simple Queue Service

10. CloudWatch

1. Elastic Cloud Computing

2. Simple Storage Service

3. Elastic Map Reduce

4. Elastic Beanstalk

5. Relational Database Service

6. SimpleDB

7. DynamoDB

8. Virtual Private Cloud

9. Route 53

Page 12: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Cloud by Numbers…

12

Page 13: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Big Data Processing in the Cloud

13

( 3.5 Billion records, 71 million unique cookies a day)

100-600 Machine

cluster created on

demand

EMR S3

( 180 days = ½

Trillion ICA

records )

Page 14: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Complexity in the Cloud

14

Page 15: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Working with Cloud-Friendly Partners

15

Page 16: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

Challenges in Going Cloud 1. Ensuring security mis-conceptions are addressed squarely

2. Putting cloud costs in perspective

– Training your employees to be more resource-conscious

3. Adapting IT processes to the cloud

– Custom-developed API based resource provisioning to enforce

standard policies

– Password Management

– Virtual Private Cloud

16

Page 17: Pradeep Vivaki TDWI Cloud BI Summit Scottsdale

17

Contact Information • If you have further questions or comments:

Pradeep Ananthapadmanabhan

CTO, Vivaki

[email protected]