intuit analytics cloud 101

Intuit Confidential and Proprietary 1

Tilmann Bruckhaus Group Engineering ManagerIntuit Data Engineering and Analytics (IDEA)

Intuit Analytics Cloud 101

Intuit Confidential and Proprietary 2

Tilmann BruckhausGroup Engineering Manager Intuit

tilmann_bruckhaus@intuit.com

Follow me on twitter: @tillirix

Intuit’s big vision for dataTransform the lives of our customers by unleashing the power of data

CustomerInspired

Era of Windows Era of Web Era of the CloudEra of DOS

Spanning three decades of data

Compliantdata

Mobile First

1980s 1990s 2000s

• Employees: 150• Customers: 1.3M customers• Revenue: $33M

• Employees: 4,500 • Customers: 5.6M • Revenue: $1.04B

• Employees: 7,700• Customers: 37M• Revenue: $4.2B

20162010

Regulatory data Transactional data Batch data Real time data Complex, secure data

The Intuit Analytics Cloud (IAC)

Data-Driven Users Data-Driven Products

CG SBG GenericData products derive value from IAC

Intu

it A

naly

tics

Clo

ud

Real Time Ingest

Batch Ingest

IAC = Data + Infrastructure + Foundational Services

Business Lookup Unified Profile Personalization A/B Testing …

Real Time Data Layer

Intermediate Data

Source Data

Online Accountant

Use Case 1: Tax Personalization & Ease of Use

Key Practices for Planning, Deploying and Managing

❏ Data security

❏ Data governance

❏ Managed metadata

❏ Committed schemas

❏ Auto Deploy

❏ Monitored Operations

Key Practices for Planning, Deploying and Managing

❏ Data security

❏ Data governance

❏ Managed metadata

❏ Committed schemas

❏ Auto Deploy

❏ Monitored Operations

Key Practices for Planning, Deploying and Managing

❏ Data security

❏ Data governance

❏ Managed metadata

❏ Committed schemas

❏ Auto Deploy

❏ Monitored Operations

Key Practices for Planning, Deploying and Managing

❏ Data security

❏ Data governance

❏ Managed metadata

❏ Committed schemas

❏ Auto Deploy

❏ Monitored Operations

Key Practices for Planning, Deploying and Managing

❏ Data security

❏ Data governance

❏ Managed metadata

❏ Committed schemas

❏ Auto Deploy

❏ Monitored Operations

Key Practices for Planning, Deploying and Managing

❏ Data security

❏ Data governance

❏ Managed metadata

❏ Committed schemas

❏ Auto Deploy

❏ Monitored Operations

The Big Data Lake Journey at Intuit

On Premise

First Generation IAC

Batch BatchCloudLift & Shift

˝

The Big Data Lake Journey at Intuit

Real-Time IAC in the Cloud

On Premise

First Generation IAC

Batch BatchCloudLift & Shift

Re-Architect

Cloud Streaming

˝

The Big Data Lake Journey at Intuit

Real-Time IAC in the Cloud

Cloud Challenges❏ Service Security❏ Whitelisting❏ Restacking❏ Auto Deploy❏ Service Monitoring

On Premise

First Generation IAC

Batch BatchCloudLift & Shift

Re-Architect

Cloud Streaming

˝

The Big Data Lake Journey at Intuit

Real-Time IAC in the Cloud

Cloud Challenges❏ Service Security❏ Whitelisting❏ Restacking❏ Auto Deploy❏ Service Monitoring

Streaming Challenges❏ Stateful processes❏ Performance❏ Elastic scaling❏ Replay❏ Event ordering

On Premise

First Generation IAC

Batch BatchCloudLift & Shift

Re-Architect

Cloud Streaming

IAC Real-Time Ingest Architecture

IAC Architecture in the cloud

Event -Ingest Architecture

File -Ingest Architecture

Questions?

Questions?

We’re Hiring!data@intuit.com