moving and transforming data with pentaho data integration 5.0 ce (aka kettle)

Moving and Transforming Data with

Pentaho Data Integration

a.k.a. KETTLE

Welcome!

Software engineer

[email protected]

Pentaho

Business Intelligence & Analytics

Full stack

Open coreGPLv2, Apache 2.0

Enterprise and OEM licenses

Java-based

Web front-ends

The Pentaho Stack

Data Integration / ETL

Big Data / NoSQL

Data Modeling

Reporting

OLAP / Analysis

Data Visualization

Dashboarding

Data Mining / Predictive Analysis

(Mobile) Delivery

Bursting, Scheduling, Self Service

Instant AnalyticsBlendingETLFull Stack BI & BA

SourcesModelsReportsOLAPVisualizationDashboardsMining

Data WarehouseTTTT

FDDDDD

Information:

A well-prepared, well-presented meal

Information:

Catching the right data and hauling it in

Extraction:

Disgusting job of validating & cleaning data

Transformation

Store manageable units for later use

Loading:

Store manageable units for later use

Loading:

Pentaho Data Integration

KettleExtract, Transform, Load

Blending

Instant Analytics

Changing input to desired output

Kettle Architecture

Tools and UtilitiesData Integration Engine

Job

Job
EngineTransformation
Engine

Launch:Kitchen, CarteLaunch:PanDevelop: Spoon

Call

Repository(RDBMS)

.ktr

.kjb

Transformation

Jobs & Transformations

Jobs

Synchronous workflow of job entries (tasks)

Transformations

Stepwise parallel & asynchronous processing of a recordstream

Distributed

Sources and Destinations

RDBMS (> 40)

NoSQL / Big Data

OLAP (Mondrian, Palo, XML/A)

Web (REST, SOAP, XML, JSON .)

Files (CSV, Fixed, Excel )

ERP (SAP, Salesforce, OpenERP)

...way Too Many To Mention!

Transformations

String & Date manipulation

Data Validation / Business Rules

Lookup / Join

Calculation, Statistics

Cryptography

Decisions, Flow control

Scripting

...> 150, excluding plugins

Demo

NLUUG Program Webpage

fact_talkdim_room

dim_track

dim_speaker

ETLInput

Output

dim_company

Demo Transformation

Business Model

Open coreMajority is open source

Give and take

Enterprise EditionExtra features, Support, Services

Community

PluginsPentaho Marketplace

Code contributions

Applications & Solutions

Tutorials, Support

Marketplace

Community Meetups

Pentaho Software

Community Edition Binariescommunity.pentaho.com (release)

ci.pentaho.com (development)

Source codegithub.com/pentaho

Enterprise Edition Evaluationpentaho.com/testdrive

Resources

Online documentationinfocenter.pentaho.com (manual)

wiki.pentaho.com (community wiki)

Issue trackerjira.pentaho.com

Community Supportforums.pentaho.com

Freenode IRC: ##pentaho

Books

Thank You

Join the conversation. You can find us on:blog.pentaho.com

@Pentaho

Facebook.com/Pentaho

Pentaho Business Analytics

Click to edit the title text formatClick to edit Master title style

2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555


Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level

Seventh Outline LevelClick to edit Master text styles

Second level

Third level

Fourth level

Fifth level





Second level

Third level

Fourth level

Fifth level



Second level

Third level

Fourth level

Fifth level








moving and transforming data with pentaho data integration 5.0 ce (aka kettle)

Technology