big challenges in data modeling: nosql and data modeling

14
Your Moderator Karen Lopez Sr. Project Manager / Architect Infoadvisors @datachick #BCDModeling Joining Karen Dan McCreary Principal Kelly-McCreary & Associates @dmccreary

Upload: dataversity

Post on 20-Aug-2015

975 views

Category:

Technology


3 download

TRANSCRIPT

Page 1: Big Challenges in Data Modeling: NoSQL and Data Modeling

Your

Mod

erat

or

Karen LopezSr. Project Manager / Architect

Infoadvisors@datachick

#BCDModeling

Join

ing

Kare

n

Dan McCrearyPrincipal

Kelly-McCreary & Associates@dmccreary

Page 2: Big Challenges in Data Modeling: NoSQL and Data Modeling

NoSQL And Data ModelingBig Challenges in Data Modeling

Page 3: Big Challenges in Data Modeling: NoSQL and Data Modeling

Making Sense of NoSQL clearly

and concisely explains the

concepts, features, benefits,

potential, and limitations of

NoSQL technologies. Using

examples and use cases,

illustrations, and plain, jargon-

free writing, this guide shows

how you can effectively

assemble a NoSQL solution to

replace or augment the

traditional RDBMS you have

now.

Page 4: Big Challenges in Data Modeling: NoSQL and Data Modeling

Data Models – Traditional Process

Conceptual (Data) Model

Logical Data Model

Physical Data

Model(s) OLTP

OLTPOLTP OLTP

OLTP

MARTMART

OLTP

OLTPOLTP

Page 5: Big Challenges in Data Modeling: NoSQL and Data Modeling

NoSQL Data Store Types

• Key Value

• Graph

• Columnar

• Document

• XML

• ….more?

Page 6: Big Challenges in Data Modeling: NoSQL and Data Modeling

Traditional Data Modeler Involvement

Project Initiation

Architecture and

Infrastructure Design

SW Requirements

Development

Deployment

Page 7: Big Challenges in Data Modeling: NoSQL and Data Modeling

Modern Data Modeler Involvement

Project Initiation

Architecture and

Infrastructure Design

SW Requirements

Development

Deployment

Page 8: Big Challenges in Data Modeling: NoSQL and Data Modeling

ETL

EDW

Data Mart

Data Mart

Page 9: Big Challenges in Data Modeling: NoSQL and Data Modeling

Hadoop

ETL

EDW

Analytics Mart

Data Mart

Page 10: Big Challenges in Data Modeling: NoSQL and Data Modeling

“Every design decision should include cost, benefit and risk”

• - Karen Lopez

Page 11: Big Challenges in Data Modeling: NoSQL and Data Modeling

10 Tips For Modeling in a Hybrid World

1. Models require a modeler

2. Data modeling tools are essential – choose wisely

3. There are many types of data models: know which ones you need

4. Modeling does not have to happen at the same time in every project. It should happen at the right time

5. Modeling is not just schema design. Think outside the boxes and lines

Page 12: Big Challenges in Data Modeling: NoSQL and Data Modeling

10 Tips for Modeling in a Hybrid World

6. A data model is much more than a diagram

7. You will need training. More than you think.

8. Team members may not understand modeling. They will need training

9. NoSQL is not one thing. Learn many patterns

10.Modern data architectures are likely hybrid solutions. You can’t just support one part.

Page 13: Big Challenges in Data Modeling: NoSQL and Data Modeling

This book is written for anyone

who is working with, or will be

working with MongoDB, including

business analysts, data

modelers, database

administrators, developers,

project managers, and data

scientists.

Page 14: Big Challenges in Data Modeling: NoSQL and Data Modeling

See you 24 JulyBig Data - Myths, Misunderstandings and Mistakes

Thank you!

Karen Lopez@datachick