mongodb evenings minneapolis: medtronic's mongodb journey

24
Add photo or leave as solid Color PRESENTED BY: MATT CHIMENTO: ENGINEERING MANAGER JEFF LEMMERMAN: PRINCIPAL SOFTWARE ENGINEER MEDTRONIC’S JOURNEY WITH MONGODB

Upload: mongodb

Post on 11-Jan-2017

429 views

Category:

Technology


3 download

TRANSCRIPT

Page 1: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

Add photo or leave as solid Color

PRESENTED BY:MATT CHIMENTO: ENGINEERING MANAGERJEFF LEMMERMAN: PRINCIPAL SOFTWARE ENGINEER

MEDTRONIC’S JOURNEY WITH MONGODB

Page 2: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

2

INTRODUCTION

Jeff Lemmerman B.S. Physics, B.S. Astrophysics

University of Minnesota MS Software Engineering

University of Minnesota Pr. Software Engineer – Medtronic (2006-

Present)

Matt Chimento B.S. Computer Engineering

Kettering University Master of Business Administration (2014)

University of Minnesota Carlson School of Management

Engineering Manager – Medtronic (2006-2014), Target (2014-2015), Medtronic (2015-Present)

Page 3: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

3

MEDTRONIC ENERGY AND COMPONENT CENTER

MECC est. 1976 Research, Development, and Manufacturing Manufacture components for devices Census – 1200 Employees Plant Size – 190,000 Square Feet

40,000 Manufacturing 15,000 R&D Labs 38,000 Office 97,000 Common, Support, Warehouse

Page 4: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

4

MEDTRONIC USE CASES

Results API: RESTful API for storing results from automated test equipment

Component Database: Complete 360˚ View of the components we manufacture at MECC

Tests: Storing test information for automated test equipment

Other Medtronic groups are using MongoDB differently

Page 5: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

5

RESULTS API: PROBLEMVARIETY OF COMPONENTS

Page 6: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

6

RESULTS API: PROBLEMVARIETY OF DATA INTENSIVE TESTS

Multivariate Analysis

Statistical Process Control

Waveform Measurements

Operational Dashboards

Page 7: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

7

HOW THE JOURNEY BEGANLEARNING NEW CONCEPTS AND TOOLS: WHAT CAN I BUILD?

Page 8: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

8

TEST MEASUREMENTS – WAVEFORMRESULTS API

RESTful API

Model Comparison

Page 9: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

TESTS: PROBLEM

0.6M unique battery tests

Since 1976

Export as Analysis-Ready Data-Sets

Many thousand test channels for primary and rechargeable batteries

Some tests extending >15 years Each system has very different Test

Information Commercial and Custom Systems

MECC Test Systems Data Management

Rechargeable Battery Test Systems and

Ovens

Batteries on Test Boards in Oven

9

Page 10: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

TESTS: PROBLEM

10

Custom TagsSearching By Tags

Custom PropertiesSearching By Properties

Page 11: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

11

TEST INFORMATION – RELATIONAL DATABASE

Test Table System Specific Table(s)

Test Table Properties Table

Test Table

Page 12: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

12

TEST INFORMATION – RELATIONAL DATABASE

Test Table

Key Trade Offs For Flexibility –Joining System Specific TablesQuerying and Processing Key/Value TableQuerying and Processing Structured Text Fields (JSON/XML)

Page 13: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

13

TEST INFORMATION – MONGODB

Page 14: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

RESULTS: VISUALIZE

14

Visualize ResultsExport -> CSV

Page 15: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

15

COMPONENT DATABASE - UPDATE

Full Material Consumption Full Manufacture Step History Summarized Data Scrap Codes

15

Page 16: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

16

WHAT HAVE WE LEARNED IN 4 YEARS

MongoDB Training, Support, Documentation have remained excellentStill struggling with standardization vs. flexibilityResponsibility for querying and processing data in MongoDB –

Application vs. MongoDB vs. 3rd Party Tools

Can be difficult to keep up with fast release cycle, new features -C# Driver 2.x – methods, query builders/filters, Async methods

Page 17: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

17

WRITING CUSTOM SERIALIZATION IS TRICKY

Automapping functionality works in most cases

Can add control over how class properties are serialized

Add serialization information or override Serialize/Deserialize Methods

Page 18: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

18

NEW FRONTIERS

Data Discovery/VisualizationData Mining

Machine Learning/Pattern Recognition Data Lakes

Page 19: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

THANK YOU.QUESTIONS?

Page 20: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

HOW IS DATA RETRIEVED?

20

Page 21: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

LOADING DATA INTO CENTRAL REPOSITORY

21

Page 22: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

Component Dataset In Excel

Page 23: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey

23

Component Dataset in RDBMS

Page 24: MongoDB Evenings Minneapolis: Medtronic's MongoDB Journey