data architectures for the api economy
TRANSCRIPT
DATA ARCHITECTURES FOR THE API ECONOMY
Eliot C. Arnold, Co-Founder & Chief Strategist
September 16, 2016Copyright © 2016, Crunch Data, inc.
WHAT’S IN IT FOR YOU?
2
• Learn how we “Follow the Data” to make it useful and understandable in the organization
• Learn a straightforward framework for categorizing / cataloging your data assets
• Learn how the API Economy works and how to use it to make / save money
• Learn a practical approach for getting started
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 2
FOLLOW THE DATA
3
• Data at Rest
• Data in Motion
• Data at Work
From Cloud to Ground
Inter-connect, Data Tiering, Processing, Storage, Retrieval all have relevance to data architectures
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 3
THE 4Ps
Proprietary Purchased
Public Partner
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 4
ORGANIZING YOUR DATA ASSETS BY NEED
5
Volu
me
Velocity
Performance and Volume Challenges
Size of Bubble = Variety
Need for Stream Processing Engines
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 5
WHERE TO BURN THE PROCESSING / PREPARATION CALORIES
6
Data Asset(s)
Structured
Semi-Structured
Unstructured
Binary
JSONXMLLogs
SchemasTables
Data LakeData Warehouse
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 6
WHAT IS AN API?
7
1B+ Per Day
15B+ Per Day
10B+ Per Day
&
Your data architecture needs to account for diverse protocols and data flows
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 7
NETWORK EFFECT OF THE API ECONOMY
8
Pull Push
Subscribe Publish
APIs give you automated access to Cloud data, extend functionality and help catalyze new ways of doing business
Processing Processing
20K+ viable services B2D, Platform
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 8
EXTENSIBLE PLATFORMS FOR VALUE CREATION
9
1. Embedded Apps
2. Platform for API Services (EDI 2016) – Active / Passive
3. Composite Apps built off shared resources – Uber
4. Other data services
Ways to bring your data to market but adds complexity to overall architecture requirements
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 9
THE NEED FOR INTEGRATION MANAGEMENT
109/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 10
THE PRACTICAL APPROACH
11
• Prioritize your data assets by need / where you can devote resources
• Bucket People, Processes and Technology by Following the Data
• Get clear on: “What winning looks like”
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 11
THANK YOU
12
Eliot Arnold
Co-Founder & Chief StrategistPhone: 720-412-6830Toll Free: 855-562-7748
[email protected]#crunch_data
9/16/2016 COPYRIGHT © 2016, CRUNCH DATA, INC. 12