how open source cloud platforms can solve big data needs in a location-aware, socially connected app...

Community StackerBret Piatt

Web 2.0 Expo 2010How Open Source Cloud Platforms Can Solve Big Data Needs in a Location-Aware, Socially Connected App World

&Twitter: @bpiatt

OBLIGATORY

“WHAT IS THE CLOUD?”

GLOBAL

ON DEMAND

INFRASTRUCTURE

OBLIGATORY

“WHAT IS THE WEB?”

GLOBAL

ON DEMAND

APPLICATIONS

OBLIGATORY

“WHAT IS THE SOCIAL WEB?”

GLOBAL

ON DEMAND

PERSONAL

HOW ABOUT NOW..

“..YOU TALK ABOUT SOMETHING REAL?”

WEB SCALE DATA

TERABYTES PETABYTES OF DATA

MILLIONS BILLIONS OF WRITES EACH DAY

BLOGS, FEEDS, CHAT – ALL IN SILOS

DATA OWNED AND CONTROLLED BY PROVIDERS

ACCESSIBLE ONLY UNDER THEIR TERMS

THE OPPORTUNITY

COMMUNITY DATA STORES

COMMON SCHEMAS

AGGREGATED INFORMATION

SHARE THE FOUNDATION

PAY FOR WHAT IS UNIQUE TO YOU

COMPUTABLE OBJECT STORE

COMMON STORAGE

ACCESS VIA API

SHARED ACCESS

SHARED COSTS

ORGANIZED AS A COMMUNITY

WHY COMPUTE MOVES TO DATA

1 PETABTYE OF DATA TAKES OVER 10 DAYS TO MOVE..

NOT

..ON A 10 GIGABIT NETWORK!

WHY OPEN MATTERS

LOCK-IN IS A REAL CONCERN IN THE CLOUD

OPEN SOURCE / DATA MAKES IT ACCESSIBLE TO YOU

GAIN THE KNOWLEDGE OF A COMMUNITY

SHARE YOUR KNOWLEDGE WITH EVERYONE

TURNS COMPETITION INTO COOPERATION

THE VALUE

MORE ACCURATE

MORE RAPID DEVELOPMENT

MORE USER TRUST

MORE OPPORTUNITY FOR PARTNERSHIPS

THE RISKS

HOMOGINIZATION / GROUP THINK

MALICIOUS CHANGES

LACK OF COMMUNITY SUPPORT

PERFORMANCE / AVAILABILITY

EARLY EXAMPLES

OKFN.ORG

CKAN.ORG

DATAMOB.ORG

OPENSTREETMAP.ORG

TREESNEARYOU.ORG

REAL-TIME COLLABORATION

WHERE WE ARE TODAY

PRIVATE DATA DOMINATES

PUBLIC DATA SETS EMERGING

COMMUNITIES ARE DIFFICULT TO FORM

NEED TO BROADEN AWARENESS

NEED TO STANDARDIZE ACCESS

QUESTION & ANSWERS

Bret Piatt

Twitter: @bpiatt

Email: bret@openstack.org

THANK YOU