drupalcon keynote: open source and open data in the age of the cloud

Open Source and Open Datain the Age of the Cloud

Tim O’Reilly

DrupalCon San Francisco, CA

April 20, 2010

Tuesday, April 20, 2010

“Major Strasser has been shot...Round up the usual suspects”

Open Source

“You keep using that word. I do not think it means what you think it means.”

Web 2.0 Cloud Computing

Just what does it mean?

“I’m an inventor. I became interested in long term trends because an invention has to make sense in the world in which it is finished, not the world in which it is started.”

-Ray Kurzweil

You may think of me as a book publisher

What We Really Do At O'Reilly

Change the world by spreading the knowledge of innovators

O’Reilly Radar Methodology

“The future is here. It’s just not evenly distributed yet.” - William Gibson

We “watch the alpha geeks” and think about the futures they are living in

We then look for trend data that tells us that a particular future is becoming mainstream

I’m going to tell you some seemingly unconnected technology stories from the front lines of innovation. Then we’re going to connect the dots.

Innovation in Action

Hackers build devices that show off possible futures

Entrepreneurs and innovative companies take these futures and push them to the mainstream

The cloud future includes...

Devices acting as sensors for intelligent data collection

Devices whose UI is on the web rather than the device

Feeding data into multiple online services that will turn into a full-on sensor web

Setting the stage for robotics, augmented reality, and the next generation of personal electronics

What we see here

Peer-to-peer credit card payments Social networks used for risk evaluation

The PC is out of the loop The phone is a sensor platform

– Hardware add-on innovation– Location based sensing– Touch screen UI

Processing is done in real time in the cloud– Allowing processing that can’t be done on the device– Big data analysis– Building new networks on the back of existing ones

Reinventing a major industry

The Yelp Monocle

Find cafes nearby.

Crowdsourcing includes the use of humans as sensors

AMEE - the world’s energy meter

We’re moving to a world in which every device generates useful data, in which every action creates “information shadows” on the net.

The smart phone plus local search. Today pizza,

Pazzia, 337 3rd StreetCalifornia Pizza Kitchen, 53 3rd StreetBlondie’s Pizza. 63 Powell Street

An application running on a mobile device whose user interface is driven by sensors:

- Touch screen- Motion and proximity sensors- Microphone- GPS or cell tower triangulation

An application that depends on cooperating cloud data services: - Speech recognition- Search- Location data

An application that applies context-sensitive filters to give users just the information they need.

In real time

•Search in plain English•Search by voice•Traffic view•Search along route•Satellite view•Street view

An application that depends on cooperating cloud data services: - Location- Search- Speech recognition- Live Traffic- Imagery

Cloud Computing

“You keep using that word. I do not think it means what you think it means.”

The Internet Operating System is A Data Operating System

The Internet Operating System is a Data Operating System

It helps applications find out about– People– Places– Things– Prices– Documents– Images– Sounds– Relationships– ...

and helps people interact with them through services– Search– Payment– Matching and Recognition– ...

In Real Time

This is the 21st century data challenge

Not transactions Not data warehouses and business intelligence Not database-backed web sites Not even NoSQL-backed web services

Real time cloud-based intelligence delivered to mobile applications

Algorithmic intelligence

This is the world that Drupal must be designed to support

A good start, but is it enough?

Who will own the Internet Operating System?

Do we want anyone to own it?

If not, we’d better get busy!

Who Owns What

Infrastructure As a Service

Storage — —

Computation — —

Hosted SaaS Apps —

Media access

Music —

Video —

Books — — — — —

Web Content —

Photos — — —

Monetization

Advertising — —

Payment

Location

Maps & Directions — — —

Real Time Location Detection — —

Calendaring/Scheduling —

Social Graph — —

Communications

Email — —

Voice — —

Chat — —

Video — —

Sensor Management

Speech Recognition — —

Image Recognition — — —

Mobile Device OS —

Mobile Device Hardware —

Web Browser — —

Chart Title?

Strong o!eringMedium o!eringGetting started

— Not on the board yet

“In the future, being a developer on someone’s platform will mean being hosted on their infrastructure.”

- Debra Chrapaty, VP Windows Live (2006)

Infrastructure As a Service

Storage — —

Computation — —

Hosted SaaS Apps —

Media access

Music —

Video —

Books — — — — —

Web Content —

Photos — — —

Monetization

Advertising — —

Payment

Location

Maps & Directions — — —

Real Time Location Detection — —

Calendaring/Scheduling —

Social Graph — —

Communications

Email — —

Voice — —

Chat — —

Video — —

Sensor Management

Speech Recognition — —

Image Recognition — — —

Mobile Device OS —

Mobile Device Hardware —

Web Browser — —

Chart Title?

Strong o!eringMedium o!eringGetting started

— Not on the board yet

Who Owns What

Interoperable web services, open data, and standard protocols are at least as important as open source

The underdog is the ally of open source

Potential open source supporters

Search: Microsoft Maps: Microsoft, Nokia,Yelp, Foursquare Speech: Nuance, Microsoft Social Graph: Google Payment: Paypal Cloud infrastructure: VMware Smartphones: Google Device Operating Systems: Google

Corporate data sharing

There’s a lot of data in the world

Switching tracks (a bit)...

What’s wrong with Government today

Vending Machine Government

Vending Machine Gov concept from Donald Kettl: The Next Government of the United States

We Need to Do More Than Shake the Vending Machine!

http://image06.webshots.com/6/2/57/50/190125750NgQXwu_ph.jpg

Drupal is a DIY tool! But so is Arduino. Keep rediscovering the DIY spirit.

Work on stuff that matters!

For more information

The Open Source Paradigm Shift (2003) http://bit.ly/cKLSUP

What is Web 2.0? (2005) http://oreil.ly/a0zT65

Web Squared: Web 2.0 Five Years On (2009) http://bit.ly/kEKgs

Government as a Platform (2010) http://opengovernment.labs.oreilly.com/

Ongoing commentaryhttp://radar.oreilly.comhttp://twitter.com/timoreillyhttp://buzz.google.com/timoreilly

drupalcon keynote: open source and open data in the age of the cloud

location data

open data

useful data

trend data

cooperatingcloud data

location search

cloud future

device big data analysis

Technology

politics of open source keynote

state of drupal keynote, drupalcon new orleans

state of drupal keynote, drupalcon los angeles

open stack london keynote

open source communities (php benelux keynote)

eurosai open data seminar opening keynote

open generation mikkopuhakka-keynote-4

astd keynote on open leadership

selling the open-source philosophy - drupalcon latin america

1etp open day - keynote

agile open holland 2011 keynote

keynote on open/public education

2012 open storage summit keynote

open zfs keynote (public)

state of drupal keynote, drupalcon baltimore

cloud foundry open tour keynote

2015 open education conference: opening keynote

state of drupal keynote, drupalcon prague

drupalcon london

state of drupal keynote, drupalcon india