the next generation of open data

55
THE NEXT GENERATION OF OPEN DATA JOEL NATIVIDAD (@JQNATIVIDAD) East - Boston - May 2016

Upload: joel-natividad

Post on 18-Feb-2017

469 views

Category:

Presentations & Public Speaking


1 download

TRANSCRIPT

THE NEXT GENERATION OF OPEN DATA

JOEL NATIVIDAD (@JQNATIVIDAD)

East - Boston - May 2016

3TrillionDollars!!!

Not all is right in Open Data Land…

No Revisions No Near Real-Time

No Context No Stories

No Small Data No Answers

No Collaboration No Conversations

Stale Data No/little Metadata

Not Institutionalized Additional Burden

Innovation Tax

#FancyFTPServer

FIRST, A STORY ABOUT THE WEB

In the mid-90s, during the early days of the Web, AOL helped America get Online...

Most Annoying Tech Product- PC World 2007

OVER $300 MILLION. :) AT ONE POINT, 50% OF THE CD’S PRODUCED WORLDWIDE HAD AN AOL LOGO ON IT.

Jan Brandt AOL Head of Marketing

HOW MUCH DID AOL SPEND?

AOL's Walled Garden and it did get a lot of Americans online! (27 million at its peak)

…and then came the Open Web

with BILLIONS of users and a Vibrant Ecosystem

INN

OVA

TIO

N

image - DrAfter123

OPENWEB

…would these companies have been possible in AOL's walled garden?

& countless more!!!

So what has this got to do with Open Data?!

We are ready for#NextGenOpenData

#BeyondTransparency

…following the same principles of the Open Web

#NextGenOpenData• Open Source

• Open Standards

• Federated

• Infrastructure

• Open Knowledge

#NextGenOpenData is Open Source

• Ecosystem• Data Publishers / Other Cities & Agencies • Curators • Users • Developers • Third-Party Vendors

• No Innovation Tax Don’t penalize me for using the system

• Allow users to “Scratch Itches” Innovation without Permission

• #BuildWithNotFor Let me Build it with Ecosystem partners, not just one vendor

#NextGenOpenData is “Open Standards”

#NextGenOpenData is “Open Standards”

• Metadata Standards• Project Open Data • DCAT, Data Packages, etc. • schema.org, permitdata.org

• Technology Standards• SQL - not dialect, real queries • Linux - OS standard • AWS - market standard

• File Standards• JSON, GeoJSON • CSV • little to no PDFs

• Data Standards• ISO 8601 date format • WGS84 - lat/longs

“Open Standards” are pragmatic, widely-deployed, simple standards

An “open standard” got you here today!

#NextGenOpenData is Federated

Cities that Work like the WebInstead of one big data portal, each jurisdiction/organization will have a hosted mini-portal, as they know their data best and each jurisdiction can be tailored to their needs/workflows.

Boston Globe

Suffolk County

Boston

NGO

Business Improvement

District

Metropolitan Area Planning

Council

Boston University

Cambridge

City Council

DOiTT

Public Library

Fire Dept

Police Dept

MITNeighborhood

Assoc

Small City 1

Transit Authority

DOT

NGO 1

NGO 2

CfA Brigade

Hubway

BarnstableSomerville

MTA

Web of

Data

#NextGenOpenData is Infrastructure

• Not a #FancyFTPServer

• Use Best-of-Breed tools allow me to use 3rd-party tools, not just your tools ("Not invented here")

• Can support Transactional Workloads to build Smart City/Gov systems

• IT-friendly

#NextGenOpenData is Plumbing

Standard Gauge

The Standard Gauge accelerated the Industrial Revolution

…the same way Elevator, Plumbing & Building

Standards redefined the City

#NextGenOpenData is Open Knowledge

Open Data that is Useful, Usable, and Used

#NextGenOpenData is Open Knowledge

• Useful, Usable & Used• Agencies (It has to be USEFUL to Agencies!!!)• Researchers • Journalists • Developers (Internal & External) • YOU!

• Integrated into day-to-day Workflowbeyond transparency/data publishing

• Curated/Linked

• “Small Data”answers - usable insights/KPIs, not raw data

Dave Guarino, CfA Fellow

& with best-of-breed ETL tools!

ing

Anthea Watson Strong, Google

Ate !!!

Waldo Jaquith, US ODI

Coz it helps me workmore efficiently!

CULTURE CHANGED!!!

Mark Headd

#NextGenOpenData will help us build the

21st Century Connected Govtwe expect & deserve

...and you have a role in building our Shared Future!

THE BEST MINDS OF MY GENERATION ARE THINKING ABOUT HOW TO MAKE PEOPLE CLICK ADS. THAT SUCKS.

Jeff Hammerbacher co-founder Cloudera

CALL TO ACTION TO DATA SCIENTISTS

Ben Wellington, IQuantNY

Thanks!

[email protected] • @jqnatividad • opengov.com

YOU can Help Build the Smart Cities of our Future with

#NextGenOpenData

East - Boston - May 2016