open data in a day - introduction to open data

IntroducingOpenData

Ian HenshawRegistered ODI Trainer

ian.henshaw@gmail.com@ihenshaw

Overview

● Defining open data

● Benefits

● Open, closed and personal data

● Why now?

Aims

● What is open data, its benefits and opportunities

● Case studies of successful open data projects

● How to discover and use open data?

Learning Objectives

● Describe open data, Explain the difference between big, personal and open data

● Describe the benefits, of working with open data

● Describe successful case studies of using and publishing open data

● Explain how open data sits in the current economic climate

What is Data?

Exercise

Definition of Data (1)

A collection of facts, informationand statistics that can be analyzed

to develop new knowledge

Definition of Data (2)

A collection of numbers assigned asvalues to quantitative variables and/or characters assigned as values to qualitative variables

Definition of Data (3)

The lowest level of abstractionfrom which information and then

knowledge are derived.

The DIKW Pyramid

Data

Information

Knowledge

Wisdom

LinkElements

Organize Information

ApplyKnowledge

What is Open Data?

Exercise

Definition of Open (OKF)

A piece of data or content is open if anyone is free to use, reuse, and redistribute it - subject only, at most, to the requirement to attribute and/or share-alike.

Definition of Open (ODI)

Open data is data that is made available by organizations, businesses and individuals for anyone to access, use and share.

● Open data has to have a license that says it is open data. Without a license, the data can’t be reused. The license might also say:

– that people who use the data must credit whoever is publishing it (this is called attribution)

– that people who mix the data with other data have to also release the results as open data (this is called share-alike)

Definition of Open Data

Open Data is accessible public data that people, companies and organizations can use to launch new ventures, analyze patterns and trends, make data-driven decisions, and solve complex problems.

http://www.opendatanow.com/book-open-data-now/

ISBN-10: 0071829776ISBN-13: 978-0071829779

opendefinition.org

Access

Redistribution

Reuse

Integrity

Attribution

Non-discriminatory

Remix and Combine

“Data is the new Oil” - Clive Humby

kenhodge13 (40132991@N07) on flickr.com

“Data is just like crude.” - Michael Palmer

● It’s valuable, but if unrefined it cannot really be used.

● It has to be changed into gas, plastic, chemicals, etc to create a valuable entity that drives profitable activity

Data must be broken down and analyzed for it to have value.

Data is the raw material of the new industrial revolution

- Francis Maude MP

Justifications

Trust and Transparency

Enabling the Economy

Benefits of Open Data

● Data Driven Decision Making

● Performance Measurement

● Reduction of Government Costs

● Support an Open Government Initiative

– e.g. Transparency

● Economic Development

● Increased Citizen Engagement

● Talent Attraction / Retention

Data Driven Decision Making

http://london-fire.labs.theodi.org/explore/

Performance Measurement

https://data.maryland.gov/goals/energy-efficiency

Reduction of Government Costshttp://theodi.org/news/prescription-savings-worth-millions-identified-odi-incubated-company

Reduction of Government Costs

http://www.bloomberg.com/news/2014-04-09/top-medicare-doctor-paid-21-million-in-2012-data-shows.html

Support for Open Government

http://cms.gov/openpayments/

Support for Open Government

http://cms.gov/openpayments/

Support for Open Government

http://www.openbudget.ny.gov/

Economic Developmenthttp://www.mckinsey.com/insights/high_tech_telecoms_internet/what_executives_should_know_about_open_data

Report:January 2014

Economic Developmenthttp://www.gpsalliance.org/docs/GPS_Report_June_21_2011.pdf

The Economic Benefits of Commercial GPS Use in the United States and the Costs of Potential Disruption

“GPS technology will create $122.4 billion benefits per year and will directly affect more than 5.8 million jobs in the downstream commercial GPS-intensive industries when penetration of GPS technology reaches 100 percent in the commercial GPS-intensive industries.”

Increased Citizen Engagement

Talent Attraction / Retention

Presentation to the world class city partnership annual conference in Barcelona focusing on Dublin and talent attraction by Jamie Cudden

http://www.slideshare.net/jcudden/dublin-talent-presentation-23-06-12-wccp

http://www.indychamber.com/news/indy-chamber-news/hacking-talent-pool/

NC Cities: Open Data Portals

http://technologytank.org/2015/02/26/open-data-portals-in-nc/

Examples of Open Data● Government Data ● Commercial Data

Examples of Open Data

● Crowd Sourced Data

GODAN Report

Global Open Data for Agriculture and Nutrition initiative: Open Data can help solve these problems:

● Enabling more efficient and effective decision making

● Fostering innovation that everyone can benefit from

● Driving organizational and sector change through transparency

http://www.godan.info/wp-content/uploads/2015/04/ODI-GODAN-paper-27-05-20152.pdf

GODAN Use Cases

Enabling more efficient and effective decision making

● Protecting crops from pest outbreaks with vegetation maps: GroenMonitor

● Helping farmers forecast with weather apps and SMS: Awhere

● Boosting crop yields with a best practice knowledge bank: Plantwise

● Saving $3.6m in drought damage with a climate-smart tool: CIAT Colombia

● Managing the California drought with data visualizations: California Department of Water Resources

GODAN Use Cases

Fostering innovation to benefit everyone

● Saving crops and cash with weather simulation and smart insurance: Climate Corporation

● Improving crop varieties with open data on breeding trials: AgTrials

● Bringing agricultural research to the masses: FAO AGRIS portal AGRIS

● Making agri-food data more discoverable: the CIARD RING

GODAN Use Cases

Driving organizational and sector change through transparency

● Tracking water, pesticide, water and fuel use with an open, collaborative platform: Syngenta

● Exposing misspent farm subsidies in Mexico: FUNDAR

● Empowering consumers to make smart food choices: US national nutrient database

● Helping consumers understand risks of the food they eat: EU Food alerts

● Highlighting restaurant inspection scores and improving food safety: LIVES

Syngenta Good Growth Plan

http://www.syngenta.com/global/corporate/en/goodgrowthplan/Documents/pdf/The%20Good%20Growth%20Plan_%2016pp%20brochure%20ENG.pdf

Activity

● Harris Teeter

● Lenovo

● Avon

● JC Penney

● Proctor & Gamble

● Exxon / Mobil

● What opportunities can you identify with open data?

– What data can you give?

– What data do you need?

Challenges and Risks

http://theodi.github.io/data-definitions/

Types of personal data

Open personal data

Data about peoplenot a person

Available to anyone

Has been anonymised

e.g. number of people attendingevent, gender split, age ranges.

(bigger numbers are better!)

Available personal data

Data about a person

Available to the person only!

Often known as MiData

e.g. credit scores, energy and other consumption data.

Personal data

Data about a personwhich is neither

open nor available.

Might belong to you or be collected by a

company.

Opportunities

● Open Data– Brings transparency, open peer review

● Big Data– Brings the evidence

● Personal Data– Makes it relevant

Opportunity

http://theodi.github.io/data-definitions/

Discovering Data

● The idea of this exercise is to help you gain a better understanding and be able to critically appraise the different types of open data publication practice on the web.

● http://training.theodi.org/resources/Discovering_Open_Data_Exercise.pdf

Why Now?

A Global Movement

http://theodi.github.io/open-data-barometer-viz/

Knowledgefor

everyone