edf2012 rufus pollock - open data. where we are where we are going
TRANSCRIPT
![Page 1: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/1.jpg)
Open Data: Where We Are,Where We're Going
European Data Forum, Copenhagen
Rufus Pollock@rufuspollock[.org] - @okfn[.org]
Licensed under cc-by v3.0 all jurisdictions
![Page 2: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/2.jpg)
Community-based not-for-profit founded in 2004
We have projects and collaborations around the world - more than a dozen local groups and
chapters and 15 working groups
![Page 3: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/3.jpg)
We build tools, communities and applications to create, share and use open data and
knowledge - content and data that everyone can use, share and build on.
![Page 4: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/4.jpg)
![Page 5: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/5.jpg)
2 Stories
![Page 6: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/6.jpg)
http://blog.okfn.org/2008/02/18/a-traffic-data-odyssey/
![Page 7: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/7.jpg)
Request for count data collected by UK’s Department for Transport in the form of MIDAS (motorway incident detection and automatic signalling): I’m a UK citizen interested in getting access to the Traffic Count Data and Logs dataset linked to from: http://www.midas-data.org.uk/ It appears that a username and password is required from yourselves in order to do this and so I wondered if you could therefore be kind enough to provide me with such a username and password.
The Request (and the Refusal)
![Page 8: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/8.jpg)
I need your acceptance of the conditions stated below and some information regarding the research project you are undertaking before we allow you access to the data. The conditions and information I have requested will allow the Group to justify the costs associated with supplying this data [what costs, it's already in a bzip file on a website?] and to ensure the data is being used appropriately [why is such paternalism needed?]. Note:- if the project is being undertaken jointly with another organisation then that organisation will also be required to supply the information requested. Please ensure all grant and contract holders, staff and students associated with the grant and project are made aware of the conditions contained within this letter.
Conditions1. The data may not be copied to any other persons or organisations without the prior approval of the Highways Agency.
The data may only be copied to another person or organisation after that person or organisation has confirmed with the HA the purpose for which the data is required and accepted the conditions laid down in this letter.
2. The data may not be used for any other purpose within your organisation without the prior written approval of the Highways agency.
3. The data must not be sold or used for commercial gain.4. The data will not be used to contradict or challenge any research project, works or statement made by the
Government, the Department of Transport or the The Highways Agency as a result of analysis of the data by them or their agents.
5. the Highways Agency will be provided, upon publication and free of charge, with: annual progress reports; any interim reports describing significant findings; a complete copy of the final report; and any technical papers resulting from the research.
The Conditions and the Refusal
![Page 9: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/9.jpg)
![Page 10: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/10.jpg)
Anyone means anyone! No restrictions on commercial use. Open != Creative Commons. Many CC licenses NOT open (and most not appropriate for data).
![Page 11: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/11.jpg)
![Page 12: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/12.jpg)
![Page 13: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/13.jpg)
![Page 14: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/14.jpg)
![Page 15: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/15.jpg)
![Page 16: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/16.jpg)
Machine ReadableBulk Data
APIs are not enough!
![Page 17: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/17.jpg)
![Page 18: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/18.jpg)
Powered by CKAN
![Page 19: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/19.jpg)
![Page 20: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/20.jpg)
DataHub.io Community DataHub powered by CKAN
![Page 21: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/21.jpg)
![Page 22: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/22.jpg)
![Page 23: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/23.jpg)
Where We Are
![Page 24: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/24.jpg)
Huge Growth in Last Few Years
Especially for Government Data
![Page 25: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/25.jpg)
Data Catalogs Around the World as of May 2012
http://datacatalogs.org/http://datahub.io/dataset/datacatalogs-org
![Page 26: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/26.jpg)
![Page 27: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/27.jpg)
![Page 28: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/28.jpg)
Where Next?
![Page 29: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/29.jpg)
Toy vs Core DatasetsLocation of park benches vs National Map
![Page 30: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/30.jpg)
http://census.opengovernmentdata.org/
![Page 31: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/31.jpg)
Machine Readable
![Page 32: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/32.jpg)
Education and Skills
![Page 33: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/33.jpg)
Scale(how do we?)
![Page 34: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/34.jpg)
We Compentize to Scale
We Want and Need to Integrate
Without Open Data this will Fail!
![Page 35: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/35.jpg)
Small Datavs
Big DataIt's about small pieces loosely joined not
one ring to rule them all!
![Page 36: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/36.jpg)
Machine Integrable(?)
![Page 37: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/37.jpg)
![Page 38: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/38.jpg)
Keep it Simple ...
![Page 39: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/39.jpg)
![Page 40: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/40.jpg)
MicroSchemas
A Set of Simple Cross-Country Data Formats
Transport (time-tables), Locations, Spending etc
![Page 41: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/41.jpg)
Conclusion
![Page 42: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/42.jpg)
Open Data is Platform not a Commodity
Let's Build on It, Not Sell
It!
![Page 43: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/43.jpg)
Increasing Amounts of Data
![Page 44: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/44.jpg)
Be Problem and Application Driven
(Rather than Data and Technology Driven)
![Page 45: EDF2012 Rufus Pollock - Open Data. Where we are where we are going](https://reader033.vdocuments.net/reader033/viewer/2022052908/5594a8b01a28ab41348b478f/html5/thumbnails/45.jpg)
Thank-you!
Rufus Pollock@rufuspollock[.org] - @okfn[.org]