open data in practice - the oditraining.theodi.org/resources/odp_publication_platforms.pdf ·...
TRANSCRIPT
![Page 1: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/1.jpg)
David Tarrant · @davetaz
Open Data in Practice
http://training.theodi.org/InPractice
![Page 2: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/2.jpg)
Session 3 Data Publication Platforms
![Page 3: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/3.jpg)
Understand the difference between “data on the web” and the “web of data”
Evaluate a number of different approaches for publishing open data.
Publish a dataset on one of the many available platforms.
Outcomes
![Page 4: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/4.jpg)
Types Specialist Solu-on Integrated Solu-on
+ Easy to get setup and maintain. + Open Data focused + Clear workflows for publishing open data + Visualisa?on tools + Data mashing tools + Best for transac?onal data
+ No new plaBorm to learn + Data is provided in parallel to web pages + No separa?on from authorita?ve data + Easy discovery of data + Best for reference data + Best for Linked Open Data
![Page 5: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/5.jpg)
Key characteristics of specialist solution
1. Separate from your main org website
2. Designed to publish open data, not to fulfill other organisation goals
Examples: data.gov.uk | data.cityofchicago.org | data.sncf.com
![Page 6: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/6.jpg)
Key characteristics of integrated solution
1. It is your main website
2. Publishes data alongside everything else that the organisation does
Examples: bbc.co.uk/programmes | southampton.ac.uk | gov.uk
![Page 7: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/7.jpg)
Merging specialist and integrated
Method 1: Build the functionality of your current website into a new open data platform. Method 2: Hide the specialist solution behind your main website and use it as a loosely coupled CMS.
Example: southampton.ac.uk
Example: West Sussex Country Council
![Page 8: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/8.jpg)
The sliding scale of specialist solutions
1. Catalogue: Point to data (leave it at source) 2. Re-present: Provide data services (leave it at source)
3. Host the data: Be the source
4. Control the data: Be the authority
5. Be the hub: Host the data and processor
1 2 3 4 5
![Page 9: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/9.jpg)
Specialist Solutions
hKp://www.flickr.com/photos/okfn
1 2
2 3
4 5
![Page 10: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/10.jpg)
Open Knowledge Foundation Supported
Data Catalogue Open Source
Feels like a record manager Simple API and search
Lots of community tools http://demo.ckan.org/
1 2
![Page 11: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/11.jpg)
Updated July 2014 Early) Dataset catalogue (data.gov.uk)
no data hosted or searched Mid) Data and dataset catalogue
no data hosted but it is searchable Now) Integrated data driven web site
data platform is integrated with data, search and content
Evolution of CKAN 1 2
![Page 12: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/12.jpg)
Features…
Publish, Store and Manage Data and Metadata
Visual and Geospatial Social Full Stored History Federate Your Data With Other Organizations
Rich RESTful JSON API for Developers
1 2
![Page 13: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/13.jpg)
Open Data Soft
2 3
![Page 14: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/14.jpg)
Open Data Soft
Data as a Service (DaaS) Hosted enterprise solution
Rich Interface Query based API (3-Star)
2 3
![Page 15: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/15.jpg)
Open Data Soft
2 3
![Page 16: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/16.jpg)
Open Data Soft
Data as a Service (DaaS) Hosted enterprise solution
Rich Interface Query based API (3-Star)
Closed Source (main product) EU Based
2 3
![Page 17: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/17.jpg)
Data as a Service (DaaS) Hosted enterprise solution
Allows user created content Full linked API (5-Star)
https://opendata.socrata.com/
4 5
![Page 18: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/18.jpg)
Features… Data Publishing, Optimized for Business Users
Flexible Metadata Management
Federate Your Data With Other Organizations
Metrics of the Success of Your Initiative in Real-time
Anyone Can Create Maps and Charts Data Becomes Social Developers Are Supported Every Step of the Way 4 5
![Page 19: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/19.jpg)
Data as a Service (DaaS) Hosted Solution Clean Interface
Powerful API (SODA)
Closed Source (main product) US Based
4 5
![Page 20: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/20.jpg)
The sliding scale of specialist solutions
1. Catalogue: Point to data (leave it at source) 2. Re-present: Provide data services (leave it at source)
3. Host the data: Be the source
4. Control the data: Be the authority
5. Be the hub: Host the data and processor
1 2 3 4 5
![Page 21: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/21.jpg)
Specialist Solutions
hKp://www.flickr.com/photos/okfn
1 2
2 3
4 5
![Page 22: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/22.jpg)
Integrated solutions
Integrated solutions expose data using the current infrastructure (web pages).
Data driven web site
Best for reference and live data
![Page 23: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/23.jpg)
The developers secret
![Page 24: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/24.jpg)
Linked data Amazing but hard to publishing and use.
![Page 25: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/25.jpg)
Formats, Structures and Files
Data formats are complex and have suffered benefited from years of
development in many different domains.
One domain is bringing them all together…
![Page 26: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/26.jpg)
Recap Specialist Solu-on Integrated Solu-on
+ Easy to get setup and maintain. + Open Data focused + Clear workflows for publishing open data + Visualisa?on tools + Data mashing tools + Best for transac?onal data
+ No new plaBorm to learn + Data is provided in parallel to web pages + No separa?on from authorita?ve data + Easy discovery of data + Best for reference data + Best for Linked Open Data
Both great for open data
Integrated solutions more suited for building a web of linked data
![Page 27: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/27.jpg)
Exercise
Each table will have one of the publication platforms to explore. Your task is to publish a prescribed dataset on this platform, with an associated open data certificate.
![Page 28: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/28.jpg)
Understand the difference between “data on the web” and the “web of data”
Evaluate a number of different approaches for publishing open data.
Publish a dataset on one of the many available platforms.
Outcomes
![Page 29: Open Data in Practice - The ODItraining.theodi.org/resources/ODP_Publication_Platforms.pdf · Flexible Metadata Management Federate Your Data With Other Organizations Metrics of the](https://reader036.vdocuments.net/reader036/viewer/2022081523/5fcf1509e42c970a787defda/html5/thumbnails/29.jpg)
Thank-you