Introduction to the

Open Refine RDF tool

March 2014 PwC EU Services

Learning objectives

By the end of this module, you will have an understanding of:

How to easily describe your solutions using a pre-defined template compliant with ADMS-AP.

How to automatically transform your solutions’ descriptions into machine readable language, i.e., RDF.

How to get your interoperability solutions ready to be shared on Joinup.

2

How can this tutorial help you to use ADMS-AP?

This tutorial shows how you can generate ADMS-AP-compliant descriptions of your interoperability solutions from a spreadsheet using the RDF extension in Open Refine.

What is the ADMS-AP?

The ADMS-AP (Asset Description Metadata Schema – Application Profile for Joinup) allows publishers of interoperability solutions to easily share their description metadata on Joinup using a common vocabulary, and consequently enabling the reuse possibilities of their solutions by a wider audience.

“More than 35 repositories from EU Member States, EU Institutions (such as the Publications Office and Eurostat), standardisation bodies (such as W3C, CEN and the DCMI), and EU co-funded initiatives (such as e-CODEX) have shared description metadata of their interoperability solutions on the catalogue on Joinup”

For more info about ADMS-AP: https://joinup.ec.europa.eu/svn/adms/traini

ngs/Introduction_to_ADMS-AP.pptx

3

Outline

• ADMS-AP for describing your interoperability solutions • Automatic or manual path to generate ADMS-AP compliant RDF

1. The context

• Using the spreadsheet • Importing into Open Refine • Adding the skeleton • Exporting

2. The manual path

3. A practical example

4

ADMS-AP for describing your interoperability solutions on Joinup

Repository

Repository

ADMS-AP Your Repository

Repository

Using the ADMS Application Profile

Public administrations

Academic

Standardisation bodies

Businesses

Explore Find Select Obtain

5

Automatic or manual path to generate ADMS-AP

Cleansing with SPARQL

Your repository of interoperability

solutions

Transformation with Open Refine

See how to cleanse RDF with SPARQL: https://joinup.ec.europa.eu/svn/adms/trainings/Introduction_

to_metadata_cleansing.pptx

6

Outline

• ADMS-AP for describing your interoperability solutions • Automatic or manual path to generate ADMS-AP compliant RDF

1. The context

• Using the spreadsheet • Importing into Open Refine • Adding the skeleton • Exporting

2. The manual path

3. A practical example

7

This tutorial will describe the 4 steps of the MANUAL path for

transforming your interoperability solution’s description into an

ADMS-AP-compliant description:

1. Use the spreadsheet template to describe your solution project, releases, packages, etc.

2. Import your spreadsheet in Open Refine

3. Add the pre-defined mappings using the Open Refine RDF extension

4. Export to RDF using the Open Refine RDF extension

8

1. Use the spreadsheet template to describe your solution

… getting the template

Click on the following link to get the Excel template

https://joinup.ec.europa.eu/elibrary/document/excel-adms-ap

9

1. Use the spreadsheet template to describe your solution

… understanding the template

The spreadsheet template contains all concepts and fields included in the ADMS Application Profile.

To describe your solution you have to fill in the different fields of the spreadsheet according to the following colour codes:

10

1. Use the spreadsheet template to describe your solution

… some spreadsheets refer to controlled vocabulary

The following sheets help you to select the right codes when completing the classes’ fields:

Asset_Type Theme_Taxonomy

Publisher_Type Theme

Status File_Format

License_Type Geographic_Coverage

Representation_Technique Operating_System

Interoperability_level User_Interface_Type

Language Programming_Language

Example: the field “theme” in the “Asset” sheet has to be in the format “http://eurovoc.europa.eu/....” based on the controlled vocabulary described in the “Theme” sheet.

11

2. Import your spreadsheet into Open Refine … getting Open Refine and the RDF extension

Download Open Refine from this link

http://openrefine.org/

Note that Open Refine does not work properly on Internet Explorer

Download the RDF extension from this link

http://refine.deri.ie/

Install RDF extension into Open Refine following the installation guide

http://refine.deri.ie/installationDocs

12

2. Import your spreadsheet into Open Refine … creating your project

• Import the Excel file you completed in step 1

• Fill in the following parameters:

• Create your project

13

3. Add the pre-defined mapping using the Open Refine RDF extension … understanding the RDF skeleton

What

•The Open Refine RDF extension allows you to map the current fields of your data to the required RDF structure by drawing a so-called RDF Skeleton.

Why

•The RDF skeleton specifies how the RDF data will get generated from your own data. The cells in each record of your data will get placed into nodes within the skeleton that conforms to the ADMS-AP.

How

•Even though it is possible to build the RDF Skeleton “manually”, it is easier here to re-apply the operation history that contains all operations required to build the RDF Skeleton from the template.

14

https://joinup.ec.europa.eu/elibrary/document/excel-adms-ap

… applying the operations history

1. Click ‘Undo/Redo’ > ‘Apply’ 2. Paste the operation history

3. Click “Perform Operations” 4. Click “RDF” > “Edit RDF Skeleton...” and verify that the RDF Skeleton has been created

3. Add the pre-defined mapping using the Open Refine RDF extension

15

… aligning the RDF schema

By clicking on RDF > Edit RDF Skeleton..., you can check/modify the current mapping between your data and the RDF skeleton.

3. Add the pre-defined mapping using the Open Refine RDF extension

16

4. Export to RDF using the Open Refine RDF extension

… the final step

Now everything is in place to generate an ADMS RDF file, containing your solution’s description.

Click “Export” > “RDF in Turtle” to get an RDF description of your solution

17

Outline

• ADMS-AP for describing your interoperability solutions • Automatic and manual path to generate ADMS-AP compliant RDF

1. The context

• Using the spreadsheet • Importing into Open Refine • Adding the skeleton • Exporting

2. The manual path

3. A practical example

18

Practical example … describe your asset

CLASS PROPERTY EXAMPLE OF VALUE

Asset (models an

interoperability solution)

AssetURI http://myasset.com

Theme (controlled voc.) http://eurovoc.europa.eu/100142

Description Description of the asset

Modified 2014-01-01

Publisher http://myasset.com/publisher

Name The name of the asset

Type (controlled voc.) http://purl.org/adms/assettype/CoreComponent

Publisher

PublisherURI http://myasset.com/publisher

Name The name of the publisher

Publisher type label (controlled voc.) National authority

Publisher type (controlled voc.) http://purl.org/adms/publishertype/NationalAuthority

Note that for simplifying the example, we only filled up the mandatory classes with their mandatory properties.

19

Practical example … describe your asset

Use the template to describe your asset:

Asset

Publisher

20

Practical example … import your description

Import the Asset and Publisher descriptions into Open Refine

21

Practical example … map to the RDF Skeleton

Copy/Paste the operation history for building the ADMS-AP RDF Skeleton

22

Practical example … export your RDF description to Turtle or RDF/XML

Turtle RDF/XML

For more info about RDF: https://joinup.ec.europa.eu/community/ods/document/tm13-introduction-rdf-sparql-en

23

24

Upload your metadata to Joinup

How to import and export ADMS-AP conform metadata of interoperability solutions on Joinup

The following tutorial helps you uploading your ADMS-AP RDF containing the descriptions of your solutions to Joinup

Related learning resources

• Introduction to ADMS-AP

• How to import and export ADMS-AP conform metadata of interoperability solutions on Joinup

• Introduction to metadata cleansing using SPARQL

• Using Joinup as catalogue for interoperability solutions

• Introduction to the advanced search functionality of EFIR

25

Disclaimers

1. The views expressed in this presentation are purely those of the authors and may not, in any circumstances, be interpreted as stating an official position of the European Commission. The European Commission does not guarantee the accuracy of the information included in this presentation, nor does it accept any responsibility for any use thereof. Reference herein to any specific products, specifications, process, or service by trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favouring by the European Commission. All care has been taken by the author to ensure that s/he has obtained, where necessary, permission to use any parts of manuscripts including illustrations, maps, and graphs, on which intellectual property rights already exist from the titular holder(s) of such rights or from her/his or their legal representative.

2. This presentation has been carefully compiled by PwC, but no representation is made or warranty given (either express or implied) as to the completeness or accuracy of the information it contains. PwC is not liable for the information in this presentation or any decision or consequence based on the use of it. PwC will not be liable for any damages arising from the use of the information contained in this presentation. The information contained in this presentation is of a general nature and is solely for guidance on matters of general interest. This presentation is not a substitute for professional advice on any particular matter. No reader should act on the basis of any matter contained in this publication without considering appropriate professional advice.

Follow @Joinup_EU on Twitter

Join the CISR community on Joinup

Project Officer Szabolcs.SZEKACS@ec.europa.eu

Contractors Nikolaos.Loutas@be.pwc.com

Joan.Bremers@be.pwc.com

Get involved Visit our initiatives

ADMS.

SWCISRCOMMUNITY OF INTEROPERABILITY SOLUTION REPOSITORIES

27

Joinup and ADMS are funded by the ISA Programme