Publishing Clearinghouse resources to geodata.gov

Doug NebertFGDC Secretariat

Geospatial One-Stop TeamSeptember 17, 2004

2

NSDI: a Foundation for GOSGeospatial One-Stop (GOS) implements the principles of the NSDI spelled out in Executive Order 12906 (recently revised)GOS builds on the resources already available in the NSDI – FGDC and endorsed external Framework Standards, NSDI Clearinghouse NetworkOperated as project coordinated through FGDC Secretariat with many agency partners

3

Geodata.gov and the NSDI Clearinghouse

Over 150 collections of metadata exist within searchable NSDI Clearinghouse Nodes in the US All FGDC metadata records are searchable by fields and full-text through six replicated search gatewaysAdditional non-Z39.50 metadata collections exist that should be part of the NSDI via geodata.gov

5

Some operational featuresgeodata.gov will speed and simplify search and browse of metadata as a replacement for the domestic NSDI GatewaysMetadata are harvested from remote collections into a single metadata ‘cache’ to speed search and rankingBrowsing for geospatial data is made possible through common ISO Categories

6

Portal at geodata.govOGC Web Map Services (WMS) and ArcIMS ‘image’ services supported in viewer where links provided in metadata (Online_Linkage)Data, map services, static maps, and applications are among the resource types indexedChannels (thematic communities) post selected browseable content

7

8

How do I publish?Before you can publish metadata in geodata.gov, you need to register as a publisher After your registration is completed, you will have username and password to access the portal as a publisher

9

1. Start registration: Login

2. Register online

10

3. Complete user account information

4. Receive e-mail and confirm registration

5. Read and accept publisher agreement

11

6. Complete publisher registration

Publisher main menu

12

13

Current Publication Options Users may contribute metadata one of three ways: Enter FGDC metadata into a form at

geodata.gov and they are stored and indexed there

Upload metadata as FGDC XML to the geodata.gov site

Register their existing metadata collection to be harvested into the GOS metadata repository

14

metadatacache

geodata.gov

map viewer

metadata

metadata

metadatametadatadata

data

data

data

formentry

XMLupload

search

map services

15

Data Entry Form

If you do not have any FGDC metadata and anticipate only a few records to be published to geodata.gov you can use an online entry form to collect abbreviated FGDC metadata that will be hosted at geodata.gov

16

Upload XML Metadata If you have access to a metadata editor such as ArcCatalog but do not have a Z39.50 server or ArcIMS Metadata Server you can upload a small set of FGDC metadata to geodata.gov

17

Register metadata site(s) to be harvested (must use Internet Explorer 6+)

18

Help files

19

Metadata Validation

Valid values for minimum FGDC:Derived values, for example resource type (Live Map, Downloadable Data…)

In your FGDC Online_Linkage field:

For a OGC Web Map Server, enter: http://myserver/ms?VERSION=1.1.0&REQUEST=getmap&LAYERS=roadsFor an OGC Web Feature Service, enter:http://myserver/fserv?VERSION=1.0.0&SERVICE=WFS&REQUEST=getCapabilitiesFor an ArcIMS image service, enter:http://myserver/image/mymapFor an ArcIMS feature service, enter:https://myserver/feature/myfeaturemap

<onlink>http://mywebsite.org/index.html</onlink>

20

Harvesting Option If you have or would like to maintain a collection of metadata at your site and can let geodata.gov know its location, geodata.gov can ‘harvest’ or fetch new and updated metadata to make it searchable You can describe any type of resource (planned data activity, existing data, a map service, an application, etc.) using your published set of metadata

21

Harvesting options A provider wanting to have content harvested into in geodata.gov can register: Z39.50 “GEO” Metadata server (NSDI

Clearinghouse Node) ArcIMS Metadata Server OAI-PMH (Open Archives Initiative,

Protocol for Metadata Harvest) Web Accessible Folder

22

Harvesting capabilities Harvesting is a scheduled retrieval of metadata from a remote collection, such as an existing Clearinghouse Node The harvester detects new content and brings it into a metadata ‘cache’ at geodata.gov for inclusion in search Scheduling can be established in the registration profile of each provider

23

If you have a Z39.50 Clearinghouse Node

If your metadata collection is served on Z39.50 (such as Isite), you need to implement the newest version of Isite (2.10) Update version for Isite is available at: ftp://ftp.awcubed.com/pub/Software/Isite2/

Other brands of Z39.50 software (Compusult, Intergraph, ESRI, Blue Angel) will be implementing the new features for harvest in coming months

24

Web Accessible Folder Simplest option for publishing moderate numbers of metadata records (<1000) from an organization Create browse-enabled web directory (directory listing view, no default.htm or index.html file present) with FGDC XML and optionally HTML records present Register organization and WAF location with geodata.gov Initial harvest pulls all content, subsequent harvests pull only changed content based on file time-stamps

25

Inclusion Strategy FGDC Staff has been working on an outreach and ‘inclusion’ schedule to get all domestic Clearinghouses (Z39.50 and otherwise) from State/Local, Federal, and Commercial sources Encourage partnerships and community networking to include as many resources as possible

26

Summary StepsIf you have FGDC metadata, get it in XML form and register as a publisherEvaluate a crosswalk of your theme keyword values with ISO CategoriesInsert map service and/or download URLs in your Online_Linkage fields – you may have multiple onlinks!Consider an upgrade of software or change of protocol to be more efficient in your servicesDepending on your site: register to be harvested, use form to enter individual records, or upload multiple XML filesView and test your resources once the registration and publishing is processed using the geodata.gov viewer

27

Metadata harvest counselors

Federal Providers Sharon Shin, sharon_shin@usgs.gov Sharon Maccini, smaccini@usgs.gov

Western States Doug Nebert, ddnebert@fgdc.gov

Intermountain/Great Plains, Northeast States

Matt Orstad, morstad@usgs.gov

Gulf/Southern States Lynda Wayne, lwayne@fgdc.gov

Midwest, Carolinas, Mid-Atlantic States Melissa Wegner, wegner@usgs.gov