how can you use fme to power your open data initiative?

CONNECT. TRANSFORM. AUTOMATE.

Use FME to power yourOpen Data InitiativeBrett Lord-CastilloGIS Programmer, St Louis County

Open Data Definitions

Open Licensing Machine Readable Open Format Bulk Access Discoverable (http://okfn.org/opendata/) (http://opendefinition.org/od/)

Open Formats

Shapefile

CSV

GeoJSON

TopoJSON?

(Yes, there are other options)

Bulk Access

Self-Host

Socrata

CKAN/DKAN

GitHub? Yes, GitHub

File Geodatabase to Socrata

Writing to https://communities.socrata.com/catalog/rhok-st-louis

Just a reader and a writer Edit writer feature types Pay attention to your geometry column

We get a little bit crazy

Three different datasets

Vague attribute names

Some records are in the wrong projection!

This is Not Alternative UniverseSt Louis County

File Geodatabase to GeoJSON

Live Demo!

Live Demo!

Live Demo!

ArcSDE to GeoJSONWe get more than a little bit crazy

One Writer to rule them all

Remove all sorts of attributes

Use fme_feature_type to fanout

(Not crazy enough to do this live)

But we can do this live!

Modify ToSocrata workbench to write GeoJSON1. Copy transformers and dynamic GeoJSON writer

from last workbench2. Remove the SubstringExtractor3. Edit writer Advanced Properties

Destination Fanout Attribute

4. Run?

So you have an error…

Remember to set your Dynamic Properties too!

This error fixed by adding Schema Sources

Bringing into GitHub (simple)

Go to GitHub repository online

Create a new file

It’s text! Copy-paste!

Save with .json extension

Go to your file and see the pretty!

Bringing into GitHub (less simple)

Use a client

https://windows.github.com/

https://mac.github.com/

Or use git

Zip big files! (or post-process with TopoJSON)

https://github.com/mbostock/topojson

Wishlist

Publish to GitHub API Git?

README.md writer Write a text file in markdown

TopoJSON writer Publish Metadata to Socrata

Might be a bit more complicated

Thank You!

Questions?

For more information: Brett Lord-Castillo:blord-castillo@stlouisco.com St Louis County Emergency Management @blordcastillo http://github.com/blordcastillo http://github.com/marigolds6