a farmers market of open data

https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche

Megan Taylor, UI Developer at Spies/Assassins, volunteer teacher at ScriptEd, news & data junkie, bibliophile, Flyers fan, scifi geek, kitteh servant

• https://github.com/megantaylor/NYCFarmersMarketLocator

• http://megantaylor.github.io/NYCFarmersMarketLocator/index.html

• mtaylor@megantaylor.org

• @selfmadepsyche

A FARMERS MARKET OF OPEN DATA• What is Open Data?

• Why Open Data?

• What Can Open Data Do?

• What’s Out There?

• Farmers Market App

• Open Data Challenges

• Solutions?

• Why Open Data?

• Solutions?

WHAT IS OPEN DATA?

According to the Open Knowledge Foundation…

Open data is data that can be freely used, reused and redistributed by anyone - subject only, at most, to the requirement to attribute and share.

WHAT IS OPEN DATA?

AVAILABILITY AND ACCESS + REUSE AND REDISTRIBUTION + !

UNIVERSAL PARTICIPATION = !

INTEROPERABILITY

• Why Open Data?

• Solutions?

WHY OPEN DATA?

Numerous scientists have pointed out the irony that right at the historical moment when we have the technologies to permit worldwide availability and distributed process of scientific data, broadening collaboration and accelerating the pace and depth of discovery…..we are busy locking up that data and preventing the use of correspondingly advanced technologies on knowledge.

John Wilbanks, VP Science, Creative Commons

WHY OPEN DATA?

My Administration is committed to creating an unprecedented level of openness in Government. We will work together to ensure the public trust and establish a system of transparency, public participation, and collaboration. Openness will strengthen our democracy and promote efficiency and effectiveness in Government.

President Obama, 2009

WHY OPEN DATA?

INTEROPERABILITY

WHY OPEN DATA?

This untapped potential can be unleashed if we turn public government data into open data. This will only happen, however, if it is really open, i.e. if there are no restrictions (legal, financial or technological) to its re-use by others. Every restriction will exclude people from re-using the public data, and make it harder to find valuable ways of doing that. For the potential to be realized, public data needs to be open data.

http://opendatahandbook.org/en/why-open-data/index.html

• Why Open Data?

• Solutions?

WHAT CAN OPEN DATA DO?

http://www.nytimes.com/2013/03/24/nyregion/mayor-bloombergs-geek-squad.html?pagewanted=all&_r=0

http://wheredoesmymoneygo.org

BigApps NYC isn't just a competition – it’s three months of community building. Participants have access to hundreds of data resources, mentors, and partners. The event culminates in a grand showcase in the largest-ever public demo of civic tech.

http://www.nycbigapps.com

• GPS data alone benefits US economy to the tune of ~$90 billion

• Open weather data supports an estimated $1.5 billion in applications in the secondary insurance market – but much greater value comes from accurate weather predictions, which save the U.S. more than $30 billion annually.

Sources: GPS Innovation Alliance, The Governance Lab @ NYU

• Why Open Data?

• Solutions?

WHATS OUT THERE?!

OPEN DATA AROUND THE WORLD

• 260+ open data portals

• 110+ open data events

WHAT’S OUT THERE?• data.gov

• Socrata

• Infochimps

• Google Public data explorer

• W(eather)underground

• The New York Times

• The Guardian Data Blog

• Why Open Data?

• Solutions?

FARMERS MARKET APP

FARMERS MARKET APPDATA NEEDED

• location

• open hours

• special closed days?

• special events?

• products?

• misc

FARMERS MARKET APP

EFF SCRAPING • Farmers Market data from the State of New York

https://data.ny.gov/

• More Farmers Market data from the USDA http://search.ams.usda.gov/farmersmarkets/v1/svcdesc.html

USDA FARMERS MARKET DATA

{"results"[ {"id":"1000087","marketname":"0.2 Sunnyside Greenmarket"},{"id":"1009304","marketname":"0.7 Orchard Farmers Market"}, ]}

USDA FARMERS MARKET DATA{"marketdetails":{ "Address":"Skillman - 42 & 43 Sts, Queens, New York, 11104", "GoogleLink":"http:\/\/maps.google.com\/?q=40.746899%2C%20-73.921230%20(%22Sunnyside+Greenmarket%22)", "Products":"Baked goods; Cheese and\/or dairy products; Eggs; Fish and\/or seafood; Fresh fruit and vegetables; Honey; Canned or preserved fruits, vegetables, jams, jellies, preserves, salsas, pickles, dried fruit, etc.; Meat; Poultry; Wine, beer, hard cider","Schedule":"06\/01\/2013 to 12\/21\/2013 Sat: 8:00 AM-3:00 PM;<br> <br> <br> " }}

DATA.NY.GOV

DATA.NY.GOV{ "market_name" : "Sunnyside Greenmarket", "zip" : "11104", "phone" : "2127887476", "operation_hours" : "Saturday 8am-3pm", "location" : "Skillman Ave., btwn 42nd & 43rd Sts.", "location_points" : { "needs_recoding" : false, "longitude" :"-73.92173", "latitude" : "40.74699" }, "state" : "NY",

"market_link" : { "url" : "http://www.grownyc.org" }, "contact" : "Chelsea Whittaker", "city" : "Sunnyside", "address_line_1" : "Skillman Ave and 42nd St", "county" : "Queens", "fmnp" : "Y", "operation_season" : "May 10 - December 20", "longitude" : "-73.92173", "latitude" : "40.74699"}

FARMERS MARKET APP

• Messy USDA data, how to clean it up?

• Multiple data sources, how to merge?

GROW NYC

• Why Open Data?

• Solutions?

OPEN DATA CHALLENGES

For developers

• Formats

• Definitions

• Standards

• Guidelines

• Quality

For non-technical users

• Technical

• Economic

• Socio-cultural

For activists

• Low civil engagement

Findability precedes usability. In the alphabet and on the Web. You can’t use what you can’t find.

Peter Morville, President of Semantic Studios, an information architecture and findability consulting firm

OPEN DATA CHALLENGES• data.gov

• Socrata

• Infochimps

• Google Public data explorer

• W(eather)underground

• The New York Times

• The Guardian Data Blog

For providers

• Audience

• Definitions

• Intermediaries

• Funding and sustainability

• Quality

INTEROPERABILITY

• Why Open Data?

• Solutions?

SOLUTIONS?

2013 OPEN DATA POLICY MANAGING INFORMATION AS AN ASSET

The White House developed Project Open Data – this collection of code, tools, and case studies – to help agencies adopt the Open Data Policy and unlock the potential of government data.

http://project-open-data.github.io/

SOLUTIONS?• Time

• Data journalism in 2006 vs today

• Research

• Education / Awareness

• http://sunlightfoundation.com/opendataguidelines/

• http://schoolofdata.org/courses/

• What else?

• https://github.com/megantaylor/NYCFarmersMarketLocator

• http://megantaylor.github.io/NYCFarmersMarketLocator/index.html

• mtaylor@megantaylor.org

• @selfmadepsyche

a farmers market of open data

farmers market of open

public data needs

turnpublic government

news data junkie

reusingthe public data

public participation

kitteh servant https

universal participation

Technology

ubc farmers’ market

farmers market update

farmers market ad

farmers market — meals

columbus farmers market

downtown development authority agenda thursday, february...

farmington farmers' market

portland farmers market

alaska farmers alaska farmers south central markets ... ·...

farmers market federal grants daniel blaustein rejto farmers...

farmers’ market regulations farmers’ market entrepreneur

farmers market

farmers' market ebt news -...

farmers market rfp

farmers market - ogdencity.com

farmers’ market entrepreneur

farmers market cd

farmers’ market recipes farmers’ market recipes …

hubbards farmers’ market

bestpracticevillage farmers market