a farmers market of open data

https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche

Megan Taylor, UI Developer at Spies/Assassins, volunteer teacher at ScriptEd, news & data junkie, bibliophile, Flyers fan, scifi geek, kitteh servant

• https://github.com/megantaylor/NYCFarmersMarketLocator

• http://megantaylor.github.io/NYCFarmersMarketLocator/index.html

• [email protected]

• @selfmadepsyche

https://github.com/megantaylor/NYCFarmersMarketLocator


http://megantaylor.github.io/NYCFarmersMarketLocator/index.html

mailto:[email protected]


A FARMERS MARKET OF OPEN DATA• What is Open Data?

• Why Open Data?

• What Can Open Data Do?

• What’s Out There?

• Farmers Market App

• Open Data Challenges

• Solutions?



WHAT IS OPEN DATA?

According to the Open Knowledge Foundation…

Open data is data that can be freely used, reused and redistributed by anyone - subject only, at most, to the requirement to attribute and share.



WHAT IS OPEN DATA?

AVAILABILITY AND ACCESS + REUSE AND REDISTRIBUTION + !

UNIVERSAL PARTICIPATION = !

INTEROPERABILITY




• Why Open Data?





• Solutions?



WHY OPEN DATA?

Numerous scientists have pointed out the irony that right at the historical moment when we have the technologies to permit worldwide availability and distributed process of scientific data, broadening collaboration and accelerating the pace and depth of discovery…..we are busy locking up that data and preventing the use of correspondingly advanced technologies on knowledge.

John Wilbanks, VP Science, Creative Commons



WHY OPEN DATA?

My Administration is committed to creating an unprecedented level of openness in Government. We will work together to ensure the public trust and establish a system of transparency, public participation, and collaboration. Openness will strengthen our democracy and promote efficiency and effectiveness in Government.

President Obama, 2009



WHY OPEN DATA?



INTEROPERABILITY



WHY OPEN DATA?

This untapped potential can be unleashed if we turn public government data into open data. This will only happen, however, if it is really open, i.e. if there are no restrictions (legal, financial or technological) to its re-use by others. Every restriction will exclude people from re-using the public data, and make it harder to find valuable ways of doing that. For the potential to be realized, public data needs to be open data.

http://opendatahandbook.org/en/why-open-data/index.html


http://opendatahandbook.org/en/why-open-data/index.html



• Why Open Data?





• Solutions?



WHAT CAN OPEN DATA DO?

http://www.nytimes.com/2013/03/24/nyregion/mayor-bloombergs-geek-squad.html?pagewanted=all&_r=0


http://www.nytimes.com/2013/03/24/nyregion/mayor-bloombergs-geek-squad.html?pagewanted=all&_r=0



http://wheredoesmymoneygo.org


http://wheredoesmymoneygo.org



!

BigApps NYC isn't just a competition – it’s three months of community building. Participants have access to hundreds of data resources, mentors, and partners. The event culminates in a grand showcase in the largest-ever public demo of civic tech.

http://www.nycbigapps.com


http://www.nycbigapps.com



• GPS data alone benefits US economy to the tune of ~$90 billion

• Open weather data supports an estimated $1.5 billion in applications in the secondary insurance market – but much greater value comes from accurate weather predictions, which save the U.S. more than $30 billion annually.

Sources: GPS Innovation Alliance, The Governance Lab @ NYU




• Why Open Data?





• Solutions?



WHATS OUT THERE?!

OPEN DATA AROUND THE WORLD

• 260+ open data portals

• 110+ open data events



WHAT’S OUT THERE?• data.gov

• Socrata

• Infochimps

• Google Public data explorer

• W(eather)underground

• The New York Times

• The Guardian Data Blog


http://data.gov



• Why Open Data?





• Solutions?



FARMERS MARKET APP



FARMERS MARKET APPDATA NEEDED

• location

• open hours

• special closed days?

• special events?

• products?

• misc



FARMERS MARKET APP

EFF SCRAPING • Farmers Market data from the State of New York

https://data.ny.gov/

• More Farmers Market data from the USDA http://search.ams.usda.gov/farmersmarkets/v1/svcdesc.html


https://data.ny.gov/

http://search.ams.usda.gov/farmersmarkets/v1/svcdesc.html


USDA FARMERS MARKET DATA

{"results"[ {"id":"1000087","marketname":"0.2 Sunnyside Greenmarket"},{"id":"1009304","marketname":"0.7 Orchard Farmers Market"}, ]}



USDA FARMERS MARKET DATA{"marketdetails":{ "Address":"Skillman - 42 & 43 Sts, Queens, New York, 11104", "GoogleLink":"http:\/\/maps.google.com\/?q=40.746899%2C%20-73.921230%20(%22Sunnyside+Greenmarket%22)", "Products":"Baked goods; Cheese and\/or dairy products; Eggs; Fish and\/or seafood; Fresh fruit and vegetables; Honey; Canned or preserved fruits, vegetables, jams, jellies, preserves, salsas, pickles, dried fruit, etc.; Meat; Poultry; Wine, beer, hard cider","Schedule":"06\/01\/2013 to 12\/21\/2013 Sat: 8:00 AM-3:00 PM;<br> <br> <br> " }}



DATA.NY.GOV


http://DATA.NY.GOV


DATA.NY.GOV{ "market_name" : "Sunnyside Greenmarket", "zip" : "11104", "phone" : "2127887476", "operation_hours" : "Saturday 8am-3pm", "location" : "Skillman Ave., btwn 42nd & 43rd Sts.", "location_points" : { "needs_recoding" : false, "longitude" :"-73.92173", "latitude" : "40.74699" }, "state" : "NY",

"market_link" : { "url" : "http://www.grownyc.org" }, "contact" : "Chelsea Whittaker", "city" : "Sunnyside", "address_line_1" : "Skillman Ave and 42nd St", "county" : "Queens", "fmnp" : "Y", "operation_season" : "May 10 - December 20", "longitude" : "-73.92173", "latitude" : "40.74699"}


http://DATA.NY.GOV


FARMERS MARKET APP



FARMERS MARKET APP

• Messy USDA data, how to clean it up?

• Multiple data sources, how to merge?



GROW NYC




• Why Open Data?





• Solutions?



OPEN DATA CHALLENGES

For developers

• Formats

• Definitions

• Standards

• Guidelines

• Quality




For non-technical users

• Technical

• Economic

• Socio-cultural

For activists

• Low civil engagement



Findability precedes usability. In the alphabet and on the Web. You can’t use what you can’t find.

Peter Morville, President of Semantic Studios, an information architecture and findability consulting firm




OPEN DATA CHALLENGES• data.gov

• Socrata

• Infochimps

• Google Public data explorer

• W(eather)underground

• The New York Times

• The Guardian Data Blog


http://data.gov



For providers

• Audience

• Definitions

• Intermediaries

• Funding and sustainability

• Quality





INTEROPERABILITY




• Why Open Data?





• Solutions?



SOLUTIONS?

2013 OPEN DATA POLICY MANAGING INFORMATION AS AN ASSET

The White House developed Project Open Data – this collection of code, tools, and case studies – to help agencies adopt the Open Data Policy and unlock the potential of government data.

http://project-open-data.github.io/


http://project-open-data.github.io/


SOLUTIONS?• Time

• Data journalism in 2006 vs today

• Research

• Education / Awareness

• http://sunlightfoundation.com/opendataguidelines/

• http://schoolofdata.org/courses/

• What else?


http://sunlightfoundation.com/opendataguidelines/

http://schoolofdata.org/courses/


HALP

• https://github.com/megantaylor/NYCFarmersMarketLocator

• http://megantaylor.github.io/NYCFarmersMarketLocator/index.html

• [email protected]

• @selfmadepsyche



http://megantaylor.github.io/NYCFarmersMarketLocator/index.html

mailto:[email protected]

a farmers market of open data

Technology

farmers market of open

public data needs

turnpublic government

news data junkie

reusingthe public data

public participation

kitteh servant https

universal participation