Smart Cities, Open Data and SMW

SMWCon Spring 2012Carlsbad, CA

http://www.thecardiffkook.org/blog/blog/

http://www.thecardiffkook.org/blog/blog/

http://www.thecardiffkook.org/blog/blog/

http://www.thecardiffkook.org/blog/blog/

http://www.thecardiffkook.org/blog/blog/

http://www.thecardiffkook.org/blog/blog/

http://www.thecardiffkook.org/blog/blog/

http://www.thecardiffkook.org/blog/blog/

http://www.thecardiffkook.org/blog/blog/

http://www.thecardiffkook.org/blog/blog/

Confidential Copyright © 2011 MCUBE Technologies8

!e ComingData Tsunami!!!

Confidential Copyright © 2011 MCUBE Technologies8

Background

Citywide  Events  CalendarElectronics  StoresParking  Facili7esSidewalk  CafesLaundry  Facili7esFinancial  Empowerment  CentersIPIS  (Integrated  Property  Informa7on  System)City  government  retrofit  projectsNYC  Civil  Service  TitlesNYC  Department  of  Educa7on  Job  TitlesLis7ng  of  cultural  organiza7ons  with  vital  statsPrograms  Funding  for  FY2010Completed  Percent  for  Art  projects  with  ar7st  informa7onDemographic,  Social,  Economic,  and  Housing  Profiles  by  BoroughDemographic,  Social,  Economic,  and  Housing  Profiles  by  Community  District/PUMALION:  single  line  street  base  map  GIS:  ESRI  Geo-­‐databaseLION:  single  line  street  base  map  GIS:  MapInfo  TableZoning  GIS  Data:  ESRI  Shape  fileZoning  GIS  Data:  ESRI  Geo-­‐databasePoli7cal  &  Elec7on  Districts  GIS:  State  Assembly  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  City  Council  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  Congressional  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  State  Senate  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  Elec7on  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  Municipal  Court  DistrictsBorough  &  Community  Districts  GIS:  BoroughsBorough  &  Community  Districts  GIS:  Boroughs  (Water  Areas  Included)Borough  &  Community  Districts  GIS:  Community  DistrictsSchool,  Health,  Fire  &  Police  GIS:  School  DistrictsSchool,  Health,  Fire  &  Police  GIS:  Fire  CompaniesSchool,  Health,  Fire  &  Police  GIS:  Fire  Ba\alionsSchool,  Health,  Fire  &  Police  GIS:  Fire  DivisionsSchool,  Health,  Fire  &  Police  GIS:  Police  PrecinctsSchool,  Health,  Fire  &  Police  GIS:  Health  Center  DistrictsSchool,  Health,  Fire  &  Police  GIS:  Health  Areas2000  Census  Blocks  &  Tracts  GIS:  2000  Census  Tracts2000  Census  Blocks  &  Tracts  GIS:  2000  Census  Tracts  (water  areas  included)2000  Census  Blocks  &  Tracts  GIS:  2000  Census  Blocks2000  Census  Blocks  &  Tracts  GIS:  2000  Census  Blocks  (water  areas  included)Areas  of  Interest  GISNeighborhood  Names  GISProjec7on  Areas  GIS  (depicted  in  PLANYC  2030)Property  Address  DirectorySelected  Facili7es  and  Program  Sites:  AccessSelected  Facili7es  and  Program  Sites:  TextNYC  Popula7on  Age/Sex  Projec7on  by  Borough  2000  -­‐  2030Privately  Owned  Public  SpacesFRESH  Street  name  Dic7onaryNodes  FileLION  Differences  FilePublicly  Accessible  Waterfront  Spaces  (PAWS)  DatabasePublicly  Accessible  Waterfront  Spaces  (PAWS)  ShapefileNYC  Waterfront  Parks  ShapefileProperty  Data  (Buildings  Informa7on  System)Building  License  FeesAc7ve  Building  JobsAc7ve  PermitsComplaintsProperty  valua7on  and  assessment  dataProperty  valua7on  and  assessment  dataProperty  valua7on  and  assessment  dataParking  TicketsAnnualized  Rolling  Sales  UpdateDOF  Statement  of  account  (Queens)DOF  Statement  of  account  (Brooklyn)DOF  Statement  of  account  (Manha\an)DOF  Statement  of  account  (Bronx)DOF  Statement  of  account  (Staten  Island)Open  Balance  (Queens)Open  Balance  (Brooklyn)Open  Balance  (Manha\an)Open  Balance  (Bronx)Open  Balance  (Staten  Island)Community  Health  Survey  (GIS  data)World  Trade  Center  Health  RegistryHealth  and  Nutri7on  Examina7on  Survey  resultsRestaurant  inspec7on  resultsCommunity  Health  Survey  (SAS  data)2008  birth  names  (Bronx)2008  birth  names  (Brooklyn)2008  birth  names  (Manha\an)2008  birth  names  (Queens)2008  birth  names  (Staten  Island)Aber-­‐School  ProgramsAgency  Service  CenterAirport  PointAirport  Polygon  (City  Airport  Runways)JFK  AirtrainJFK  Airtrain  Sta7on  Loca7onsBuilding  Perimeter  OutlinesBusiness  Improvement  District  BoundariesBasic  Descrip7on  of  Colleges  and  Universi7esCity  Day  Care  Center  Loca7onsFerry  Terminal  Loca7onsGreen  Market  Loca7onsLibrary  Loca7onsNew  Jersey  transit  New  Jersey  Transit  Sta7onsPath  Sta7on  Loca7onsPath  trainPost  Office  Loca7onsSenior  Center  Loca7onsUniversal  Pre-­‐K  Loca7onsWife  Hotspot  Loca7onsZip  Code  BoundariesBoardwalk  FeaturesEleva7on  pointsHydrography  (Water  Features)Hydrography  Structures  (Piers,  Seawalls)Roadway  Median  FeaturesOpen  Spaces  (Parks,  Courts,  Tracks,  Cemetery  Outlines)Parking  Lot  FeaturesPavement  Edge  LinesRailroad  FeaturesRoadbedShoreline  FeaturesSidewalk  FeaturesStreet  CenterlineTransporta7on  StructuresArt  GalleriesBotanical  GardensClassical  MusicDOITT  TheaterDSNY  Special  WasteDYCD  BeaconDYCD  FatherhoodDYCD  LiteracyDYCD  OSY  (Out-­‐of-­‐School  Youth)DYCD  RHY  (Runaway  and  Homeless  Youth)  ServicesDYCD  SYEP  (Summer  Youth  Employment)DYCD  YAIP  (Young  Adult  Internship  Programs)Empire  ZonesEmpower  ZonesGreenthumbLPC  Landmark  DistrictsLPC  Landmark  InteriorsLPC  Landmark  PointsMINY  VendorsMuseums  and  GalleriesNYCHA  PSA  (Police  Service  Areas)OACE  (Office  of  Adult  and  Con7nuing  Educa7on)  SitesSubway  EntrancesSubway  LinesSubway  Sta7onsSubway  Transfer311  Street  Signs311  Taxi  Complaints311  Damaged  Trees311  Broken  Parking  Meters311  Consumer  ComplaintsCitywide  Performance  Report  Public  IndicatorsNYC  Feedback  Citywide  Customer  SurveyStreet  Condi7ons  Observa7on  Unit  (SCOUT/311)Mul7-­‐Agency  ReportNYPD  Public  IndicatorsFederal  S7mulus  UsageWeekday  Traffic  UpdatesWeekend  Traffic  UpdatesSpecial  Traffic  UpdatesWeekly  Resurfacing  ScheduleBicycle  ParkingAlternate  Side  ParkingMunicipal  Parking  Facili7es  (Bronx)Municipal  Parking  Facili7es  (Brooklyn)Municipal  Parking  Facili7es  (Manha\an)Municipal  Parking  Facili7es  (Queens)Municipal  Parking  Facili7es  (Staten  Island)Citywide  Low  BridgesNYC  Truck  Routes  (Local  and  Thru  maps)Parking  Regula7ons  (Loca7ons  File)Parking  Regula7ons  (Signs  File)Street  Network  changesReal-­‐Time  Traffic  Speed  DataReal-­‐Time  Traffic  Speed  DataCalendar  of  Citywide  Fes7vals    Calendar  of  Special  Events    Directory  of  Barbecuing  Areas    Directory  of  Basketball  Courts    Directory  of  Beaches    Directory  of  Boa7ng  and  Marinas    Directory  of  Dog  Runs    and  Off-­‐Leash  AreasDirectory  of  Handball  Courts    Directory  of  Hiking  Trails    Directory  of  Historic  Houses        Directory  of  Horseback  Riding  Trails    Directory  of  Ice  Ska7ng  Rinks    Directory  of  Nature  Centers    Directory  of  Parks  Disability  Accessibility  Facili7es  and  Programs        Directory  of  Playgrounds    Directory  of  Public  Computer  Resource  Centers    Directory  of  Recrea7on  Centers    Directory  of  Running  Tracks    Directory  of  Swimming  Pools    Directory  of  Tennis  Courts    Directory  of  Zoos  and  Aquariums    List  of  capital  projectsMap  of  Baseball  and  Sobball  DiamondsMap  of  BeachesMap  of  Handball  CourtsMap  of  ParksMap  of  PoolsMap  of  SprayshowersMap  of  Basketball  CourtsMap  of  Golf  CoursesMap  of  Mul7purpose  FieldsMap  of  PlaygroundsMap  of  Soccer  and  Football  FieldsMap  of  Tennis  CourtsMap  of  Water  FountainsMap  of  TracksStreet  Tree  Census  (Bronx)Street  Tree  Census  (Brooklyn)Street  Tree  Census  (Manha\an)Street  Tree  Census  (Queens)Street  Tree  Census  (Staten  Island)Nature  PreservesDirectory  of  EateriesDirectory  of  Temporary  Public  ArtDirectory  Historical  SignsPark  Closure  No7fica7onsPress  ReleasesMap  of  Access  PointsMap  of  BathroomsMap  of  kayak  and  canoe  launchesMap  of  monumentsDirectory  of  Nature  PreservesRecycling  Diversion  and  Capture  RatesSpecial  Waste  Drop-­‐off  SitesGraffi7  Loca7onsDSNY's  Refuse  and  Recycling  Disposal  NetworksCollec7on  Tonnages  DYCD  ProgramsPrimary  Commercial  Zoning  by  lotPrimary  Manufacturing  Zoning  by  lotPrimary  Residen7al  Zoning  by  lotProject  loca7onsFDNY  Monthly  response  7meFDNY  community  board  incident  countFDNY  fire  housesLa7n  media  and  entertainment  events,  organiza7ons,  and  companiesHistoric  district  mapsNYC  LandmarksProduc7on  office  spaceLocal  Film  Fes7valsRecording  StudiosFilming  loca7ons  (Scenes  from  the  City)Hurricane  evacua7on  zonesHurricane  evacua7on  centers911  receiving  hospitalsNursing  homesFerry  terminalsCommunity  Emergency  Response  Team  (CERT)Snow  emergency  routesBrooklyn  Public  Library  CatalogBPL  Electronic  ResourcesBPL  BranchesBPL  Events  CalendarCalendar  of  Library  Events:  Classes  and  PerformancesNYPL  BlogsLibrary  Exhibi7ons    Queens  Public  Library  Hours  and  Loca7onsOnline  directory  of  cer7fied  businesses  with  a  detailed  profileBlack  Car  basesCommuter  Van  Authoriza7onsCommuter  Van  DriversCommuter  VansLuxury  Limousine  BasesLuxury  Limousine  VehiclesCommunity  Car  service  basesCommunity  Car  Service  VehiclesParatransit  BasesParatransit  DriversParatransit  VehiclesCurrent  Medallion  DriversCurrent  MedallionsCurrent  FHV  DriversVehicle  InsuranceApproved  registrants  in  the  wholesale  marketsApproved  licensees  and  registrants  for  trade  wasteDenied  licensees  and  registrants  for  trade  wasteDenied  registrants  in  the  wholesale  marketsCCRB  Sta7s7cal  Appendix  ACCRB  Sta7s7cal  Appendix  BCCRB  Sta7s7cal  Appendix  CElec7on  2013  Contribu7onsElec7on  2013  ExpendituresElec7on  2009  Contribu7onsElec7on  2009  ExpendituresElec7on  2009  Public  Funds  PaymentsElec7on  2005  Contribu7onsElec7on  2005  ExpendituresElec7on  2005  Public  Funds  PaymentsElec7on  2003  Contribu7onsElec7on  2003  ExpendituresElec7on  2003  Public  Funds  PaymentsElec7on  2001  Contribu7onsElec7on  2001  ExpendituresElec7on  2001  Public  Funds  PaymentsWomen's  organiza7ons  database                                                                                          Awarded  Construc7on  ContractsFuture  Construc7on  ContractsEmployment  Opportuni7esNYC  City  Hall  Library  CatalogNYC  City  Hall  Library  Publica7onsRudy  W.  Giuliani,  1994-­‐2001Board  of  Educa7on,  1934-­‐2002Chancellor  of  NYC  Board  of  Educa7on,  1970-­‐1989Cultural  Ins7tu7ons  by  block  and  lot  Parks  by  block  and  lot  Retailers  by  block  and  lot  with  Wi-­‐Fi  loca7ons  Quality  of  Life  IndicatorsReal  Estate  Market  indicatorsBike  rack  loca7ons  Building  types  by  block  and  lot  Canyon  of  Heroes  Heritage  Trail  markers  Hotel  –  number  of  rooms,  development  status  Orienta7on  poles  Residen7al  Data  with  number  of  units,  type  of  development,  development  status  Streetlights  Wayfinding  Health  Insurance  Enrollment  SitesAssembly  district  breakdownsCommunity  district  breakdownsCongress  district  breakdownsCouncil  district  breakdownNeighborhood  development  area  breakdownsSchool  district  breakdownsSenate  district  breakdownsZip  code  breakdownsNYC  Budget  Expense  City  FundsNYC  Budget  RevenueNYC  Budget  Revenue  Addi7onalNYC  Capital  All  FundsNYC  Capital  City  FundsNYCHA  Community  Facili7es  NYCHA  Public  Housing  DevelopmentsPrequalified  firmsDisqualified  firmsUpcoming  contracts  to  be  awardedProjects  in  construc7onBronx  2009  TC  Reduc7onsBrooklyn  2009  TC  Reduc7onsManha\an  2009  TC  Reduc7onsQueens2009  TC  Reduc7onsStaten  Island  2009  TC  Reduc7onsBronx  Open  Ar7cle  7  Pe77onsBrooklyn  Open  Ar7cle  7  Pe77onsManha\an  Open  Ar7cle  7  Pe77onsQueens  Open  Ar7cle  7  Pe77onsStaten  Island  Open  Ar7cle  7  Pe77onsGTFS  Schedule  dataNew  York  City  Transit  -­‐  Bus  ScheduleNew  York  City  Transit  -­‐  Train  ScheduleLong  Island  Rail  Road  scheduleMetro-­‐North  RailroadLong  Island  BusBus  CompanyCurrent  Service  StatusNYC  Transit  Elevator/Escalator  StatusTag/Field  defini7ons  for  XML  fieldMTA  all  agency  performance  dataNYC  Transit  turns7le  dataBridges  and  Tunnels  Daily  Plaza  traffic  dataSubway  entrance  and  exit  GIS  dataWater  reservoir  levelsWatershed  sta7s7cs  DEP  CPR  Cri7cal  indicatorsWatershed  sta7s7cs  Land  coverReservoir  and  Dam  sta7s7csHydrostatsTSA  Entertainment  venuesTSA  Food  and  Beverage  loca7onsTSA  HotelsTSA  screensTSA  pedestrian  countsLincoln  Square  BID  Business  ListMuseums  and  galleriesCity  government  retrofit  projectsSchool  Point  Loca7onsSchool  Zones2009  School  Survey2010  School  Survey

Citywide  Events  CalendarElectronics  StoresParking  Facili7esSidewalk  CafesLaundry  Facili7esFinancial  Empowerment  CentersIPIS  (Integrated  Property  Informa7on  System)City  government  retrofit  projectsNYC  Civil  Service  TitlesNYC  Department  of  Educa7on  Job  TitlesLis7ng  of  cultural  organiza7ons  with  vital  statsPrograms  Funding  for  FY2010Completed  Percent  for  Art  projects  with  ar7st  informa7onDemographic,  Social,  Economic,  and  Housing  Profiles  by  BoroughDemographic,  Social,  Economic,  and  Housing  Profiles  by  Community  District/PUMALION:  single  line  street  base  map  GIS:  ESRI  Geo-­‐databaseLION:  single  line  street  base  map  GIS:  MapInfo  TableZoning  GIS  Data:  ESRI  Shape  fileZoning  GIS  Data:  ESRI  Geo-­‐databasePoli7cal  &  Elec7on  Districts  GIS:  State  Assembly  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  City  Council  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  Congressional  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  State  Senate  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  Elec7on  DistrictsPoli7cal  &  Elec7on  Districts  GIS:  Municipal  Court  DistrictsBorough  &  Community  Districts  GIS:  BoroughsBorough  &  Community  Districts  GIS:  Boroughs  (Water  Areas  Included)Borough  &  Community  Districts  GIS:  Community  DistrictsSchool,  Health,  Fire  &  Police  GIS:  School  DistrictsSchool,  Health,  Fire  &  Police  GIS:  Fire  CompaniesSchool,  Health,  Fire  &  Police  GIS:  Fire  Ba\alionsSchool,  Health,  Fire  &  Police  GIS:  Fire  DivisionsSchool,  Health,  Fire  &  Police  GIS:  Police  PrecinctsSchool,  Health,  Fire  &  Police  GIS:  Health  Center  DistrictsSchool,  Health,  Fire  &  Police  GIS:  Health  Areas2000  Census  Blocks  &  Tracts  GIS:  2000  Census  Tracts2000  Census  Blocks  &  Tracts  GIS:  2000  Census  Tracts  (water  areas  included)2000  Census  Blocks  &  Tracts  GIS:  2000  Census  Blocks2000  Census  Blocks  &  Tracts  GIS:  2000  Census  Blocks  (water  areas  included)Areas  of  Interest  GISNeighborhood  Names  GISProjec7on  Areas  GIS  (depicted  in  PLANYC  2030)Property  Address  DirectorySelected  Facili7es  and  Program  Sites:  AccessSelected  Facili7es  and  Program  Sites:  TextNYC  Popula7on  Age/Sex  Projec7on  by  Borough  2000  -­‐  2030Privately  Owned  Public  SpacesFRESH  Street  name  Dic7onaryNodes  FileLION  Differences  FilePublicly  Accessible  Waterfront  Spaces  (PAWS)  DatabasePublicly  Accessible  Waterfront  Spaces  (PAWS)  ShapefileNYC  Waterfront  Parks  ShapefileProperty  Data  (Buildings  Informa7on  System)Building  License  FeesAc7ve  Building  JobsAc7ve  PermitsComplaintsProperty  valua7on  and  assessment  dataProperty  valua7on  and  assessment  dataProperty  valua7on  and  assessment  dataParking  TicketsAnnualized  Rolling  Sales  UpdateDOF  Statement  of  account  (Queens)DOF  Statement  of  account  (Brooklyn)DOF  Statement  of  account  (Manha\an)DOF  Statement  of  account  (Bronx)DOF  Statement  of  account  (Staten  Island)Open  Balance  (Queens)Open  Balance  (Brooklyn)Open  Balance  (Manha\an)Open  Balance  (Bronx)Open  Balance  (Staten  Island)Community  Health  Survey  (GIS  data)World  Trade  Center  Health  RegistryHealth  and  Nutri7on  Examina7on  Survey  resultsRestaurant  inspec7on  resultsCommunity  Health  Survey  (SAS  data)2008  birth  names  (Bronx)2008  birth  names  (Brooklyn)2008  birth  names  (Manha\an)2008  birth  names  (Queens)2008  birth  names  (Staten  Island)Aber-­‐School  ProgramsAgency  Service  CenterAirport  PointAirport  Polygon  (City  Airport  Runways)JFK  AirtrainJFK  Airtrain  Sta7on  Loca7onsBuilding  Perimeter  OutlinesBusiness  Improvement  District  BoundariesBasic  Descrip7on  of  Colleges  and  Universi7esCity  Day  Care  Center  Loca7onsFerry  Terminal  Loca7onsGreen  Market  Loca7onsLibrary  Loca7onsNew  Jersey  transit  New  Jersey  Transit  Sta7onsPath  Sta7on  Loca7onsPath  trainPost  Office  Loca7onsSenior  Center  Loca7onsUniversal  Pre-­‐K  Loca7onsWife  Hotspot  Loca7onsZip  Code  BoundariesBoardwalk  FeaturesEleva7on  pointsHydrography  (Water  Features)Hydrography  Structures  (Piers,  Seawalls)Roadway  Median  FeaturesOpen  Spaces  (Parks,  Courts,  Tracks,  Cemetery  Outlines)Parking  Lot  FeaturesPavement  Edge  LinesRailroad  FeaturesRoadbedShoreline  FeaturesSidewalk  FeaturesStreet  CenterlineTransporta7on  StructuresArt  GalleriesBotanical  GardensClassical  MusicDOITT  TheaterDSNY  Special  WasteDYCD  BeaconDYCD  FatherhoodDYCD  LiteracyDYCD  OSY  (Out-­‐of-­‐School  Youth)DYCD  RHY  (Runaway  and  Homeless  Youth)  ServicesDYCD  SYEP  (Summer  Youth  Employment)DYCD  YAIP  (Young  Adult  Internship  Programs)Empire  ZonesEmpower  ZonesGreenthumbLPC  Landmark  DistrictsLPC  Landmark  InteriorsLPC  Landmark  PointsMINY  VendorsMuseums  and  GalleriesNYCHA  PSA  (Police  Service  Areas)OACE  (Office  of  Adult  and  Con7nuing  Educa7on)  SitesSubway  EntrancesSubway  LinesSubway  Sta7onsSubway  Transfer311  Street  Signs311  Taxi  Complaints311  Damaged  Trees311  Broken  Parking  Meters311  Consumer  ComplaintsCitywide  Performance  Report  Public  IndicatorsNYC  Feedback  Citywide  Customer  SurveyStreet  Condi7ons  Observa7on  Unit  (SCOUT/311)Mul7-­‐Agency  ReportNYPD  Public  IndicatorsFederal  S7mulus  UsageWeekday  Traffic  UpdatesWeekend  Traffic  UpdatesSpecial  Traffic  UpdatesWeekly  Resurfacing  ScheduleBicycle  ParkingAlternate  Side  ParkingMunicipal  Parking  Facili7es  (Bronx)Municipal  Parking  Facili7es  (Brooklyn)Municipal  Parking  Facili7es  (Manha\an)Municipal  Parking  Facili7es  (Queens)Municipal  Parking  Facili7es  (Staten  Island)Citywide  Low  BridgesNYC  Truck  Routes  (Local  and  Thru  maps)Parking  Regula7ons  (Loca7ons  File)Parking  Regula7ons  (Signs  File)Street  Network  changesReal-­‐Time  Traffic  Speed  DataReal-­‐Time  Traffic  Speed  DataCalendar  of  Citywide  Fes7vals    Calendar  of  Special  Events    Directory  of  Barbecuing  Areas    Directory  of  Basketball  Courts    Directory  of  Beaches    Directory  of  Boa7ng  and  Marinas    Directory  of  Dog  Runs    and  Off-­‐Leash  AreasDirectory  of  Handball  Courts    Directory  of  Hiking  Trails    Directory  of  Historic  Houses        Directory  of  Horseback  Riding  Trails    Directory  of  Ice  Ska7ng  Rinks    Directory  of  Nature  Centers    Directory  of  Parks  Disability  Accessibility  Facili7es  and  Programs        Directory  of  Playgrounds    Directory  of  Public  Computer  Resource  Centers    Directory  of  Recrea7on  Centers    Directory  of  Running  Tracks    Directory  of  Swimming  Pools    Directory  of  Tennis  Courts    Directory  of  Zoos  and  Aquariums    List  of  capital  projectsMap  of  Baseball  and  Sobball  DiamondsMap  of  BeachesMap  of  Handball  CourtsMap  of  ParksMap  of  PoolsMap  of  SprayshowersMap  of  Basketball  CourtsMap  of  Golf  CoursesMap  of  Mul7purpose  FieldsMap  of  PlaygroundsMap  of  Soccer  and  Football  FieldsMap  of  Tennis  CourtsMap  of  Water  FountainsMap  of  TracksStreet  Tree  Census  (Bronx)Street  Tree  Census  (Brooklyn)Street  Tree  Census  (Manha\an)Street  Tree  Census  (Queens)Street  Tree  Census  (Staten  Island)Nature  PreservesDirectory  of  EateriesDirectory  of  Temporary  Public  ArtDirectory  Historical  SignsPark  Closure  No7fica7onsPress  ReleasesMap  of  Access  PointsMap  of  BathroomsMap  of  kayak  and  canoe  launchesMap  of  monumentsDirectory  of  Nature  PreservesRecycling  Diversion  and  Capture  RatesSpecial  Waste  Drop-­‐off  SitesGraffi7  Loca7onsDSNY's  Refuse  and  Recycling  Disposal  NetworksCollec7on  Tonnages  DYCD  ProgramsPrimary  Commercial  Zoning  by  lotPrimary  Manufacturing  Zoning  by  lotPrimary  Residen7al  Zoning  by  lotProject  loca7onsFDNY  Monthly  response  7meFDNY  community  board  incident  countFDNY  fire  housesLa7n  media  and  entertainment  events,  organiza7ons,  and  companiesHistoric  district  mapsNYC  LandmarksProduc7on  office  spaceLocal  Film  Fes7valsRecording  StudiosFilming  loca7ons  (Scenes  from  the  City)Hurricane  evacua7on  zonesHurricane  evacua7on  centers911  receiving  hospitalsNursing  homesFerry  terminalsCommunity  Emergency  Response  Team  (CERT)Snow  emergency  routesBrooklyn  Public  Library  CatalogBPL  Electronic  ResourcesBPL  BranchesBPL  Events  CalendarCalendar  of  Library  Events:  Classes  and  PerformancesNYPL  BlogsLibrary  Exhibi7ons    Queens  Public  Library  Hours  and  Loca7onsOnline  directory  of  cer7fied  businesses  with  a  detailed  profileBlack  Car  basesCommuter  Van  Authoriza7onsCommuter  Van  DriversCommuter  VansLuxury  Limousine  BasesLuxury  Limousine  VehiclesCommunity  Car  service  basesCommunity  Car  Service  VehiclesParatransit  BasesParatransit  DriversParatransit  VehiclesCurrent  Medallion  DriversCurrent  MedallionsCurrent  FHV  DriversVehicle  InsuranceApproved  registrants  in  the  wholesale  marketsApproved  licensees  and  registrants  for  trade  wasteDenied  licensees  and  registrants  for  trade  wasteDenied  registrants  in  the  wholesale  marketsCCRB  Sta7s7cal  Appendix  ACCRB  Sta7s7cal  Appendix  BCCRB  Sta7s7cal  Appendix  CElec7on  2013  Contribu7onsElec7on  2013  ExpendituresElec7on  2009  Contribu7onsElec7on  2009  ExpendituresElec7on  2009  Public  Funds  PaymentsElec7on  2005  Contribu7onsElec7on  2005  ExpendituresElec7on  2005  Public  Funds  PaymentsElec7on  2003  Contribu7onsElec7on  2003  ExpendituresElec7on  2003  Public  Funds  PaymentsElec7on  2001  Contribu7onsElec7on  2001  ExpendituresElec7on  2001  Public  Funds  PaymentsWomen's  organiza7ons  database                                                                                          Awarded  Construc7on  ContractsFuture  Construc7on  ContractsEmployment  Opportuni7esNYC  City  Hall  Library  CatalogNYC  City  Hall  Library  Publica7onsRudy  W.  Giuliani,  1994-­‐2001Board  of  Educa7on,  1934-­‐2002Chancellor  of  NYC  Board  of  Educa7on,  1970-­‐1989Cultural  Ins7tu7ons  by  block  and  lot  Parks  by  block  and  lot  Retailers  by  block  and  lot  with  Wi-­‐Fi  loca7ons  Quality  of  Life  IndicatorsReal  Estate  Market  indicatorsBike  rack  loca7ons  Building  types  by  block  and  lot  Canyon  of  Heroes  Heritage  Trail  markers  Hotel  –  number  of  rooms,  development  status  Orienta7on  poles  Residen7al  Data  with  number  of  units,  type  of  development,  development  status  Streetlights  Wayfinding  Health  Insurance  Enrollment  SitesAssembly  district  breakdownsCommunity  district  breakdownsCongress  district  breakdownsCouncil  district  breakdownNeighborhood  development  area  breakdownsSchool  district  breakdownsSenate  district  breakdownsZip  code  breakdownsNYC  Budget  Expense  City  FundsNYC  Budget  RevenueNYC  Budget  Revenue  Addi7onalNYC  Capital  All  FundsNYC  Capital  City  FundsNYCHA  Community  Facili7es  NYCHA  Public  Housing  DevelopmentsPrequalified  firmsDisqualified  firmsUpcoming  contracts  to  be  awardedProjects  in  construc7onBronx  2009  TC  Reduc7onsBrooklyn  2009  TC  Reduc7onsManha\an  2009  TC  Reduc7onsQueens2009  TC  Reduc7onsStaten  Island  2009  TC  Reduc7onsBronx  Open  Ar7cle  7  Pe77onsBrooklyn  Open  Ar7cle  7  Pe77onsManha\an  Open  Ar7cle  7  Pe77onsQueens  Open  Ar7cle  7  Pe77onsStaten  Island  Open  Ar7cle  7  Pe77onsGTFS  Schedule  dataNew  York  City  Transit  -­‐  Bus  ScheduleNew  York  City  Transit  -­‐  Train  ScheduleLong  Island  Rail  Road  scheduleMetro-­‐North  RailroadLong  Island  BusBus  CompanyCurrent  Service  StatusNYC  Transit  Elevator/Escalator  StatusTag/Field  defini7ons  for  XML  fieldMTA  all  agency  performance  dataNYC  Transit  turns7le  dataBridges  and  Tunnels  Daily  Plaza  traffic  dataSubway  entrance  and  exit  GIS  dataWater  reservoir  levelsWatershed  sta7s7cs  DEP  CPR  Cri7cal  indicatorsWatershed  sta7s7cs  Land  coverReservoir  and  Dam  sta7s7csHydrostatsTSA  Entertainment  venuesTSA  Food  and  Beverage  loca7onsTSA  HotelsTSA  screensTSA  pedestrian  countsLincoln  Square  BID  Business  ListMuseums  and  galleriesCity  government  retrofit  projectsSchool  Point  Loca7onsSchool  Zones2009  School  Survey2010  School  Survey

• stimulate development of apps that improve access to info and govt transparency, and;

• encourage innovation & the creation of new IP with commercial potential

Main Goals

CROWDSOURCING

CROWDSOURCING

INCENTIVIZEDCOMPETITION

INNOVATION

+

=

CROWDSOURCING

CROWDSOURCING

• Challenge: Improve Recommendation Algorithm by 10%

• Dataset:

• 100 million ratings (training set)

• Half a million Users

• 18 thousand movies

• Prize:One million US Dollars

STATISTICS

• just 6 days into contest, Cinematch bested by 1%

• 20,000 Teams, 150 countries

• Entrants:

• Bell Labs

• Opera Solutions

• Well-renowned universities

CROWDSOURCING

• Challenge: Improve Recommendation Algorithm by 10%

• Dataset:

• 100 million ratings (training set)

• Half a million Users

• 18 thousand movies

• Prize:One million US Dollars

STATISTICS

• just 6 days into contest, Cinematch bested by 1%

• 20,000 Teams, 150 countries

• Entrants:

• Bell Labs

• Opera Solutions

• Well-renowned universities

CROWDSOURCING

• Washington DC CTO - Vivek Kundra

• First Federal CIO - Vivek Kundra

• Open Government Initiative

• Recovery.gov

• Data.gov

• USAspending.gov

• IT Dashboard

• Performance.gov

• Fedspace

• Citizen Services Dashboard

• First Federal CIO - Vivek Kundra

• Open Government Initiative

• Recovery.gov

• Data.gov

• USAspending.gov

• IT Dashboard

• Performance.gov

• Fedspace

• Citizen Services Dashboard

• First Federal CIO - Vivek Kundra

• Open Government Initiative

• Recovery.gov

• Data.gov

• USAspending.gov

• IT Dashboard

• Performance.gov

• Fedspace

• Citizen Services Dashboard

• First Federal CIO - Vivek Kundra

• Open Government Initiative

• Recovery.gov

• Data.gov

• USAspending.gov

• IT Dashboard

• Performance.gov

• Fedspace

• Citizen Services Dashboard

• First Federal CIO - Vivek Kundra

• Open Government Initiative

• Recovery.gov

• Data.gov

• USAspending.gov

• IT Dashboard

• Performance.gov

• Fedspace

• Citizen Services Dashboard

}Life Support

• First Federal CIO - Vivek Kundra

• Open Government Initiative

• Recovery.gov

• Data.gov

• USAspending.gov

• IT Dashboard

• Performance.gov

• Fedspace

• Citizen Services Dashboard

}Life SupportBudget slashed

from $34 million to

$8 million

Open Data in NYC

Council Member Gale Brewer

Open Data in NYC

Council Member Gale Brewer

Int. No. 29: Accessibility to Public Data Sets

“...requires that all public data sets maintained by City agencies shall be made available on the Internet through a single web portal, formatted to enable viewing by web browsers and mobile devices and also in their raw or unprocessed form.”

Principles• Cost Effective

• Easy to Use (Developers/Publishers/Citizens)

• based on Open Standards

• Low Adoption Curve

• Help Accelerate Open Data Innovation

• Useable Data Now!

bionic hand

The Next Web of Open Linked DataFebruary 2009

Useable Data Now• “Beautiful” Website

• Useable by Developers/Publishers/Citizens

• based on Open Standards

• Low Adoption Curve

• Help Accelerate Open Data Innovation

• Useable Data Now!

What  NYCBigApps  Developers  were  Doing

Siloed Data

42

ETL Processes

• Spend inordinate amount of time interpreting data

• Massaged Data was then staged locally

• Developers kept reinventing the wheel

• Limited Data mashups

• Applications disconnected from NYCDatamine

Text

Download &Decipher

There must be a Better Way

How it Started

• Oct 12, 2010 - NYCBigApps 2.0 announced

• Nov 9, 2010 - NYCBigApps 2.0 kickoff meeting

• late Nov 2010 - spoke with Revelytix/Spry about collaborating

• early Dec 2010 - started work on NYCDataWeb

• Jan 26, 2011 ~4:30p - submitted entry

http://www.youtube.com/watch?v=rpVO4gZXktw

What  We  Did

47

Query &Results

Siloed Data

MappingOntology

MetadataOntology

DomainOntology

Optimizer

PlannerIndexes

Re-Writer

Cache

Re-Writer

Indexes

Optimizer

Rules

Planner

Rules

Definitions

“Beautiful” Website

“Beautiful” Website

Three dashboards were built

• NYC Agile Analytics (Spry)

• NYCreation (SMW+)- visualized SPARQL query results

• NYCmantics (SMW+)- NYC datamine explorer

What’s Next?

Phase 2• Integrate NYCreation

and NYCmantics

• Incorporate the whole NYC datamine

• Make it easier for Publishers

• Make it easier for Developers

• Make it easier for Citizens

• Incorporate the best of Socrata and data.gov

• Position SMW+ as the accelerated data mashup platform

• ...powered by NYC DataWeb

Phase 3• Open-source

collaboration with Revelytix (more info at SemTech 2011)

• <Your city here> DataWeb

• DataWeb Deployment Framework bundle

• Make it easier STILL for Publishers, Developers and Citizens

• Widespread adoption of SMW/SMW+

• ... keep standing on the shoulders of giants

Phase 3• Open-source

collaboration with Revelytix (more info at SemTech 2011)

• <Your city here> DataWeb

• DataWeb Deployment Framework bundle

• Make it easier STILL for Publishers, Developers and Citizens

• Widespread adoption of SMW/SMW+

• ... keep standing on the shoulders of giants

Phase 3• Open-source

collaboration with Revelytix (more info at SemTech 2011)

• <Your city here> DataWeb

• DataWeb Deployment Framework bundle

• Make it easier STILL for Publishers, Developers and Citizens

• Widespread adoption of SMW/SMW+

• ... keep standing on the shoulders of giants

• Oct 4, 2011 - “Find your next Startup Partner” meetup - NYEBN

• Oct 5, 2011 - Steve Jobs dies

• Oct 11, 2011 - NYCBigApps 3.0 announced

• Oct 17, 2011 - Joel leaves TCG

• Oct 25, 2011 - Ontodia, LLC formed

The Genesis of Ontodia

Your time is limited. Don’t waste your time living

someone else’s life.

We’re here to put a dent inthe universe. Otherwise,

why even be here?

Computers for the  rest of us.

Semantics for the  rest of us.

D8 Conference - Steve Jobs InterviewJune 1, 2010

Human-powered,Machine-accelerated,

Collective Knowledge Systems

CROWDKNOWING

“Smart” Cities brand of Ontodia

"Over  the  next  decade,  cities  will  continue  to  grow  larger  at  a  rapid  pace.  At  the  same  time,  new  technologies  will  unlock  massive  streams  of  data  about  cities  and  their  residents.  As  these  forces  collide,  they  will  turn  every  city  into  a  unique  civic  laboratory—a  place  where  technology  is  adapted  in  novel  ways  to  meet  local  needs."  

December  2010.    Institute  of  the  Future's  2020  Forecast  –  The  Future  of  Cities,  Information  and  Inclusion.  

Ci4es:Worldwide,  city  leaders  and  managers  need  cost-­‐effective  &  smart  solutionsPopula'on  Growth:

-­‐ 221  cities  globally  with  more  than  1  million  citizens-­‐  China  will  move  300  million  people  to  cities  by  2020-­‐  90%  of  these  cities  are  in  emerging  markets-­‐  In  2008,  more  people  lived  in  cities  (3.3  billion),  by  2030,  5  billion-­‐ Cities  are  more  efJicient  and  have  less  environmental  impact

Cost  of  City  Services:Aging  infrastructure,  resource  constraints  &  waste

-­‐ Washington  DC’s  water  system  has  elements  that  date  to  the  Civil  War-­‐ InefJiciency,  leaks  and  waste  rival  maintenance  and  expansion  costs

source:  Gartner  –  Is  Smart  Cities  the  Next  Big  Market?    March  2011

Why NYC?• City Population:

8.1 million (2010 Census)

• Metro NYC Population: 18.9 million (2010 Census)

• City Density: 10,630/km2 (2010 Census)

• Metro NYC Density: 1,085.7/km2 (2010 Census)

• 50 million visitors a year

• Gross Metropolitan Product: USD $ 1.28 Trillion (Greyhill Advisors)

• DOITT annual budget: USD $325 million

• ~120 City Agencies/Departments, each with multiple datasources and standards

• Second only to Silicon Valley for most startups

Why NYC?

• Jan 24, 2011 - First Chief Digital Officer Appointed

• May 16, 2011 - NYC Digital Roadmap released

• Dec 19, 2011 - Cornell University-Technion-Israel Institute of Technology announced

• Mar 7, 2012 - NYC Open Data Bill passed

• April 17, 2012 - NYC Open Data Standards wiki launched

• April 17, 2012 - NYCBigApps 3.0 awards ceremony

ROAD MAP FOR THE

DIGITALCITY

the city of new york • spring 2011

ACHIEVING NEW YORK CITY’S DIGITAL FUTURE

ROAD MAP FOR THE

DIGITALCITY

the city of new york • spring 2011

ACHIEVING NEW YORK CITY’S DIGITAL FUTURE

ROAD MAP FOR THE

DIGITALCITY

the city of new york • spring 2011

ACHIEVING NEW YORK CITY’S DIGITAL FUTURE

ROAD MAP FOR THE

DIGITALCITY

the city of new york • spring 2011

ACHIEVING NEW YORK CITY’S DIGITAL FUTURE

NYCOpenData

NYCOpenData

ROAD MAP FOR THE

DIGITALCITY

the city of new york • spring 2011

ACHIEVING NEW YORK CITY’S DIGITAL FUTURE

NYCOpenData

ROAD MAP FOR THE

DIGITALCITY

the city of new york • spring 2011

ACHIEVING NEW YORK CITY’S DIGITAL FUTURE

APIsLinked Data

???

NYCOpenData

ROAD MAP FOR THE

DIGITALCITY

the city of new york • spring 2011

ACHIEVING NEW YORK CITY’S DIGITAL FUTURE

APIsLinked Data

???

Developers, Businesses,

Citizens, etc.

Supercalifragilistic-exponentiallyHUGE OPEN DATA!!!

0. Huge Open Data1. Extract Metadata

2. Derive ExtraMetadata (Semantics + Statistics + Algorithm + Crowd)

3. Do Federated Queries on both the Metadata AND the Data

Crowdknowing

Human-powered, Machine-accelerated, Collective Knowledge Systems

Crowdknowing

Human-powered, Machine-accelerated, Collective Knowledge Systems

Crowdknowing

Curation, Comments, Feedback, Bug Reports,

Likes, Shares, Profile, Votes, Subscribes, Tagging,

etc. etc. etc.

Ontology, Inferencing, Semantic Mapping, Query Federation, Statistics,

Pattern Recognition, Multivariate Analysis & Forecasting, Automated

linking, Feeds, Notificationsetc. etc. etc.

...is primarily an Open Data Developer resource

Hans Rosling Shows the best stats you've ever seen

February 2006

... that “Search Function”and something for the everyday user

New York > Manhattan > Midtown > Times Square > 42nd Street

Tourist Resident Business Developer Government

What do you want?

Top Gluten-free Restaurants

Eat for less than $10

Discount Broadway Tickets

Item 4

Events in the next hour

Michelin-rated restaurants

Semantic Web

PUBLIC

We need your help & feedback

A Smart Data Exchange for All Data NYC

Find out more athttp://nyc.pediacities.com/facets

CREDITS• Lego Faceparty picture by RichardAM (http://www.richard-am.net/)

• Lego Inauguration Pictures from various Flickr Users (sluggobear, Atwater, Dan Hontz)

• Lego Luke looses his Hand by Flickr user wwwayazdotcom

• Tim Berners-Lee highlight from TED (http://www.ted.com/talks/tim_berners_lee_on_the_next_web.html)

• Hans Rosling highlight from TED (http://www.ted.com/talks/hans_rosling_shows_the_best_stats_you_ve_ever_seen.html)

• FlowerPowerpont2.pptx provided by Anna Rosling Rönnlund of gapminder

• several images taken from NYC.gov properties

• Various screenshots provided by Revelytix, Spry Inc. and TCG Software Services