computer-assisted reporting seminar

Computer-Assisted Reporting (CAR)

Computer-Assisted Reporting (CAR)

Computer-Assisted Reporting Computer-Assisted Reporting

Better title: Data-Assisted Reporting.Or… reporting using data instead of, or along with, documents.

Better title: Data-Assisted Reporting.Or… reporting using data instead of, or along with, documents.

Useful dataUseful data

• Databases• Spreadsheets• Email• Maps

• Databases• Spreadsheets• Email• Maps

Understand data tablesUnderstand data tables

Fields (or columns) contain types of data.

Records (or rows) contain the information you want .

Fields (or columns) contain types of data.

Records (or rows) contain the information you want .

Why use data?Why use data?

• No more “according to…” State as fact, don’t attribute.• Uncovers stories even the subjects don’t know.• Confirms the obvious; reveals the unexpected.

• No more “according to…” State as fact, don’t attribute.• Uncovers stories even the subjects don’t know.• Confirms the obvious; reveals the unexpected.

Other CAR ideasOther CAR ideas

• Overpass inspection records.• Mayoralty campaign donors.• Ambulance response times.• Health/safety reports in city-run apartment buildings.• Complaints against taxi drivers.

• Overpass inspection records.• Mayoralty campaign donors.• Ambulance response times.• Health/safety reports in city-run apartment buildings.• Complaints against taxi drivers.

More CAR ideasMore CAR ideas

• Pet licenses by postal code.• Single men/women by census tract.• Day most marriage licenses.• Most common street name.

• Pet licenses by postal code.• Single men/women by census tract.• Day most marriage licenses.• Most common street name.

Data sourcesData sources

• Inspection reports• Complaints• Incidents reports• Discipline records• Registrations and licenses

Check reporting requirements.

• Inspection reports• Complaints• Incidents reports• Discipline records• Registrations and licenses

Check reporting requirements.

How…How…

1. Identify the data you want.2. Go get it.3. Format the data.4. Crunch the numbers.5. Then start reporting.

1. Identify the data you want.2. Go get it.3. Format the data.4. Crunch the numbers.5. Then start reporting.

The CAR Inverse Pyramid of Aggravation

The CAR Inverse Pyramid of Aggravation

Obtaining data (hard)Formatting dataAnalyzing data

ReportingWriting (easy)

Obtaining data (hard)Formatting dataAnalyzing data

ReportingWriting (easy)

Where to get dataWhere to get data

• Ask for it.• Download from the Web.• Scrape from the Web.• Build it yourself from

documents.• FOI or ATIP.

• Ask for it.• Download from the Web.• Scrape from the Web.• Build it yourself from

documents.• FOI or ATIP.

How to FOI/ATIP?How to FOI/ATIP?

FOI/ATIP hurdlesFOI/ATIP hurdles

• Privacy.• Price.• General stupidity.

• Privacy.• Price.• General stupidity.

FOI/ATIP strategiesFOI/ATIP strategies

• Ask for everything except names (and sometimes addresses)

• Negotiate.• Appeal.

• Ask for everything except names (and sometimes addresses)

• Negotiate.• Appeal.

Negotiating for dataNegotiating for data

• Request a sample of the data.

• Arrange a meeting with the ATIP/FOI person or the data expert.

• Eliminate fields that need to be severed.

• Modify your request.

• Request a sample of the data.

• Arrange a meeting with the ATIP/FOI person or the data expert.

• Eliminate fields that need to be severed.

• Modify your request.

Finding the story Finding the story

• Think vertically. Look at columns.

• Cross-tab columns.• Chart over time.• Look for patterns.• Dig down from data..

• Think vertically. Look at columns.

• Cross-tab columns.• Chart over time.• Look for patterns.• Dig down from data..

SpreadsheetsSpreadsheets

• “Smart paper,” great for adding up totals, calculating percentages and other data summary.

• Limited to 65,000 records.

• “Smart paper,” great for adding up totals, calculating percentages and other data summary.

• Limited to 65,000 records.

Database managersDatabase managers

• Quickly organizes large numbers of records.

• No 65,000-record limit.• Can summarize data, too.

• Quickly organizes large numbers of records.

• No 65,000-record limit.• Can summarize data, too.

Mapping or GISMapping or GIS

• Puts data on a map.• Analyzes data based on

location and distance.

• Puts data on a map.• Analyzes data based on

location and distance.

Software for MacSoftware for Mac

• Spreadsheet: Excel ($), OpenOffice (open source)

• Database manager: Filemaker($), MySQL (open source)

• Mapping : QGIS (open source), Google Maps mash-ups.

• Spreadsheet: Excel ($), OpenOffice (open source)

• Database manager: Filemaker($), MySQL (open source)

• Mapping : QGIS (open source), Google Maps mash-ups.

Software for PCSoftware for PC• Spreadsheet: Excel ($),

OpenOffice (open source)• Database manager:

Access($), MySQL (open source)

• Mapping : ArcView ($, Citizen owns a copy), MapInfo ($), Google Maps mash-ups.

• Spreadsheet: Excel ($), OpenOffice (open source)

• Database manager: Access($), MySQL (open source)

• Mapping : ArcView ($, Citizen owns a copy), MapInfo ($), Google Maps mash-ups.

Problems with CARProblems with CAR

• Long lead times. • Time consuming.• Requires software and hardware.• Extra work not seen by readers (or editors)

• Long lead times. • Time consuming.• Requires software and hardware.• Extra work not seen by readers (or editors)

ScaleScale

• A little goes a long way• Think story, not series• Keep and reuse your data

• A little goes a long way• Think story, not series• Keep and reuse your data

Why learn CAR?Why learn CAR?

• Few doing it in Canada• Easy online components• Useful in almost any beat• Works in print, broadcast,

web

• Few doing it in Canada• Easy online components• Useful in almost any beat• Works in print, broadcast,

web

ResourcesResources

• nicar.org• caj.ca• ire.org• thescoop.org

• nicar.org• caj.ca• ire.org• thescoop.org

Ask for helpAsk for help

• (613) 235-6685•

gmcgregor@thecitizen.canwest.com

• http://www.sushiboy.org/car.pdf• http://www.sushiboy.org/car.ppt

-30-

• (613) 235-6685•

gmcgregor@thecitizen.canwest.com

• http://www.sushiboy.org/car.pdf• http://www.sushiboy.org/car.ppt

-30-