open sourcing the measurement of public life€¦ · open sourcing the . measurement of public...

BENCHMARKOpen Sourcing the Measurement of Public Life

March 20, 2018

Project Team

Can we create open source, digital measurement tools to quantify human interaction within our public spaces?

Digitally Measuring the City

Limitations of Digitally Measuring the City

Temporary Urbanism

DIY Sensing

Sensing Furniture

Prototypes

• Pressure• GPS

• Light• Sound• Acceleration

• Rotation

STATIONARYINTERACTIONS

• GoPro Images

Desired Data

PEDESTRIANINTERACTIONS

Bench & Board

Sensor Box

Bench Assembly

Bench Assembly

Benchmark in Practice: MIT

Benchmark in Practice: MIT

Benchmark in Practice: MIT

Benchmark in Practice: MIT

Benchmark in Practice: MIT

Benchmark in Practice: Charlotte, NC

Benchmarkin Practice:HUBweek

Benchmarkin Practice:HUBweek

Benchmark in Practice: HUBweek

Interpreting the Data

GPS Data

AI Algorithm Comparison

DETECTORS Pros Cons

Haar Cascade Classifiers(Viola and Jones, 2001)

• Robust when the task requires detecting human faces.

• Hard to identify people when their face is not visible.

• Harder to detect people when they’re distant from the camera.

SVM-HOG(Dalal and Triggs, 2005)

• Fast and robust when people are at various distances from camera.

• Low recall when multiple people are present in the image.

Faster R-CNN VGG-16(Girshick et al., 2015)

• Highest mean average precision (mAP) among all implemented methods.

• Harder to train custom classes with few examples.

• Slow processing time during prediction.

“You Only Label Once” Network (YOLO)(Girshick et al., 2016)

• Easy to train with new object classes.• Faster processing time during prediction.• Better fit for mobile use. (e.g. can run

efficiently on a Raspberry Pi)

• Lower mAP (mean average precision) compared to Faster R-CNN VGG-16 algorithm.

Future Development:Tackling Privacy Issues

Image Recognition

Questions that will determine whether Benchmark is able to quantify pedestrian interaction:

• How many people pass by the site?• Are people interested in the benches?

Data Analysis: Pedestrian Interactions

Curiosity Index

Pedestrian Activities

Questions that will determine whether Benchmark is able to quantify stationary interaction:

• When are people sitting on them?• Are people moving them?• Are people socializing the benches?

Data Analysis: Stationary Interactions

Stationary Interactions

Conclusion

Next Steps & Future Research

• Process Improvements

• Broader Engagement Opportunities