real-time monitoring systemonlinepubs.trb.org/onlinepubs/conferences/2012/natmec/refai.pdf ·...
TRANSCRIPT
![Page 1: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/1.jpg)
Real-Time Monitoring System
The University of Oklahoma Hazem Refai, Ph.D.
NATMEC
June 5, 2012 Dallas, TX
![Page 2: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/2.jpg)
Outline: • Motivation • Brief Review of FHWA Section 1201
– Real-Time System Management Information Program • State Traffic Data Monitoring and Collection Systems • Project Objectives • AVC/WIM System Development—Extending
Continuous Count Site Capabilities. • Real-Time Backend Server and Applications • Data Validation Software Solution • Conclusion • Acknowledgment
NATMEC 2012- Dallas, TX 3
![Page 3: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/3.jpg)
Motivation: FHWA—Real Time System Management Information Program: To provide the capability to monitor, in real-time, the traffic and travel conditions of the major highways of the United States and to share that information to improve surface transportation system security, address congestions, improve response to weather events and surface transportation incidents, and to facilitate national and regional highway traveler information.
NATMEC 2012- Dallas, TX 4
![Page 4: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/4.jpg)
FHWA Section 1201: Real-Time System Management Information Program
•Traffic and travel conditions reporting: –Report traffic and travel conditions along the metropolitan
Interstate highways and other routes of significance. –Metropolitan Interstate highways to be completed by
November 8, 2014. –Other routes of significance to be completed by November
8, 2016. •“Full Construction activities” reporting:
–Report close and reopen roads or lanes. –10 minutes or less for highways within metropolitan areas. –20 minutes or less for highways outside of metropolitan
areas
NATMEC 2012- Dallas, TX 5
![Page 5: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/5.jpg)
FHWA Section 1201: Real-Time System Management Information Program cont’d
•Roadway or lane blocking incidents and events reporting
–Report the time when the traffic incident is verified. •Roadway Weather Observations reporting:
–Report confirmed weather conditions that result in hazardous driving conditions or roadway and lane closures.
–20 minutes or less of notice of a changed condition. • Data quality reporting:
–Develop procedures for measuring and ensuring the quality of the information provided under the real-time
system management information program.
NATMEC 2012- Dallas, TX 6
![Page 6: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/6.jpg)
State Traffic Data Monitoring and Collection Systems
•Intelligent Transportation System –Monitors traffic and travel time information
–Uses radars and camera. –Available in major metropolitan Interstate highways
–Real-time •Data Collection System
–Collects traffic volume, speed, and classifications and weigh-in-motion information.
–Uses automatic vehicle classifiers (AVCs) and weigh-in-motion (WIM) systems.
–Available across the State’s roadways and highways. –Non-real-time.
NATMEC 2012- Dallas, TX 7
![Page 7: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/7.jpg)
Project Objectives:
• Extend the capabilities of AVCs and WIM systems by outfitting the sites with inexpensive hardware and software solutions.
• Develop a backend server for data collections and visualization of real-time traffic, weather, and road surface conditions.
• Develop software solutions to validate data quality. • Automate the the system and its processes. • Integrate into the State real-time system
management information program.
8 NATMEC 2012- Dallas, TX
![Page 8: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/8.jpg)
But First, is AVC data useful for real-time systems?
NATMEC 2012- Dallas, TX 9
![Page 9: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/9.jpg)
•Improve AVC/WIM Internet connectivity •Deploy embedded computing system
•Interface weather station •Interface road surface temperature probe(s)
Extending AVC/WIM capabilities
NATMEC 2012- Dallas, TX 10
![Page 10: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/10.jpg)
ODOT Data Collection system Oklahoma Department of Transportation (ODOT) has approximately 80 Peek ADR 2000 devices and 20 IRD iSINC Lite.
•Maps of state or metro scale. •Color Coded
•Click on icon for more details NATMEC 2012- Dallas, TX 11
![Page 11: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/11.jpg)
Extending AVC/WIM Capabilities—Wireless Connectivity
NATMEC 2012- Dallas, TX 12
![Page 12: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/12.jpg)
Cellular Network
•Widely, available •Easily provisioned wherever there is a tower
•Highways are a special service target for service providers •High data rate – service providers constantly upgrading
•Low latency •IP enabled – connections can be handled in parallel
NATMEC 2012- Dallas, TX 13
![Page 13: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/13.jpg)
•REECE – Roadside Embeddable Extensible Computing Equipment
Extending AVC/WIM capabilities—Embedded Computing
NATMEC 2012- Dallas, TX 14
![Page 14: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/14.jpg)
REECE Device Capabilities
•Full Linux O/S –IP Addressable
–Direct Device Communication or Server Control Available •Connectivity
–8 RS-232 Serial Ports –4 USB Ports
–16 channel 16-bit 100KHz A/D Converter –Fast Ethernet
–… and more.
NATMEC 2012- Dallas, TX 15
![Page 15: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/15.jpg)
REECE Device Capabilities
•Low Power Consumption –9.4W fully loaded
–Successfully deployed on 80W solar panels and 200Amp/hour battery.
•High Temperature Tolerance –-40˚F to 185˚F •Input Power
–7-25VDC –External Step-Down enables AC or different voltages •Optional Out of Band Management Available
•Wireless Device Auto-Detection of Supported Devices •Flash storage (1 Gbyte)
NATMEC 2012- Dallas, TX 16
![Page 16: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/16.jpg)
Every 15 minutes
Main Server accessible by ODOT
Extending AVC/WIM capabilities—Weather Station
NATMEC 2012- Dallas, TX 17
![Page 17: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/17.jpg)
Weather Station
NATMEC 2012- Dallas, TX 18
![Page 18: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/18.jpg)
Temperature of the ground below the surface of the road
Extending AVC/WIM Capabilities—Road Surface Condition- Temperature Probes
NATMEC 2012- Dallas, TX 19
![Page 19: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/19.jpg)
•ODOTPeekScheduler –Daemon checks SQL database of registered sites
–Schedules downloads –Select devices that have not been monitored in the last N
minute- run download program. –Logs result of download process
•ODOTMonitor –Checks download process log for exceptions
–Generates alerts to configurable email addresses •ODOTRealTimeProcessor
–Implements real-time data processing –Update database
–Presents information
Real-Time Back-End Server and Applications
NATMEC 2012- Dallas, TX 20
![Page 20: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/20.jpg)
Real-Time—Traffic data: Classes
NATMEC 2012- Dallas, TX 21
![Page 21: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/21.jpg)
Real-Time—Traffic data: Speed
NATMEC 2012- Dallas, TX 22
![Page 22: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/22.jpg)
23
Real-Time—Weather Data
NATMEC 2012- Dallas, TX
![Page 23: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/23.jpg)
Validation Software Solution
•Monitor the wireless network and Internet connectivity.
•Monitor the health of sensors, AVCs, and WIM systems.
•Examine traffic data for unusual traffic patterns: excessive zeros, classes, speed, vehicle rate, etc.
•Examine real-time traffic data with historical data per site, lane, date, and time.
NATMEC 2012- Dallas, TX 24
![Page 24: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/24.jpg)
• General errors: ADR, network, or others • Long-term overview
Validation and Error Visualization
NATMEC 2012- Dallas, TX 25
![Page 25: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/25.jpg)
Validation—Excessive Zeros
NATMEC 2012- Dallas, TX 26
![Page 26: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/26.jpg)
Validation—Excessive Vehicle Rate
NATMEC 2012- Dallas, TX 27
![Page 27: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/27.jpg)
Validation—Excessive Vehicle Rate
NATMEC 2012- Dallas, TX 28
![Page 28: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/28.jpg)
Validation—Excessive Classes
NATMEC 2012- Dallas, TX 29
![Page 29: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/29.jpg)
Validation— Historical Traffic Data
NATMEC 2012- Dallas, TX 30
![Page 30: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/30.jpg)
Conclusions •States have many components to implement FHWA
real-time system management information program. •States need to take advantage of their investment in
traffic data collection systems. •With minimal additional investment, Non-real-time
AVCs and WIM systems could be used to monitor traffic flows, roadway incidents, and road surface conditions.
•Backend server(s) and databases required for real-time traffic data processing and dissemination.
•Data validation is essential to guarantee the quality of the provided information
31 NATMEC 2012- Dallas, TX
![Page 31: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/31.jpg)
Acknowledgement
•The work has been funded by the Oklahoma Transportation Center as well as the Department of Transportation.
•In particular, I thank Lester Harragarra (ODOT retiree), Aaron Fridrich (Data Collection Branch Manager), and Brian Thompson (Automatic Traffic Section Supervisor).
NATMEC 2012- Dallas, TX 32
![Page 33: Real-Time Monitoring Systemonlinepubs.trb.org/onlinepubs/conferences/2012/NATMEC/Refai.pdf · Backend server(s) and databases required for real- • time traffic data processing and](https://reader034.vdocuments.net/reader034/viewer/2022042802/5f398878dea71c3b4e10cdc3/html5/thumbnails/33.jpg)
VPN Network, fault tolerant, and Security