1 / 43

Steward

Steward. Statewide Traffic Engineering Warehouse for Archived Regional Data. Update: July 2008. Daily Reports. ETL Process. STEWARD Database. Daily Archive Data. Facility Data. Analysis Reports. Proof of Concept Project. Proof of Concept: March 2008. District 2 data

stew
Télécharger la présentation

Steward

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Steward Statewide Traffic Engineering Warehouse for Archived Regional Data Update: July 2008

  2. Daily Reports ETL Process STEWARD Database Daily Archive Data Facility Data Analysis Reports Proof of Concept Project

  3. Proof of Concept: March 2008 • District 2 data • Occasional manual data transfer by FTP • Basic reporting capability • Basic quality assurance • Traffic count demo • Internet demo • UF Campus based

  4. Reports

  5. Daily Reports • Daily conversion Report • Time covered • Orphan and null detectors • Polling interval distribution • Conversion History Summary (1 record per day) • Diagnostic Reports • Effective vehicle length distribution • Max flow rate at each station

  6. QA Reports • Mobility Management (TTI) Tests • Lane distribution • I/O continuity • Comparison with Statistics Office counts

  7. Analysis Reports • Daily Volume Summary for Freeway Lanes and Ramps • Lane Distribution Summary by Station • Link Continuity Report • Performance Analysis Report by Station • Level of Service Report

  8. Summary Reports(Future) Daily Performance Summary Monthly Performance Summary Annual Summary and Trend Analysis

  9. Travel Time Reliability Reporting(Requires discussion with Systems Planning Office) • Travel time reliability delay, based on 10 mph below speed limit vs congestion delay, based on TT index > 1.5. • Percent on-time arrivals • Must be geared to District’s TT link structure

  10. All reports are generated in CSV format to facilitate further analysis, compilation and plotting

  11. Past and Current Clients • Work-Zone Crash Analysis sponsored by the Southeastern Transportation Center • Analysis of Breakdown at a Freeway Ramp sponsored by National Cooperative Highway Research Program • Identification of Recurring Congestion by RS&H • Travel Time Reliability Reporting as part of Strategic Intermodal System management • Mobility Monitoring Program by Cambridge Systematics • Freeway Capacity Project sponsored by National Cooperative Highway Research Program

  12. Resources for Continued Operation and Expansion • UF CMS Project • FDOT Research Office Project • TERL Support Activities

  13. UF CMS Project ... • Present a series of stakeholder workshops • Expand to include additional SunGuide detectors • Operate the system to provide data and reports to agencies and researchers • Analyze the data to explore congestion modeling relationships

  14. FDOT Research Office Project • Integrate Functions with Other FDOT Data Management Programs • Transfer Operations to the TERL Center in Tallahassee • Automate and fine tune the transfer of daily archive data reporting processes. • Expand to Include Other Data Sources • Incorporate the CDW Functionality into Requirements for Future SunGuide Versions

  15. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development

  16. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development

  17. 3. Return to TMC by email 2. Scheduled Task Process the archive data files to perform ETL and diagnostic functions STEWARD Etc. D5 D4 Diagnostic Reports 1. Scheduled Task “Push” daily archive file to UF FTP D2 FTP sites set up for each District Automated Archive Transfer

  18. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development

  19. Working Paper CDW2008-1: Development of STEWARD Configuration Data for SunGuide Archives • Stage 1: Enables processing of daily archive data and diagnostic report generation • Stage 2: Enables loading of daily archive data into the STEWARD database • Stage 3: Enables full report generation

  20. Diagnostic reports indicating archive data problems and inconsistencies Stage 1: Develop basic facility configuration and verify the integrity of the archive data 1. Obtain sample archive files from the TMC 2. Extract basic facility configuration required to produce diagnostic reports 3. Process several days of archive data using the basic configuration 4. Modifications to facility configuration by SunGuide staff

  21. Reports for district review and refinement Stage 2: Expand the facility data configuration to include all data required for development of the STEWARD database 1. Add the data fields that can be extracted from the archive data or the district facility inventory 3. Process more archive data 2. Add the data fields that require individual attention in cooperation with the district

  22. Stage 3: Expand the facility data configuration to include all data required for report generation 1. Add the data fields that require individual attention in cooperation with the District 2. Test the report generation features Reports for district review and refinement

  23. District 2 Status • I-95 at Stage 3 (Proof of Concept project) • Data availability TSS: 6/28/07 ~ 2/6/08 TVT: 2/25/07 ~ 2/5/08 Incident: 5/10/06 ~ 2/5/08 • 133 TSS stations with RTMS detectors and 37 TVT links • District is adding detectors on I-295 and I-10

  24. District 4 Status • Stage 1 (TSS ), No TVT data yet • Data availability TSS: 5/18/08 ~ 7/21/08 TVT: None Incident: None • TSS stations: 100 detectors at I-95 and 30 at I-595 • Invalid time stamps on some records

  25. District 5 Status • Stage 1(TSS and TVT) • Data availability TSS: 4/24/08, 5/2/08, 5/3/08 TVT: 4/24/08, 5/2/08, 5/3/08 Incident: None • TSS stations: 143 detectors at I-4, 124 at I-95, 14 at SR-528 and 70 unknown • TVT links: 310 at Turnpike, I-4, I-95, SR 408, SR 414, SR 417, SR 423, etc • Some invalid data (e.g., negative speeds and occupancies)

  26. District 6 Status • Stage 1 (TSS and TVT) • TSS detector locations are not available • Data availability TSS: 5/26/08 ~ 7/21/08 TVT: 5/26/08 ~ 7/21/08 • TVT link locations: SR 826, I-75, SR 826, I-195 • Duplicate data records on some days • 2 min TVT sampling rate will not support 5 or 15 min aggregation

  27. District 7 Status • Stage 1 (TSS), No TVT data • TSS stations: 104 detectors at I-275 and 46 at I-95 • TSS data availability: 6/3/08 ~ 6/5/08 • No apparent issues in TSS data

  28. Modifications to Accommodate Additional TMCs • Station number: increase from 2 characters to 3 characters Impacts: SunETLUtility was revised All the transformations were rerun All the data were reloaded into the database All the materialized views were regenerated Steward web interfaces were updated Overall system operations were tested and verified step by step • Steward testbed was built to test the multiple districts. District 2 and 4 data were loaded and Steward operations were tested.

  29. Other Modifications in Progress • Conversion program from TSS data to traffic count are included in the Steward • Max numbers of lanes and ramp per station must be extended from 6 and 3. District 6 has several stations with 7 lanes or 5 ramps.

  30. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development

  31. Working Paper CDW2008-2:Conversion of SunGuide Archive Data to the FDOT Count Formats • Good potential for agreement • Mutual calibration and improvement of data quality • Supplement to District counts

  32. Traffic Counts Traffic Counts Statistics Office Format ITSCounts Utility District Planning Office Format ITS Traffic Counts Lane counts (CSV) STEWARD Database

  33. Sample Traffic Count Plots

  34. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development

  35. Date and Time Selection

  36. Facility and Station Selection

  37. Incident (01-09-2008) • Upstream Station (I-95 NB Entrance from Butler Blvd EB) • Downstream Station (I-95 NB Exit to Butler Blvd)

  38. Before Incident http://cdwserver.ce.ufl.edu/steward/index_main/MAP_IF/0730AM.html

  39. During Incident http://cdwserver.ce.ufl.edu/steward/index_main/MAP_IF/0740AM.html

  40. Next Steps ... • Continuing the operation of STEWARD to capture the SunGuide archive data • Continuing our efforts to bring more SunGuide TMCs into STEWARD • Expanding the automated transfer of archived data to all districts • Coordinating with District Planning Offices to produce traffic count data • Improving the Internet interface to facilitate queries and report production

  41. Future Steps ... • Reporting Procedures • QA Procedures • Transfer to TERL • Crash Record Integration • Congestion Modeling • Workshop Presentations • Requirements Development

  42. Demonstration and Discussion

More Related