Data Collection Practices for Use with In-Service Performance Evaluations (2024)

Chapter: 3 ISPE Data Collection Procedures Manual

Previous Chapter: 2 Background
Suggested Citation: "3 ISPE Data Collection Procedures Manual." National Academies of Sciences, Engineering, and Medicine. 2024. Data Collection Practices for Use with In-Service Performance Evaluations. Washington, DC: The National Academies Press. doi: 10.17226/27911.

3 ISPE DATA COLLECTION PROCEDURES MANUAL

The primary objective of this research was to develop an ISPE Data Collection Procedures Manual. Both a peer review and a pilot test of the ISPE Data Collection Procedures Manual were conducted under this research. The comments received during the peer review and pilot test have been incorporated, culminating in the “In-Service Performance Evaluation: Guidelines for the Collection, Extraction, and Documentation of Data” (ISPE Data Collection Procedures Manual) included in Appendix A. The manual is a stand-alone document so it will not be discussed at length in this report.

Chapter 1 of the manual introduces the “In-Service Performance Evaluation: Guidelines for the Collection, Extraction, and Documentation of Data” (ISPE Data Collection Procedures Manual). This chapter provides the underlying philosophy of ISPEs and the organization of the manual.

Chapter 2 introduces the ISPE data elements. While Chapter 2 covers a variety of data elements, Chapter 2 explains that some of the elements can be used in every ISPE conducted and some will only be helpful when conducting investigative ISPEs. Even more data elements are provided for use in targeted, large-scale ISPEs that aim to evaluate national guidelines. The manual is clear that it is not necessary to collect every data element for every ISPE. ISPE data elements which can be collected on an ongoing basis or on an as needed basis are presented. Chapter 3 identifies possible sources for each of the elements.

Chapter 4 discusses data collection techniques in the context of performing an ISPE. Techniques range from data collectors visiting roadside locations and making observations and measurements with simple hand tools to more technologically sophisticated methods like using photographs or laser scans from data logging vehicles traveling along the roadways. Manual data collection, cellular applications, and GPS data logging are the methods best suited to collect detailed scene information. Remote data collection techniques can be used to collect information which is independent of a crash occurring (e.g., presence of curb, offset to hardware). On-site techniques expose the data collectors to traffic and weather conditions. The disadvantage of data collector exposure is balanced by the increased detail available due to the data collector’s physical proximity.

Chapter 5 provides techniques for data management, documentation, extraction, and linking. It is effective to dedicate a single point of contact for data management so that data are not lost or mis-filed by being sent to the wrong person. The data collectors should know how to forward the collected data to the data manager. The collected data may, for example, be forwarded automatically (e.g., via mobile device application) or by email or hand delivered for each crash event. Hard copy forms are more easily and quickly developed and deployed since they only need to be typed and printed then distributed. Using cellular application or fillable PDFs, however, streamlines the data extraction process.

The complete “In-Service Performance Evaluation: Guidelines for the Collection, Extraction, and Documentation of Data” (ISPE Data Collection Procedures Manual) are included in Appendix A.

Suggested Citation: "3 ISPE Data Collection Procedures Manual." National Academies of Sciences, Engineering, and Medicine. 2024. Data Collection Practices for Use with In-Service Performance Evaluations. Washington, DC: The National Academies Press. doi: 10.17226/27911.
Page 7
Next Chapter: 4 Pilot Test
Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.