Evaluation of the Every Day Counts Program (2025)
Chapter: Appendix B: Detailed Evaluation Planning Matrix
APPENDIX B
Detailed Evaluation Planning Matrix
| Evaluation Questions and Sub-questions | Data Sources | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Document review | Program data | Portfolio data | Stakeholder lists | Lit review | Interviews | Focus groups | Surveys | Case studies | |
|
1. Strategies and Processes: How is the EDC Program designed, structured, and operated to support state-led deployment of proven technologies that are lagging in adoption? |
|||||||||
|
1.1 What are the EDC Program’s objectives and strategy? Have these evolved over time and if so, why? |
X | X | |||||||
|
1.2 What are the processes the EDC Program uses to conduct planning, implementation management, and assessment processes, and have these evolved over time? |
X | X | |||||||
|
1.3 As the program is planned and implemented, who does the EDC staff work with, for what end, and for whom? [who are stakeholders and what role(s) does each type play (we need to have clear tags for each role)] |
X | ||||||||
|
1.4 Collaborations specific to EDC initiatives: Who are collaborators and what role(s) does each type play? What inputs, activities, and resources do they provide? |
X | X | |||||||
|
1.5 What are the challenges and opportunities for FHWA and states to deploy emerging new processes/business models during the timeframe of this evaluation? |
X | ||||||||
|
1.6 What are the general processes for implementing EDC Initiatives in the states? |
X | X | X | X | |||||
|
1.7 In general, who do the states involve in their decisions about implementation of EDC Initiatives (advisors, participants, other stakeholders?) |
X | X | |||||||
|
1.8 In general, how does the context differ for states for innovations in highway systems, and how does this reflect challenges and opportunities for adoption of innovative technologies and practices? [population, population density, median income, topography, weather, etc.] |
X | X | X | X | |||||
|
1.9 For selected states, what does the specific context of the state and their strategies for the EDC Initiatives, suggest about the characteristics of the innovation culture in that state (drivers, how people see potential in attempting to implement, capacity for, and knowledge of observed impact)? |
X | X | X | X | X | X | |||
| Evaluation Questions and Sub-questions | Data Sources | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Document review | Program data | Portfolio data | Stakeholder lists | Lit review | Interviews | Focus groups | Surveys | Case studies | |
|
2. Outputs and Outcomes. What are potential and realized outcomes of FHWA EDC Program activities to support emerging innovations and state-led implementation of EDC initiatives? |
X | X | X | ||||||
|
2.1 Outputs and Shorter-term Outcomes. What are potential and realized outputs and outcomes of FHWA EDC Program strategies and activities to support emerging innovations and state-led implementation of EDC initiatives? |
X | X | X | X | |||||
|
2.2 What are Intermediate Outcomes (potential and realized) of the FHWA EDC Program to support emerging innovations and state-led implementation of EDC initiatives? |
X | X | X | ||||||
|
2.3 What are the End Outcomes and Impacts (potential and realized) of the FHWA EDC Program? |
X | X | X | ||||||
|
3. Program Efficiency and Effectiveness: Are the EDC Program’s strategies and implementation supporting the achievement of the program’s mission and the FHWA’s strategic objectives, including catalyzing efficiencies that support deployment of innovations in the highway ecosystem? |
X | X | X | X | X | ||||
|
4. Future Options: What factors influenced the effectiveness and outcomes of the EDC Program and what might be done differently in the future to improve the Program? |
X | X | X | X | |||||
