Relying on metrics typically collected by companies that disseminate messages and materials is another method for evaluating the performance of traffic safety messaging campaigns. These metrics can be used for formative, process, and outcome evaluation. Applying these metrics often begins before the campaign is launched, with the establishment of campaign goals and objectives, defining the audiences for the campaigns, and identifying channels to reach them. This sets up which key performance indicators (KPIs) will be used to evaluate the performance of the campaign as the campaign is being implemented, and afterward to measure its impact. The following sections describe the steps necessary to implement and evaluate various media channels as part of a traffic safety messaging and communication campaign, including social media, radio, television, out-of-home media, and digital media. They provide an overview for effectively planning, implementing, monitoring, and evaluating these various channels in their effectiveness for targeting and reaching priority audience segments. Steps will include researching effective and efficient media channels for the target audiences, using these channels to deliver traffic safety messaging and communication campaign materials, monitoring campaign performance metrics and optimizing the campaign throughout, and conducting post-campaign evaluation and analysis. The quick reference guide for using the media metrics costing tool is available in BTSCRP Web-Only Document 7.
Appendix A, Tab 3, Media Metrics Costing Tool (Exhibit 4.1) estimates the labor hours for personnel for each of the following steps described below that relate to media planning and communication campaign plan development, implementation, performance analysis, and reporting. Additionally, the tab also includes ODCs beyond labor that may be needed to fulfill each task. This includes estimated costs for pre-campaign messaging research and analysis services. It also includes costs associated with implementing a campaign, including ad buys and media monitoring tools, which can be used to increase the reach and effectiveness of media buys throughout the campaign. The selection of tools and ad buys will depend on the available budget.
As described in Exhibit 4.2, deploying an effective traffic safety messaging campaign requires at least two key team members: the campaign manager (CM) and assistant campaign manager (ACM).
The data given in the table row-wise are as follows: Row 1: CM develops a research plan and defines a targeted audience profile by using published audience segmentation data. CM also determines KPIs. Row 2: ACM provides support for CM by monitoring and reporting on KPI throughout the campaign, communicating with media partners, and other tasks as needed.
Ideally, the CM should have the following:
Ideally, the ACM should have the following:
The responsibilities for each role are as follows:
These bullet items describe the ideal experience, expertise, and skills that each team member should have to understand and manage the campaign evaluation. If the CM and ACM do not have all this experience or knowledge, they should plan to rely a bit more on market research and dissemination partners. More information is provided in Step 3c.
Exhibit 4.3 provides an overview of various media metrics that are important for evaluating campaign effectiveness. The exhibit is tailored to specific aspects of campaign analysis, including the units and frequency of messaging, earned media, website metrics, social media engagement, social media followers, reach, and impressions. These metrics can be gathered through a combination of tracking mechanisms and analytical tools. Using a range of data-collection methods—from social media management tools like Hootsuite and CrowdTangle to traditional tracking and Google Analytics—these metrics offer actionable insights into the volume, visibility, and impact of media efforts across platforms. When selecting KPIs for ongoing monitoring, it is essential to align them with the campaignʼs specific goals and objectives. KPIs should be chosen based on their relevance to desired outcomes, their measurability, and their ability to provide actionable insights. Regular review and adjustment of KPIs ensure they remain aligned with evolving campaign dynamics and strategic priorities.
Exhibit 4.4 displays the steps involved in using media metrics to monitor and evaluate traffic safety messaging campaigns.
(continued on next page)
Each row has sub-rows. The data given in the table row-wise are as follows: Row 1: Units of Messaging or Frequency: Objective: To provide insight on the volume and frequency of campaign media being published; Data Collection Methods; Tracking of posts, usually facilitated through the online platform (e.g., Facebook, Twitter) or tracking ad buys in traditional media; Resources: Social media management tools (e.g., Hootsuite, CrowdTangle) and can track posts from different accounts if they use the same hashtag; If working with traditional media (e.g., Radio, T V, newspaper), the sources should track and provide these numbers, for instance, the number of radio or TV spots played or the number of advertisements placed on in print on a daily, weekly, monthly or quarterly basis, including, for broadcast media, the time of day they played. Row 2: Earned Media: Objective: Shows how much free publicity the campaign earned; Data Collection Methods: Tracking of posts, usually facilitated through the online platform (e.g., Facebook, Twitter) or tracking ad buys in traditional media; Resources: Traditional media: generally manually tracked; the source will likely contact the campaign managers to ask about the campaign and one can track from there; Digital or social media: Social media management tools (e.g., Hootsuite and CrowdTangle) can track use of campaign hashtags, but manual tracking and searching may be done to collect posts that do not use the campaign hashtags. Row 3: Website Metrics: Objective: Shows how many people used the campaign-related website, if and how they interacted with it; how effective campaign media was in encouraging visits the website; Data Collection Methods: Metrics can be tracked through Google Analytics; To track where website visitors come from, you can create unique links through UTM codes and services like Bitly; Resources: Google Analytics; Bitly or UTM codes. Row 4: Social Media Engagement: Objective: Assess the level of interaction users have with content and evaluate a campaign's reach, awareness, and resonance with the target audience; Data Collection Methods: Metrics can be tracked through Google Analytics; Analytics tools built-in to platforms like Meta (Facebook or Instagram) or X or Twitter that allow tracking engagement such as likes, shares or re-tweets, and clicks; Third-party social media tools that gather and analyze data across multiple platforms (e.g., Hootsuite, Buffer); Resources: Google Analytics; Built-in media analytic tools; Social media management tools (e.g., Hootsuite, Buffer). Row 5: Social Media Followers: Objective: Measure the rate or number of followers; assess the ability to expand audience and reach of a campaign; Data Collection Methods: Metrics can be tracked through Google Analytics; Built-in analytics tools can provide real-time follower count; Third-party social media tools; Manual counts. Row 6: Social Media Followers, Continued: Resources: Google Analytics; Built-in media analytic tools; Social media management tools (e.g., Hootsuite, Buffer). Row 7: Reach: Objective; Assess the number of different people who have seen or heard a campaign message or content; Data Collection Methods: Metrics can be tracked through Google Analytics; Built-in analytics tools that track engagement; Third-party social media tools; Built-in analytics tools that provide metrics on number of viewers or listeners; Resources: Google Analytics; Built-in media analytic tools; Social media management tools (e.g., Hootsuite, Buffer). Row 8: Impressions: Objective: Assess the number of times the campaign has been presented to audience; Data Collection Methods: Print: Based on metrics provided by advertising media buyers and readership metrics provided by print outlets; Broadcast: Also based on metrics provided by advertising media buyers and viewership (T V or Streaming Video or Cable)or listenership (Radio or Streaming Audio) metrics provided by stations; Out-of-Home: Also based on metrics provided by advertising media buyers linked to traffic around specific locations; Digital or Social: Metrics can be tracked through Google Analytics; Built-in analytics tools tracking engagement such as likes, shares, and clicks; Third-party social media tools; Resources: Metrics provided by advertising media buyers for print, broadcast and out-of-home; Digital social metrics from Google Analytics, built-in platform analytic tools, and social media management tools.
Step 1 is pre-campaign assessment and planning. Step 2 is campaign media platform selection. Step 3 is campaign performance. Step 4 is post-campaign evaluation.
The data given in the table are as follows: These steps enable the CM to understand the overall impact of the campaign in their designated market area, based on available FY budgets, total size of population, and audience reach and engagement goals.
Goals may include the following:
On top of informing the design of the campaign and selection of campaign channels, the chosen market segmentation data provider(s) also assist in the evaluation throughout the campaign. When subscribing to market research services, the CM and ACM should request and receive a guided tutorial from the platformʼs representatives to help define and establish campaign goals, audience geography and profile, timing, and duration. Coordinating with the help of representatives ensures optimum campaign results and final deliveries. This collaboration can help determine what metrics to measure and provide actionable steps for optimizing campaign performance. Within this phase, the CM should
The target audience profile provides clarity on who the campaign will reach. This includes insights into the audienceʼs social habits, the platforms and channels they frequent, and how different audience segments may interact with the advertising campaign.
Audience and media research data and insights can be overwhelming. While audience segmentation data is important, being able to speak with members of the local community who are affected by particular traffic safety issues can provide common-sense insights that can be better for the campaign overall. To navigate this process, consider constituting a community advisory board (CAB) with a diverse group of local community representatives with a range of perspectives, backgrounds, and experience. CMs and ACMs can leverage the CAB to gain valuable local insights that might not be evident in data alone. It is important in this process to document decisions, feedback, and rationale, maintaining transparency in the decision-making process. Likewise, it is also critical to continuously refine the campaign strategy and integrate data-driven insights with regular check-ins with the CAB. For costs for forming a CAB, refer to the focus group costing tab and assume the cost of recruiting and conducting two focus groups.
The data given in the table are as follows: Nielsen Scarborough captures local and national consumer insights across 2,000-plus categories, including unique behaviors, social patterns, and media consumption habits. Nielsen Scarborough conducts over 330,000 plus surveys across the United States. MRI Simmons provides insights on American consumers. With thousands of attitudinal, behavioral data points gathered through ongoing survey measurements, MRI-Simmons empowers advertisers and media companies with deeper insights into the “why” behind consumer behavior.
The data given in the table are as follows: Example: If the media plan initially considers targeting Adults 55 and older using digital and social media, the market segmentation and media company data may recommend targeting Adults 45 plus due to data that may present a higher likelihood of reaching and engaging a broader audience, such as those who listen to news or talk-radio, and watch evening news on local T V.
The following actions not only help the CM and ACM optimize campaign performance throughout its run but also set up for the final evaluation process, giving insight into how campaign reach, engagement, and cost efficiency goals were ultimately met.
The data given in the table are as follows: Also known as social listening, social media monitoring is the process of listening out for social media conversations relevant to your brand. C Ms might use social media monitoring tools for several reasons, like connecting with audiences and or to measure social media.
The data given in the table are as follows: Managing and reviewing KPIs and analytics on social and digital media are time-consuming and cost-prohibitive. Management tools in 2023 that you can add for free to your campaign include: Crowdfire, Tailwind, Buffer, CoSchedule, and Google Analytics.
The data given in the table are as follows: Reports and insights can be overwhelming for external stakeholders unless they also have C Ms to guide them. C Ms and ACMs should establish a relationship that helps guide internal and external supports, including step-by-step instructions on what to do with the information that is shared with them.
This step can involve considering potential shifts in media allocations, such as moving resources from radio to digital media, if the data indicates better performance. Making ongoing and active changes, whether tactical adjustments or messaging refinements, does not incur additional costs. This process is continuous and an integral part of ongoing monitoring, as outlined in Step 3d. This process has the potential to add hours of work to apply the changes.
ODC considerations for monitoring tools are detailed in Appendix A, Tab 3 of the Media Metrics Costing Tool, which estimates expenses associated with monitoring media metrics. For social media metrics, it is noteworthy that most social media platforms offer engagement metrics as part of their platform, typically at no additional cost to advertisers or campaign implementers. However, for enhanced functionality, services like Hootsuite and Loomly are available, with costs ranging between $64 to $249, see Cell H15 (see Exhibit 4.9). In contrast, digital media metrics such as website visits, time on-site, and email opens, clicks, and shares are often free through tools like Google Analytics or included in the pricing of email marketing services such as MailChimp or Constant Contact. Costs for email marketing services can vary based on factors like the number of emails sent, with sample costs for a team of three members ranging from $13 to $35, see Cell H16 (see Exhibit 4.11).
As targeted campaigns conclude, CMs and ACMs gain valuable insights into the campaignʼs performance, gauging its effectiveness in achieving the campaign objectives and goals. This evaluation revolves around three essential elements: review, analysis, and comparison.
The column headers under columns G, H, and I are subscription costs, ranges, and actuals. Two headers in rows 9 and 14 are market research companies and digital or social media metrics monitoring services. The data are given until row 16.