Download
1 / 14
140 likes | 245 Vues
Tobacco Free Nebraska’s TRAIN:. Using an online reporting system for program evaluation. Poster Abstract.
E N D
Tobacco Free Nebraska’s TRAIN: Using an online reporting system for program evaluation.
Poster Abstract • Problem/Objective: Tobacco control evaluation can be very challenging given the wide range of activities that exist in most statewide programs. Identifying and monitoring the activities that take place in multiple communities can be very burdensome unless that information is housed in a centralized reporting system which provides easy ways to access and analyze the data. • Methods: Tobacco Free Nebraska implemented the Tobacco Reporting and Information Network (TRAIN) to facilitate information delivery among the state’s 22 local tobacco control coalitions, and between the local coalitions and the state. In addition to being a communications resource for the program, the TRAIN system is an excellent evaluation tool because it provides a centralized database that details local tobacco control initiatives. • Results: The evaluation team worked closely with state staff and local coalitions to work out the technical issues involved in implementing TRAIN and in identifying the key indicators to be measured using the system. Results suggest that the TRAIN system provides excellent data for evaluators, local coalitions, and state staff. • Conclusions: Tobacco Free Nebraska’s local tobacco control initiatives are now documented in and reported through the TRAIN system. This interactive online reporting and information system has facilitated the evaluation and surveillance efforts of the statewide program, and has enhanced communication among Nebraska’s 22 local coalitions.
What is the TRAIN? • Tobacco Reporting And Information Network. • TRAIN is a web-based information management and reporting system that provides local tobacco control coordinators with the ability to create and update the strategies and action steps needed to accomplish the goals of their program. • TRAIN tells TFN and program evaluators what activities have taken place in local tobacco control coalitions.
TRAIN and Evaluation • Tobacco control evaluation can be challenging given the wide range of activities that exist in most statewide programs. • Identifying and monitoring the activities of multiple community-based coalitions can be particularly difficult unless information about coalition activities is gathered in a systematic way and housed in a centralized system that provides easy ways to access and analyze data.
Prior to TRAIN • Qualitative data from personal interviews was used to monitor the activities of TFN-sponsored coalitions. • This provided rich data and fostered a strong relationship between the evaluation coordinator and local coalitions. • However, the process was time consuming and did not provide standardized measures for the program’s long-term evaluation needs.
Three Functions of TRAIN • Reporting: TFN-funded coalitions report on work plan objectives and strategies during biannual reporting periods. • Evaluation: TRAIN reports provide the primary source of process measures for Nebraska’s community-based tobacco coalition activities. • Information: TRAIN allows information sharing among Nebraska’s tobacco coalitions, and between the statewide program and local coalitions.
TRAIN Highlights • Coalition work plans improved. Objectives and strategies became more specific and measurable because of system requirements and interaction with the evaluation technical assistant. • The system provides the core process measures for Nebraska’s community-based tobacco control initiatives.
TRAIN Challenges System rolled out before all the elements were in place. • Early on, users were frustrated by occasional system changes, down times and “bugs”. • Quality check measures were not in place until midway through the first 2003 reporting period. • Data from 2002 was gathered by the system but deemed too unreliable for evaluation.
