690 likes | 882 Vues
Maryland SPF SIG Needs Assessment Training Meeting . ADAA MSPF Evaluation Team April 2012. Agenda. Introductions and Expectations MSPF Evaluation Overview Needs Assessment Capacity Building Meeting with coalitions Wrap-up Evaluation. Training Objectives.
E N D
Maryland SPF SIG Needs Assessment Training Meeting ADAA MSPF Evaluation Team April 2012
Agenda • Introductions and Expectations • MSPF Evaluation Overview • Needs Assessment • Capacity Building • Meeting with coalitions • Wrap-up • Evaluation
Training Objectives • Understand MSPF evaluation at the state and community level • Collect data on intervening variables and contributing factors • Prioritize intervening variables • Assess organization, resources, and community readiness
Introductions • Where you are in the MSPF process? • Expectations for today • Barriers/challenges
What Are We Evaluating? • MSPF priority: reduce underage drinking and alcohol abuse • Reduce the number of youth, ages 12-20, reporting past month alcohol use • Reduce the number of young persons, ages 18-25, reporting past month binge drinking • Reduce the number of alcohol-related crashes involving youth ages 16-25
Process Evaluation • State Level • Focus on the extent to which the state successfully adheres to the five steps of the SPF • Community Level • Assess each community coalition’s adherence to and progress on implementation of the five steps of the SPF
Process Evaluation • Community Level (cont.) • Work with local community evaluator to track and document all SPF related activities • Example: Providing Monthly Reports on Coalition and SPF activities • Examine whether selected strategies are being implemented as planned
Outcome Evaluation • State Level • Will examine whether or not implemented strategies are effective in reducing underage drinking • Will work with the State Epidemiological Outcomes Workgroup (SEOW) to evaluate the outcomes of interest
Outcome Evaluation • Community Level • Is critical since we may not be able to see an overall change in the state rates due to only 24 communities being funded • The outcome evaluation at the community level will focus on the primary indicators • Will work with the local evaluator • Community coalitions will select their strategies bases on their needs assessment
SEOW • State Epidemiology and Outcomes Workgroup • To provide state substance abuse prevention providers and policy makers with information to determine prevention priorities • Identify, monitor, and interpret key indicators that provide information on consequences of alcohol and drug use and measures of use • State level • Jurisdictional level
MSPF Evaluation Team • University of Maryland, School of Pharmacy • Françoise Pradel, PhD-Lead Evaluator • Nicole Sealfon, MPH-Program Coordinator • Michelle Campbell, MS-Research Assistant • Linda Simoni-Wastila, PhD-SEOW Lead Epidemiologist
Where We Are Currently • At the State Level • Completed a state-wide needs assessment and developed a state-wide strategic plan • At the Jurisdiction Level • Completed a jurisdictional assessment to determine needs and to select a community • At the Community Level • Are working on their Needs Assessment, Capacity Building, and Strategic Plan
Community Needs and Resources Assessment • Substance use rates of the potential target population • Substance use consequences in the potential target population • Factors that might cause, lead to, or promote substance abuse • Community readiness • Cultural Competence • Prevention resources • Partnerships within the community
Organizational Needs Assessment • Leadership • Human resources • Technical resources • Infrastructure • Finding sources • Mission/Vision • Organizational experience • Cultural Competence
The Community Needs Assessment is completed by the coalition with the local evaluator.
Community Needs Assessment • A systematic gathering and analysis of data about the community your coalition serves for the purpose of identifying and addressing local Alcohol problems. • The overall goal of the needs assessment is to answer the five “W” questions: • What? • Who? • Where? • When? • Why?
Types of Data • Quantitative Data • Defined as variables that you can count • Data that help answer the question “how many?” • Can be collected from archival data or surveys • Qualitative Data • Defined as people’s attitudes, opinions, or beliefs • Non-numerical data rich in detail and description • Can be collected from interviews, town hall meetings, focus groups, open-ended survey questions, individual interviews
Data Collection Methods • Primary Data • Focus groups • Surveys • Interviews • Environmental Scans • Town Hall Meetings • Secondary Data • Existing Surveys • Hospital Records • Law Enforcement Records
Assessing the Indicators: the WHAT? • Maryland Indicators • Reduce the number of youth, ages 12-20, reporting past month alcohol use • Reduce the number of young persons, ages 18-25, reporting past month binge drinking • Reduce the number of alcohol-related crashes involving youth ages 16-25 • Identify the problem in your community
Data Collection Sources • Community level surveys • FARS • NSDUH • Maryland Adolescent Survey • YRBSS • BRFSS
Identifying the Who?, Where?, and When? • WHO? • Should we target a demographic subgroup? • WHERE? • Should we target a geographic location? • WHEN? • Does the time of the year matter?
Data Collection Sources • Law Enforcement • Hospital Staff/EMS • DOT/SHA website • Existing Survey Data • Focus Groups • Interviews • Court Records
What are Intervening Variables and Contributing Factors? • Intervening Variables are constructs that have been identified as being strongly related to, and influencing the occurrence and magnitude of substance abuse- in our case Alcohol. • Contributing Factors are the specific issues in a community that contribute to the problem
Intervening Variables • Retail Availability • Social Availability • Enforcement and Adjudication • Social/Community Norms • Promotion • Pricing • Low Perceived Risk
Retail Availability • Availability of alcohol in your community • How easy it is to obtainalcohol
Data Collection Tools and Methods Retail Availability • Liquor Licenses Per Capita • Where and How is Alcohol sold • Bar Availability • How is alcohol sold, priced, and promoted • Law Enforcement Activities • Alcohol Compliance Checks
Social Availability • Obtaining alcohol from friends, associates, and family members
Data Collection Tools and MethodsSocial Availability • Town Hall Meeting • Focus Groups • Individual Interview • Community Social Events • Law Enforcement Activities • Party Patrols
Enforcement and Adjudication The impact of law enforcement practices and judicial processes on underage drinking, binge drinking, and alcohol-related crashes.
Data Collection Tools and MethodsEnforcement and Adjudication • DUI alcohol results • Number of impaired driving cases • Conviction rates for alcohol-related offenses • Law Enforcement Interviews • Parental Surveys
Social/Community Norms • The acceptability or unacceptability of certain behaviors in a community
Data Collection Methods and ToolsSocial/Community Norms • Focus Groups • Interviews • Surveys • Town Hall Meetings
Pricing The cost of alcohol and the extent to which changes (i.e., discounting or price increase) affect consumption.
Data Collection Tools and MethodsPricing • Pricing Assessment Tool
Promotion • Attempts by alcohol retailers and industry to increase demand through the marketing of their products.
Data Collection Tools and MethodsPromotion • Sponsorships • Community Events and Festivals and their alcohol-related sponsors • Advertising • Local alcohol advertisements and promotional events
Low Perceived Risk Beliefs about the likelihood of receiving an alcohol-related violation or penalty or being harmed as a result of drinking alcohol.
Data Collection Tools and MethodsLow Perceived Risk • Focus Groups • Interviews • Surveys
Prioritization Process • Based on data obtained: • Rank each intervening variable on a scale from 0-10 using the following question: • To what degree do you believe the intervening variable is affecting underage drinking, binge drinking, or alcohol related crashes in your community? • Select up to 3 contributing factors for the top ranked intervening variables • Assess your community’s readiness and capacity to address each contributing factor selected