ADCANP/CTF Program Evaluation: Grantee Training September 21 – 24, 2010 & September 29, 2010

1. ADCANP/CTF Program Evaluation:Grantee TrainingSeptember 21 – 24, 2010&September 29, 2010 Debra Nelson-Gardell, Ph.D., LCSW M. Felicia Woerner, MA The University of Alabama School of Social Work

2. Gone Through Any Changes Lately?

3. Changes to the Evaluation Project • 2009-2010 Evaluation: Process Evaluation • 2010-2011 Enhancement: Outcome Evaluation • For client-level data • Parent-Focused & Home Visiting Programs • Protective Factors Survey • Respite Care Programs • Perceived Stress Scale • Child-Focused Programs • Custom Created Child-Focused Measures • Thank you to Child Abuse Prevention Services of Tuscaloosa for piloting!

4. DCAP/CTF Overall Goal • Programs will work to decrease risk factors and increase protective factors related to child maltreatment. • Congruent with current, empirically supported, best practices • Same goal recommended for all programs • Implementation differs across program types • Goals by type of program are listed in the RFP

5. Protective Factors • Nurturing and attachment • Knowledge of parenting and of child and youth development • Parental resilience • Social connections • Concrete supports for parents

6. Risk Factors • Parent or caregiver factors • Personality characteristics/mental health • History of abuse • Substance abuse • Child rearing approaches • Teen parents • Family factors • Family structure • Domestic violence • Stressful life events • Child factors • Birth to age 3 • Disabilities • Environmental factors • Poverty and unemployment • Social isolation and social support • Violence in communities

7. 2010-2011 Enhancements • Updates to client form • To decrease repetitiveness of data entry • Give more control over data • Provide clearer “saved” notifications • Increase efficiency through “Quick Facts” • Less data on agency form • Addition of outcome measures • scoring vs. entering responses • reduce burden • maintain data quality

8. Pre- and Post-Test Instruments • Instruments were selected to maximize data quality when measuring objective attainment while minimizing instrumentation burden on clients and program staff. • Parent Focused & Home Visiting Program • Protective Factors Survey • Respite Care Programs • Perceived Stress Scale • Child-Focused Programs • Assessments of Prosocial and Self-Protective Behaviors • Kindergarten to 2nd grade • 3rd grade – 5th grade • 6th grade – 12th grade

9. Orientation • Refer to email sent on Sept. 15th (available on website) • Location: “Outcome Instruments” tab on left side of webpage • Page contains instruments, User Manuals, and scoring guides (optional) • User Manuals provide general instructions • customize to your program’s specific needs • Optional scoring guides

10. Special Instructions • Instruments are available at http://dcapdata.ua.edu • Do NOT download them from another source! • Instruments have been customized for CTF programs.

11. Important Reminders • Use online forms template to make demographic sheet for clients to complete or for program staff to ask. • Race and ethnicity must be asked separately. • All clients must complete a post-test even if they do not complete a pre-test. • With time, this situation will “even out.”

12. User Manual Overview • User Guide versus User Manuals • website versus instrument-related instructions • Administration Timing • Material preparation • instrument with client ID • consent if required • Templates need to be customized to your program. • demographic form if needed • Instrument Administration • Report of responses on website • Record for the reporting month the pre- or post-test was completed by client.

13. Instrument Administration Highlights • PSS:Perceived Stress Scale • self-report, alone or in group setting • PFS:Protective Factors Survey • self-report, alone or in group setting • APSB:Assessment of Prosocial and Self-Protective Behaviors • Kindergarten • one-on-one or guided self-report with at least two adults (one to read items and one to guide) • 1st – 5th grade • self-report (adult reads items) • 6th – 12th grade • self-report, alone or in group setting

14. Evaluation Website: FAQs & Reminders • How do I know my program’s data has been saved and received by the UA evaluation team? • How do I make corrections? • email needed corrections • include either your program’s contract number and/or agency ID • FAQs section forthcoming • This presentation is available for download under the “Additional Resources” link.

15. Evaluation Data Reminders • Client form must be entered and finalized every month even if your program did not serve clients that month • exception: programs that are ONLY Public outreach & trainings • Agency form still must be completed every month • All reports submissions are now time stamped as well as date stamped.

16. Thank you! • Debra Nelson-Gardell, Principle Investigator • dnelsong@ua.edu • 205-348-2990 • M. Felicia Woerner, Project Manager • dcapdata@ua.edu • 205-348-8011