Assessment of Intervention Outcomes

1. Assessment of Intervention Outcomes Dr Dave Daley & Dr Tracey Bywater

2. 2 Why evaluate your clinical work? NHS Trusts demand evaluation It is useful to be able to demonstrate improvement Helps to maintain funding and/or win new funding

3. 3 Overview of workshop Rationale for conducting evaluations How to manage the numbers Suggested evaluation material

4. 4 Is it difficult to evaluate outcome? The most important decisions to make when considering evaluation are: 1) Design 2) Evaluation measures

5. 5 1. Design It is very important that you have baseline measures (before) and outcome measures (after) It is also important that you have the same measures on everyone

6. 6 What can we do with our evaluation scores? Even simple spreadsheet programmes like Excel will allow you to conduct simple statistics For evaluation purposes you are most interested in change in scores from start to end

7. 7 What can we do with our evaluation scores II? Change scores should demonstrate improvements in child behaviour at outcome You can also begin to examine whether your groups are more effective for particular types of parents

8. 8 What can we do with our evaluation scores III? Rather than do lots of fancy statistics, it is also interesting to examine scores at outcome Most evaluation measures will have scores which indicate clinical concern It is very easy but also meaningful to examine the percentage of children and/or parents who score above cut off scores before intervention and after intervention

9. 9 2. Evaluation Measures Which ones? Pathfinders project uses: Demographic Questionnaire Beck Depression Inventory Eyberg Child Behaviour Inventory Strengths & Difficulties Questionnaire x 2 Parenting Scale Overt Hostility Scale Teacher Questionnaire/Report Describe pathfinders briefly. Describe what each of these measures assess and why important, have to pay for BDI & ECBI. Going to look at 2 measures - demographics & Eyberg (may want to assess siblings as well) If time will show what to do with eyberg scores Describe pathfinders briefly. Describe what each of these measures assess and why important, have to pay for BDI & ECBI. Going to look at 2 measures - demographics & Eyberg (may want to assess siblings as well) If time will show what to do with eyberg scores

10. 10 Demographics What do you need to know? Do you want to compare outcomes of:- older versus younger parents? Boys versus girls? Different areas? Any other ideas? Eg higher versus lower risk families - high/low income, large versus small families 2-parent versus 1-parent families Parents who left education before or after 16 Depressed versus less depressed parents VERY important to have built up a raport with the parent/family when asking these questions, especially if asking about sensitive subjects such as crime or drug use within the family Show our demographic qu�aire and show the 6 risk factors SED - see scoring pathfinder sheetEg higher versus lower risk families - high/low income, large versus small families 2-parent versus 1-parent families Parents who left education before or after 16 Depressed versus less depressed parents VERY important to have built up a raport with the parent/family when asking these questions, especially if asking about sensitive subjects such as crime or drug use within the family Show our demographic qu�aire and show the 6 risk factors SED - see scoring pathfinder sheet

11. 11 The Eyberg Child Behaviour Inventory 36 items, ages 2-16 years, 10 minutes to complete Problem score has a minimum of 0, maximum of 36 (yes/no answers, problem or not) Intensity scale - minimum score of 36, maximum 252 (scale of 1 � 7, where 1 = never and 7 = always) Clinical cut-off scores, =127 intensity, or =11 problem Purchase from http://www3.parinc.com/

12. 12 Strengths & Difficulties Questionnaire FREE, website: http://www.sdqinfo.com/b1.html 10 minutes to complete, 25 items: Emotional symptoms Conduct problems Hyperactivity Peer relationship problems Prosocial behaviour An additional impact supplement Parent & teacher Normal, borderline & atypical ranges/cut-off Sample means plus standard deviations on website for britain and other countries: For the sample as a whole For the sample split by gender For the sample split by age band (5-10 and 11-15) For the sample split by gender and age band (5-10 and 11-15) 5 items in each subscale. They can be looked at separately or the 1st 4 scales are added together (20 items) to generate a total difficulties score Impact supplement: These extended versions of the SDQ ask whether the respondent thinks the young person has a problem, and if so, enquire further about chronicity, distress, social impairment, and burden to others.? This provides useful additional information for clinicians and researchers. Can score online, go to scoring n the above website, or by hand, with a transparency downloadable from website Sample means plus standard deviations on website for britain and other countries: For the sample as a whole For the sample split by gender For the sample split by age band (5-10 and 11-15) For the sample split by gender and age band (5-10 and 11-15) 5 items in each subscale. They can be looked at separately or the 1st 4 scales are added together (20 items) to generate a total difficulties score Impact supplement: These extended versions of the SDQ ask whether the respondent thinks the young person has a problem, and if so, enquire further about chronicity, distress, social impairment, and burden to others.? This provides useful additional information for clinicians and researchers. Can score online, go to scoring n the above website, or by hand, with a transparency downloadable from website

13. 13 Any questions?????