True Transformations:

1. True Transformations: Measuring Changes in Attitudes, Behaviors, Values and Relationships as a Result of BBYO Involvement Avery M. Budman May 2011

2. Research Question: What is the best way to measure the developing identities of Jewish teenagers in today’s environment? Conclusion was that the best way is to look at attitudinal shifts, rather than behavioral, which often just reflect the behaviors of their parents in whose home they  live. The project continues to provide specific recommendations to create a system that measures how a teen participant’s attitudes, behaviors, values and relationships change as a result of their involvement with BBYO.

3. Reviewing the Measurement Landscape • BBYO Alumni Study and Impact Studies • Reviewed Day School, Birthright, Foundation for Jewish Camp, Girl Scouts of America • Research resulted in: • “While there is a wealth of information for the past several decades on “measuring Jewish,” there appears to be a lack of information on non-residential, “come-at-will” experiences. For example, even though Day Schools are non-residential, their high cost limits the odds of payment for membership and then not showing up multiple times. While BBYO has residential experiences, the vast majority of BBYO teens attend on a local “pop-in and pop-out” experience.”

4. How Can We Best Capture Identity Changes in Jewish American Teens? While traditionally the measure of Jewish identity is a single-scale composed of a set of practices that together convey a certain way of being Jewish we must ask ourselves a new question: If Jews are not Jewish the way their grandparents were (or were supposed to have been), how, if at all, do they relate to anything Jewish in their own lives?* *Horowitz, Bethamie. “Reframing the Study of Contemporary American Jewish Identity.” Contemporary Jewry. New York, NY. 2002.

5. The Survey Instruments • Approximately 5 minutes in length • Intake has 12 questions; Exit has 14 questions • Questions focus on background (what teens BBYO engages initially); life cycle choices; importance of Judaism in their life; and BBYO’s Impact Criteria • Only one qualitative response to make controlling incoming information easier to sort and manage.

6. What are we trying to measure?

8. Measuring BBYO’s Impact Criteria • How important of a role do the following things play in your life: • Very important Somewhat Important Not Very Important Not at all Important • Visiting or connecting with Israel (Visit and Connect with Israel) (7.4) • Jewish religious observance including praying (Celebrate Shabbat/holidays and use Jewish traditions to mark lifecycle events) • Celebrating Jewish holidays (Celebrate Shabbat/holidays and use Jewish traditions to mark lifecycle events) (7) • Being a part of the Jewish people (Feel strongly about being a part of the Jewish people) (9) • Having Jewish friends (Maintain a Jewish social circle) (6.1) • Learning about Jewish history, people, culture or sacred texts (Celebrate Shabbat/holidays and use Jewish traditions to mark lifecycle events) (6.1) • Commitment to community service (Engage in social causes and volunteer service) (5.5) • Involvement in social or political causes (Engage in social causes and volunteer service) (4.6) • Being a leader in my school or my community (Gain leadership skills and a desire to use them) (4.5)

9. Measuring BBYO’s Impact Criteria • How often do you engage in each of the following activities? • Never Rarely Sometimes Fairly Often Very Often • Do volunteer work for charities or other non-profit organizations (Engage in social causes and volunteer service) (5.6) • Talk about Jewish concerns, values, anti-Semitism, Israel or related topics (Feel strongly about being a part of the Jewish people) (8.6) • Wear a Jewish star, chai, Jewish t-shirt or other sign that you are Jewish (Feel strongly about being a part of the Jewish people) (8.3) • Public speaking on issues of importance to you (Gain leadership skills and a desire to use them) (n/a) • Work with others towards common goals (Gain leadership skills and a desire to use them) (n/a)

10. Proposals for Implementation • Make the Intake Survey available immediately upon registration for BBYO programs. Original suggestion is not to make it mandatory. • Make the Exit Survey available during second semester of senior year to all BBYO participants. • Make survey emails from local program professionals. • Offer the survey as a valuable gift. • This survey is also meant as a valuable tool for all BBYO teens and families as same survey will be taken at the completion of the BBYO experience. BBYO will be happy to share the results of the two surveys for comparative purposes only upon the teen participants’ consent. Aside from this purpose, all information you provide will remain confidential. • Incentivize Completion of the Intake and Exit Surveys.

11. How BBYO Should Use Survey Information • Ability to demonstrate clear impact on interest areas for particular donors. • Understanding of what BBYO “paths” have the most impact. • Further clarity and proof as to whether the “International BBYO” • experience is stronger than the “Chapter BBYO” experience. • Qualitative responses on what all BBYO participants want to gain and have gained from their BBYO experience. • Some insight into what programs do not “hook” teens.

12. Moving Forward • Survey developed with idea in mind that Impact Matrix will be done in conjunction – save time by not asking teens about their involvement because we already know it! • Suggestion to make sure questions/answer choices match those of National Jewish Population Survey so that we can easily compare apples to apples. • Finalize implementation plan with technology vendors

13. Questions?