STEM2 Community of Practice Stock Exchange and RISP Share Out

1. “Communities of practice are groups of people who share a concern or a passion for something they do and learn how to do it better as they interact regularly.” -Etienne Wenger

2. The Power of Discovery: STEM2 Community of Practice February 26, 2013

3. Agenda • Welcome and Introductions • Stock Exchange • RISP Share Out • Project Updates • Evaluation • Team Work Time • Program Planning and Programmatic Sustainability • Virtual Innovation Support Center Overview • Practices Worthy of Attention • Team Work Time

4. Stock ExchangeFold the index card in half; creating 4 spaces to write down information 3. In the third space, write down challenges you are currently facing (i.e. recruitment, communication, RNA) 4. In the last space, write down any questions you currently have 1. In the first space, write down some successes you have had or practices worthy of attention 2. In the second space, write down great resources (i.e. person, website, book, you have utilized for this initiative etc.)

5. Stock Exchange Findsomeone in the room you don’t know that well You will each share out the specified section of your card (we will tell you when to switch) Use this time to exchange “stock”, find great resources and try to find resources to overcome challenges

6. Stock Exchange Share Out! What are some of your “ah-ha” moments with regards to success, challenges, and resources

7. RISP Share Out • Briefly share out your current work. • Recruitment • Communication • Supporting Programs • Readiness and Needs Assessment • Other

8. Project Updates • STEM Council • Funders • Broadcom Jr. Varsity • Quarterly Reports • Mott Conference • CSU Collaboration • CSLNet Regional Alliances

9. CSLNet Vision We Envision a Time When: All students in California will graduate with the STEM knowledge and skills required for success in education, work and their daily lives 2011 CSLNet Student STEM Showcase

10. CSLNet Mission CSLNet’s Mission is to: Help California Prepare the Nation’s Most STEM-Capable Graduates

11. CSLNet Regional Networks • These organizations actively build partnerships with PK-12, higher education, and business and industry to address regional needs in STEM teaching and learning through the implementation of innovative and effective strategies. • These strategies will build the capacity to capture learning at the local level and translate into a statewide STEM agenda and solution.

12. Building STEM Capacity in California: CSLNet’s Regional Partners CAPITAL AREA INLANDEMPIRE EAST BAY SAN DIEGO CENTRAL COAST ORANGE COUNTY SAN FRANCISCO CSLNET CENTRAL VALLEY SILICON VALLEY LOS ANGELES

13. Evaluation Plan: Process and Purpose

14. Selection of Study Sample & Evaluation Activities • Selection of Study Sample • About 100-125 sites selected across all program partners • About 20-25 sites from each of 5 RISPs regions • Selected sites will be a representative sample, based on type of program, and location • Staff and Student Surveys • Baseline survey data collected Spring 2013 • Time One (Fall 2013) and Time Two (Spring 2014) survey administrations • STEM Activity Documentation Forms • Completed by instructional staff at each site (Spring 2013 – Spring 2014)

15. Commitment of Selected Study Sites Staff and Student Surveys • Download Excel Template (Participant Data) from website, enter information for all participating students and staff, and upload to website • Program administrators and staff receive survey access codes and instructions by email prior to survey administration • Test internet access at site and check survey links prior to administration • Orient staff on administrating surveys to students and completing staff surveys. Refer to the step-by-step instructions provided for both. • Complete staff and student surveys within survey administration window

16. Commitment of Selected Study Sites Continued STEM Activity Documentation Forms • Sites receive packet of forms and pre-addressed and postage-paid envelopes • One-page instructions for completing forms provided • All staff implementing STEM activities complete forms weekly and mail back to UC Irvine in the provided envelopes

17. Next steps…getting started • Ensure programs are inputting site information into UC Davis online database of participating program sites • Indicate sites with computer and internet access for students • Support programs in preparing for data collection • Review “Getting Started” guidelines and Survey Administration instructions with program directors and site staff • Support programs during data collection • Check with programs to make sure they are aware of the dates of the survey administration window • Check with programs to make sure that staff are completing and mailing the STEM Activity Documentation Forms • Encourage communication with UC Irvine regarding challenges or questions by emailing: afterschool@uci.edu

18. Proposed Observation Sub-study Spring/Summer 2013 • Select sample of observation study sites (30 in Northern CA; 30 in Southern CA) • PEAR torecruit and train and calibrate a team of externaland internal observers in use Dimensions of Success (DoS) observation tool Fall 2013 • Collect Observational Data from selected sample of sites • PEAR observes 30 sites in Northern California • UC Irvine observes 30 sites in Southern California • 2 visits per site; total 120 site observations Purpose of Observation Sub-study: • Assess the quality of STEM activities at all sites in the observation study sample • Compare the reliability of DoS observation scores by program staff or managers (internal observers) versus external evaluation observers • Look for links between scores on the DoS tool to the program staff and student reports of the quality and quantity of STEM-related activities at sites

19. Team Time • Teams will have the opportunity to work together in their groups •  At this time, we also encourage you to talk to other RISP’s

20. The Virtual Innovation Support Center How was the VISC created? •  The VISC work group of the STEM Committee has helped to inform the new website so that it meets the needs of the field. • Ongoing project that will continually be assessed and improved upon based off of the feedback we receive from the field and the RISPs What is the VISC? The VISC is a place for the out-of-school time field to obtain resources, tools, strategies, and find opportunities that will help support quality STEM learning opportunities in out-of-school time programs

21. The Virtual Innovation Support Center What types of things can I find on the VISC?  Information on the Regional Innovation Support Providers Assessment and Planning Tools Curriculum and Activities Funding Opportunities Research Professional Development Opportunities STEM Committee Information....and much more!

22. The Virtual Innovation Support Center • Individual Log-In and Password • Upload Programs and Sites • Upload Current Work Plan • Upload Quarterly Report (private) • Document Practices Worthy of Attention • General Discussion Board

23. Practices Worthy of Attention What is a Practice Worthy of Attention? Practices worthy of attention are practices that have been identified as strategies, methods, or techniques that achieve certain results in an effective way that may likely advance the desired program, staff, and student outcomes of the initiative and result in student engagement. Why do we need to document practices worthy of attention? These practices are important to document because they will ultimately help guide other OST programs in their efforts to implement quality STEM learning opportunities throughout California.

24. Documenting Program/ Site Practices Worthy of Attention • STEM Learning Opportunities (What are the sites doing that’s working?) • Staffing • Community Partnerships • Time & scheduling • Technical Assistance • Alignment & Linkage with the Core Instructional Day • Professional Development/ Staff Development

25. Documenting RISP Practices Worthy of Attention • Technical assistance strategies (coaching, mentoring, training, consulting, brokering of resources) • Sustainability (both programmatic and fiscal) • Administering/ Supporting sites through the Readiness and Needs Assessment and Program Planning Tool • Documenting Communities of Practices (topics, audience, timing, logistics) • Outreach and program recruitment • Establishing/maintaining relationships with key stakeholders

26. How will these practices get documented? Documenting Program/ Sites • Program Director Interviews • Program Directors Surveys  • Backend portal Documenting RISPs • One-on-one check ins (primary method) • Quarterly reports • Communities of Practice • Back end portal

27. Why do we have to document these practices? CAN is currently working with the CDE ASD to create a “How to Guide” that will ultimately guide OST programs to implement high-quality STEM learning opportunities in their program. • RISP practices– will help identify practices, strategies, tools, etc. that work the best from a Technical Assistance point of view • Program/ Site practices– will help programs identify different strategies to implement STEM learning opportunities and what are promising practices around implementation

28. Team Time • Teams will have the opportunity to work together in their groups •  At this time, we also encourage you to talk to other RISP’s

29. Kudos! • Now, we are giving you the chance to show your appreciation to a person, event, or item that has helped you in today’s COP. • Time to give Kudos!!!

30. Next Steps • Next Community of Practice • May 21, 2013 10:00am – 12:00pm (Virtual) • Invoice • Quarterly Report • Virtual Innovation Center • RISP back end portal

31. THANK YOU!!! Words cannot express our level of gratitude for your ongoing hard work, time and perseverance in an effort to improve OST programs throughout California.