1 / 22

Guide to MN WorkForce Center System Job Seeker Satisfaction Survey

5/28/2012. 2. About the Survey. Telephone interviews are conducted with: Exiters from Workforce Investment Act (WIA) Adult, WIA and State Dislocated Worker, WIA and State Youth, and Minnesota Family Investment Program (MFIP)Exiter and in-progress Vocational Rehabilitation Services (VRS) and Stat

jaden
Télécharger la présentation

Guide to MN WorkForce Center System Job Seeker Satisfaction Survey

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

    1. 5/28/2012 1 Guide to MN WorkForce Center System Job Seeker Satisfaction Survey Making Sense of the Semi-Annual Charts and Reports

    2. 5/28/2012 2 About the Survey Telephone interviews are conducted with: Exiters from Workforce Investment Act (WIA) Adult, WIA and State Dislocated Worker, WIA and State Youth, and Minnesota Family Investment Program (MFIP) Exiter and in-progress Vocational Rehabilitation Services (VRS) and State Services for the Blind (SSB) customers Core Services customers (universal customer, formerly Job Service). Visit the link below for specific selection criteria information: http://www.positivelyminnesota.com/About_Us/Customer_Satisfaction/Job_Seeker_Satisfaction/Background_2.aspx

    3. 5/28/2012 3 About the Survey Survey Vendor: Strategic Research Group (SRG) Chosen based on best response to our Request for Proposals Based in Columbus, Ohio Has conducted WIA customer satisfaction surveys for State of Ohio (our vendor since May 2005) Out-of-state vendor helps limit survey bias

    4. 5/28/2012 4 About the Survey Survey questions provide a score as well as descriptive comments: Minnesota Customer Satisfaction Index (MnCSI) is a numeric score based on 3 standard questions about general satisfaction (more on this in the Questions slide). Descriptive comments are from open-ended questions asking about what services/activities program or WFC should START doing, STOP doing, KEEP doing.

    5. 5/28/2012 5 About the Survey The survey presents a broad view of customer satisfaction: Local area results are based on balanced input from local area customers. Results represent a range of customers: most satisfied, least satisfied, and everyone in-between. Results are produced semi-annually from on-going survey.

    6. 5/28/2012 6 Why is this survey important? Job Seeker Satisfaction Survey (JSSS) is based on large, random samples; these produce a credible picture of overall satisfaction for the whole system / program / local area. JSSS focuses on the customers entire services experience, particularly in relation to finding a job. JSSS complements results of Mystery Shoppers that focus on quality of WorkForce Center facilities and short-term interaction with staff.

    7. 5/28/2012 7 Why is this survey important? (cont.) JSSS is on-going, with new results each quarter; this allows tracking over time of customer response to changes in service strategy. JSSS provides detailed understanding of the customers experience by capturing verbatim responses to which services were most help [in getting a job] and what about the services could be improved.

    8. 5/28/2012 8 Reports Produced WorkForce Center System (minus MFIP & any additional extra sample, e.g. VRS, DW) Each major program at the statewide level Each local area, all programs combined. Each local area, extra sample reports; VRS Team report & DW Provider report

    9. 5/28/2012 9 Samples For a WorkForce Service Area (WSA), the proportion of interviews from a program roughly equals that program's portion of the total customer population. One exception: Core Services customers receive less-intense services than customers in other programs, so the Core Services population is halved. Example: Program Population in WSA Sample Adult 80 8 Dislocated Worker 600 60 Youth 240 24 VRS 900 90 Core Services 2800 (use 1400) 140

    10. 5/28/2012 10 Samples SSB and MFIP are not included in local area samples or results. SSB program results are based on a statewide sample (~262 interviews over 12 months). MFIP program results are based on a statewide sample (~376 interviews over 12 months).

    11. 5/28/2012 11 Questions Three questions ask about general satisfaction: Overall satisfaction with the services? To what extent have the services met expectations? How well do the services compare with ideal? Questions are asked on a 1-to-10 scale where 1 is least satisfied and 10 is most satisfied. Responses to the three questions are averaged and converted to 0-to-100 scale to create MnCSI (Minnesota Customer Satisfaction Index). MnCSI can be used to compare results over time.

    12. 5/28/2012 12 Questions Two questions asked about staff: How satisfied that staff understand your needs? How satisfied that staff responded to request for help in reasonable amount of time? (response scale - very satisfied to very dissatisfied) Two additional questions asked (for all programs except Core Services) also use very satisfied to very dissatisfied How satisfied that were given enough information to make good choices for employment plan? How satisfied that had an active role in decisions about services? Core Services questions: How satisfied that were given enough help in the Resource Area? Have you used Minnesotaworks.net to look for openings? If YES to using MNW, then job seeker is asked Did you find that it was quite easy, somewhat easy, somewhat difficult, or quite difficult to use?

    13. 5/28/2012 13 Questions Three open-ended questions ask (customers asked only 2 of these 3 questions): What would you like the program/WFC to START doing? What would you like the program/WFC to STOP doing? What would you like the program/WFC to KEEP doing? Verbatim responses sorted into categories (e.g., service quality, staff, level of service) Each category reported as a percent of total responses Customers often mention more than one topic in their response (e.g., the computer class, learning what they are looking for in a resume, and the interview techniques . . .)

    14. 5/28/2012 14 Three Things to Keep in Mind When Viewing Quarterly MnCSI Results Results fluctuate from quarter to quarter; watch them over a longer period. After five or six quarters, ask: Is there any consistent pattern to our WSA [program] score? Is the score generally rising or falling? If we changed our services or processes, did the score change? Smaller samples give less exact results. Always check the width of the confidence intervals. Its best not to compare scores among WSAs. Differences may be due to variations in sample make-up or: local economic conditions customer-to-staff ratios financial resources program strategies customer characteristics, etc.

    15. 5/28/2012 15 Overall Satisfaction with Services: Local Area, Region, State Track the changes over time. Remember, the larger the sample (the bigger the N) the more precise the result. Local area MnCSI scores are put in context by comparing to State and corresponding region (Metro or Greater MN) MnCSI scores. The chart uses an enlarged scale range (60.0 80.0) so you can better see trends in MnCSI scores.

    16. 5/28/2012 16 Overall Satisfaction with Services: Local Area/Program Scores This chart shows average MnCSI score over time. Examine the confidence intervals, the black bars extending above and below the average scores. The bar indicates we are 95 percent confident the true score lies within the length of the bar. The narrower the bar, the more precise the MnCSI score. Think of confidence intervals as margin of error, much like political polls that refer to a margin of error of plus or minus three points.

    17. 5/28/2012 17 Summaries of answers to open-ended questions Tables provide a quick summary of topics mentioned in answers to: What would you like the programs/WFC to START, STOP, KEEP doing? The local area summary is put in context by comparing to State and region (Greater MN or Metro) summaries .

    18. 5/28/2012 18 What would you like the program/WFC to START, STOP, KEEP doing? Responses categorized into 6 to 7 major groups (issues or help finding and searching for a job, Staff helpfulness or improvements, etc.) and many more detailed sub-groups. Compare to State and Region (Metro or Greater MN) by looking across the rows.

    19. 5/28/2012 19 Comments on Good Services, September 2009 Results Youth My counselor went way beyond just finding me a job, he hooked me up with finding scholarships, that is what I am most thankful for. (WSA 3) Rehab Services A program called Brighter Futures. All of these programs boil down to the individual that has hands on contact. The person that I had contact with was wonderful. ( WSA 5) My job coach. They helped me adjust problems to my employer properly, and also helped me find affordable transportation. (WSA 17) Adult / Dislocated Worker The weekly group session, job club, we got a lot of different ideas on how to react in interviews. (WSA 8)

    20. 5/28/2012 20 Feedback on Good Services (cont.) Resume writing, interviewing skills, creative job searching. They seemed to be very current in terms of what employers wanted. (WSA 12) I went to a three day boot camp; it was beneficial to see how things changed over the years. I also received two computer classes and I really enjoyed those. (WSA 16) Core Services I had a one on one meeting with a job placement worker and he spent a lot of time going over possible classes, training and useful internet job searching tools. (WSA 4) They are actually helping me look for jobs by providing referrals via email and phone calls. (WSA 12) The combination of everything is important, talking one-on-one with a counselor is important so that they can get a feel for who you are and your needs. The classes and knowing the website is important. There is a wide range of needs so one-on-one talking is important. (WSA 17)

    21. 5/28/2012 21 Flexibility of the Survey Local areas that would like more detailed results may purchase a larger sample so their results can be broken-out by program. (Two programs, Voc Rehab Services and the Dislocated Worker program have enlarged their samples to break-out results down to local levels. VRS to 18 RAM or Team level and DW to 22 local area providers) Local areas or programs can explore additional topics by purchasing additional questions asked just of their customers. (State Services for the Blind and LMI Research have purchased additional questions.)

    22. 5/28/2012 22 Sample Job Seeker Web Page Look for the link to your local area or program at these following links System http://www.positivelyminnesota.com/About_Us/Customer_Satisfaction/Job_Seeker_Satisfaction/Entire_WorkForce_System_Results.aspx Program http://www.positivelyminnesota.com/About_Us/Customer_Satisfaction/Job_Seeker_Satisfaction/Results_by_Program.aspx WSAs http://www.positivelyminnesota.com/About_Us/Customer_Satisfaction/Job_Seeker_Satisfaction/Results_by_Workforce_Service_Area.aspx

    23. 5/28/2012 23 Need Further Information? Visit http://www.positivelyminnesota.com/About_Us/Customer_Satisfaction/index.aspx to view the entire Customer Satisfaction Survey results. Contact Devin Colvin of the Policy, Planning and Measures Unit via email, devin.colvin@state.mn.us or by phone, 651-259-7190, with questions, comments or requests about the presentation or results.

More Related