Reporting tools

1. Reporting tools Webinar Thursday 5th September 2013

2. Your speaker today Matt Roddan Director, Employee Research ORC International

4. Introduction • highlights report • How to interpret the results in your highlights report • Online Reporting / accesspoint • highlights • Questions

5. accesspoint

6. Logging in • After following the link to the online tool, the first thing to do is log in. • Easy! – just enter Username and Password and click ‘Log In’. • If there are any difficulties had trying to log in, please contact your local IT.

7. accesspoint • Document store / resources • Highlights reports • Webinars • Communication of results information • Action planning information • Survey questionnaire

8. highlights reports

9. Highlights reports to agencies • When in accesspoint, under Documents, you will be able to access and download your static ‘Highlight’ reports. • Design tailored to agency needs. The highlights reports highlight noteworthy data and present branch and divisional comparisons. • The following slides will explain how to interpret the information provided in thesereports

10. Highlights reports for managers • Quintile indicates the position of your agency when the 51 participating agencies are ranked against individual workplace factors and workplace outcomes. Graded into five 20%levels, ranging from top 20% to bottom 20%.

11. Highlights reports • Top 6 statements that have the maximum impact for your team and can increase your engagement score. • Predicts expected improvement if action is taken • Explore these statements in more detail with your team to have a better understanding of their responses and their ideas/solutions that can form part of your action plan. • Factors • Factor analysis categorises each statement into a theme • Your % positive score may be compared here to the average % positive of the area you belong to. • Benchmarks will only be used in sub-level highlight reports ie. % positive scores for a division will be benchmarked against % positive scores for theagency.

12. Highlights reports • All Questions • Allows you to see your full results for each item under their respective workplace factor. • You can compare your % positive score to the average % positive of the division or branch where you work. • A variance of + / - 5% is also shown with different coloured text.

13. What is the data saying? Focus on the questions within the driver factors, not just the lowest scoring questions. The drivers have the biggest impact on engagement, and subsequently on organisational performance. Remember the importance of the agency context…

14. Negatively worded questions • Some questions are negatively worded i.e. strongly agree/ agree indicates a negative response • Such questions have been coded such that the % positive score represents the % of respondents who disagree or strongly disagree • Negatively worded questions are indicated with an * in the reporting outputs • Example Question: • * I intend to leave my organisation within the next 12 months

15. Interpreting Results • The majority of questions use a 5-point scale. Responses are collapsed into 3 categories. • Example Question: My job makes good use of my skills and abilities • Be sure to look at the complete distribution of responses. • Mixed result — half positive, but most of the remaining neutral • Warning sign — half positive, large % negative

16. Online reporting highlights

17. Interactive access to the quantitative data online • Complete access to the full data set for your agency excluding free text comments • In a format that enables filtering and querying of results • Cut data according to demographic information • Secure format and password protected • Options to export pages into other formats

18. Accessing the online reporting tool • When in accesspoint, select the ‘highlights’ tab to access the tool

19. Simply press on the start button to launch the tool

20. When you first open the tool a pop up window will appear. This is where you can access guides and videos to help you through the tool. • Click on ‘Close this screen’ if you want to skip this introduction.

21. Welcome to highlights • Welcome to highlights! • The first page you will see is a dashboard of all key results • From here, the tool can display findings by different Business unit and results views

22. 1. Select your business unit • Clicking this button will bring up the screen below • Here, the user can specify the group of data to be displayed. • This can be at the overall, division/branch or work unit. • This will depend on your access level.

23. 1. Select your business unit 10 • Please note, data can only be viewed if this group consists of at least 10 respondents. This assures the confidentiality of employee responses.

24. 2. Select a view from the tabs along the top • Additional to the opening dashboard, there are five different ways of viewing the survey results in the highlights tool. • These will be detailed in the following slides.

25. Results: Full results • This is the initial view for ‘Full results’. This shows the % Positive score for all questions (the percentage of respondents that either ‘Agreed’ or ‘Strongly agreed’). • It also shows the results for all five options for each question. • Sometimes high levels of ‘Neither agree nor disagree’ or disagreement can help analysis of certain questions.

26. Results: Full results - Options • To get specific data, the user can hover their cursor over one of the 5 response options. • This can be helpful when percentages are very small, as there is sometimes not enough space for the figure. • Furthermore, this view can be expanded by clicking ‘Options’.

27. Results: Full results – Options: Questions • You can choose to select all questions or a particular section. • Under ‘Options’, the user can determine which questions are displayed and the types of responses shown (e.g., can show neutral or negative if preferred).

28. Results: Full results – Options: Benchmark variance • An important reference point in comparing survey results is the comparison with Benchmark scores. These are average % positive scores from specific groups of organisations. • The benchmark variance shows how the results compare with the selected benchmark. • Variances in a shade of green are 5 or more % points favourable whereas those in a shade of red are 5 or more % points lower than the benchmark score.

29. Comparisons: Compare work areas • The ‘Compare work areas’ view exhibits comparisons between areas. The green and red shading corresponds with the overall % positive. This is an effective way of quickly seeing which areas of the organisation answered questions more positively than others. • The comparison unit can be changed by clicking the ‘Change’ button.

30. Comparisons: Comparison units • The pop up box allows you to add particular areas of the hierarchy to compare against. There is the capability to bulk add and also bulk remove.

31. Demographics: Data breakdown • This view shows how questions were answered by different demographic groups. The ‘Options’ tab is important for this view to specify which demographic comparisons displayed. • The red/green shading can be moderated by ‘variance highlighting’

32. All Questions: • ‘All questions’ portrays a cross tabulation representation of all results. This can be useful if a user wishes to export the data into an Excel spreadsheet (e.g. To produce their own charts). Please note that data will only be available for groups with 10 or more responses.

33. Exporting • All of the data that is displayed in the highlights tool can be exported into either Adobe PDF or an Excel spreadsheet. This can be useful for printing or sending survey results. • By clicking ‘Export’, the adjacent window opens. Here, users can follow simple instructions to transfer information from highlights into these other formats.

34. Submitting feedback • Highlights also has an in-built review system. • By clicking on ‘Feedback’, users can provide their opinions to ORC International about different aspects of the survey results tool. And feedback is always appreciated!

35. Questions?