Corporation Test Coordinator  Algebra II  English 11 WebCast for the A3 Administration

1. Corporation Test CoordinatorAlgebra IIEnglish 11WebCast for the A3 Administration Fran Linhart Principal Consultant 319-337-1444 Fran.Linhart@act.org

2. Agenda • General Information • Educator Resources • Technical • System Requirements • Loading VanGuard™ • Logging On • Navigation • Student Files and Teacher Files Uploaded from the STN • Uploading New Students (data not provided in the STN) • Search for and Edit Users/Students • Test Rosters • Reports • Additional Resources • The User Experience at the School Level • The Student Experience

3. General Information The QualityCore program consists of: • Algebra II: a paper-and-pencil test, with 3 open-ended questions • English 11: a computer-based test, with 1 open-ended question Both tests consist of one 45-minute multiple-choice session and one 45-minute constructed-response session. The QualityCore hierarchy includes: • State: Site Administrator • Corporation: District Administrator • School: School Administrator, Teacher, User, and Student All Corporation and Corporation Test Coordinator information has been uploaded into the system. Corporations that are testing in A3 will also have student and teacher information uploaded by ACT in early April.

4. General Information The QualityCore program consists of: • Algebra II: a paper-and-pencil test, with 3 open-ended questions • English 11: a computer-based test, with 1 open-ended question ACT is committed to ensuring that EVERY STUDENT will have a test available on the day of testing.

5. General Information The QualityCore program consists of: • Algebra II: a paper-and-pencil test, with 3 open-ended questions • English 11: a computer-based test, with 1 open-ended question ACT is committed to ensuring that EVERY STUDENT will have a test available on the day of testing. All corporations will automatically be shipped back-up paper-and-pencil English 11 tests to arrive one-week prior to the start of the test administration window. The goal is to administer the English 11 tests online … but corporations will have the option of delivering English 11 as a paper-and-pencil administration.

6. Educator’s Resources • Educator’s Guide: Practical information on how all the Educator’s Resources are intended to be used. It includes activities to guide instructors in comparing their current instructional materials with the QualityCore materials, which reflect a data-based, proven approach to rigorous instruction. • Course Objectives: Enable educators to align school curricula with the essential knowledge and skills students need to be prepared for postsecondary education or workforce training programs. • Course Description and Syllabus: Describes pedagogical strategies that make a course rigorous, defines course content, and sets forth classroom policies that encourage learning. • Test Blueprint: Describes the thinking skills and content that are measured by questions in the end-of-course assessment, so that curricula and interim assessments may be aligned with the essential skills that will be measured. • Guidelines for Developing Instructional Units: Provides a step-by-step process for designing instruction for specific learning goals, student needs, student characteristics, and learning contexts. • Model Instructional Unit: Illustrates how the course objectives are connected to instruction and can be delivered in the classroom. Teachers may use as-is, or as a model to assess the quality of existing units, or as a way to develop new instructional units.

7. Technical System Requirements Check • Each student computer must undergo a system requirements check prior to testing to confirm that each student computer meets the system requirements. • Log on to www.act.org/qualitycore/indiana and click the Systems Requirement check … OR • Go to http://qc.vantage.com .. OR 3. Use this link to run the system check: http://browserhawk.vantage.com/bhawk/jsp/qualitycoreSystemRequirements.jsp • A feedback form will appear on screen. If there are issues, links will be provided to help resolve the issues. Once steps are taken to resolve any issues, click the "Run Test Again" button to rerun the test and update the results.

8. Technical Installing VanGuard™ Designed to reduce the risk of cheating, test interruption, or variances in the testing environment, VanGuard™ adds security, reliability, and validity to the test experience. VanGuard must be loaded on to all computers prior to testing. To help schools find directions for installing VanGuard, ask them to log on to www.act.org/qualitycore/indiana. Click on the Download VanGuard Secure Browser link. Clicking on this link will provide directions for installing VanGuard to a PC and/or a Mac. Technical directions for uploading VanGuard can be found on pages 7 – 10 in the Online Manual.

9. Technical • VanGuard Guidelines • Add vanguard.vantage.com to the proxy bypass list • Link to the full self-extracting installer. This version uses the Windows registry, rather than the file system, to store the downloaded VanGuard configuration. Use this link if you encounter “file access” errors when logged in with a restricted student account. • http://vanguard.vantage.com/VanGuardv3_1_1.exe • OR • For users who want to manually upgrade a previously installed version of VanGuard, here is a link to a zip file containing two executables. These should replace the existing files in c:\Program Files\VanGuard. • http://vanguard.vantage.com/VanGuardv3_1_1_exes.zip • NOTE: It is not necessary to first uninstall previous versions of VanGuard.

10. Logging On There are two ways to get to the QualityCore site: • Go to: www.act.org/qualitycore/indiana and click on the “Log on to QualityCore” link. • Key in: http://qc.vantage.com. • A log in screen will appear. Type your username in the Username field. • Type your password in the Password field. • Click once on Login. • You will be asked to confirm who you are. First-time users will be asked to read and sign a user agreement. NOTE: Your username is not case sensitive; your password is case sensitive.

11. CTC Navigation The screen banner has these links: • Main Menu: This link will take you back to the main menu. • Resources: Click here to access the three manuals (Online User Guide, Examiner’s Manual, Test Administrator’s Manual). • Contact Us: Send an email to ACT. • Log Out: Click here to log out of QualityCore (located on the far right side of the screen).

12. CTC Navigation The mid section of the screen displays these links: • Site Administration • Test Rosters • View Reports • Update My Account • Test Control Code Click on Site Administration.

13. Site Administration Clicking on “Site Administration” results in a new screen. • Search and Manage Users: Allows you to find school administrators, teachers, users, & students. • Create New Users: Allows new users (school administrators, teachers, users, & students) to be created. • Clicking on “Site Administration” results in a new • screen. • Search & Manage Users: Allows you to find school administrators, teachers, users, & students • Create New Users: Allows new users (school administrators, teachers, users, & students) to be created • Upload Accounts: Allows you to upload groups of administrators, teachers & students. • View Previous Orders: Allows you to check your previous order. • Order Against Existing Commitment: Allows you to place additional materials orders (with the exception of Braille and Large Print.

14. Search & Manage Users Scenario: You want to create a list of all the Algebra II teachers at a school. • Click on Search & Manage Users • Click on the Sub-district drop-down box and select No Sub-district. NOTE: Schools will appear ONLY if a value for Sub-district is selected. If a value for the Sub-district is not selected, no schools will appear. • Select the school. • Select a User Type from the drop-down menu. • Click on Perform Search. The list of teachers will appear.

15. AddingNew Users Scenario: A new student has transferred into the Corporation two days prior to a test being administered. • Click on Create New User • Click on the Sub-district drop-down box and select No Sub-district. • Select a School from the drop-down box. • Select User Type. The screen will vary based on user type selected. Key in the required fields (identified by an asterisk). • When you are finished, click Save. To exit without saving, click Cancel.

16. Uploading Multiple New Users Scenario: 23 new students transferred into your corporation after you submitted your student file to the state. • Click Upload Accounts from the Site Administration Menu. • A display of information related to previous uploads will appear. • Select Student Template to view the fields that the upload will contain; a description of acceptable values for the data contained will be located in each column.

17. Uploading Multiple New Users 4. Click on Download Template to save a copy of the Student Template to your computer. 5. Click Save in the pop-up window, and then select a location on the computer where you will save the file. The template includes two tabs at the bottom of the screen. The first tab (Student) opens the worksheet in which the student information is to be entered. The second tab (Codes for student info.) serves as a lookup for ensuring that student information is entered correctly.

18. Uploading Multiple New Users 6. Enter student information into the StudentTemplate using the prescribed format. • Click on Upload Student File or Upload Teacher / Admin File. • In the new screen, select Sub-District and School. • Key in a title for the upload file. • Click Browse to locate the student information that has been saved to the template on your computer. • Click Submit to upload the template into the system. The Student / Teacher Import screen will appear, and the upload will be added to the upload history screen. The system will now “check” the data.

19. Uploading Multiple New Users 11. Click View to review the uploaded data. The data will be classified as “Valid-Add” or “Invalid.” Only data classified with a “Valid-Add” status will successfully complete the upload process. • To correct the “Invalid” data, click on the word Invalid and correct the data error. Or, correct the data in the original file, then select Reupload File to locate and upload the template. • After the errors are corrected, click on Import Valid Records to complete the student upload process. The program will take you to the Teacher/Student Import screen, where the status will now show as “Finished.”

20. Scenario: After uploading the student file you find an error that you would like to correct. Click on Search and Manage Users. Click on the Sub-district drop-down box and select No Sub-district. Use the School drop-down menu to select the school where the individual is located. Click on the school. Use the User Type drop-down menu to select the type of user that you are seeking. A final screen will appear. The appearance of the screen will vary based on the type of user that you are searching for. Provide the requested information and click on Perform Search. Editing User Information

21. WHO can edit WHAT? At the CTC level A CTC can edit information for users in the corporation hierarchy … district users, school administrators, school users, teachers, and students But a CTC can not edit CTC information. At the STC level An STC can edit information for users in the school … school administrator, school users, teachers, and students At the Teacher level A teacher can edit the teacher’s own information or information for students in the teacher’s rosters Editing User Information

22. Editing User Information Editing Teacher or User Information Editing Student Information *Asterisks indicate mandatory fields.

23. Test Rosters Test Rosters have been pre-loaded based on the student files. Scenario: The school needs to create a new and separate roster for those students who need extended time for the English II online exam. • Log on and click Test Rosters . • Click on the Sub-district drop-down box and select No Sub-district. • A drop-down screen will list the schools in the district. Click on the button Create Test Roster located on the lower left section of the screen.

24. Test Rosters • Use the pull-down menu to select a test for the roster. The number of test units available will display in red below the Test Selection drop-down menu. NOTES: Red text will appear here *The administrator must have placed an online order for units (entered counts) for the test administration prior to creating a roster and assigning test units to the roster. *If no test units appear, then an order needs to be placed. *If an insufficient number of tests appear, you can increase the number of test units by placing an additional order.

25. Test Rosters • Enter a Test Roster Name. You may choose to specify Description, Building, Room Number, Period, and a Subject. Use the drop-down menus to select the Grade Level and Class Type (optional). • Click on the Next Step link located on the lower right section of the screen. Scenario: You have created a class roster containing 25 students, but you only have 20 units available. Should you: (1) order an additional 5 units, or (2) order a block of 25 units for the complete class? • The correct answer is #2. Increase the order to accommodate the entire class.

26. Test Rosters 7. A new screen will display the Test Roster information. Use the Active/Inactive drop-down menu to set a status. Click Next to proceed or Save to save your work. • The timer screen will appear. You may use the drop-down menus to hide the timer, set a time limit for each session (including extended time), indicate a warning message, the out-of-time message, and if the timer should show seconds. REMINDER: Each session of the QualityCore test is a 45 minute session. Students who require extended testing time for the online exam should be placed in a separate Test Roster.

27. Test Rosters • After making your selections, click Save & Exit. • Find the new roster. Click Members to view the list of student names that you would like to add to the new test roster. • Click inside the white box to the left of each student name to add the student to the test roster. • When you have completed selecting the students, click on the Save link in the lower right hand corner of the screen.

28. Online Reports • Log on and click Test Rosters. A report menu will appear.

29. Online Reports There are two reports: • Preliminary Multiple-Choice Report: contains a raw score • Interim Final Report: Contains transformed raw score for Multiple-Choice (MC) and Constructed-Response (CR). MC % correct + CR % correct + 600. Reports will be available: • Online: Student reports will be available a maximum of 10 business days after a student submits a test. • PP: Student reports will be available a maximum of 10 business days after the vendor receives materials from your corporation.

30. Online Reports

31. Online Reports Formula for calculating the interim QualityCore score: Multiple-choice % correct Constructed-response % correct + 600 720

32. Online Reports

33. Online Reports

34. The School-User Experience • The CTC designates school test coordinators and provides STCs with user IDs and passwords. • The Log On experience, Main Menu and Site Administration Menus are identical to your CTC experience. • Navigation is identical to your CTC navigation. • The difference – schools only access data from their school (and they do not have to click through the sub-district box).

35. The Teacher Experience • Once teachers’ names have been uploaded into the system based on IDOE Data Collection files, send usernames and passwords to the teachers in your corporation/school: TYPE FORMULAEXAMPLENOTES User name firstnamelastname mariagarcia All one word, all lowercase Password quality All lowercase • Some files did not provide first names of the teachers. If this is the case, insert the names of the teachers’ respective high schools in place of the missing first names: FIRSTLASTEXAMPLE (blank) Smith richmondsmith (blank) Kasad northterrehautekasad • Log on and select Site Administration. • Select Search and Manage Users. • Use the pull-down menu to select the corporation / school. • Use the pull-down User Type menu to select the user type.

36. The Teacher Experience Follow these steps for online and paper-and-pencil administrations You can produce a roster showing teachers’ usernames and passwords: • Log on and select Site Administration. • Click on Search and Manage Users. • Use the pull-down menu to select the desired corporation/school. • Use the pull-down User Type menu and select Teacher. A report will appear.

37. The Online Test Experience • Log on and select Site Administration. • Click on Test Control Code.

38. The P/P Test Experience Test materials will be shipped to the corporations, boxed for distribution to the schools. Materials will include: • Materials packing list (in packing list window outside of the box – keep this list and include it in your return shipment). • QualityCore Test Booklets: • Multiple-Choice Part 1 • Constructed-Response Part 2 • Algebra II Reference / Formula Sheets. • QualityCore answer document. • QualityCore school (building) and group (class) headers. • Envelopes to return completed answer docs to the QualityCore Scoring Center address. • Text books and other non-scannable materials to be returned to the ACT McCarrel building address.

39. The P/P Test Experience Upon receipt of the materials at the schools, STCs shall: • Open the boxes and verify that the contents match those listed on the enclosed packing slip. • Count the individual test booklets and other items to ensure that you have received the correct numbers of materials. If there are any discrepancies, contact the CTC. The CTC has overage materials available should additional materials be needed. • After verification, reseal the boxes and lock them in a secure storage area. • Remember to save the boxes! – they will be used to return the non-scorable test materials to the ACT McCarrel address.

40. The P/P Test Experience Prior to distributing test materials to the examiners: • Record the number of test booklets issued to each teacher and class. • Ask each Examiner to count and verify the number of booklets they receive from and return to STC. When distributing materials for the exam, each Examiner should receive: • Test Booklets. • QC MC Part 1 test booklet. • QC CR Part 2 test booklet. • Answer document – one per student. • Algebra reference / formula sheet – one per student. • QualityCore Group Header Sheet(s) – one per group assigned to the Examiner.

41. The P/P Test (with Pre-ID labels) Do NOT make edits to the Pre-ID label! Marking up a pre-ID label may delay the scanning and scoring process. The student demographic information on the answer document MUST match the online information. If the information contained on a label is incorrect, you should: • update the student demographic information online – and bubble the updated information on the answer document (Destroy the pre-ID label).

42. The P&P Test Experience (Bubbling) Bubble the student demographic information EXACTLY as it appears on the Student Log In printout. Changing the gridded-in information may delay the scanning and scoring process. If the information on the Student Log In printout is incorrect, you may: • Log on and update the student’s record; • Print out a REVISED Student Log In file; and • Grid the answer document using the REVISED Student Log In printout.

43. The Student Experience • Click on the VanGuard icon on the desktop. The student login screen will appear. • The student keys in his QC ID, first name, middle initial (optional) and last name EXACTLY as they appear on the student roster. The student selects his date of birth, and clicks Sign In. • First-time users are asked to read and accept the QC Terms of Use (selecting Decline will log the student out of the system).

44. The Student Experience • After accepting the agreement, a pop-up window asks the student to confirm the log-in information. • An assignment screen will appear. Students click on the test that they will be taking.

45. The Student Experience • A pop-up screen will ask students to confirm that this is the correct test. • A directions page will appear. This page is accessible throughout the test session.

46. The Student Experience • The testing screen contains either a reading passage, question and answer options, or only a question and answer options. • Some test questions are presented in a side-by-side format, shown here. • Others are presented in a top-to-bottom format.

47. The Student Experience The student has these tools available: - Bookmark - Review - Finish - Next - Return to Test - Final Submit - Previous - Save and Finish Later - Show Directions

48. The Student Experience A Final Test Review Page will show the questions that are unanswered. The student will the question number or select Return to Test to review, change, or add an answer.

49. The Student Experience Students will select Final Submit to submit their tests for scoring. By clicking Final Submit, they will not be able to return to this section of the test. A screen will ask the students to confirm their intention to exit/end the test. The Teacher / Examiner will need to enter the Test Control Code* to either exit the test or move on to the next section. *Do NOT enter the Exit Code to submit tests.

50. FAQs Extended Testing:Is it possible to extend the test time once a class has started taking a test? Have the student PAUSE the test. The Examiner /Teacher must enter in the Test Control Code. Contact ACT Customer Service. ACT will be able to override the system to enable “Extended Time” for the student. The student should then log on and resume testing. What is the difference between the Test Control Code and the Exit Code? Both codes can be found by clicking on the Test Control Code button found on the Main Menu. Use Test Control to submit a student’s test. Use the Exit Code to remove the VanGuard icon from the desktop.