1. The Modernisation of Higher EducationFrom Degree Programme Design to LOLA • Anthony Vickers

2. Transparency = EmployabilityQualifications are global

3. Programme Design

4. Programme Design and Transparency Part 2: Information on programmes General description: • qualification awarded • level of qualification • specific admission requirements • specific arrangements for recognition of prior learning (formal, non-formal and informal) • qualification requirements and regulations • profile of the programme • key learning outcomes • occupational profiles of graduates with examples • access to further studies • course structure diagram with credits (60 per full-time academic year) • examination regulations, assessment and grading • graduation requirements • mode of study (full-time, par t-time, elearning...), • programme director or equivalent. refer to page 28 of the Users Guide for course Catalogue content

5. Key Learning Outcomes at Programme Level • http://www.vfu.bg/en/index.php/ects/204 • http://www.essex.ac.uk/programmespecs/progspec.asp?prog=BENGH610++11

6. Programme Key LO Module Maps Programme Key Learning Outcomes Module Map

7. ECTS Users Guide Question: How many occurrences of the phrase “learning outcomes” appear in the current Users’ Guide? Answer: 139

8. The ECTS Users’ Guide • Introduction “The 2009 Users’ Guide elaborates on the previous version of 2005. It has been updated to take account of developments in the Bologna Process, the growing importance of lifelong learning, the formulation of qualifications frameworks and the increasing use of learning outcomes.” • Section 2 – ECTS Key Features “ECTS is a learner-centred system for credit accumulation and transfer based on the transparency of learning outcomes and learning processes.” “ECTS credits are based on the workload students need in order to achieve expected learning outcomes. “Learning outcomes describe what a learner is expected to know, understand and be able to do after successful completion of a process of learning.” • Section 3 – ECTS Key Features Explained “Learning outcomes statements are typically characterised by the use of active verbs expressing knowledge, comprehension, application, analysis, synthesis and evaluation, etc.” • Section 7. References for Further Reading

9. What are Learning Outcomes? • “Learning outcomes describe what a learner is expected to know, understand and be able to do after successful completion of a process of learning.” • They must be assessed. • They clearly involve students in undertaking work and therefore have a workload associated with them. • They need to contain an appropriate verb (Blooms Taxonomy). • They need to be obtainable and measureable. • Learning Outcomes need to be written in a holistic context taking into account the Learning and Assessment. (LOLA) • Feedback should be given in relation to Learning Outcomes.

10. An example Process from the UK • Generate the programme specification taking into account the relevant Benchmark Statements. The programme specification will list the programme learning outcomes. (http://www.essex.ac.uk/programmespecs/progspec.asp?prog=BENGH610++10 ) • Create a structure of modules across the study programme taking into account the level. In each year set the appropriate workload to meet the learning outcomes. In this example all modules are either 7.5 or 15 ECTS credits. • Write the module learning outcomes relating them to the programme learning outcomes and taking into account the learning, teaching and assessment methods or strategies. The workload within a module should be distributed amongst the activities in an appropriate way to enable the students to meet the learning outcomes. • http://www.essex.ac.uk/courses/Default.aspx • http://www.modules.napier.ac.uk/ • Take care that you assess the learning outcomes you wrote and that any other skills required have already been demonstrated.

11. What LO’s are not! • A set of statements that are for administration purposes only. • Written with no thought given to the learning or assessment. • Written without careful choice of the verb. (for example “describe, identify, analyse, explain” and not “know, understand, learn, appreciate”.)

12. Programme Key LOs to Module LOs

13. Learning Outcomes at Module Level (LOLA) • Learning outcomes are an essential part of ECTS. • At module level Learning Outcomes need to be written in an holistic way taking into account the Learning that will be undertaken by the student and the Assessment they will way to demonstrate they have acquired the learning outcome (LOLA).

14. The Learning Outcome Create a critical review of relevant international literature. This learning outcome requires the student to identify or be given relevant international literature and then critically review that literature. The following paragraph is an example statement that would be given to students at the start of the module in order for them to understand what is required in order to achieve this learning outcome. Students are required to research the international literature to find articles relating to programme and module design. They should concentrate on peer reviewed academic literature and policy/guidance literature generated by Institutions, National Authorities, and International bodies such as the European Universities Association (EUA). Students should read and précis the articles they find. From their set of précis the students should write a 5000 word article on a theme they decide. The article should not only report on the literature they have found but also provide an in depth critical review. This statement expands the module learning outcome to give it more clarity and also indicates the broad learning the student will undertake and what written work they must produce.

15. The Learning Process A further statement should be provided that give more depth to the learning process. For example a statement of the learning process might be; This module will run in the first semester. The module is a 7.5 ECTS credit module and therefore students should aim to undertake 187.5 workload hours (25/ECTS credit) in total taking into account all lectures, seminars, individual work, and assessments. At the first lecture students will be introduced to the varied research tools available to them such as the online databases available in on the intranet. A short questionnaire will be completed online by students. This questionnaire will provide a score regarding readiness to undertake independent research and critical analysis. The results of the questionnaires are only provided to the individual student. The result will indicate what action the student should take to raise their skills to the level assumed to undertake the module. Support will be provided through two weekly seminars with the module tutor. Through the semester the students will produce libraries of articles which they will store in an online document repository. The module tutor will have access to these libraries and will provide guidance regarding the relevance of the material being accumulated. A further document repository will be used to store précis. Again the module tutor will provide feedback on these précis. The précis themselves are not assessed. Students should aim to produce an outline of their final critical review article by the 10th week of the semester. This outline will be reviewed by the module tutor and feedback provided. For the remainder of the semester the students should work on their critical review article submitting the final version to the online submission server by the deadline which is Friday 12 noon of the last week of the semester.

16. The Assessment The final statement that is required to be given to students at the start of the module is the statement regarding the assessment criteria. This statement can take many forms but it should give a clear indication of how the student will be assessed in order to meet the learning outcomes. Remember that the learning outcome was, “a critical review of relevant international literature”.

17. The Assessment

18. Questions & Discussion