Centre for Employment Research

1. Centre for Employment Research What Does a Degree Give You? A Quantitative Analysis of the Skills of Prospective Government EconomistsPhilip Hedges*, Peter Urwin** & Franz Buscha***Department of Economics & Quantitative Methods**Centre for Employment ResearchWestminster Business SchoolDevelopments in Economics Education September 2007hedgesp@westminster.ac.uk, urwinp@westminster.ac.uk,f.buscha@westminster.ac.uk

2. Centre for Employment Research Introduction • Investigate the effects of various candidate characteristics on the probability of passing or failing the GES Economic Assessment Centre (EAC). • Binomial probit regression model in order to ascertain the marginal effects of each of the characteristics on the likelihood of passing. • OLS regressions explore the significant variables determining scores in knowledge, application & communication of economics. • Care needs to be taken in interpretation, as we have at present few control variables and do not account for the possibility of endogeneity and/or selection bias. • Though we do offer a tenuous conclusion to spark debate.

3. Centre for Employment Research Background • Just over 1,000 GES Economists 2007. • Candidates to the GES have the opportunity to attend the EACs twice a year. • Analysis covers first three rounds of the newly introduced process (two from 2006/07 & one from 2007/08). • Little specific literature examining the skills and abilities of graduates applying for Economics posts (whether in the private or public sector). • That which does exist tends to take a qualitative approach [Colander, 2004; O’Doherty et al., 2007). • Contribution of our analysis is that we are able to distinguish the characteristics of those who do and do not meet the skills requirements set by the GES.

4. Centre for Employment Research The Data • Dataset of 717 candidates, with a range of characteristics; scores in three skill areas and pass/fail/withdraw status. • 255 passes, 319 fails (Overall pass rate 44%). Covariates • Degree Classification • Subject of Degree [Pure Econ] [Mixed] [PPE] [Other] • UG University [Oxbridge] [Russell 18] [Other UK] [New UK] [Overseas] • PG Study [MA/MSc Econ] [Other PG] [NoPG] • Nationality [British & Commonwealth] [EU]

5. Centre for Employment Research Covariates • Verbal & Numeracy application test scores converted into quartile dummies. • UCAS points converted into quartile dummies • Extra Curricular & Work Experience ‘scores’ • Pass/fail status breaks down into three skill areas (assessment scores from 1 to 5) • Knowledge • Application • Communication of Economics • Page 6 for Table of descriptives; comment on key indicators.

6. Centre for Employment Research Pass/Fail Frequencies by Degree Class(Percentage pass/fail rate given in parenthesis)

7. Centre for Employment Research Pass/Fail Frequencies by Degree Subject(Percentage pass/fail rate given in parenthesis)

8. Centre for Employment Research Pass/Fail Frequencies by UCAS Points(Percentage pass/fail rate given in parenthesis)

9. Centre for Employment Research Skill Assessment Scores(Each skill scored from 1 to 5)

10. Centre for Employment Research Binomial Probit Results (1) • Table VII Page 9 • Possessing a 2:1 degree is associated with a significant reduction in the probability of passing. • 2:2 or N/A results are insignificant. • Negative 2.1 effect driven by criteria for being accepted into the process of EAC, which requires candidates to possess at least a 2:1 OR Masters. • Group not recorded as 2:1 are predominantly those with a 1st ; but also those with a Masters.

11. Centre for Employment Research Significant Probit Results (2) • EU (other than UK) nationality reduces the predicted pass rate by 13.8% points. • Important to ensure that this is not an artifact of the process, rather than a characteristic of the students. • This impact remains after controlling for verbal score (significant effect for those who score between the median and upper quartile; increasing the predicted pass rate by 19.2%). • Controls for ability/achievement both before (UCAS Tariffs) and after (verbal and numeracy test scores) UG study. • Various of these controls are significant; as is the indicator of significant work experience. • The histogram of predicted values from this probit model shows a kernel distribution with no systemic bias towards failing or ‘humps’.

12. Centre for Employment Research OLS Models • The Knowledge, Application & Communication scores were modelled using OLS and support Probit findings. • However, in addition: • Significant positive coefficients for the Oxbridge and Masters variables when explaining Knowledge scores • Significant positive effect of possessing a Masters qualification when explaining Application scores. • Significant positive effect of extra curricular activity when explaining Communication scores (which is encouraging).

13. Centre for Employment Research Tenuous Conclusion and Extensions • Type of university and type of degree (PPE, Econ, mixed etc.) does not seem to have much effect. • Limited controls for innate ability, but we do have some indicators of ability or achievement both before and after study at levels 4 to 6. • Tentatively suggest that our results indicate that innate ability is more important than other factors which are aimed at ‘moulding’ Economists. Extensions • Interactions as sample size grows – e.g. Class and Type of degree with institution (breakdown of ESRC Masters). • More explanatory variables such as years since graduation, gender, ethnicity and re-applicant status. • Analysis of withdrawals based on candidate’s expectation of likely EAC outcome and/or other alternatives available.