230 likes | 234 Vues
Auto-evaluation of FAO outlook studies work programme. Adrian Whiteman FAO, Rome. Introduction. FAO has to auto-evaluate each work programme element every 6 years Surveyed OS users and experts Oct-Dec 2004 Present the results of the evaluation - achievements - guidance from WP.
E N D
Auto-evaluation of FAOoutlook studies work programme Adrian Whiteman FAO, Rome
Introduction • FAO has to auto-evaluate each work programme element every 6 years • Surveyed OS users and experts Oct-Dec 2004 • Present the results of the evaluation • - achievements • - guidance from WP
Auto-evaluation survey • Users (from various FAO databases) – internet, e-mail and paper questionnaire • Experts and policymakers – telephone interviews • FAO staff – telephone and face-to-face interviews • Citation analysis • Website statistics
Survey of experts and policy makers • 83 people approached: experts; opinion formers; contributors • 70 people contacted • One-third non-users; one-fifth only slight users (not getting to opinion formers – especially in government) • Some significant users: CIRAD; METLA; Forest Trends; CIFOR; World Bank; WWF; African Development Bank; Conservation International • 35 people interviewed in detail
Strengths and competitive advantages • Unrivalled database • Credible, unbiased, transparent and free • Long-term and multi-country analysis, not available elsewhere • Have the authority of FAO’s backing, especially in broader agriculture and land-use context
Shortcomings and limitations • Not well advertised and weak follow-up • Audience is unclear – need more focus • Too big and too long/detailed for policymakers • Not enough country-specific follow-up (especially in Africa) • Presentation is sometimes a problem • Overly cautious • Short shelf-life • (Experts/contributors) – data quality is an issue, sometimes a heavy demand on contributors
Citations – use of outlook studies • PUBLIC SECTOR: used to stimulate debate, explain policy and raise awareness of the sector • PRIVATE SECTOR: used to stimulate investment • ACADEMIC: used for research planning • In particular, outlook studies are used to debate environmental issues, then economic and social issues in the forestry sector
Survey of (37) FAO staff • Mixed response • Not used extensively, mainly used for information rather than analysis • Unclear focus • Poor marketing • Little follow-up in countries • Short shelf-life, need regular updates • Should work more holistically
Audience: national policy; international policy; investment – need better focus? Large studies every 10 years or shorter more regular studies? Process – top down or greater country capacity building? Marketing – getting the product onto desks! Other issues (e.g. future developments)? Comments, questions and guidance please! Especially: