180 likes | 195 Vues
Explore ABS's transformation in data collection methods, embracing innovation to meet changing demands while managing challenges. Discover how ABS is reshaping its infrastructure and processes to enhance statistical information delivery for the future.
E N D
Seminar on New Frontiers for Statistical Data CollectionWP 30 Moving to common survey tools and processes – the ABS experience Jenine Borowik, Adrian Bugg, Brent Ross
Outline • ABS experience – progressive convergence of data collection tools and methods • ABS 2017 directions • Risks and issues • Conclusion
Major ABS Change • 1960’s • - Integration of Economic Statistics • Integration of Household Statistics 1980 2010 1950 1960 1965 1970 • 1995 • Analysis Unit Established • ABS Website • 1stConfidentialised unit record file 1992 National Project Centres 1990’s Increased use of Adm Data 2011 Future Organisation Structure 1968-69 Economic Census Information Management Transformation 1990 2000 2002 Business Statistics Innovation Program 1964 1st Mainframe ABS 2017 1992 Lotus Notes/WDBs 1950’s Introduction of Sample Surveys 1970’s Formal User Consultation Introduced
Individual collection methods and systems for Progressive convergence of tools and methods CAPI / CATI Paper and scanning Establishment of ESDC (100-400 office based interviewers) Single field interviewer workforce (300-900 field based interviewers) Administrative Data Acquisition Unit Integrated Collection and Dissemination Division • Household surveys • Business surveys • Population Census • Others • “cottage industries”
ABS experience • Existing purpose built capability • Specialised • Inflexible and vulnerable • High cost to maintain and change • Slow to change • Cycle of leap and legacy
The Challenges Riding the big data wave New competitors & changing expectations Increasing cost & difficulty of acquiring data Competition for skilled resources - low unemployment Reducing budget Rapid changes in the environment
Where are we headed? • Over the next 5 years we will transform the way the ABS manages information from collection to dissemination • Providing a better evidence base for use by Governments and the community
ABS 2017 Program Goals • Reduce the cost and time of doing business • Grow the business through new statistical products and services • Deliver the first large scale digital Census (2016) on time, to budget and quality • while delivering Business As Usual.
How will we get there? • Through large scale Innovation across the whole ABS • We will: • radically transform the way we acquire, collate, use, reuse and disseminate statistical information • By: • industrialising, modernising and reengineering our business processes • reengineering our statistical infrastructure and the way we manage information • developing capability needed to meet future needs • collaborating with other international NSIs • focussing on a limited number of centralised projects, including the digital Census for 2016
1. Business Process Reengineering • Change the way we acquire and process data – emphasis on e-collect for Census 2016, business and household surveys, including web and hand held devices • Increase our access to and use of large administrative datasets • Integrate and join data from a range of sources
2. Reengineering Statistical Infrastructure • New Core Information Management Infrastructure tools • metadata driven systems based on agreed standards • One ABS data warehouse to store, manage data from all sources • On-line data that can be queried • Management of statistical workflows • International collaboration to build next generation statistical tools
Acquire@ABS High Level Overview PROVIDERS Governments Households Individuals Businesses CHANNELS/MODES en masse (system to system) On paper On the phone On line On the go On site ABS Receive data Digitise data Support Providers Despatch Instruments / Requests for Info Run Collection Transform & Load data Design, Build & Test Collection Instruments, Processes & Systems Manage Provider Information Manage Workforce & Workload
Collection Futures for Census, Household & Business Surveys Household Surveys Business Surveys Population Census
ABS 2017 Infrastructure ABS 2017 Strategy Line of business - silo / legacy Enterprise Solution Line of business - utilising core infrastructure Enterprise Ready Candidate for future upgrade Minimise -where enterprise is undesirable (business case doesn't exist) Freeze, Minimise investment
Risks and issues • New stovepipes with standard tools • Future organisational structure – “Operations Division” • Don’t want to build if we don’t need to • Standards versus flexibility • Cultural change and resistance • Achieving the savings • One size may not fit all • Trade offs will need to occur in some business areas • We can’t resolve all problems
Thank you Further information: • Jenine Borowik jenine.borowik@abs.gov.au • Adrian Bugg adrian.bugg@abs.gov.au