200 likes | 338 Vues
This document outlines essential quality control tools and procedures for agricultural data collection. It covers the implementation of listing controls, interviewer observations, reviews, and reinterviews to ensure high data quality. The text details the roles of supervisors, the significance of both formal and informal reviews, and random sampling methods to validate enumerator work. It highlights the need for immediate corrective actions in cases of identified errors and emphasizes continuous training and feedback mechanisms to maintain and improve data collection standards.
E N D
Agricultural Data Collection Procedures Section B
Quality Control Tools • Listing sheet controls • Interviewer observations • Formal / Informal reviews • Reinterview • Address listing QC
Listing Quality Control Tools Dependent Quality Control, including: • Advance listing • Suppression If errors are found, choices include: • Listing mistakes corrected • Re-list enumeration area
Dependent Quality Control • Supervisor or another enumerator checks a sample of the listing. • Copy listing information for select units without enumerator knowledge. • Review a randomly chosen area to verify coverage, check for omissions and completeness.
Other Listing Quality Control Tools Advance Listing • Supervisor lists sample before enumerator • Compare work when enumerator completes the sample section. Suppression • Enumeration units are removed from listing • Supervisor checks for enumerator updating of suppressed (omitted) units
Interviewer Observations • Supervisor watches enumerator work • Does not interact to minimize bias • Makes notes during observation • Provides feedback after observation
Interviewer Observations • Assess effectiveness of training • Ensure enumerators can do their work • Provides continuous feedback • Corrective actions may be needed
Formal / Informal Reviews What are the goals of reviews? • To ensure the quality of the data collected on forms and questionnaires • To ensure interviewers and clerks understand and follow procedures for completing forms and questionnaires
Informal Reviews • Supervisor reviews enumerator forms during enumeration • Check for legibility, completeness and accuracy • Provide feedback • Repair errors
Formal Reviews • Conducted by field office staff upon completion of EA • Provides check of supervisory work • Repair errors or return to field where necessary
Random Reinterview • Another field staff member interviews an enumeration unit after enumerator • Finds same respondent and completes new questionnaire • Questionnaires are compared to verify content
Random Reinterview Sample • Supervisor takes simple random sample from each enumerator’s workload • Above supervisory level uses two-stage sample: • Sample of enumerators in their area • Sample of enumeration units from those enumerators
Reinterview Errors • Falsification (release interviewer) • Interviewer error (retraining/feedback) • Respondent error (no action) Rework may be necessary for falsification or other serious errors
Administrative Reinterview • Accumulates data on work characteristics for all interviewers • Vacant enumeration units • Partial interviews • Enumeration units by type/location • Deleted enumeration units • Average size per enumeration unit
Administrative Reinterview • Provides a more targeted and informed approach to identifying outliers • Does not replace other reviews • Management tool and provides organizational operational data
Administrative Reinterview • Compile data for all enumerators • Compare individual data to compiled data • Note areas of variance for investigation • Could be that individual is performing better than group
Administrative Reinterview Actions • Cannot take corrective action without investigation • Increase suspect enumerator reviews: • Informal/formal review • Reinterview
Supplemental Reinterview • Purposeful selection of a particular enumerators work for reinterview • Supervisor selects sample size • Ensure quality • Avoid over-sampling
Supplemental Reinterview • Means for checking work of selected enumerators • Especially useful for suspected falsification • Should be stopped once quality is of acceptable level
Section B Quiz • What are the five quality control tools available for data collection operations? • What are three listing quality controls? • Explain how to conduct interviewer observation. • Name the three types of reinterviews that can be used to assess the content and quality of data collection. • Is falsification a serious problem? Yes or No