120 likes | 240 Vues
This presentation emphasizes the proper use of data from the National Longitudinal Survey of Children and Youth (NLSCY). It highlights key factors for reviewing research papers utilizing NLSCY data, such as identifying data sources, understanding sample design, and recognizing data limitations. We discuss the importance of using design weights, calculating variance accurately, and applying valid statistical tests. By outlining what reviewers should look for, we aim to ensure that research findings are robust and replicable.
E N D
NLSCY – Suggestions for papers NLSCY - National Longitudinal Survey of Children and Youth
Objectives of the Presentation • Emphasize proper ways to use the NLSCY data • Identify the key factors we are looking at when reviewing a paper
NLSCY • NLSCY is a longitudinal survey with a complex sample design • As a result, the data must be used properly: • Data limitations must be known • Weights, variance, valid statistical tests must be used
The factors – What are we looking for when reviewing a paper? • 1 - Data sources, domain of study • 2 - Type of study • 3 - Use of the design weights • 4 - Proper variance calculation • 5 - Statistical tests and analytical methods
The factors – 1 - Data sources • Are the data sources clearly identified? • Cycle(s) used? • Which subgroups or domains? • Which variables are used? • NLSCY target population well defined? • Are the NLSCY data limitations clearly identified?
The factors – 1 - Data sources (cont’d) • Responses rates to the key variables stated? • How is the partial non-response handled? • Sample sizes provided? Are the sample sizes sufficient? Confidentiality issues?
The factors – 2 - Type of study • What type of study is done? • Longitudinal? • Cross-sectional • NLSCY used as a repeated survey? • Mix of the above?
The factors – 3 - Design weights • Are the design weights used? • Appropriate weights (cross-sectional, longitudinal) used? • Revised weights or the original weights? • Re-weighting done to account for the partial non-response? • If the weights are not used, why?
The factors – 4 - Variance • How is the variance calculated for all the estimates? • CV look-up tables? • Excel spreadsheet with CVs for proportions? • Using the Bootstrap weights? • Using a SAS or SPSS procedure, without taking into account the design? : a big DON’T. • No variance? Another big DON’T
The factors – 5 - Statistical tests • Were statistical tests used? • If so, are they clearly identified? • Are they appropriate for what you are doing?
The factors – In brief • Would a reviewer be able to reproduce your results and reach the same conclusions, given you have used all the appropriate methods (weights, variance, statistical tests)?