SlideServe
Télécharger Obtenir Pro
Menu
Accueil Pro
Préférences
ApparenceLight Aide et commentaires
© SlideServe · v2026

Handling Missing Data in Educational Research: Imputation Techniques and Their Implications

samuru avatar
samuru
44 diapositives · 571 Views · Sep 13, 2014

This overview discusses the challenges of missing data in educational data mining, particularly in research contexts. It covers the types of missing data—unit nonresponse, item nonresponse, and attrition—and examines case deletion techniques, mean substitution methods, and considerations of data randomness (MAR vs. MNAR). The discussion emphasizes the practical implications of different imputation methods for researchers, highlighting scenarios where certain methods may be acceptable or unacceptable. Understanding these techniques is crucial for ensuring the validity and reliability of research findings.

#handling missing data in educational research: imputation techniques and their implications #handling missing data in educational research: imputation techniques and their implications ppt #powerpoint #presentation
Handling Missing Data in Educational Research: Imputation Techniques and Their Implications - slide 1
01 / 44Handling Missing Data in Educational Research: Imputation Techniques and Their Implications
1 / 17

Télécharger la présentation

Handling Missing Data in Educational Research: Imputation Techniques and Their Implications
Une image / un lien ci-dessous est fourni (tel quel) pour télécharger la présentation

Politique de téléchargement : le contenu du site vous est fourni TEL QUEL pour votre information et votre usage personnel ; il ne peut être vendu, concédé sous licence ni partagé sur d’autres sites sans l’accord de son auteur.Le contenu vous est fourni TEL QUEL, pour votre information et votre usage personnel uniquement. Téléchargez la présentation en cliquant sur ce lien. Lors du téléchargement, si vous ne parvenez pas à télécharger une présentation, l’éditeur a peut-être supprimé le fichier de son serveur.Pendant le téléchargement, si vous ne parvenez pas à obtenir une présentation, le fichier a peut-être été supprimé par l’éditeur.

F I N

Plus de contenu associé

Transcription de la présentation

  1. Special Topics in Educational Data Mining HUDK5199Spring term, 2013 March 13, 2013

  2. Today’s Class • Imputation in Prediction

  3. Missing Data • Frequently, when collecting large amounts of data from diverse sources, there are missing values for some data sources

  4. Examples • Can anyone here give examples from your own current or past research or projects?

  5. Classes of missing data • Missing all data/“Unit nonresponse” • Easy to handle! • Missing all of one source of data • E.g. student did not fill out questionnaire but used tutor • Missing specific data/“Item nonresponse” • E.g. student did not answer one question on questionnaire • E.g. software did not log for one problem • Subject dropout/attrition • Subject ceased to be part of population during study • E.g. student was suspended for a fight

  6. What do we do?

  7. Case Deletion • Simply delete any case that has at least one missing value • Alternate form: Simply delete any case that is missing the dependent variable

  8. Case Deletion • In what situations might this be acceptable? • In what situations might this be unacceptable? • In what situations might this be practically impossible?

  9. Case Deletion • In what situations might this be acceptable? • Relatively little missing data in sample • Dependent variable missing, and journal unlikely to accept imputed dependent variable • Almost all data missing for case • Example: A student who is absent during entire usage of tutor • In what situations might this be unacceptable? • In what situations might this be practically impossible?

  10. Case Deletion • In what situations might this be acceptable? • In what situations might this be unacceptable? • Data loss appears to be non-random • Example: The students who fail to answer “How much marijuana do you smoke?” have lower GPA than the average student who does answer that question • Data loss is due to attrition, and you care about inference up until the point of the data loss • Student completes pre-test, tutor, and post-test, but not retention test • In what situations might this be practically impossible?

  11. Case Deletion • In what situations might this be acceptable? • In what situations might this be unacceptable? • In what situations might this be practically impossible? • Almost all students missing at least some data

  12. Analysis-by-Analysis Case Deletion • Common approach • Advantages? • Disadvantages?

  13. Analysis-by-Analysis Case Deletion • Common approach • Advantages? • Every analysis involves all available data • Disadvantages? • Are your analyses fully comparable to each other?(but sometimes this doesn’t matter)

  14. Mean Substitution • Replace all missing data with the mean value for the data set • Mathematically equivalent: unitize all variables, and treat missing values as 0

  15. Mean Substitution • Advantages? • Disadvantages?

  16. Mean Substitution • Advantages? • Simple to Conduct • For linear, logistic, or step regression, essentially drops missing data from analysis without dropping case from analysis entirely

  17. Mean Substitution • Disadvantages? • Doesn’t work well for tree algorithms, decision rules, etc. • Can create bizarre results that effectively end up fitting what’s missing along with median values • May make it hard to get a good model if there’s a lot of missing data – lots of stuff looks average but really isn’t

  18. Distortion From Mean Substitution • Imagine a sample where the true sample is that 50 out of 1000 students have smoked marijuana • GPA • Smokers: M=2.6, SD=0.5 • Non-Smokers: M=3.3, SD=0.5

  19. Distortion From Mean Substitution • However, 30 of the 50 smokers refuse to answer whether they smoke, and 20 of the 950 non-smokers refuse to answer • And the respondents who remain are fully representative • GPA • Smokers: M=2.6 • Non-Smokers: M=3.3

  20. Distortion From Mean Substitution • GPA • Smokers: M=2.6 • Non-Smokers: M=3.3 • Overall Average: M=3.285

  21. Distortion From Mean Substitution • GPA • Smokers: M=2.6 • Non-Smokers: M=3.3 • Overall Average: M=3.285 • Smokers (Mean Sub): M= 3.02 • Non-Smokers (Mean Sub): M= 3.3

  22. MAR and MNAR • “Missing At Random” • “Missing Not At Random”

  23. MAR • Data is MAR if • R = Missing data • Ycom = Complete data set (if nothing missing) • Yobs = Observed data set

  24. MAR • In other words • If values for R are not dependent on whether R is missing or not, the data is MAR

  25. MAR and MNAR • Are these MAR or MNAR? (or n/a?) • Students who smoke marijuana are less likely to answer whether they smoke marijuana • Students who smoke marijuana are likely to lie and say they do not smoke marijuana • Some students don’t answer all questions out of laziness • Some data is not recorded due to server logging errors • Some students are not present for whole study due to suspension from school due to fighting

  26. MAR and MNAR • MAR-based estimation may often be reasonably robust to violation of MAR assumption(Graham et al., 2007; Collins et al., 2001) • Often difficult to verify for real data • In many cases, you don’t know why data is missing…

  27. MAR-assuming approaches • Single Imputation • Multiple Imputation • Maximum Likelihood Estimation • Complicated and not thought to be as effective

  28. Single Imputation • Replace all missing items with statistically plausible values and then conduct statistical analysis • Mean substitution is a simple form of single imputation

  29. Single Imputation • Relatively simple to conduct • Probably OK when limited missing data

  30. Other Single Imputation Procedures

  31. Other Single Imputation Procedures • Hot-Deck Substitution: Replace each missing value with a value randomly drawn from other students (for the same variable) • Very conservative; biases strongly towards no effect by discarding any possible association for that value

  32. Other Single Imputation Procedures • Linear regression/classification: • For missing data for variable X • Build regressor or classifier predicting observed cases of variable X from all other variables • Substitute predictor of X for missing values

  33. Other Single Imputation Procedures • Linear regression/classification: • For missing data for variable X • Build regressor or classifier predicting observed cases of variable X from all other variables • Substitute predictor of X for missing values • Limitation: if you want to correlate X to other variables, this will increase the strength of correlation

  34. Other Single Imputation Procedures • Distribution-based linear regression/classification: • For missing data for variable X • Build regressor or classifier predicting observed cases of variable X from all other variables • Compute probability density function for X • Based on confidence interval if X normally distributed • Randomly draw from probability density function of each missing value • Limitation: A lot of work, still reduces data variance in undesirable fashions

  35. Multiple Imputation

  36. Multiple Imputation • Conduct procedure similar to single imputation many times, creating many data sets • 10-20 times recommended by Schafer & Graham (2002) • Use meta-analytic methods to aggregate across data sets • To determine both overall answer and degree of uncertainty

  37. Multiple Imputation Procedure • Several procedures – essentially extensions of single imputation procedures • One example

  38. Multiple Imputation Procedure • Conduct linear regression/classification • For each data set • Add noise to each data point, drawn from a distribution which maps to the distribution of the original (non-missing) data set for that variable • Note: if original distribution is non-normal, use non-normal noise distribution

  39. MNAR Estimation

  40. MNAR Estimation • Selection models • Predict missingnesson variable X from other variables • Then attempt to predict missing cases using both the other variables, and the model of situations when the variable is missing

  41. Reducing Missing Values • Of course, the best way to deal with missing values is to not have missing values in the first place • Outside the scope of this class…

  42. Asgn. 6 • Questions? • Comments?

  43. Next Class(after Spring Break) • Monday, March 25 • Social Network Analysis • Readings • Haythornthwaite, C. (2001) Exploring Multiplexity: Social Network Structures in a Computer-Supported Distance Learning Class. The Information Society: An International Journal, 17 (3), 211-226 • Dawson, S. (2008) A study of the relationship between student social networks and sense of community. Educational Technology & Society, 11(3), 224-238 • Assignments Due: 6. Social Network

  44. The End