SlideServe
Menu
Préférences
© SlideServe · v2026

Enhancing Skill-Item Mapping Through Learning Factors Analysis and Hybrid Approaches

tracey avatar
21 diapositives · 364 Views · Jul 25, 2014

This video explores advanced methodologies for skill-item mapping in education. It emphasizes hand-development, automatic model discovery, and hybrid approaches like Learning Factors Analysis (LFA). LFA uses a mathematical model to evaluate cognitive factors and improve skill-item mapping by considering various learning factors. It highlights the importance of precise skill-item mapping as a prerequisite for effective predictive algorithms like BKT and PFA, as well as discussing the limitations of Q-Matrices and the flexibility of Bayesian Networks for modeling complex relationships in learning environments.

Enhancing Skill-Item Mapping Through Learning Factors Analysis and Hybrid Approaches - slide 1
01 / 21Enhancing Skill-Item Mapping Through Learning Factors Analysis and Hybrid Approaches
1 / 17

Télécharger la présentation

Enhancing Skill-Item Mapping Through Learning Factors Analysis and Hybrid Approaches
Une image / un lien ci-dessous est fourni (tel quel) pour télécharger la présentation

Politique de téléchargement : le contenu du site vous est fourni TEL QUEL pour votre information et votre usage personnel ; il ne peut être vendu, concédé sous licence ni partagé sur d’autres sites sans l’accord de son auteur.Le contenu vous est fourni TEL QUEL, pour votre information et votre usage personnel uniquement. Téléchargez la présentation en cliquant sur ce lien. Lors du téléchargement, si vous ne parvenez pas à télécharger une présentation, l’éditeur a peut-être supprimé le fichier de son serveur.Pendant le téléchargement, si vous ne parvenez pas à obtenir une présentation, le fichier a peut-être été supprimé par l’éditeur.

F I N

Plus de contenu associé

Transcription de la présentation
  1. Week 4 Video 7 Knowledge Inference: Other Structures

  2. How do we get a skill-item mapping? • Hand-development and refinement • Automatic model discovery • Hybrid approaches

  3. Hybrid Approaches • The most popular hybrid approach is called Learning Factors Analysis • Cen, H., Koedinger, K., Junker, B. (2006) Learning Factors Analysis – A General Method for Cognitive Model Evaluation and Improvement. Proceedings of the International Conference on Intelligent Tutoring Systems, 164-175.

  4. Learning Factors Analysis (LFA) • Uses a mathematical model similar to Performance Factors Analysis • Adds a student parameter, has only one learning parameter per skill

  5. Learning Factors Analysis (LFA) • Take an existing skill-item mapping • Add a set of potential candidate “learning factors” • Repeatedly tries to split skills based on learning factors • Using A* space search algorithm • For Skill A, Learning Factor B • Test new skills (A and B), (A and not B)

  6. Three Ways to Improve Skill-Item Mappings • Hand-development and refinement • Automatic model discovery • Hybrid approaches

  7. Why is this important? • A good skill-item mapping is a prerequisite to using algorithms like BKT, PFA • If you consider irrelevant evidence (student performance at hockey when predicting math) • You’ll have ineffective prediction

  8. A limitation of Q-Matrices • Assumes no relationship between skills • Except that a specific item can involve multiple skills

  9. A definite limitation • Several ways that skills can interconnect

  10. Partial Order Knowledge Structures • Desmarais, M.C., Maluf, A., Liu, J. (1996) User-expertise modeling with empirically derived probabilistic implication networks. User Modeling and User-Adapted Interaction, 5(3–4), 283–315. • Desmarais, M.C., Meshkinfam, P., Gagnon, M. (2006) Learned Student Models with Item to Item Knowledge Structures. User Modeling and User-Adapted Interaction, 16, 5, 403-434.

  11. Partial Order Knowledge Structures • Postulate relationships between items • Mastery of one itemis prerequisite to mastery of another item

  12. Example (Desmarais et al., 2006) B does not inform us about C If student succeeds at C, they will succeed at D; D is prerequisite to C

  13. Extension to skills • POKS can be extended rather easily to use skills (interchangeable items) rather than items

  14. Bayesian Networks • Less restricted set of models that also infer relationships between skills and items, and between skills • Can infer more complicated relationships between material than the very restricted set of relationships modeled in POKS • Can infer {skill-skill, item-item, skill-item} relationships at the same time • Can model hierarchies of skills and meta-skills • Can integrate very diverse types of information • That extra flexibility can lead to over-fitting (cf. Desmarais et al., 2006)

  15. Martin & VanLehn (1995)

  16. Conati et al., 2009

  17. Shute et al., 2009

  18. Propagation of Information • Several algorithms are used for propagating information around a Bayes Net • If we know that a student has skill A • Then this provides us with information about all of that skill’s prerequisite skills • And some information for skills for which skill A is a prerequisite • And some information about relevant meta-skills

  19. Bayes Net or Simpler Model? • How much do the interconnections between your skills matter in the context of your learning system? • How much do you care about hierarchy in skills? • The cost of a Bayes Net is complexity, over-fitting, and over-propagation of information

  20. Tools for creating Bayes Nets • Netica • http://www.norsys.com/netica.html • SamIam • http://reasoning.cs.ucla.edu/samiam/

  21. Next Up • Week 5: Relationship Mining