1 / 33

Integrating Object-Oriented Technology with Cognitive Modeling

Integrating Object-Oriented Technology with Cognitive Modeling. Pamela E. Scott-Johnson, Ph.D. Department of Psychology, College of Liberal Arts Bheem Kattel, Ph.D., CPE Industrial, Manufacturing, & Information Engineering, School of Engineering LeeRoy Bronner, Ph.D., P.E.

jimbo
Télécharger la présentation

Integrating Object-Oriented Technology with Cognitive Modeling

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Integrating Object-Oriented Technology with Cognitive Modeling Pamela E. Scott-Johnson, Ph.D. Department of Psychology, College of Liberal Arts Bheem Kattel, Ph.D., CPE Industrial, Manufacturing, & Information Engineering, School of Engineering LeeRoy Bronner, Ph.D., P.E. Industrial, Manufacturing, & Information Engineering, School of Engineering

  2. Cognitive Models • Anderson & Byrne • Carnegie Melon University • Currently used by HRED (Army) • Overview of ACT-R • Experiments • Face / Pattern Recognitions • Terrains • Eye Tracking • Object Orienting

  3. ACT-R • A cognitive architecture: a theory about how human cognition works. • Looks like a programming language. • Its constructs reflect assumptions about human cognition. These assumptions are based on numerous facts derived from psychology experiments. • These assumptions can be tested by comparing the results of the model with the results of people doing the same tasks. • By "results" we mean the traditional measures of cognitive psychology: • time to perform the task, • accuracy in the task, and, • (more recently) neurological data such as those obtained from FMRI.

  4. Motivations for a Cognitive Architecture • Philosophy: Provide a unified understanding of the mind. • Psychology: Account for experimental data. • Education: Provide cognitive models for intelligent tutoring systems and other learning environments. • Human Computer Interaction: Evaluate artifacts and help in their design. • Computer Generated Forces: Provide cognitive agents to inhabit training environments and games. • Neuroscience: Provide a framework for interpreting data from brain imaging. Anderson & Byrne Tutorial

  5. UserModel DriverModel UserModel ••• Approach: Integrated Cognitive Models • Cognitive model = computational processthat thinks/acts like a person • Integrated cognitive models…

  6. These Goals for Cognitive Architectures Require • Integration, not just of different aspects of higher level cognition but of cognition, perception, and action. • Systems that run in real time. • Robust behavior in the face of error, the unexpected, and the unknown. • Parameter-free predictions of behavior. • Learning.

  7. Atomic Components of Thought (ACT-R) • ACT-R is a production system theory that tries to explain human. Cognition through a model of knowledge structures. • Two types of knowledge declarative and procedural. • Declarative knowledge. • Corresponds to things we know and can describe. • Represented by structures call chunks. • Chunk defined by a: type and slots ( ES –frame). • Example: dog chased the cat – type: chase, agent: dog, object: cat. • Procedural knowledge. • Knowledge displayed by our behavior but we are not conscious of. • No one can describe the rules by which we speak a language, but we do. • Defined by production rules: • Example: IF the goal is to classify a person and he is unmarried. Then classify him as a bachelor (action part). • Chunks and productions are the basic building blocks of ACT-R.

  8. Embodied Cognition Interactive Behavior Task Artefact Figure 1. The embodied cognition – task-artefact triad. Adapted from Byrne 2001 article. ETA Embodied Cognition Task Artefact Triad • The user’s ability to interact with an interface is dependent upon the properties of the • The embodied cognition or cognitive, perceptual, and motor capacities of the user, • The task(s) that the user is engaged in, • The artefact or “device” that the user manipulates or utilizes in order to perform the task(s).

  9. ACT-R/PM system diagram described by Byrne (2001). There are 4 perceptual-motor modules which communicate with the central components of cognition. Central cognition and each module are serial and use spreading activation process which work in parallel.

  10. ACT-R 5.0 Intentional Module (not identified) Declarative Module (Temporal/Hippocampus) Goal Buffer (DLPFC) Retrieval Buffer (VLPFC) Matching (Striatum) Productions (Basal Ganglia) Selection (Pallidum) Execution (Thalamus) Visual Buffer (Parietal) Manual Buffer (Motor) Manual Module (Motor/Cerebellum) Visual Module (Occipital/etc) Environment

  11. Face and Pattern Recognition

  12. Face Recognition • Purpose • Persons use particular characteristics or features of the face in order to determine if the face is familiar. The purpose of our study will be to determine which feature of the face (e.g. nose, eyes, forehead, mouth…) will allow participants to increase accuracy and reaction time in identifying familiar faces. • We will also determine how the length of time for which the stimulus (face) is view increases accuracy.

  13. Signal Detection Theory (SDT) • Defined as a mathematically based theory of signal (stimulus) detection • Assumptions • The observer is not a passive receiver of stimulus • The observer is an active decision-maker who makes difficult perceptual judgment under conditions of uncertainty

  14. SDT Outcome Matrix • When the signal is “present” and the response is “yes,” the observer has made a hit. • If the observer responded “yes” when that signal was absent, then a false alarm has been made. • The other cells are called misses and correct negatives for obvious reasons.

  15. Industrial Engineering Research

  16. Terrain Hazard Detection • Objective • To collect data to study if providing depth in the field of vision would enhance the terrain hazard detection capability. • Method and Procedure • Terrain scenes with and without hazards were video taped simultaneously by four video cameras mounted horizontally in line at the same level. The distances of center of lenses of the video cameras from the center of lens of the left most video camera (reference) were in multiples of 2.5 inches. This was done to give binocular parallax of 1X, 2X, and 3X.

  17. Terrain Hazard Detection • A computer with DPS Velocity software was used to prepare sets of images representing different viewing conditions. • Images under different viewing conditions were projected by two DPL projectors on a special screen. • A braking mechanism was designed in-house to stop the video stream as soon as the hazard was detected and also when the hazard was verified by the subjects. • The response times were recorded from the time code on the monitor for different viewing conditions. • The data collected were submitted to Army Research Laboratory, Aberdeen for further analysis.

  18. Eye Tracking • This is an ongoing experiment and will be integrated into OO technology. • Objective • To study how much time eyes are focused on a given target with and without distractions. • Method and Procedure • Video images of terrains with and without hazard will be presented separately on a video monitor. The eye tracking camera will track the movement of the eyes and record them in a file. Area of interest can be selected on the image to find how much time the eyes dwelled on the area. Thus by assigning a target as an area of interest the time eye dwelled on the target can be monitored.

  19. Eye Tracking • Experimental setup • The following are the components of eye • tracking device • Controller • Eye monitor • Pan/Tilt Optics • Scene monitor • Interface PC and monitor • PC with monitor for viewing by subject • Scan Converter • Artificial eye

  20. Integrating Object-Oriented Technologywith Cognitive Modeling

  21. Atomic Components of Thought (ACT-R) • ACT-R is a production system theory that tries to explain human. Cognition through a model of knowledge structures. • Two types of knowledge declarative and procedural. • Declarative knowledge. • Corresponds to things we know and can describe. • Represented by structures call chunks. • Chunk defined by a: type and slots ( ES –frame). • Example: dog chased the cat – type: chase, agent: dog, object: cat. • Procedural knowledge. • Knowledge displayed by our behavior but we are not conscious of. • No one can describe the rules by which we speak a language, but we do. • Defined by production rules: • Example: IF the goal is to classify a person and he is unmarried. Then classify him as a bachelor (action part). • Chunks and productions are the basic building blocks of ACT-R.

  22. ACT-R Demonstration

More Related